-- Logs begin at Wed 2021-11-24 13:07:18 UTC, end at Wed 2021-11-24 15:26:37 UTC. -- Nov 24 13:46:47.843826 dv-neutron-818151-2-hyperv systemd[1]: Started Devstack devstack@q-svc.service. Nov 24 13:46:49.977293 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.common.config [-] Logging enabled! Nov 24 13:46:49.978036 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 17.2.2.dev65 Nov 24 13:46:49.978036 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=83422) setup_logging /opt/stack/neutron/neutron/common/config.py:111}} Nov 24 13:46:49.980560 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.common.config [-] Logging enabled! Nov 24 13:46:49.981562 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 17.2.2.dev65 Nov 24 13:46:49.981820 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=83422) setup_logging /opt/stack/neutron/neutron/common/config.py:111}} Nov 24 13:46:49.982788 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 13:46:49.983021 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 13:46:49.983372 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 13:46:49.983614 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 13:46:49.983869 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 13:46:49.984186 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.984483 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.984781 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.985009 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.985302 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.985595 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.985877 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.986165 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.986457 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.986739 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.987015 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.987296 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.987525 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.987833 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] config_source = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.988121 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.988404 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.988625 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] debug = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.988901 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.989322 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.989729 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.990006 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.990293 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.990565 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.990837 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.991117 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.991448 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] host = dv-neutron-818151-2-hyperv {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.991724 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.992037 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.992318 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.992600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.992873 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.993146 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.993429 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.993701 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_dir = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.993971 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_file = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.994244 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.994534 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.994819 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.995108 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.995334 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.995552 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.995859 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.996165 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.997024 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.997299 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.997580 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.997847 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.998119 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.998385 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.998666 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.998944 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.999224 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.999493 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:49.999776 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.000052 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.000325 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.000608 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.000878 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.001147 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.001417 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.001704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.001971 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.002246 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.002544 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.002829 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.003106 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.003388 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.003661 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.003966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.004235 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.004512 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] use_journal = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.004780 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] use_json = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.005049 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.005314 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.005592 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.005861 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.006129 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.006397 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.006661 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.006940 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:50.007230 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.007524 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.007860 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.008151 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.008438 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.008721 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.009008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.009281 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.009568 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.009854 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.010140 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.010415 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.010698 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.010988 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.011273 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.011553 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.011841 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.012666 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.012956 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.013256 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.013539 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.013832 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.014112 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.014384 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.014668 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.014949 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.015221 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.015492 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.015776 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.016079 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.016355 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.016626 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.016897 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.017171 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.017439 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.017721 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.017997 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.018267 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.018537 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.018811 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.019082 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.019353 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.019624 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.019922 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.020199 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.020469 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.020738 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.021008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.021278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.021548 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.021817 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.022089 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.022370 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.022638 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.022910 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.023179 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.023451 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.023720 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.024030 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.024330 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.024609 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.024894 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.025173 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.025448 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.025724 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.026001 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.026278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.026556 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.026827 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.027117 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.027400 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.028268 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.028687 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.028797 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.029096 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.029375 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.029662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.029942 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.030224 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.030511 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.030795 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.031093 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.031390 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.031687 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.032008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.032300 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.032583 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.032892 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.033174 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:50.033391 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 13:46:50.033630 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=83422) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 24 13:46:50.439415 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO keyring.backend [-] Loading KWallet Nov 24 13:46:50.446902 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO keyring.backend [-] Loading SecretService Nov 24 13:46:50.450566 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO keyring.backend [-] Loading Windows Nov 24 13:46:50.451989 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO keyring.backend [-] Loading chainer Nov 24 13:46:50.452567 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO keyring.backend [-] Loading macOS Nov 24 13:46:50.487266 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=83422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:46:50.487552 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.002s {{(pid=83422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:46:50.487872 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=83422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:46:50.488209 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 24 13:46:50.794130 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.794409 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.794676 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.851463 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.851743 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.852030 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.855071 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.855343 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.855611 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.884029 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.884300 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.884568 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.912116 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.912386 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:50.912648 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.233573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.234228 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.234228 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.234389 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.235094 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.361633 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.361953 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.362237 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.362504 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.362763 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.363067 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.363327 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.363580 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.363857 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.364135 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.364391 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.364650 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.364909 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.365162 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.365424 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.365688 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.365939 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.366211 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.366462 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.366741 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.367096 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.367344 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.367590 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.367891 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.368139 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.368381 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.368767 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:51.369006 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:51.369240 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:51.369474 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:51.369705 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:51.369937 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:51.370481 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 24 13:46:51.373750 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 24 13:46:51.377700 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 24 13:46:51.381737 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(850, 899)])]) Nov 24 13:46:51.383358 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 24 13:46:51.383738 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 24 13:46:51.384093 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 24 13:46:51.384474 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 24 13:46:51.387836 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 24 13:46:51.388085 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 24 13:46:51.388427 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 13:46:51.418904 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic'] Nov 24 13:46:51.419348 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.419652 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=83422) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 24 13:46:51.420045 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.421415 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=83422) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 24 13:46:51.421698 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 13:46:51.421944 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 24 13:46:51.425174 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.425456 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.486627 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 24 13:46:51.486814 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 24 13:46:51.487013 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 24 13:46:51.487391 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 24 13:46:51.518238 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_db.sqlalchemy.engines [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 13:46:51.838182 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing driver for type 'gre' Nov 24 13:46:51.838638 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] gre ID ranges: [(1, 1000)] Nov 24 13:46:51.892626 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing driver for type 'local' Nov 24 13:46:51.893063 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing driver for type 'vlan' Nov 24 13:46:51.906462 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] VlanTypeDriver initialization complete Nov 24 13:46:51.906859 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing driver for type 'vxlan' Nov 24 13:46:51.907530 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] vxlan ID ranges: [(1, 1000)] Nov 24 13:46:51.963609 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing extension driver 'port_security' Nov 24 13:46:51.963985 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.extensions.port_security [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] PortSecurityExtensionDriver initialization complete Nov 24 13:46:51.964336 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing mechanism driver 'openvswitch' Nov 24 13:46:51.964677 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing mechanism driver 'hyperv' Nov 24 13:46:51.972199 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.plugins.ml2.plugin [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=83422) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:46:51.972963 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.973335 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.973694 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.974077 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.974430 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.974770 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.975153 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.975499 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.975865 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.976243 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > security_group after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.976589 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > security_group after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.976929 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > security_group after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.977306 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.977649 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.977984 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.978318 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] ML2 OVO RPC backend initialized. {{(pid=83422) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:140}} Nov 24 13:46:51.978955 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_interface after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.979309 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.979724 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.980094 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > networks before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.980438 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.980778 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > ports before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.981126 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.981462 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnets before_response 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.981807 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.982142 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.982476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.982807 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.983141 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.983473 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.983831 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.984174 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.984506 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > subnet after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:51.985082 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.plugin [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Modular L2 Plugin initialization complete Nov 24 13:46:51.985405 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading services supported by the core plugin {{(pid=83422) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 24 13:46:51.985729 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.plugins.ml2.managers [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Got port-security extension from driver 'port_security' Nov 24 13:46:51.986191 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.extensions.vlantransparent [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Disabled vlantransparent extension. Nov 24 13:46:51.986600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=83422) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 24 13:46:51.986908 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: router Nov 24 13:46:52.023429 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_interface before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.023854 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_create 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.024225 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router before_create 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.024588 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.024958 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.025313 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_delete 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.025666 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > floatingip after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.026028 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_create 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.026377 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_update 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.026728 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_update 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.027074 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.027437 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_update 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.028495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_update 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.028877 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.029216 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.029555 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: subnet after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.029895 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.030243 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > port precommit_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.030590 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_create 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.030932 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.031274 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.031630 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router after_update 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.032005 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_delete 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.032352 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_create 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.032712 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router_interface after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.033052 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_update 55549900 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.033417 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > agent after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.033764 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > agent after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.034104 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > network after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.034975 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Tracking information for resource: router configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:52.035304 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Tracking information for resource: floatingip configured {{(pid=83422) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 13:46:52.040393 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.db.l3_agentschedulers_db [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 24 13:46:52.040975 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.041338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port after_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.041688 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port after_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.042037 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: port after_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.042837 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router before_create 55550100 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.043441 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_delete 55550100 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.043870 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_create 55550100 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.044240 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > router precommit_update 55550100 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.048690 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.provider_configuration [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service providers = [] {{(pid=83422) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 24 13:46:52.049056 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.db.servicetype_db [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=83422) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 24 13:46:52.052185 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.service_base [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=83422) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 13:46:52.052537 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.service_base [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=83422) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 13:46:52.052886 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.service_base [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=83422) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 13:46:52.053770 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.services.service_base [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=83422) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 13:46:52.054141 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.services.service_base [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 24 13:46:52.054519 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.054835 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 24 13:46:52.065666 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.066001 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: auto_allocate Nov 24 13:46:52.071973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: network precommit_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.072343 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: network precommit_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.072863 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.073183 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: tag Nov 24 13:46:52.080748 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.081078 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: timestamp Nov 24 13:46:52.084926 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.085255 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: network_ip_availability Nov 24 13:46:52.091572 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.091915 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.092273 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.092984 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.093305 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: flavors Nov 24 13:46:52.098322 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.098655 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading Plugin: revisions Nov 24 13:46:52.102977 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=83422) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 13:46:52.103371 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_concurrency.lockutils [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.615s {{(pid=83422) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:46:52.104153 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=83422) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:637}} Nov 24 13:46:52.104490 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Initializing extension manager. Nov 24 13:46:52.105003 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: __init__.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.105403 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: __pycache__ {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.105796 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: _admin_state_down_before_update_lib.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.106097 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: _availability_zone_filter_lib.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.106424 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: _filter_validation_lib.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.106747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.107070 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: address_group.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.107854 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.108405 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: address-group Nov 24 13:46:52.108721 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: address_scope.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.109429 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.109931 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: address-scope Nov 24 13:46:52.110248 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: admin_state_down_before_update.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.111181 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is down (admin_state_up=False) before updating the distributed attribute" updated="2019-04-08 13:30:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.111686 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: router-admin-state-down-before-update Nov 24 13:46:52.112031 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: agent.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.112735 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.113237 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: agent Nov 24 13:46:52.113557 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: agent_resources_synced.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.114469 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.114971 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: agent-resources-synced Nov 24 13:46:52.115291 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: allowedaddresspairs.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.117114 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.117641 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: allowed-address-pairs Nov 24 13:46:52.117965 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: auto_allocated_topology.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.119054 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.119565 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: auto-allocated-topology Nov 24 13:46:52.119917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: availability_zone.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.120622 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.121621 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: availability_zone Nov 24 13:46:52.121621 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: availability_zone_filter.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.122541 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.123048 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: availability_zone_filter Nov 24 13:46:52.123367 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: data_plane_status.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.124318 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.124822 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension data-plane-status not supported by any of loaded plugins Nov 24 13:46:52.125140 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: default_subnetpools.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.126058 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.126562 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: default-subnetpools Nov 24 13:46:52.126881 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: dhcpagentscheduler.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.127652 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.128176 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: dhcp_agent_scheduler Nov 24 13:46:52.128496 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: dns.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.129414 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.129916 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension dns-integration not supported by any of loaded plugins Nov 24 13:46:52.130234 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: dns_domain_ports.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.131151 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.131648 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 24 13:46:52.131994 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: dvr.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.132670 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.133169 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: dvr Nov 24 13:46:52.133485 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: empty_string_filtering.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.134392 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.134892 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: empty-string-filtering Nov 24 13:46:52.135211 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.136156 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.136806 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 24 13:46:52.137678 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.138617 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.139115 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 24 13:46:52.139433 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: external_net.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.140375 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.140880 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: external-net Nov 24 13:46:52.141197 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: extra_dhcp_opt.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.142101 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.142608 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: extra_dhcp_opt Nov 24 13:46:52.142926 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: extraroute.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.143860 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.144366 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: extraroute Nov 24 13:46:52.144684 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: extraroute_atomic.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.145726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.146227 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: extraroute-atomic Nov 24 13:46:52.146547 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: filter_validation.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.147215 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-03-21T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.147712 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: filter-validation Nov 24 13:46:52.148080 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: fip_pf_description.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.149165 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.149664 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 24 13:46:52.149984 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: fip_port_details.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.150900 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.151394 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: fip-port-details Nov 24 13:46:52.151712 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: flavors.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.153701 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.154221 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: flavors Nov 24 13:46:52.154545 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.156264 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.156782 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 24 13:46:52.157117 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: floatingip_pools.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.157820 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.158326 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: floatingip-pools Nov 24 13:46:52.158651 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: ip_allocation.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.159572 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.160103 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension ip_allocation not supported by any of loaded plugins Nov 24 13:46:52.160431 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.161357 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.161864 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: ip-substring-filtering Nov 24 13:46:52.162195 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l2_adjacency.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.163114 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.163621 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 24 13:46:52.163973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.164945 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.165458 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: router Nov 24 13:46:52.165781 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3_conntrack_helper.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.168047 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.168770 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 24 13:46:52.169103 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.170033 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.170547 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: ext-gw-mode Nov 24 13:46:52.170875 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.171822 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.172339 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: l3-ha Nov 24 13:46:52.172662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3_flavors.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.173584 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.174092 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: l3-flavors Nov 24 13:46:52.174417 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.175344 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.175875 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 24 13:46:52.176198 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: l3agentscheduler.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.177217 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.177724 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: l3_agent_scheduler Nov 24 13:46:52.178049 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: logging.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.179565 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.180110 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension logging not supported by any of loaded plugins Nov 24 13:46:52.180442 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: metering.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.181186 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.181761 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: metering Nov 24 13:46:52.182092 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.183255 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.183864 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: metering_source_and_destination_fields Nov 24 13:46:52.184236 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: multiprovidernet.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.185330 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.185841 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: multi-provider Nov 24 13:46:52.186222 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: netmtu.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.187107 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.187612 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: net-mtu Nov 24 13:46:52.187963 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: netmtu_writable.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.188936 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.189441 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: net-mtu-writable Nov 24 13:46:52.189775 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: network_availability_zone.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.190427 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.190929 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: network_availability_zone Nov 24 13:46:52.191247 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: network_ip_availability.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.192425 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.192901 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: network-ip-availability Nov 24 13:46:52.193222 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: network_segment_range.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.194029 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.194523 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension network-segment-range not supported by any of loaded plugins Nov 24 13:46:52.194849 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: pagination.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.195980 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.196336 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: pagination Nov 24 13:46:52.196666 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.197646 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.198195 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: port-mac-address-regenerate Nov 24 13:46:52.198456 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: port_resource_request.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.199919 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.200579 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension port-resource-request not supported by any of loaded plugins Nov 24 13:46:52.200833 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: portbindings.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.201787 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.202322 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: binding Nov 24 13:46:52.202652 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: portbindings_extended.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.204009 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.204523 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: binding-extended Nov 24 13:46:52.204897 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: portsecurity.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.205813 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.206317 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: port-security Nov 24 13:46:52.206641 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: project_id.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.207617 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.207975 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: project-id Nov 24 13:46:52.208297 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: providernet.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.209220 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.209722 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: provider Nov 24 13:46:52.210041 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.213889 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.214411 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos not supported by any of loaded plugins Nov 24 13:46:52.214744 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.216663 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.217182 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 24 13:46:52.217505 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.218435 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.218944 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 24 13:46:52.219289 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_default.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.220196 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.220703 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-default not supported by any of loaded plugins Nov 24 13:46:52.221024 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_fip.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.221674 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.222175 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-fip not supported by any of loaded plugins Nov 24 13:46:52.222499 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_gateway_ip.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.223423 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.223954 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 24 13:46:52.224277 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_port_network_policy.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.225190 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.225690 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 24 13:46:52.226010 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_rule_type_details.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.226920 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.227421 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 24 13:46:52.227741 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: qos_rules_alias.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.228814 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.229320 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 24 13:46:52.229641 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: quotasv2.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.230658 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.230977 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: quotas Nov 24 13:46:52.231305 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: quotasv2_detail.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.233153 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.233488 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: quota_details Nov 24 13:46:52.233814 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: rbac.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.234885 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.235406 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: rbac-policies Nov 24 13:46:52.235734 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: rbac_address_scope.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.236686 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.237191 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: rbac-address-scope Nov 24 13:46:52.237516 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: rbac_security_groups.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.238446 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.238952 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: rbac-security-groups Nov 24 13:46:52.239278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: rbac_subnetpool.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.240231 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.240736 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: rbac-subnetpool Nov 24 13:46:52.241058 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: revisionifmatch.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.241989 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.242499 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: revision-if-match Nov 24 13:46:52.242822 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: revisions.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.243970 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.244479 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: standard-attr-revisions Nov 24 13:46:52.244806 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: router_availability_zone.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.245482 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.245988 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: router_availability_zone Nov 24 13:46:52.246338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: routerservicetype.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.247363 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.247812 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension router-service-type not supported by any of loaded plugins Nov 24 13:46:52.248136 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: security_groups_port_filtering.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.249056 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.249560 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: port-security-groups-filtering Nov 24 13:46:52.249881 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: securitygroup.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.260880 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.261409 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: security-group Nov 24 13:46:52.261737 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: segment.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.263151 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.263667 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension segment not supported by any of loaded plugins Nov 24 13:46:52.264025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.264983 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.265494 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 24 13:46:52.265816 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: servicetype.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.267183 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.267433 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: service-type Nov 24 13:46:52.267778 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: sorting.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.268765 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.269102 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: sorting Nov 24 13:46:52.269424 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: standard_attr_segment.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.270337 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.270846 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 24 13:46:52.271163 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: standardattrdescription.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.271839 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.272343 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: standard-attr-description Nov 24 13:46:52.272665 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: stateful_security_group.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.273601 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.274109 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: stateful-security-group Nov 24 13:46:52.274430 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: stdattrs_common.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.275014 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 24 13:46:52.275331 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.276277 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.276780 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 24 13:46:52.277099 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: subnet_onboard.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.279012 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.279528 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: subnet_onboard Nov 24 13:46:52.279882 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.280819 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.281325 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 24 13:46:52.281646 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: subnet_service_types.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.282570 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.283096 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: subnet-service-types Nov 24 13:46:52.283416 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: subnetallocation.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.284540 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.285054 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: subnet_allocation Nov 24 13:46:52.285377 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.286045 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.286545 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: subnetpool-prefix-ops Nov 24 13:46:52.286865 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.287842 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.288343 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 24 13:46:52.288661 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: tagging.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.289730 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, router, floatingip, policy, security_group, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.290238 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: standard-attr-tag Nov 24 13:46:52.290562 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: timestamp.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.291799 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.292312 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loaded extension: standard-attr-timestamp Nov 24 13:46:52.292638 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: trunk.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.293819 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.294334 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension trunk not supported by any of loaded plugins Nov 24 13:46:52.294660 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: trunk_details.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.295579 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.296123 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension trunk-details not supported by any of loaded plugins Nov 24 13:46:52.296447 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: uplink_status_propagation.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.297373 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.297881 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 24 13:46:52.298202 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Loading extension file: vlantransparent.py {{(pid=83422) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:447}} Nov 24 13:46:52.298876 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=83422) _check_extension /opt/stack/neutron/neutron/api/extensions.py:413}} Nov 24 13:46:52.299379 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 24 13:46:52.301635 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:network Nov 24 13:46:52.302367 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:subnet Nov 24 13:46:52.303145 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 13:46:52.303740 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:port Nov 24 13:46:52.305042 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.305482 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service FLAVORS assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.306109 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.306529 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.306858 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:router Nov 24 13:46:52.307507 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 13:46:52.308244 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service METERING assigned prefix: /metering {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.310298 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.310663 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.311015 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=83422) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:46:52.312166 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 13:46:52.312601 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:security_group Nov 24 13:46:52.313249 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 13:46:52.313999 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service CORE assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.314329 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 13:46:52.314673 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] subnetpool is already registered Nov 24 13:46:52.315272 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service CORE assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.315599 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 13:46:52.315951 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] subnetpool is already registered Nov 24 13:46:52.318449 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.318881 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service FLAVORS assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.319465 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.319932 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.320248 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:router Nov 24 13:46:52.320576 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] router is already registered Nov 24 13:46:52.321159 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 13:46:52.321488 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] floatingip is already registered Nov 24 13:46:52.322107 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service METERING assigned prefix: /metering {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.322768 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 13:46:52.323096 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] rbac_policy is already registered Nov 24 13:46:52.323640 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:security_group Nov 24 13:46:52.324082 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] security_group is already registered Nov 24 13:46:52.325265 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 13:46:52.325657 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] security_group_rule is already registered Nov 24 13:46:52.326335 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service CORE assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.326662 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 13:46:52.326987 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] subnetpool is already registered Nov 24 13:46:52.327589 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.v2.resource_helper [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Service CORE assigned prefix: {{(pid=83422) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 13:46:52.327946 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 13:46:52.328268 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING neutron.quota.resource_registry [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] subnetpool is already registered Nov 24 13:46:52.328905 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: extensions {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.330362 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: address-groups {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.331959 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: address-scopes {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.333142 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: agents {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.334300 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: auto-allocated-topology {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.335532 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: availability_zones {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.337105 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: dhcp-networks {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.338488 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: dhcp-agents {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.339907 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: routers {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.341989 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: flavors {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.343077 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: service_profiles {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.344286 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: next_providers {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.345788 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: service_profiles {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.347216 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: floatingip-pools {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.348439 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: routers {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.350210 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: floatingips {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.351426 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: l3-routers {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.352789 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: l3-agents {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.354156 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: metering-labels {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.356471 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: metering-label-rules {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.357712 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: network-ip-availabilities {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.358933 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: bindings {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.360599 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: quotas {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.362008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: quotas {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.363417 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: rbac-policies {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.364730 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: security-groups {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.365912 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: security-group-rules {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.367113 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: service-providers {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.368358 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: subnetpools {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.369757 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: subnetpools {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.371174 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.373486 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.375244 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.377037 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.378775 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.380449 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.382170 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.384041 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.385847 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.388342 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron.api.extensions [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Extended resource: tags {{(pid=83422) __init__ /opt/stack/neutron/neutron/api/extensions.py:154}} Nov 24 13:46:52.394244 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING keystonemiddleware.auth_token [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 13:46:52.399003 dv-neutron-818151-2-hyperv neutron-server[83422]: WARNING keystonemiddleware.auth_token [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 13:46:52.407316 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_concurrency.lockutils [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Acquired lock "singleton_lock" {{(pid=83422) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 24 13:46:52.407815 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_concurrency.lockutils [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Releasing lock "singleton_lock" {{(pid=83422) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 24 13:46:52.408443 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Starting 2 workers Nov 24 13:46:52.412987 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Started child 83525 {{(pid=83422) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Nov 24 13:46:52.417109 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Started child 83526 {{(pid=83422) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Nov 24 13:46:52.418458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:46:52.419010 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO neutron.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 24 13:46:52.419484 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Notify callbacks [] for process, before_spawn {{(pid=83422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:46:52.420089 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [-] (83525) wsgi starting up on http://0.0.0.0:9696 Nov 24 13:46:52.422014 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Starting 1 workers Nov 24 13:46:52.422169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:46:52.423560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [-] (83526) wsgi starting up on http://0.0.0.0:9696 Nov 24 13:46:52.426953 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Started child 83527 {{(pid=83422) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Nov 24 13:46:52.427473 dv-neutron-818151-2-hyperv neutron-server[83422]: INFO oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Starting 1 workers Nov 24 13:46:52.430727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] calling RpcWorker wait() {{(pid=83527) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 24 13:46:52.431517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] returning from RpcWorker wait() {{(pid=83527) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 24 13:46:52.431616 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Started child 83528 {{(pid=83422) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Nov 24 13:46:52.432405 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG neutron_lib.callbacks.manager [None req-ddbc2987-43cf-4d19-9ef8-bf59f54abe12 None None] Notify callbacks [] for process, after_spawn {{(pid=83422) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:46:52.434580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:46:52.435128 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=83422) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Nov 24 13:46:52.435333 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 13:46:52.435426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:46:52.435519 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 13:46:52.435925 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 13:46:52.436285 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 13:46:52.436451 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 13:46:52.436936 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.437212 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.437301 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:46:52.437754 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.437754 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439237 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439237 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439237 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439237 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439537 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439645 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.439996 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.440160 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.440570 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.440808 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.441114 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.441381 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.441640 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.441904 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.442071 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.442486 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config_source = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.442753 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.442986 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.443244 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] debug = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.443504 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.444023 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.444270 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.444510 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.444747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.445016 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.445259 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.445524 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.445767 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.445989 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.446223 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.446470 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.446682 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.446926 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.447178 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.447395 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.447903 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] host = dv-neutron-818151-2-hyperv {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.448143 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.448388 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.448637 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.448886 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.449140 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.449353 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.450177 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.450741 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.450917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.451056 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.451297 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.451521 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.451824 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_dir = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.452066 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_file = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.452216 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_options = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.452469 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.452694 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.452948 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.453135 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.453290 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.453463 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.453729 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.453880 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.454109 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.454339 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.454557 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.454787 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.455033 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.455268 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.455514 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.455749 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.456018 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.456274 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.456499 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.456725 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.457474 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.457474 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.457474 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.459394 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.460476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.460476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.460476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.460476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.460476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.461455 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.461455 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.461455 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.461866 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.462083 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.462232 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.462376 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.462602 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.462765 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_journal = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.462965 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_json = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.463178 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.463390 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.463645 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.464022 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.464242 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.464513 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.464900 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.465333 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.465732 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.466092 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:46:52.466260 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.466497 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.466887 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.467135 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.467391 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.467718 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.467886 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.468109 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.468385 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.468678 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.468918 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.469240 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.469554 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.469823 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.70/identity {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.470083 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.470316 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.470562 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.470798 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.471018 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.471236 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.471449 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.471713 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.471958 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.472214 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.472512 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.472752 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.472962 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.473190 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.473432 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.473696 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.473926 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.474179 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.474375 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.474599 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.474813 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.475025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.475256 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.475511 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.475788 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.476019 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.476258 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.476549 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.476700 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.476881 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.477117 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.477538 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.477826 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.478051 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.478377 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.478835 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.482025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.482025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.482025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.482025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.484962 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.486299 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.486557 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.486811 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.487073 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.487343 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.487585 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.487841 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.488094 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.488342 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.488568 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.488809 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.489048 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.489274 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.489493 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.489712 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.489935 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.490165 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.490391 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.490710 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.491039 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.491289 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.491552 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.496769 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.497072 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.497324 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.497596 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.497875 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.498700 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.498971 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.499265 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.499531 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.499824 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.500082 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.500494 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.502478 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.502917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.503177 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.503450 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.503709 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.504006 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.504723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 33952) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:46:52.506521 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.506852 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.507085 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.507379 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.507665 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.507983 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.508256 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.508570 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.508817 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.509100 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.509400 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.509692 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.509979 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.510223 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.510473 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.510731 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.510971 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.511266 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.511640 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.512785 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.513706 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.514140 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [-] 10.222.0.70 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0072641 Nov 24 13:46:52.514261 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.514867 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.515180 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.515625 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.516088 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.516638 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.517107 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.517416 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.517762 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.519374 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.520153 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.520611 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.521119 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.521457 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.521969 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.522292 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.522743 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.70/identity {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.522977 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.523264 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.524494 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.524734 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.524993 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.526074 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.526348 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.526579 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.526803 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.527227 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.527458 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.527889 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.528252 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.529269 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.529269 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.529772 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.530092 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.530416 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.530725 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.530987 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.531236 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.531466 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.531706 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.532035 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.532291 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.532582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.532833 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.533076 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.533311 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.533541 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.533784 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.534025 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.534472 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.534692 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.535061 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.535440 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.535669 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.535901 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.536136 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.536402 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.536596 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.536873 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.537292 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.537797 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.538043 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.538310 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.538548 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.538768 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.538994 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.539217 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.539441 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.539681 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.539926 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.540170 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.540395 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.541454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.541454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.541454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.541454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.541454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.542149 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.542149 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] xenapi.connection_password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.542149 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] xenapi.connection_url = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.543222 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] xenapi.connection_username = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.543222 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.543222 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.543619 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.543619 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.543981 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.544124 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.544623 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.545747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.545747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.545747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.545747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.546317 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.546317 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.546317 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.546703 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.546849 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.547024 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.547352 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.547571 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.548633 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.548633 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.548633 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.548633 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.548923 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.549100 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.549376 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.549631 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.550156 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.550257 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.550452 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.550727 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.551723 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.551723 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.551723 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.552019 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.552199 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.552348 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.552643 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.552866 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.553083 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.553319 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.554302 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.554302 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.554302 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.554302 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.554576 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.554754 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.555012 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.555234 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.555494 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.556824 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.557084 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.557331 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.557508 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 13:46:52.558044 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=83422) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Nov 24 13:46:52.558634 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 13:46:52.559520 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 13:46:52.559809 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 13:46:52.560035 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 13:46:52.560264 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 13:46:52.560529 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.560696 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.560916 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.561042 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.561973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.561973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.561973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.561973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.562527 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.562527 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.562527 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.562909 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.562909 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.562909 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563306 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563306 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563476 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563838 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] config_source = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.563951 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.564103 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.564257 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] debug = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.564611 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.564872 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565101 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565259 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565415 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565555 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565703 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565841 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.565977 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.566736 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.566736 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.566736 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.566736 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.566736 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.567421 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.567421 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.567421 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] host = dv-neutron-818151-2-hyperv {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.567421 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.567421 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.568103 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.568103 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.568103 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.568103 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_dir = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_file = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.569412 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_options = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.570657 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.572973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.575278 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.576509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.577495 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_journal = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_json = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.578573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 13:46:52.579582 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.580726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.580726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.580726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.580726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.580726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.580726 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.581514 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.581514 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.581514 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.581896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:46:52.582038 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582038 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582038 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582038 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582038 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.70/identity {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582038 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582794 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582794 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582794 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582794 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.582794 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583453 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583453 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583453 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583453 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583996 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583996 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583996 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.583996 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.584510 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.584510 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.584510 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.584917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.584917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.584917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.585297 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.585297 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.585297 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.585674 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.585674 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586198 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586198 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586454 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586715 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586874 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.586874 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587134 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587277 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587413 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587547 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587681 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587837 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.587975 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588118 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588255 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588390 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588537 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588682 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588836 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.588973 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.589108 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.589243 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.589378 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.589647 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.589821 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.590070 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.590214 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.590351 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.590486 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.590757 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.590757 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591042 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591042 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591303 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591303 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591572 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591572 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.591933 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.593183 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.593183 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.593183 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.593600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.593600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.593600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594008 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594401 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594401 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594660 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594660 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.594917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.595185 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.595185 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.595398 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.595478 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.595633 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.596704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.596704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.596704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.596704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.596704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.596704 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.597161 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.597161 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.597161 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.597368 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.597368 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.598338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.598338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.598338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.598338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.598338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.598338 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599027 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599027 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599027 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599027 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599027 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599509 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599718 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.599865 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.600024 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.600168 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.600329 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.601552 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.601729 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.601898 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.602894 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.602894 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.70/identity {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.603273 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.603449 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604246 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604246 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604246 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604246 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604246 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604735 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604735 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.604735 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.605329 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.605494 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.606034 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.606034 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.606034 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.606334 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.606839 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.607898 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.608101 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.608283 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.608421 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.608598 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.608790 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.608905 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.609065 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.609484 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.609484 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.609639 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.609707 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.610662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.610662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.610662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.610662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.610662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.610662 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.611142 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.611142 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.611142 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612057 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612057 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612057 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612057 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612615 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612811 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.612980 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.613208 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.613735 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.615210 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.615322 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.615417 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.615799 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.615799 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.615993 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.616076 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.616238 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.616407 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.616573 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.616737 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.616903 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.617070 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.617230 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.617780 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] xenapi.connection_password = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.617937 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] xenapi.connection_url = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.618444 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] xenapi.connection_username = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.618624 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.618786 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.618964 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.619108 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.619269 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.619439 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.619600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.619783 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.619950 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.620117 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.620284 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.620439 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.620599 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622097 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622097 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622097 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622097 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622097 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622456 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622456 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622745 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.622917 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.623080 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.623244 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.623410 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.623583 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.623750 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.623932 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.624100 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.624269 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.624439 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.624600 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.624767 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.624939 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.625098 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.625266 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.625424 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.625584 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.625744 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.625904 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.626065 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.626223 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.626382 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.626541 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.626747 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.626847 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.627966 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 13:46:52.628472 dv-neutron-818151-2-hyperv neutron-server[83422]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=83422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 13:47:03.147276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d5641f5-1438-42fb-a4e3-fe8c71a45d0f None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 13:47:03.328311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d5641f5-1438-42fb-a4e3-fe8c71a45d0f None None] No non-hosted networks {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 24 13:47:03.365097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.agentschedulers_db [None req-9d5641f5-1438-42fb-a4e3-fe8c71a45d0f None None] DHCP Agent not found on host dv-neutron-818151-2-hyperv {{(pid=83527) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 24 13:47:03.477202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-81aeaa46-dd63-4c47-ab95-1c2267494eb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1007011'] for agent, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:03.622382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1007011'] for agent, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:03.623724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.623724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.624693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.625134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.627918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.627918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.627918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.627918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.627918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.628364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.628364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:03.628706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-neutron-818151-2-hyperv', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.5', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0'}) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:03.637100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-neutron-818151-2-hyperv', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.5', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0'}} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:05.666664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5d2fadef-1a3c-4fce-b23f-7c33844baad0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1007011'] for agent, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:05.713528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db9334e-5075-4234-843c-830fce1a0777 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:06.624820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1007011'] for agent, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:07.888424 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.db.l3_hamode_db [None req-253e8e24-88a6-4bf5-a818-bc371d3b2cb0 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 24 13:47:07.976619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-253e8e24-88a6-4bf5-a818-bc371d3b2cb0 None None] Routers set() bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:47:07.976954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-253e8e24-88a6-4bf5-a818-bc371d3b2cb0 None None] Router IDs set() for agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 13:47:08.271463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1007011'] for agent, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:09.917371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34050) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:10.520112 dv-neutron-818151-2-hyperv neutron-server[83526]: WARNING oslo_policy.policy [None req-f8cb627f-6297-4256-90ee-e0a69edeeb5a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:10.520735 dv-neutron-818151-2-hyperv neutron-server[83526]: WARNING oslo_policy.policy [None req-f8cb627f-6297-4256-90ee-e0a69edeeb5a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:10.735269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-f8cb627f-6297-4256-90ee-e0a69edeeb5a admin admin] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:47:10.736359 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f8cb627f-6297-4256-90ee-e0a69edeeb5a admin admin] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.8180645 Nov 24 13:47:13.001667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:13.384031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] Request body: {'subnetpool': {'shared': True, 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:13.434359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.policy [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=83526) register_rules /opt/stack/neutron/neutron/policy.py:65}} Nov 24 13:47:13.435103 dv-neutron-818151-2-hyperv neutron-server[83526]: WARNING oslo_policy.policy [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:13.436273 dv-neutron-818151-2-hyperv neutron-server[83526]: WARNING oslo_policy.policy [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:13.439588 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.quota [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] Loaded quota_driver: . Nov 24 13:47:13.454922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:13.525176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] Notify callbacks ['neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8771277829733', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8771277847416', 'neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8771277837416', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8771277925518', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8771277915930', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1514596', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1508708', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-546920', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-994850'] for rbac-policy, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:13.594221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:13.595383 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2103eb0c-877d-4eba-a345-dc521a42c714 admin admin] 10.222.0.70 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.5927746 Nov 24 13:47:16.128612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34078) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:16.517174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Request body: {'network': {'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'name': 'private', 'admin_state_up': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:16.521852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:16.526229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Usage tracker for resource:network and tenant:aba0b58bb3e84ccdb96588d066f23908 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:16.531251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:16.537239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:16.546930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Made reservation on behalf of aba0b58bb3e84ccdb96588d066f23908 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:47:16.549965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.567227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.609486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:16.613144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Usage tracker for resource:security_group_rule and tenant:aba0b58bb3e84ccdb96588d066f23908 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:16.616015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:16.621809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:16.693364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.697366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.704086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:16.724290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 855} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:47:16.751353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8771276175818', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.751973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Unsubscribe: segment precommit_create {{(pid=83526) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 13:47:16.752438 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Added segment dbc21f22-dbe5-4822-aa60-8e926afd9972 of type vlan for network 7c378b81-48f6-4815-a230-67e80372ff7b Nov 24 13:47:16.766996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44e4792a-1d1d-4e95-b00a-b5a05178d817,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:16.817770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.818109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.818435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.818757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.819092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.819466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.819884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.820275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.820734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.821053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.821360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Tracked resource versions report: Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: pushed versions: Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Log': {'1.0'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Network': {'1.1'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Port': {'1.5'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'PortForwarding': {'1.2'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'QosPolicy': {'1.8'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroup': {'1.2'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SubPort': {'1.0'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Subnet': {'1.1'}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Trunk': {'1.1'}} Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: consumer versions: Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Log': '1.0', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Network': '1.1', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Port': '1.5', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'PortForwarding': '1.2', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'QosPolicy': '1.8', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroup': '1.2', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroupRule': '1.0', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SubPort': '1.0', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Subnet': '1.1', Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Trunk': '1.1'}} Nov 24 13:47:16.822617 dv-neutron-818151-2-hyperv neutron-server[83526]: {{(pid=83526) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:47:16.875629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:16.877212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.917458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.918741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:16.919390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:16.924108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:17.024466 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8947001 Nov 24 13:47:17.028735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Pushing event updated for resources: {'Network': ['ID=7c378b81-48f6-4815-a230-67e80372ff7b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:17.032169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:17.041317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7c378b81-48f6-4815-a230-67e80372ff7b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:47:19.636290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34094) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:20.103442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a37c494-5572-4175-8bcb-1cc902af2345 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:20.104795 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8a37c494-5572-4175-8bcb-1cc902af2345 admin admin] 10.222.0.70 "GET /v2.0/networks/7c378b81-48f6-4815-a230-67e80372ff7b HTTP/1.1" status: 200 len: 825 time: 0.4675438 Nov 24 13:47:20.134495 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3e3f33c1-9ef8-4dc4-b622-652ff47a8135 admin admin] 10.222.0.70 "GET /v2.0/subnetpools/16d081a1-b1dc-49b8-8fac-f93bb873027e HTTP/1.1" status: 200 len: 734 time: 0.0242538 Nov 24 13:47:20.143651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Request body: {'subnet': {'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e', 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'ip_version': 4, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:20.148123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:20.151879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Usage tracker for resource:subnet and tenant:aba0b58bb3e84ccdb96588d066f23908 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:20.155880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:20.161461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:20.171203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Made reservation on behalf of aba0b58bb3e84ccdb96588d066f23908 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:47:20.173555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Notify callbacks [] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:20.439538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:20.443901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:20.523616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6b839039-d0d6-4190-a6d6-0528a8007847,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:20.528433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:20.530720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Checking segment: {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:47:20.531030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Network hostable DHCP agents. Network: 7c378b81-48f6-4815-a230-67e80372ff7b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:47:20.553306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Network 7c378b81-48f6-4815-a230-67e80372ff7b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:47:20.563567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7c378b81-48f6-4815-a230-67e80372ff7b) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:47:20.568963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:20.569653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:20.574545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56dff44c-d9de-4cca-9143-14811b6de5a0 None None] Network 7c378b81-48f6-4815-a230-67e80372ff7b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:47:20.591434 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4498577 Nov 24 13:47:20.890027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7c378b81-48f6-4815-a230-67e80372ff7b', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:47:20.891409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:21.074803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Allocated IP 172.20.0.2 (7c378b81-48f6-4815-a230-67e80372ff7b/6b839039-d0d6-4190-a6d6-0528a8007847/207d0c04-7d81-46d6-8286-04efa89cd02d) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:47:21.302796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:21.317282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Transition to ACTIVE for port object 207d0c04-7d81-46d6-8286-04efa89cd02d will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:47:21.337854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Transition to ACTIVE for port object 207d0c04-7d81-46d6-8286-04efa89cd02d will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:47:21.345897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:21.353596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:21.414872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Network 7c378b81-48f6-4815-a230-67e80372ff7b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:47:21.418007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:47:21.423723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Pushing event updated for resources: {'Port': ['ID=207d0c04-7d81-46d6-8286-04efa89cd02d,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:21.426032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:47:21.437017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.437358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.437689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.438010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.438345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.438660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.438978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.439304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.439619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.439952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.440263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Tracked resource versions report: Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: pushed versions: Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Log': {'1.0'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Network': {'1.1'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Port': {'1.5'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'PortForwarding': {'1.2'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'QosPolicy': {'1.8'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroup': {'1.2'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SubPort': {'1.0'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Subnet': {'1.1'}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Trunk': {'1.1'}} Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: consumer versions: Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Log': '1.0', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Network': '1.1', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Port': '1.5', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'PortForwarding': '1.2', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'QosPolicy': '1.8', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroup': '1.2', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroupRule': '1.0', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SubPort': '1.0', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Subnet': '1.1', Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Trunk': '1.1'}} Nov 24 13:47:21.441520 dv-neutron-818151-2-hyperv neutron-server[83527]: {{(pid=83527) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:47:21.473588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:21.527966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Attempting to bind port 207d0c04-7d81-46d6-8286-04efa89cd02d on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:47:21.528355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Attempting to bind port 207d0c04-7d81-46d6-8286-04efa89cd02d by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:47:21.528763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Attempting to bind port 207d0c04-7d81-46d6-8286-04efa89cd02d on network 7c378b81-48f6-4815-a230-67e80372ff7b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:47:21.535892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 47, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:47:21.536300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Checking segment: {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:47:21.536772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:21.537154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Bound using segment: {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:47:21.537626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Bound port: 207d0c04-7d81-46d6-8286-04efa89cd02d, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:47:21.538010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:21.623890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] For port 207d0c04-7d81-46d6-8286-04efa89cd02d, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:47:21.627831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] For port 207d0c04-7d81-46d6-8286-04efa89cd02d, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=207d0c04-7d81-46d6-8286-04efa89cd02d,segment=NetworkSegment(dbc21f22-dbe5-4822-aa60-8e926afd9972),segment_id=dbc21f22-dbe5-4822-aa60-8e926afd9972)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:47:21.632086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:21.636398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:21.739122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Pushing event updated for resources: {'Port': ['ID=207d0c04-7d81-46d6-8286-04efa89cd02d,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:21.742352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:22.925822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34104) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:23.325596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-70e008b9-cd56-4ae3-992d-b10aaf5071a6 admin admin] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:47:23.327271 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-70e008b9-cd56-4ae3-992d-b10aaf5071a6 admin admin] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.4004102 Nov 24 13:47:25.425673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bd592be-a44b-44f5-8123-a3a079681bc2 None None] Network 7c378b81-48f6-4815-a230-67e80372ff7b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:47:25.514675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8f595e2e-5236-4d42-8fd8-d2a4d591277d None None] Provisioning for port 207d0c04-7d81-46d6-8286-04efa89cd02d completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:47:25.642726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:25.839225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 207d0c04-7d81-46d6-8286-04efa89cd02d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:47:25.908874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 207d0c04-7d81-46d6-8286-04efa89cd02d completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:47:25.914244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 207d0c04-7d81-46d6-8286-04efa89cd02d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:25.914660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:25.989297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bcdd956e-465c-4cf8-9a01-17a70a3b00f8 None None] Provisioning complete for port 207d0c04-7d81-46d6-8286-04efa89cd02d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:25.989542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcdd956e-465c-4cf8-9a01-17a70a3b00f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:26.066976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-cecbc0c4-87ff-4a7c-b23f-34176a805914 admin admin] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:47:26.068247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cecbc0c4-87ff-4a7c-b23f-34176a805914 admin admin] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.4243729 Nov 24 13:47:26.092488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:26.178939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 207d0c04-7d81-46d6-8286-04efa89cd02d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=207d0c04-7d81-46d6-8286-04efa89cd02d,segment=NetworkSegment(dbc21f22-dbe5-4822-aa60-8e926afd9972),segment_id=dbc21f22-dbe5-4822-aa60-8e926afd9972)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:47:26.180143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcdd956e-465c-4cf8-9a01-17a70a3b00f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:26.196619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:26.207948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:26.328206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=207d0c04-7d81-46d6-8286-04efa89cd02d,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:26.331322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:26.346302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-bcdd956e-465c-4cf8-9a01-17a70a3b00f8 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:47:26.346684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-bcdd956e-465c-4cf8-9a01-17a70a3b00f8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:47:27.813846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 207d0c04-7d81-46d6-8286-04efa89cd02d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:47:27.902016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 207d0c04-7d81-46d6-8286-04efa89cd02d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:27.902635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:28.751581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34130) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:29.198548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'name': 'router1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:29.203748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:29.207496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Usage tracker for resource:router and tenant:aba0b58bb3e84ccdb96588d066f23908 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:29.210738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:29.216725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:29.227353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:29.228843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:29.265422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:29.378771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:29.396796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:29.398067 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-96b62d38-1c4c-4379-9bcb-b77feb837cdd admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6454194 Nov 24 13:47:31.660308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34140) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:32.063505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-863c3abb-9c32-4053-b9ab-dc8f88601bbb admin admin] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:47:32.064509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-863c3abb-9c32-4053-b9ab-dc8f88601bbb admin admin] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.4032478 Nov 24 13:47:33.080799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-de136e55-0d78-4730-8679-0801f13aa036 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:33.483026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.311772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34150) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:34.703791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Request body: {'network': {'is_default': True, 'router:external': True, 'admin_state_up': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'provider:network_type': 'flat'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:34.708660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:34.712673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Usage tracker for resource:network and tenant:a44d14c3167c4641ac2aa61f6ebe89e6 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:34.715431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:34.721131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:34.730560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Made reservation on behalf of a44d14c3167c4641ac2aa61f6ebe89e6 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:47:34.732894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.744506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.777453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:34.781824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Usage tracker for resource:security_group_rule and tenant:a44d14c3167c4641ac2aa61f6ebe89e6 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:34.784490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:34.790321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:34.854898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.858512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.862614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:34.877346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Reserving flat network on physical network physnet1 {{(pid=83526) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 24 13:47:34.898637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f30da28a-3cac-49e8-ab42-da04d323a3e1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:34.901946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:34.904693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.905020 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Added segment 44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9 of type flat for network 402f60a1-052a-4741-af19-c310771ae4cd Nov 24 13:47:34.935547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.970098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.971157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:34.971717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:34.976422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:35.072867 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7600191 Nov 24 13:47:35.075492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Pushing event updated for resources: {'Network': ['ID=402f60a1-052a-4741-af19-c310771ae4cd,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:35.078927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:35.086531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 402f60a1-052a-4741-af19-c310771ae4cd details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:47:35.654954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ebcec70b-965f-4221-a4b5-3ae7eaf9ac6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:36.569672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:37.357069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34166) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:37.719276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e82c78d-ebeb-43d3-aee2-163eafc80a39 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:37.720618 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2e82c78d-ebeb-43d3-aee2-163eafc80a39 admin admin] 10.222.0.70 "GET /v2.0/subnets/6b839039-d0d6-4190-a6d6-0528a8007847 HTTP/1.1" status: 200 len: 849 time: 0.3621247 Nov 24 13:47:37.862509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ce36445a-96bd-4a0b-8bab-2008b6302db0 admin admin] 10.222.0.70 "GET /v2.0/routers/a996d50c-e079-4fbe-b04f-875ecf79d2cf HTTP/1.1" status: 200 len: 704 time: 0.1366282 Nov 24 13:47:38.217006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:38.338423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:38.569458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Allocated IP 172.20.0.1 (7c378b81-48f6-4815-a230-67e80372ff7b/6b839039-d0d6-4190-a6d6-0528a8007847/6b16d621-f45b-4e01-80b3-a42c7695178e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:47:38.754379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:38.771429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Transition to ACTIVE for port object 6b16d621-f45b-4e01-80b3-a42c7695178e will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:47:38.821577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:38.826026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:38.881897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Network 7c378b81-48f6-4815-a230-67e80372ff7b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:47:38.882942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:47:38.891624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:47:38.892149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:38.936308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Pushing event updated for resources: {'Port': ['ID=6b16d621-f45b-4e01-80b3-a42c7695178e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:38.946033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:39.019213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:39.088947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-024f3e14-c74d-4acd-aa45-8b56d4ab44b0 None None] Provisioning for port 6b16d621-f45b-4e01-80b3-a42c7695178e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:47:39.095059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-024f3e14-c74d-4acd-aa45-8b56d4ab44b0 None None] Provisioning complete for port 6b16d621-f45b-4e01-80b3-a42c7695178e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:39.095438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-024f3e14-c74d-4acd-aa45-8b56d4ab44b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:39.147377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-024f3e14-c74d-4acd-aa45-8b56d4ab44b0 None None] Port 6b16d621-f45b-4e01-80b3-a42c7695178e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:47:39.250856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:39.255197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:39.256295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:39.259358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:39.386729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Pushing event updated for resources: {'Port': ['ID=6b16d621-f45b-4e01-80b3-a42c7695178e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:39.391627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:39.448713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Network 7c378b81-48f6-4815-a230-67e80372ff7b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:47:39.449734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:47:39.670294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a4744961-7ee6-4b47-9258-037bcb71a429 None None] Provisioning complete for port 6b16d621-f45b-4e01-80b3-a42c7695178e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:39.670879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a4744961-7ee6-4b47-9258-037bcb71a429 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:39.722684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a4744961-7ee6-4b47-9258-037bcb71a429 None None] Port 6b16d621-f45b-4e01-80b3-a42c7695178e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:47:39.811593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Router a996d50c-e079-4fbe-b04f-875ecf79d2cf is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:47:39.978189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:47:39.988478 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Sync routers for ids ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:47:39.990260 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] 10.222.0.70 "PUT /v2.0/routers/a996d50c-e079-4fbe-b04f-875ecf79d2cf/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.1228132 Nov 24 13:47:40.001219 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Routers {'a996d50c-e079-4fbe-b04f-875ecf79d2cf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:47:40.002070 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:47:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:40.176422 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Set router a996d50c-e079-4fbe-b04f-875ecf79d2cf gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:47:40.549384 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'name': 'router1', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:47:29Z', 'updated_at': '2021-11-24T13:47:38Z', 'revision_number': 2, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'gw_port_host': None, '_interfaces': [{'id': '6b16d621-f45b-4e01-80b3-a42c7695178e', 'name': '', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'mac_address': 'fa:16:3e:eb:db:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:38Z', 'updated_at': '2021-11-24T13:47:39Z', 'revision_number': 2, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'subnets': [{'id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:40.554127 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Checking router: a996d50c-e079-4fbe-b04f-875ecf79d2cf for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:47:40.554494 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Updating router a996d50c-e079-4fbe-b04f-875ecf79d2cf port 6b16d621-f45b-4e01-80b3-a42c7695178e binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:47:40.604423 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:40.979039 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:40.994680 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Transition to ACTIVE for port object 6b16d621-f45b-4e01-80b3-a42c7695178e will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:47:41.001122 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:41.006085 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:41.196518 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Pushing event updated for resources: {'Port': ['ID=6b16d621-f45b-4e01-80b3-a42c7695178e,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:41.258186 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Attempting to bind port 6b16d621-f45b-4e01-80b3-a42c7695178e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:47:41.258508 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Attempting to bind port 6b16d621-f45b-4e01-80b3-a42c7695178e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:47:41.258932 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Attempting to bind port 6b16d621-f45b-4e01-80b3-a42c7695178e on network 7c378b81-48f6-4815-a230-67e80372ff7b {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:47:41.267578 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.267941 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.268268 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.268592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.268924 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.269240 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.269548 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.269871 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.270178 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.270480 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.270781 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Tracked resource versions report: Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: pushed versions: Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Log': {'1.0'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Network': {'1.1'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Port': {'1.5'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'PortForwarding': {'1.2'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'QosPolicy': {'1.8'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroup': {'1.2'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SubPort': {'1.0'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Subnet': {'1.1'}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Trunk': {'1.1'}} Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: consumer versions: Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Log': '1.0', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Network': '1.1', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Port': '1.5', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'PortForwarding': '1.2', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'QosPolicy': '1.8', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroup': '1.2', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroupRule': '1.0', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SubPort': '1.0', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Subnet': '1.1', Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Trunk': '1.1'}} Nov 24 13:47:41.272069 dv-neutron-818151-2-hyperv neutron-server[83528]: {{(pid=83528) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:47:41.274805 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 47, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:47:41.275225 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Checking segment: {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:47:41.275703 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:41.276120 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Bound using segment: {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:47:41.276600 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Bound port: 6b16d621-f45b-4e01-80b3-a42c7695178e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dbc21f22-dbe5-4822-aa60-8e926afd9972', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:47:41.276984 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:41.293529 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:41.373464 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] For port 6b16d621-f45b-4e01-80b3-a42c7695178e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:47:41.378014 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] For port 6b16d621-f45b-4e01-80b3-a42c7695178e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=6b16d621-f45b-4e01-80b3-a42c7695178e,segment=NetworkSegment(dbc21f22-dbe5-4822-aa60-8e926afd9972),segment_id=dbc21f22-dbe5-4822-aa60-8e926afd9972)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:47:41.384322 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:41.388967 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:41.474148 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Pushing event updated for resources: {'Port': ['ID=6b16d621-f45b-4e01-80b3-a42c7695178e,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:41.482449 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:41.483097 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Routers {'a996d50c-e079-4fbe-b04f-875ecf79d2cf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:47:41.483676 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:47:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:41.633996 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] Set router a996d50c-e079-4fbe-b04f-875ecf79d2cf gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:47:41.969117 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'name': 'router1', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:47:29Z', 'updated_at': '2021-11-24T13:47:38Z', 'revision_number': 2, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'gw_port_host': None, '_interfaces': [{'id': '6b16d621-f45b-4e01-80b3-a42c7695178e', 'name': '', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'mac_address': 'fa:16:3e:eb:db:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:38Z', 'updated_at': '2021-11-24T13:47:41Z', 'revision_number': 4, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'subnets': [{'id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:41.973019 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc23d054-7c47-42cc-9638-b92956ea5c24 None None] The sync data for ids ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'] in dv-neutron-818151-2-hyperv is: [{'id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'name': 'router1', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:47:29Z', 'updated_at': '2021-11-24T13:47:38Z', 'revision_number': 2, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'gw_port_host': None, '_interfaces': [{'id': '6b16d621-f45b-4e01-80b3-a42c7695178e', 'name': '', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'mac_address': 'fa:16:3e:eb:db:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:38Z', 'updated_at': '2021-11-24T13:47:41Z', 'revision_number': 4, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'subnets': [{'id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:47:42.194374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34188) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:42.484567 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING oslo_policy.policy [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:42.485151 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING oslo_policy.policy [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:42.896054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.policy [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=83525) register_rules /opt/stack/neutron/neutron/policy.py:65}} Nov 24 13:47:42.896843 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING oslo_policy.policy [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:42.897213 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING oslo_policy.policy [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 13:47:42.900158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:42.902123 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-26764bc3-ee92-4a99-b042-9a11b1e99b0e admin admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 842 time: 0.7052162 Nov 24 13:47:42.911922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Request body: {'subnet': {'name': 'public-subnet', 'ip_version': 4, 'gateway_ip': '172.26.4.1', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_dhcp': False, 'cidr': '172.26.4.0/24'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:42.914898 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.quota [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Loaded quota_driver: . Nov 24 13:47:42.921926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:47:42.928043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Usage tracker for resource:subnet and tenant:a44d14c3167c4641ac2aa61f6ebe89e6 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:47:42.931701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:47:42.940026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:47:42.956170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Made reservation on behalf of a44d14c3167c4641ac2aa61f6ebe89e6 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:47:42.958966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Notify callbacks [] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:43.408530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:47:43.409187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:43.414117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:43.489851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Pushing event updated for resources: {'Subnet': ['ID=376fcf88-d7db-4a45-9380-52e3473e9bba,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:43.499087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:47:43.499443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Network hostable DHCP agents. Network: 402f60a1-052a-4741-af19-c310771ae4cd, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:47:43.505905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.506239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.506563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.506882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.507206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.507523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.507873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.508190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.508499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.508803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.509111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Tracked resource versions report: Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: pushed versions: Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Log': {'1.0'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Network': {'1.1'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Port': {'1.5'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'PortForwarding': {'1.2'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'QosPolicy': {'1.8'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroup': {'1.2'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SubPort': {'1.0'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Subnet': {'1.1'}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Trunk': {'1.1'}} Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: consumer versions: Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Log': '1.0', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Network': '1.1', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Port': '1.5', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'PortForwarding': '1.2', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'QosPolicy': '1.8', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroup': '1.2', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroupRule': '1.0', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SubPort': '1.0', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Subnet': '1.1', Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Trunk': '1.1'}} Nov 24 13:47:43.510313 dv-neutron-818151-2-hyperv neutron-server[83525]: {{(pid=83525) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:47:43.544550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:43.552969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:47:43.562822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 402f60a1-052a-4741-af19-c310771ae4cd) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:47:43.567483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:43.568144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:43.572001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ff24bce-a0aa-4994-b4d2-7fae9f9a31fb None None] Network 402f60a1-052a-4741-af19-c310771ae4cd requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:47:43.595263 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6875780 Nov 24 13:47:43.795361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca844662-5a1f-4715-963b-664933ca35ee None None] Network 402f60a1-052a-4741-af19-c310771ae4cd requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:47:43.886432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 6b16d621-f45b-4e01-80b3-a42c7695178e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:47:44.031316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 6b16d621-f45b-4e01-80b3-a42c7695178e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:47:44.040488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 6b16d621-f45b-4e01-80b3-a42c7695178e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:44.040893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:44.184583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:44.217176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 6b16d621-f45b-4e01-80b3-a42c7695178e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=6b16d621-f45b-4e01-80b3-a42c7695178e,segment=NetworkSegment(dbc21f22-dbe5-4822-aa60-8e926afd9972),segment_id=dbc21f22-dbe5-4822-aa60-8e926afd9972)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:47:44.221346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:44.223457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:44.288815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=6b16d621-f45b-4e01-80b3-a42c7695178e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:44.291985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:45.738244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34216) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:45.821785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 6b16d621-f45b-4e01-80b3-a42c7695178e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:47:45.892532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 6b16d621-f45b-4e01-80b3-a42c7695178e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:45.892993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:46.007859 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ddbfb5f7-728f-4529-a27b-9be7634c2917 admin admin] 10.222.0.70 "GET /v2.0/routers/a996d50c-e079-4fbe-b04f-875ecf79d2cf HTTP/1.1" status: 200 len: 710 time: 0.2684608 Nov 24 13:47:46.133041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81f051a6-13e0-4c44-9f5e-c38e70651393 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:47:46.133544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-81f051a6-13e0-4c44-9f5e-c38e70651393 admin admin] Synchronizing usage tracker for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:47:46.150418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-81f051a6-13e0-4c44-9f5e-c38e70651393 admin admin] Unset dirty status for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:47:46.151536 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-81f051a6-13e0-4c44-9f5e-c38e70651393 admin admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 886 time: 0.1387608 Nov 24 13:47:46.160591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:47:46.616657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:46.796518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:46.850354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:46.989357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Allocated IP 172.26.4.131 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/2971ea61-23f6-46f2-b2fb-617d5b36d466) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:47:47.129482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:47.155551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:47.159786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-159658d0-877b-48eb-bbaa-1080c6bbb630 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:47.231896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:47:47.232983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:47:47.237096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:47:47.259808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Pushing event updated for resources: {'Port': ['ID=2971ea61-23f6-46f2-b2fb-617d5b36d466,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:47.266582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:47.416630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:47.577891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:47.580982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:47.772548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Router a996d50c-e079-4fbe-b04f-875ecf79d2cf has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:47:47.969294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:47:47.977143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:47.978160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Sync routers for ids ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:47:47.978617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] 10.222.0.70 "PUT /v2.0/routers/a996d50c-e079-4fbe-b04f-875ecf79d2cf HTTP/1.1" status: 200 len: 890 time: 1.8209085 Nov 24 13:47:47.990454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Routers {'a996d50c-e079-4fbe-b04f-875ecf79d2cf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:47:47.991131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:47:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:48.181072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Set router a996d50c-e079-4fbe-b04f-875ecf79d2cf gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:47:48.522621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'name': 'router1', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.131'}], 'enable_snat': True}, 'gw_port_id': '2971ea61-23f6-46f2-b2fb-617d5b36d466', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:47:29Z', 'updated_at': '2021-11-24T13:47:47Z', 'revision_number': 4, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'gw_port': {'id': '2971ea61-23f6-46f2-b2fb-617d5b36d466', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:c3:d3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:46Z', 'updated_at': '2021-11-24T13:47:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '6b16d621-f45b-4e01-80b3-a42c7695178e', 'name': '', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'mac_address': 'fa:16:3e:eb:db:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:38Z', 'updated_at': '2021-11-24T13:47:44Z', 'revision_number': 5, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'subnets': [{'id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:48.527319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Checking router: a996d50c-e079-4fbe-b04f-875ecf79d2cf for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:47:48.527661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Updating router a996d50c-e079-4fbe-b04f-875ecf79d2cf port 2971ea61-23f6-46f2-b2fb-617d5b36d466 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:47:48.582535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:48.940909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:48.952093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Transition to ACTIVE for port object 2971ea61-23f6-46f2-b2fb-617d5b36d466 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:47:48.958165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:48.962969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:49.039224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19711c8-01b9-40ae-a15e-28a4822e7bf2 None None] Pushing event updated for resources: {'Port': ['ID=2971ea61-23f6-46f2-b2fb-617d5b36d466,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:49.042606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e19711c8-01b9-40ae-a15e-28a4822e7bf2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:49.043428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Attempting to bind port 2971ea61-23f6-46f2-b2fb-617d5b36d466 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:47:49.043922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Attempting to bind port 2971ea61-23f6-46f2-b2fb-617d5b36d466 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:47:49.044774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Attempting to bind port 2971ea61-23f6-46f2-b2fb-617d5b36d466 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:47:49.051536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 47, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:47:49.051942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:47:49.052344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:49.052735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:47:49.053198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Bound port: 2971ea61-23f6-46f2-b2fb-617d5b36d466, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:47:49.053587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:49.123308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] For port 2971ea61-23f6-46f2-b2fb-617d5b36d466, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:47:49.126317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] For port 2971ea61-23f6-46f2-b2fb-617d5b36d466, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2971ea61-23f6-46f2-b2fb-617d5b36d466,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:47:49.131487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:49.135137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:49.212187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19711c8-01b9-40ae-a15e-28a4822e7bf2 None None] Pushing event updated for resources: {'Port': ['ID=2971ea61-23f6-46f2-b2fb-617d5b36d466,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:49.217431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e19711c8-01b9-40ae-a15e-28a4822e7bf2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:49.221329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Routers {'a996d50c-e079-4fbe-b04f-875ecf79d2cf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:47:49.221934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:47:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:49.399779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] Set router a996d50c-e079-4fbe-b04f-875ecf79d2cf gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:47:49.729897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'name': 'router1', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.131'}], 'enable_snat': True}, 'gw_port_id': '2971ea61-23f6-46f2-b2fb-617d5b36d466', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:47:29Z', 'updated_at': '2021-11-24T13:47:47Z', 'revision_number': 4, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'gw_port': {'id': '2971ea61-23f6-46f2-b2fb-617d5b36d466', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:c3:d3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:46Z', 'updated_at': '2021-11-24T13:47:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '6b16d621-f45b-4e01-80b3-a42c7695178e', 'name': '', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'mac_address': 'fa:16:3e:eb:db:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:38Z', 'updated_at': '2021-11-24T13:47:44Z', 'revision_number': 5, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'subnets': [{'id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:47:49.733906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1b80240-a50d-4af3-82e4-18546df38a03 None None] The sync data for ids ['a996d50c-e079-4fbe-b04f-875ecf79d2cf'] in dv-neutron-818151-2-hyperv is: [{'id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'name': 'router1', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.131'}], 'enable_snat': True}, 'gw_port_id': '2971ea61-23f6-46f2-b2fb-617d5b36d466', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:47:29Z', 'updated_at': '2021-11-24T13:47:47Z', 'revision_number': 4, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'gw_port': {'id': '2971ea61-23f6-46f2-b2fb-617d5b36d466', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:05:c3:d3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:46Z', 'updated_at': '2021-11-24T13:47:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '6b16d621-f45b-4e01-80b3-a42c7695178e', 'name': '', 'network_id': '7c378b81-48f6-4815-a230-67e80372ff7b', 'tenant_id': 'aba0b58bb3e84ccdb96588d066f23908', 'mac_address': 'fa:16:3e:eb:db:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a996d50c-e079-4fbe-b04f-875ecf79d2cf', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:47:38Z', 'updated_at': '2021-11-24T13:47:44Z', 'revision_number': 5, 'project_id': 'aba0b58bb3e84ccdb96588d066f23908', 'subnets': [{'id': '6b839039-d0d6-4190-a6d6-0528a8007847', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '16d081a1-b1dc-49b8-8fac-f93bb873027e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:47:50.259437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34226) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:47:50.396646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-29116333-19ee-4a25-b9d6-1f69a59bd7a4 admin admin] 10.222.0.70 "GET /v2.0/ports?device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 1082 time: 0.1360645 Nov 24 13:47:51.843291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2971ea61-23f6-46f2-b2fb-617d5b36d466 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:47:51.916716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 2971ea61-23f6-46f2-b2fb-617d5b36d466 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:47:51.921602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2971ea61-23f6-46f2-b2fb-617d5b36d466 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:51.921975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:52.049836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:52.066265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 2971ea61-23f6-46f2-b2fb-617d5b36d466, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2971ea61-23f6-46f2-b2fb-617d5b36d466,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:47:52.071407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:52.073687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e19711c8-01b9-40ae-a15e-28a4822e7bf2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:47:52.143230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=2971ea61-23f6-46f2-b2fb-617d5b36d466,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:47:52.146325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:47:53.844634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2971ea61-23f6-46f2-b2fb-617d5b36d466 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:47:53.964734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2971ea61-23f6-46f2-b2fb-617d5b36d466 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:47:53.965584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:47:58.491441 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:48:03.086887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-41143373-62e6-4196-a70b-bda056474dc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:03.483237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:05.656389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28608b15-d975-4e98-b43e-1f98399cbf2c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:06.574092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:08.235711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:33.078409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e85bef3e-7733-4573-8167-5d722d8e47e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:33.492959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:35.491640 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:48:35.659038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a33cd7c6-dc4b-4fc7-9f2a-14766a62d912 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:36.577221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:48:38.238660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:03.083922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-595de373-92c5-4073-a0a3-4c14e26a67cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:03.482649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:05.663747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-270bc550-0493-4679-bdcc-9a48c844b2e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:06.580400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:08.258230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:12.491834 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:49:33.078639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c329d9ce-4957-4949-87bc-d5ecc0938fdd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:33.489558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:35.667724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-232e75aa-1852-4711-b683-51ed7356829f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:36.584557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:38.255971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:49:49.496296 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:49:58.596941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34830) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:49:58.690568 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7060a05-2913-41d1-8712-3f6b26534687 admin admin] GET failed (client error): The resource could not be found. Nov 24 13:49:58.691820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c7060a05-2913-41d1-8712-3f6b26534687 admin admin] 10.222.0.70 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0939157 Nov 24 13:49:58.824626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a7f4036-400c-4e1d-a81b-8844c05d670d admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:49:58.826082 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4a7f4036-400c-4e1d-a81b-8844c05d670d admin admin] 10.222.0.70 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1303589 Nov 24 13:50:00.897831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34840) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:01.042118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3635913e-e48f-442e-a9ec-b4729be8cfe0 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:01.043503 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3635913e-e48f-442e-a9ec-b4729be8cfe0 admin admin] 10.222.0.70 "GET /v2.0/subnets/6b839039-d0d6-4190-a6d6-0528a8007847 HTTP/1.1" status: 200 len: 849 time: 0.1446328 Nov 24 13:50:01.053287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:50:01.173800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Notify callbacks [] for subnet, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:01.383765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8771276033028'] for subnet, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:01.388923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5d5815bb-e050-44fe-8b63-968cbc439c07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:50:01.432993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:01.433492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:01.434913 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] 10.222.0.70 "PUT /v2.0/subnets/6b839039-d0d6-4190-a6d6-0528a8007847 HTTP/1.1" status: 200 len: 868 time: 0.3853037 Nov 24 13:50:01.442620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8937b13-aded-4706-a226-d257414c2449 None None] Network 7c378b81-48f6-4815-a230-67e80372ff7b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:50:01.470050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Pushing event updated for resources: {'Subnet': ['ID=6b839039-d0d6-4190-a6d6-0528a8007847,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:50:01.482133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.482515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.483021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.483395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.483781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.484166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.484544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.484896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.485253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.485604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.485963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:01.489879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:50:01.913835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a7f7ac67-0586-45f2-8295-bb56a5a567f5 None None] Provisioning complete for port 6b16d621-f45b-4e01-80b3-a42c7695178e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:50:01.914215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a7f7ac67-0586-45f2-8295-bb56a5a567f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:02.049225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a7f7ac67-0586-45f2-8295-bb56a5a567f5 None None] Provisioning complete for port 207d0c04-7d81-46d6-8286-04efa89cd02d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:50:02.049494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a7f7ac67-0586-45f2-8295-bb56a5a567f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:03.082190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-71995167-196d-4543-ada8-0702322a54e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:03.483229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:03.488120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34850) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:03.687770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e74a177f-fcad-4af7-9932-7af78263a167 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:03.688070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e74a177f-fcad-4af7-9932-7af78263a167 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:03.689574 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e74a177f-fcad-4af7-9932-7af78263a167 admin admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2004895 Nov 24 13:50:05.672415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b2f5a19-efe8-4cd9-9bef-1a76cab73bea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:05.781341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:06.001707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e30823fc-184c-4f7c-82ff-398b445f0b3a admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:06.001975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e30823fc-184c-4f7c-82ff-398b445f0b3a admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:06.003493 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e30823fc-184c-4f7c-82ff-398b445f0b3a admin admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2209466 Nov 24 13:50:06.588117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:08.124948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34870) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:08.260638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:08.353039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84eb1346-c41e-4351-a4cb-e97cc094182c admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:08.354688 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-84eb1346-c41e-4351-a4cb-e97cc094182c admin admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 886 time: 0.2284241 Nov 24 13:50:10.425695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34880) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:10.683035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-776f63d4-25ac-4c0a-be42-dcc97063e2c9 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:10.685415 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-776f63d4-25ac-4c0a-be42-dcc97063e2c9 admin admin] 10.222.0.70 "GET /v2.0/networks/7c378b81-48f6-4815-a230-67e80372ff7b HTTP/1.1" status: 200 len: 869 time: 0.2581768 Nov 24 13:50:12.753844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34890) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:12.893370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b40aef15-deac-488b-b130-ab2f22d2eff4 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:12.893728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b40aef15-deac-488b-b130-ab2f22d2eff4 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:12.895217 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b40aef15-deac-488b-b130-ab2f22d2eff4 admin admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1403947 Nov 24 13:50:14.941313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34900) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:15.073290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1285168-eed5-49f6-b1aa-5a4b43d73a8c admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:15.073648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1285168-eed5-49f6-b1aa-5a4b43d73a8c admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:15.074361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c1285168-eed5-49f6-b1aa-5a4b43d73a8c admin admin] Synchronizing usage tracker for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:50:15.095121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c1285168-eed5-49f6-b1aa-5a4b43d73a8c admin admin] Unset dirty status for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:50:15.096350 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c1285168-eed5-49f6-b1aa-5a4b43d73a8c admin admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1541107 Nov 24 13:50:17.163540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34910) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:17.306984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8d35493-4f73-4851-a060-8238ecf74eca admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:17.308469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d8d35493-4f73-4851-a060-8238ecf74eca admin admin] 10.222.0.70 "GET /v2.0/subnets/376fcf88-d7db-4a45-9380-52e3473e9bba HTTP/1.1" status: 200 len: 816 time: 0.1439307 Nov 24 13:50:19.372707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 34920) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:19.504757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dd8c22f-e81f-40d0-8f3e-9d2b63e1c4e9 admin admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:19.506076 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2dd8c22f-e81f-40d0-8f3e-9d2b63e1c4e9 admin admin] 10.222.0.70 "GET /v2.0/subnets/6b839039-d0d6-4190-a6d6-0528a8007847 HTTP/1.1" status: 200 len: 868 time: 0.1324360 Nov 24 13:50:26.497397 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:50:33.086267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-059315a9-2892-47a9-8de4-156b1a1274e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:33.486737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:35.676254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36699a6c-646f-4ea7-8869-abf2d65a1cb7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:36.588246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:38.263104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:38.331070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34958) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:38.404029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-aa39d28f-b49d-4204-98b3-480cb43d6202 admin admin] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:50:38.404999 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aa39d28f-b49d-4204-98b3-480cb43d6202 admin admin] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0730135 Nov 24 13:50:40.541850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34968) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:40.635297 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-12326944-81ad-4d62-b22b-e1ab465625e9 admin admin] GET failed (client error): The resource could not be found. Nov 24 13:50:40.637150 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-12326944-81ad-4d62-b22b-e1ab465625e9 admin admin] 10.222.0.70 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0944591 Nov 24 13:50:40.767828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef0f68dc-5225-4b26-9d69-a45873af352e admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:40.769273 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ef0f68dc-5225-4b26-9d69-a45873af352e admin admin] 10.222.0.70 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1278923 Nov 24 13:50:42.898324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34978) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:42.973094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:50:42.977957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:50:42.988433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:50:43.000041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Made reservation on behalf of a44d14c3167c4641ac2aa61f6ebe89e6 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:50:43.002659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:43.101073 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING neutron.services.revisions.revision_plugin [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Could not find related network for resource to bump revision. Nov 24 13:50:43.116360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 892} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:50:43.127858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8771276175818', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:43.128446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Unsubscribe: segment precommit_create {{(pid=83525) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 13:50:43.128877 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Added segment 080cd143-a8a4-4852-90bb-c37b18b67653 of type vlan for network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 Nov 24 13:50:43.168047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:43.205135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:43.206303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:43.206897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:43.211389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:50:43.307742 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4083250 Nov 24 13:50:43.313672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Pushing event updated for resources: {'Network': ['ID=5376da5b-ee69-4423-bedc-0b4dfeca8d60,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:50:43.325045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.325374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.325700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.326071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.326376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.326705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.327039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.327373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.327671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.328015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.328326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:43.332920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:50:43.348800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:50:45.431905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 34988) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:50:45.526125 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-42c3e1f2-82ab-4b9a-a0d9-f2a0131aba61 admin admin] GET failed (client error): The resource could not be found. Nov 24 13:50:45.526700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-42c3e1f2-82ab-4b9a-a0d9-f2a0131aba61 admin admin] Synchronizing usage tracker for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:50:45.542514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-42c3e1f2-82ab-4b9a-a0d9-f2a0131aba61 admin admin] Unset dirty status for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:50:45.543572 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-42c3e1f2-82ab-4b9a-a0d9-f2a0131aba61 admin admin] 10.222.0.70 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.1107259 Nov 24 13:50:45.653440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a626f2de-6ead-4fbf-87ec-9e950724c7f0 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:45.654971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a626f2de-6ead-4fbf-87ec-9e950724c7f0 admin admin] 10.222.0.70 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1074426 Nov 24 13:50:45.664375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Request body: {'subnet': {'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60', 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:50:45.669092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:50:45.678647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:50:45.688724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Made reservation on behalf of a44d14c3167c4641ac2aa61f6ebe89e6 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:50:45.691201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Notify callbacks [] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:45.903986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:45.908183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:50:45.977254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Pushing event updated for resources: {'Subnet': ['ID=89be5eef-9612-449d-a8e3-9b7b44d0fbad,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:50:45.983448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:50:45.993465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Checking segment: {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:50:45.993808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Network hostable DHCP agents. Network: 5376da5b-ee69-4423-bedc-0b4dfeca8d60, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:50:46.017794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:50:46.028061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 5376da5b-ee69-4423-bedc-0b4dfeca8d60) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:50:46.032485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:50:46.033134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:46.040583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3eb2b3a-fa27-43d0-93bc-2774d287029a None None] Network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:50:46.060146 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3989513 Nov 24 13:50:46.295923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-5376da5b-ee69-4423-bedc-0b4dfeca8d60', 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60', 'tenant_id': 'a44d14c3167c4641ac2aa61f6ebe89e6', 'fixed_ips': [{'subnet_id': '89be5eef-9612-449d-a8e3-9b7b44d0fbad'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:50:46.297107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:46.472711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Allocated IP 192.168.233.2 (5376da5b-ee69-4423-bedc-0b4dfeca8d60/89be5eef-9612-449d-a8e3-9b7b44d0fbad/ae28f041-10a3-4279-82ff-ec6c25ff586a) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:50:46.706209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:46.727775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Transition to ACTIVE for port object ae28f041-10a3-4279-82ff-ec6c25ff586a will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:50:46.753335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Transition to ACTIVE for port object ae28f041-10a3-4279-82ff-ec6c25ff586a will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:50:46.759436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:46.767836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:50:46.872631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:50:46.876594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:50:46.883332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:50:46.886003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Pushing event updated for resources: {'Port': ['ID=ae28f041-10a3-4279-82ff-ec6c25ff586a,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:50:46.925460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.925794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.926155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.926484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.926839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.927173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.927518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.927902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.928227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.928568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.928910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:50:46.938150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:50:46.995666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Attempting to bind port ae28f041-10a3-4279-82ff-ec6c25ff586a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:50:46.996071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Attempting to bind port ae28f041-10a3-4279-82ff-ec6c25ff586a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:50:46.996437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Attempting to bind port ae28f041-10a3-4279-82ff-ec6c25ff586a on network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:50:47.003478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:50:47.003894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Checking segment: {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:50:47.004277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:47.004685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Bound using segment: {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:50:47.005156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Bound port: ae28f041-10a3-4279-82ff-ec6c25ff586a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:50:47.005560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:47.103090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] For port ae28f041-10a3-4279-82ff-ec6c25ff586a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:50:47.107950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] For port ae28f041-10a3-4279-82ff-ec6c25ff586a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ae28f041-10a3-4279-82ff-ec6c25ff586a,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:50:47.112987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:47.117133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:50:47.199206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Pushing event updated for resources: {'Port': ['ID=ae28f041-10a3-4279-82ff-ec6c25ff586a,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:50:47.204494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:50:47.958328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ae28f041-10a3-4279-82ff-ec6c25ff586a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:50:48.040464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port ae28f041-10a3-4279-82ff-ec6c25ff586a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:50:48.098964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d31f4463-f44c-4949-8566-be9954932dfa None None] Network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:50:48.233531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Provisioning for port ae28f041-10a3-4279-82ff-ec6c25ff586a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:50:48.242881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Provisioning complete for port ae28f041-10a3-4279-82ff-ec6c25ff586a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:50:48.243252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:48.456763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:48.504952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] For port ae28f041-10a3-4279-82ff-ec6c25ff586a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ae28f041-10a3-4279-82ff-ec6c25ff586a,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:50:48.510333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:48.512895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cd8d649e-57e6-4660-b830-1262791d8447 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:50:48.580242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Pushing event updated for resources: {'Port': ['ID=ae28f041-10a3-4279-82ff-ec6c25ff586a,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:50:48.583919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:50:48.740237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d71f8120-dcd7-4f3b-a668-377303e982c8 None None] Provisioning complete for port ae28f041-10a3-4279-82ff-ec6c25ff586a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:50:48.740531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d71f8120-dcd7-4f3b-a668-377303e982c8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:50:49.916043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ae28f041-10a3-4279-82ff-ec6c25ff586a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:50:49.989566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port ae28f041-10a3-4279-82ff-ec6c25ff586a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:50:49.989934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:03.091247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-52c6a7d1-5ea7-4148-ada6-f56fb1dc9f7a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:03.489798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:03.499920 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:51:05.682833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5354ceda-f422-4268-b43a-3c04483472aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:06.591882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:08.265044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:33.092336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-981203ae-efd4-47be-9a92-a075d0a33c40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:33.492493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:35.674833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5e4b569f-3921-417b-b7a1-ca58dbe2e133 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:36.594833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:38.271811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:40.500614 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:51:55.765280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35030) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:51:55.771415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-736daacd-b3fb-4da0-aedc-7c9baeb26df9 tempest-verify_tempest_config-312939361 tempest-verify_tempest_config-312939361-project] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:51:55.772386 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-736daacd-b3fb-4da0-aedc-7c9baeb26df9 tempest-verify_tempest_config-312939361 tempest-verify_tempest_config-312939361-project] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12610 time: 0.0060973 Nov 24 13:51:56.123166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35048) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:51:56.262856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.304343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:51:56.308656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Usage tracker for resource:security_group_rule and tenant:a8e94957bc044f23823dc3c855fd296f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:51:56.311799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:51:56.317776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:51:56.388710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.392280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.398697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:51:56.438142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72cae776-1e67-4f45-82e2-5987087afbb2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:51:56.445135 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=a8e94957bc044f23823dc3c855fd296f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3208563 Nov 24 13:51:56.446945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35054) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:51:56.450442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.450786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.451121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.451448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.451799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.452127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.452448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.452772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.453088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.453400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.453711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.457993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:51:56.507548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.531416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.621614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.625497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:51:56.638615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72cae776-1e67-4f45-82e2-5987087afbb2,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:51:56.647321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:51:56.648377 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/72cae776-1e67-4f45-82e2-5987087afbb2 HTTP/1.1" status: 204 len: 168 time: 0.2003362 Nov 24 13:51:56.649918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.650290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.651154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.651486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.651846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.652253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.652485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.652810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.653127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.653458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.653770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:51:56.656770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:52:03.094703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f9b2a1c6-3d1f-41f4-9d00-fa7dab4863cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:03.498449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:05.676404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-60475124-4d1e-4009-93f4-5528b01eb0b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:06.595615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:08.274434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:17.501210 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:52:33.097549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6c92c8f9-5678-4cfd-8fad-36db5a071c20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:33.516495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:35.677130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-67afeceb-2515-4c9d-9e99-e5c7e5ef62d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:36.598276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:38.278483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:52:54.502721 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 5 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:53:03.099974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-77a61b69-dcd9-4bd3-a7ea-64e877806f48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:03.498103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:05.677882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-09591df9-852f-4ca1-be9a-63537ac8a3ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:06.600393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:08.275608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:17.450476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1007011'] for agent, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:31.504457 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:53:32.441579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35124) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:53:32.578916 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-03ee4b92-7dd9-40c0-9436-f24d2335d2a5 admin admin] 10.222.0.70 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4315 time: 0.1361880 Nov 24 13:53:33.104486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66e70a91-abe0-4618-ab8f-8bd659b9c22f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:33.499878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:34.640409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35134) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:53:34.719792 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cdad9227-77b2-4f45-b414-27df47838978 admin admin] 10.222.0.70 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4315 time: 0.0782905 Nov 24 13:53:35.680783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d92576f-3850-4f59-ae3a-afb625670fa6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:36.604983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:38.283455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:53:47.432116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:03.128154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-475fd46d-e3a3-44aa-99d2-b3b61275408c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:03.502028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:05.685394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2992febb-2cd2-4608-a711-efebcfe7d3ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:06.605671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:08.300204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:08.505198 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:54:17.424140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:33.111098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b96759bd-37c8-4fb8-8f4c-d602325aeb13 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:33.504458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:35.690948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca7ed9e8-f2b5-47ef-8e3e-d1e0cb19b912 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:36.611848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:38.288301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:45.505872 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:54:47.439721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:56.675303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35308) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:57.008553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35324) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:57.093993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35332) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:57.126433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-2018880365-network', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:57.132908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.137531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Usage tracker for resource:network and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.140546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.146478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.157700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Made reservation on behalf of cec6d7377f6a459a8b7de61e6d2b631f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:54:57.160693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.176834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.209427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.214317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Usage tracker for resource:security_group_rule and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.217316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.223103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.290230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.295665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.300199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4aada547-72e5-4037-b36a-5970f393c51c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:57.328573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e674e92-9d9b-4056-bace-5772f570a75e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:57.339732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.340378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.340919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.341300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.341816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.342134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.342630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.343334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.343334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.343580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.343912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Tracked resource versions report: Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: pushed versions: Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Log': {'1.0'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Network': {'1.1'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Port': {'1.5'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'PortForwarding': {'1.2'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'QosPolicy': {'1.8'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroup': {'1.2'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SubPort': {'1.0'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Subnet': {'1.1'}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Trunk': {'1.1'}} Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: consumer versions: Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: HyperV agent@hv-neutron-8181: {}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Log': '1.0', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Network': '1.1', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Port': '1.5', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'PortForwarding': '1.2', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'QosPolicy': '1.8', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroup': '1.2', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SecurityGroupRule': '1.0', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'SubPort': '1.0', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Subnet': '1.1', Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: 'Trunk': '1.1'}} Nov 24 13:54:57.345116 dv-neutron-818151-2-hyperv neutron-server[83526]: {{(pid=83526) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:54:57.356073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:57.364701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 896} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:54:57.376589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.376958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Added segment 423ee2bc-a1dd-4d07-afe8-56278dd019a5 of type vlan for network 192cb388-42c9-4352-94b7-0d42c68d3b4b Nov 24 13:54:57.412690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.448485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.449941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:54:57.450524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.463206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:57.564003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Pushing event updated for resources: {'Network': ['ID=192cb388-42c9-4352-94b7-0d42c68d3b4b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:57.568072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:57.570150 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.8936012 Nov 24 13:54:57.573630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35348) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:57.577789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:54:57.578694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Request body: {'subnet': {'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-2018880365-subnet', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:57.583637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.588257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Usage tracker for resource:subnet and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.591629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.598762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.613703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Made reservation on behalf of cec6d7377f6a459a8b7de61e6d2b631f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:54:57.616560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Notify callbacks [] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.662322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-1754938903-network', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:57.671910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.681494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Usage tracker for resource:network and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.686382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.696726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.721613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-665950053-network', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:57.733087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Made reservation on behalf of 8253655cf6fe49d7881f39cdb1344ce7 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:54:57.737039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.752974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.758419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Usage tracker for resource:network and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.762118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.769710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.777632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.813032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.817603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Usage tracker for resource:security_group_rule and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.821630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.827502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.833275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Made reservation on behalf of a6e6213b81eb4772a787ef2b41ed785b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:54:57.835654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.868389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.873783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.883442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:57.932894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:57.955979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:57.958562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fdef5004-cb01-46c8-ad07-7ca2196a0189,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:57.961212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Usage tracker for resource:security_group_rule and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:57.965137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:57.967850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:57.972450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:57.992979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Checking segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:54:57.997303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Network hostable DHCP agents. Network: 192cb388-42c9-4352-94b7-0d42c68d3b4b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:54:58.026441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.043347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:54:58.057919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 192cb388-42c9-4352-94b7-0d42c68d3b4b) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:54:58.058982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.059989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:58.064432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:54:58.065428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.071185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-644f7c9c-1dea-4c55-89de-3d16870ce79d None None] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:54:58.095806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5196755 Nov 24 13:54:58.096836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35364) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:58.098451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 874} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:54:58.108793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.109330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Added segment 5c305207-8a12-478f-bc44-f5b3813baa70 of type vlan for network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 Nov 24 13:54:58.110648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:58.115329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.121807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:58.135041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Usage tracker for resource:router and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:58.143278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:58.146001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.154237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:58.170073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.170823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.186495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.190341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 877} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:54:58.199250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.216530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.224165 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Added segment 294894e1-7345-4c10-ab6b-ce6e04e017bb of type vlan for network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 Nov 24 13:54:58.280659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:54:58.281257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.300821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.337441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ccb9a54-bae1-4661-b828-f31edeae24e1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:58.412791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.413337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.414105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.414686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.415260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.415838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.416378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.416905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.417436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.417961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.418491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Tracked resource versions report: Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: pushed versions: Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Log': {'1.0'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Network': {'1.1'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Port': {'1.5'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'PortForwarding': {'1.2'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'QosPolicy': {'1.8'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroup': {'1.2'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SubPort': {'1.0'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Subnet': {'1.1'}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Trunk': {'1.1'}} Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: consumer versions: Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: HyperV agent@hv-neutron-8181: {}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Log': '1.0', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Network': '1.1', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Port': '1.5', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'PortForwarding': '1.2', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'QosPolicy': '1.8', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroup': '1.2', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SecurityGroupRule': '1.0', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'SubPort': '1.0', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Subnet': '1.1', Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: 'Trunk': '1.1'}} Nov 24 13:54:58.419681 dv-neutron-818151-2-hyperv neutron-server[83525]: {{(pid=83525) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:54:58.426077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.430212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.370s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:58.431034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-434b303a-13b0-42cc-a2ac-e6800924a6ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.255s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:58.463709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:54:58.464483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.478835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a39799c9-29bb-4c79-a47b-c7cce485cff2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:58.481856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-192cb388-42c9-4352-94b7-0d42c68d3b4b', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:54:58.482703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.492433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.502893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:58.503389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.167s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:58.598647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Pushing event updated for resources: {'Network': ['ID=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:58.605321 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.5956168 Nov 24 13:54:58.606035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35378) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:58.615176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:54:58.726524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Pushing event updated for resources: {'Network': ['ID=7c23cefd-d4e1-4241-a3d2-42622a5131e3,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:58.731911 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 1.6366620 Nov 24 13:54:58.732782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35386) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:58.738644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Request body: {'subnet': {'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-665950053-subnet', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:58.743384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:58.744409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.747494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Usage tracker for resource:subnet and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:58.750475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:58.760628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:58.771946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Request body: {'subnet': {'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-1754938903-subnet', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:58.777828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:58.785734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.786110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Usage tracker for resource:subnet and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:58.790044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:58.797034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:58.815084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:58.815795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.313s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:58.816885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:58.818729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Made reservation on behalf of a6e6213b81eb4772a787ef2b41ed785b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:54:58.826707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Notify callbacks [] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.846879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:54:58.884508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Made reservation on behalf of 8253655cf6fe49d7881f39cdb1344ce7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:54:58.887657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Notify callbacks [] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:58.994792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Allocated IP 172.20.0.2 (192cb388-42c9-4352-94b7-0d42c68d3b4b/fdef5004-cb01-46c8-ad07-7ca2196a0189/4f186f8f-1323-42d7-929a-6a3cde55f1b7) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:54:59.037313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Allocated IP 172.26.4.237 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/e8f8917d-9594-4d5f-93db-365790f34888) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:54:59.228737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.236546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5c9cda56-cf9e-4e4a-aa68-63371ed992af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:59.271783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.312145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.317059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:59.327148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.332407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Pushing event updated for resources: {'Subnet': ['ID=8c839c3b-21dc-400b-8b56-739bd37025c8,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:59.344821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:59.355655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Transition to ACTIVE for port object 4f186f8f-1323-42d7-929a-6a3cde55f1b7 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:54:59.405454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Transition to ACTIVE for port object 4f186f8f-1323-42d7-929a-6a3cde55f1b7 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:54:59.414072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Checking segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:54:59.414730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Network hostable DHCP agents. Network: a9f12bbb-ee13-42dd-8eed-cf94fa9dada5, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:54:59.418151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.431116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:59.456773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.472202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:54:59.478004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Pushing event updated for resources: {'Port': ['ID=e8f8917d-9594-4d5f-93db-365790f34888,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:59.487191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:59.501340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:54:59.503143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:54:59.505487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:54:59.534934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:54:59.566724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d04c57a1-6813-42f8-932e-ab9506091c4e,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:59.572659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:59.573663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, a9f12bbb-ee13-42dd-8eed-cf94fa9dada5) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:54:59.582497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:54:59.583088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.596768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:54:59.600897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Pushing event updated for resources: {'Port': ['ID=4f186f8f-1323-42d7-929a-6a3cde55f1b7,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:54:59.607851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Checking segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:54:59.608148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Network hostable DHCP agents. Network: 7c23cefd-d4e1-4241-a3d2-42622a5131e3, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:54:59.610053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58a26c99-c005-4824-b6d7-ce5740268181 None None] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:54:59.625043 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.8907387 Nov 24 13:54:59.625843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35408) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:59.634286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:59.640325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:59.645383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Usage tracker for resource:router and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:59.649450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:54:59.650207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:59.656539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7c23cefd-d4e1-4241-a3d2-42622a5131e3) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:54:59.657976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:59.660186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.660682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.661609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:54:59.662272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.664180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.664779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.665236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.665384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.665656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.666248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.666574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.666914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.667253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Tracked resource versions report: Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: pushed versions: Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Log': {'1.0'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Network': {'1.1'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Port': {'1.5'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'PortForwarding': {'1.2'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'QosPolicy': {'1.8'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroup': {'1.2'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SubPort': {'1.0'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Subnet': {'1.1'}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Trunk': {'1.1'}} Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: consumer versions: Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: HyperV agent@hv-neutron-8181: {}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Log': '1.0', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Network': '1.1', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Port': '1.5', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'PortForwarding': '1.2', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'QosPolicy': '1.8', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroup': '1.2', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SecurityGroupRule': '1.0', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'SubPort': '1.0', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Subnet': '1.1', Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: 'Trunk': '1.1'}} Nov 24 13:54:59.668258 dv-neutron-818151-2-hyperv neutron-server[83527]: {{(pid=83527) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:54:59.678026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.679751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.680774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:54:59.685734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:54:59.693160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0767ae8e-bc79-42d1-96a0-c4a238b162b4 None None] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:54:59.702887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.703680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.714355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.719672 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9948032 Nov 24 13:54:59.720251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35416) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:54:59.725423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:54:59.730211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:54:59.734122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Usage tracker for resource:router and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:54:59.739501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:54:59.744941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:54:59.750808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:54:59.763526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.765595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:54:59.810443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.088128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.185876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Attempting to bind port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:00.186499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Attempting to bind port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:00.186647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Attempting to bind port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 on network 192cb388-42c9-4352-94b7-0d42c68d3b4b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:00.191113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.327676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35428) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:00.354490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 54, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:00.355095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Checking segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:00.355662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.356256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Bound using segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:00.356903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Bound port: 4f186f8f-1323-42d7-929a-6a3cde55f1b7, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:00.357441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.399452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.437307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.494464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.533662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.552698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Router 6fb934fe-8876-4ad1-8081-30b7959413d2 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:55:00.576965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] For port 4f186f8f-1323-42d7-929a-6a3cde55f1b7, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:00.581505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] For port 4f186f8f-1323-42d7-929a-6a3cde55f1b7, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4f186f8f-1323-42d7-929a-6a3cde55f1b7,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:00.640767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.653543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:55:00.653543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.716029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:00.727544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Allocated IP 172.26.4.220 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/728c9c54-618b-4a75-a8c2-ed9801e1b27b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:00.910515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:55:00.911368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:00.957839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-299511099'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:00.969661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:00.982127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Usage tracker for resource:router and tenant:e1ede394fd824630a46bbb7f80e6b61f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:00.993672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:01.011269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:01.024110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Pushing event updated for resources: {'Port': ['ID=4f186f8f-1323-42d7-929a-6a3cde55f1b7,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:01.043890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.045896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.060896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.064087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35448) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:01.124883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.126774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:01.140448 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Sync routers for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:01.149650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.433s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:01.170703 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:01.172794 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:01.210892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:01.222294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.260364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.309766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.311014 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.2120197 Nov 24 13:55:01.311654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35458) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:01.319727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35460) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:01.410753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Allocated IP 172.20.0.2 (a9f12bbb-ee13-42dd-8eed-cf94fa9dada5/8c839c3b-21dc-400b-8b56-739bd37025c8/399145cf-58a5-43fb-99bf-ae9950ebfae1) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:01.418353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Pushing event updated for resources: {'Port': ['ID=728c9c54-618b-4a75-a8c2-ed9801e1b27b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:01.425404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:01.448520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:01.450255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:01.453121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:01.501764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Allocated IP 172.26.4.147 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/82103695-e509-4b3b-acea-f6a9415b56f1) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:01.508860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.512787 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f29c5993-3335-42f7-bee4-19d572d7a964 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 728 time: 1.1768250 Nov 24 13:55:01.513729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35468) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:01.530007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Allocated IP 172.20.0.2 (7c23cefd-d4e1-4241-a3d2-42622a5131e3/d04c57a1-6813-42f8-932e-ab9506091c4e/56c8174f-1729-44dc-ac74-e921f21a7c80) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:01.569142 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:01.703853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.704741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:01.787453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-718808869'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:01.834313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35476) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:01.970155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.164468 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:54:59Z', 'revision_number': 3, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:54:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:02.169842 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Checking router: 6fb934fe-8876-4ad1-8081-30b7959413d2 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:55:02.170548 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Updating router 6fb934fe-8876-4ad1-8081-30b7959413d2 port e8f8917d-9594-4d5f-93db-365790f34888 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:55:02.203274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:02.230310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Usage tracker for resource:network and tenant:30281dee68af4552a511789e5f1b3d06 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:02.237221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:02.244163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:02.251812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4f186f8f-1323-42d7-929a-6a3cde55f1b7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:02.276737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:02.281254 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.285173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:02.294540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Usage tracker for resource:floatingip and tenant:5fe9003122c04c1187cb252031eccf56 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:02.299932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:02.309925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:02.360204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.378604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3af35fa-ee92-4ccb-8fa3-28e885018828 None None] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:02.437748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.457992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cb43a698-90e4-404e-88a0-42f08010c4ba None None] Provisioning for port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:02.526004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Router 29faa878-433b-448f-ae89-9e61ec9daefb is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:55:02.541313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35488) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:02.597696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Made reservation on behalf of 30281dee68af4552a511789e5f1b3d06 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:02.601378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.622697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.629979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.634764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-402056208'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:02.641868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:02.647255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Usage tracker for resource:network and tenant:923f8529d9624346aaf18120477bb30c is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:02.652024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:02.659774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:02.677166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.690874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.692473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Transition to ACTIVE for port object 399145cf-58a5-43fb-99bf-ae9950ebfae1 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:02.726906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:02.732722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Usage tracker for resource:security_group_rule and tenant:30281dee68af4552a511789e5f1b3d06 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:02.742057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:02.766784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Made reservation on behalf of 923f8529d9624346aaf18120477bb30c for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:02.769924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.804383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:02.825375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Transition to ACTIVE for port object 399145cf-58a5-43fb-99bf-ae9950ebfae1 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:02.837161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:02.849856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.856480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:02.861774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Usage tracker for resource:floatingip and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:02.863546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Transition to ACTIVE for port object 56c8174f-1729-44dc-ac74-e921f21a7c80 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:02.865226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:02.872825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:02.873183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:02.876341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Pushing event updated for resources: {'Port': ['ID=82103695-e509-4b3b-acea-f6a9415b56f1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:02.880022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:02.889032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.892212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.893298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:02.896487 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.904650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Transition to ACTIVE for port object 56c8174f-1729-44dc-ac74-e921f21a7c80 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:02.909675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.918612 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Transition to ACTIVE for port object e8f8917d-9594-4d5f-93db-365790f34888 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:02.926122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:02.926800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.935053 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:02.944534 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:02.961103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:03.002805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:03.024662 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Pushing event updated for resources: {'Port': ['ID=e8f8917d-9594-4d5f-93db-365790f34888,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:03.039095 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.040392 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.041047 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.042652 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.043622 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.044134 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.044889 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.045406 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.045933 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.046759 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.047407 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Tracked resource versions report: Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: pushed versions: Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: { 'ConntrackHelper': {'1.0'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Log': {'1.0'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Network': {'1.1'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Port': {'1.5'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'PortForwarding': {'1.2'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'QosPolicy': {'1.8'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroup': {'1.2'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroupRule': {'1.0'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SubPort': {'1.0'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Subnet': {'1.1'}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Trunk': {'1.1'}} Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: consumer versions: Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: { DHCP agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: HyperV agent@hv-neutron-8181: {}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: L3 agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: Metadata agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: Metering agent@dv-neutron-818151-2-hyperv: {}, Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: Open vSwitch agent@dv-neutron-818151-2-hyperv: { 'ConntrackHelper': '1.0', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Log': '1.0', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Network': '1.1', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Port': '1.5', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'PortForwarding': '1.2', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'QosPolicy': '1.8', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroup': '1.2', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SecurityGroupRule': '1.0', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'SubPort': '1.0', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Subnet': '1.1', Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: 'Trunk': '1.1'}} Nov 24 13:55:03.048657 dv-neutron-818151-2-hyperv neutron-server[83528]: {{(pid=83528) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 13:55:03.060043 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:03.071967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Allocated IP 172.26.4.59 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/ffcc651d-e6cc-48c1-8eec-9cb38e2b6148) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:03.075316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:03.091440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:03.094061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.111337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Sync routers for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:03.128012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:03.128284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:03.130191 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Attempting to bind port e8f8917d-9594-4d5f-93db-365790f34888 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:03.131129 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Attempting to bind port e8f8917d-9594-4d5f-93db-365790f34888 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:03.132605 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Attempting to bind port e8f8917d-9594-4d5f-93db-365790f34888 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:03.142319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:03.142542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.145727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:03.151996 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 54, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:03.152375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 918 time: 3.5250065 Nov 24 13:55:03.152872 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:03.153441 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.154022 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:03.154725 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Bound port: e8f8917d-9594-4d5f-93db-365790f34888, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:03.155047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35502) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:03.155944 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.167181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:03.167835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:03.193528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:03.212784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Usage tracker for resource:security_group_rule and tenant:923f8529d9624346aaf18120477bb30c is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:03.223630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:03.251561 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] For port e8f8917d-9594-4d5f-93db-365790f34888, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:03.256423 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] For port e8f8917d-9594-4d5f-93db-365790f34888, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e8f8917d-9594-4d5f-93db-365790f34888,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:03.263491 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.268307 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:03.313858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:03.353937 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Pushing event updated for resources: {'Port': ['ID=e8f8917d-9594-4d5f-93db-365790f34888,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:03.358815 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:03.384986 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:03.385872 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:03.421750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.440361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:03.441670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.526549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.575476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:03.645907 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:03.647542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.659482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1dfdb82a-5184-4417-b12d-769fb35e656c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:03.690140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.716782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.735496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:03.739557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:03.745502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:03.754288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.772735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Pushing event updated for resources: {'Port': ['ID=ffcc651d-e6cc-48c1-8eec-9cb38e2b6148,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:03.777550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 890} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:03.781845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:03.787875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.788367 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Added segment 307bf85f-6ea6-4d4f-8d0d-94793a3e3cac of type vlan for network 0f154df6-6b04-4807-adee-84221a46d1bb Nov 24 13:55:03.798363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:03.828305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.851584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Allocated IP 172.26.4.39 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/512b95c4-8165-4b51-b9ea-ccc73e977a5d) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:03.903023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.917550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:03.918334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Pushing event updated for resources: {'Port': ['ID=399145cf-58a5-43fb-99bf-ae9950ebfae1,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:03.936526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.976s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:03.939042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-39bfa7ac-3529-45a2-9077-98d5b95387f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.772s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:03.977900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:03.982979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:04.042416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Pushing event updated for resources: {'Port': ['ID=56c8174f-1729-44dc-ac74-e921f21a7c80,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:04.052128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:04.088610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Attempting to bind port 399145cf-58a5-43fb-99bf-ae9950ebfae1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:04.088838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.089383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Attempting to bind port 399145cf-58a5-43fb-99bf-ae9950ebfae1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:04.089926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Attempting to bind port 399145cf-58a5-43fb-99bf-ae9950ebfae1 on network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:04.112571 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:54:59Z', 'revision_number': 3, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:04.118297 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a3c73a8-ac11-4f87-811f-7d057e2cb293 None None] The sync data for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv is: [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:54:59Z', 'revision_number': 3, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:04.123718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.156567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e727c0ac-f100-4dce-9145-8425ea72d473 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.167960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:04.168564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.221088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.221975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Fanout notify agent at l3_agent the message router_deleted on router d511bc53-8c8d-4da9-bd05-ed496ba24691 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:55:04.231432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:04.231702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Checking segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:04.232129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.232534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Bound using segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:04.233024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Bound port: 399145cf-58a5-43fb-99bf-ae9950ebfae1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:04.233464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.239732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 882} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:04.245564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a30af0bf-d00a-41a9-bac5-40e772658925,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:04.259168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:04.266808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:04.282888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Attempting to bind port 56c8174f-1729-44dc-ac74-e921f21a7c80 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:04.283280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Attempting to bind port 56c8174f-1729-44dc-ac74-e921f21a7c80 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:04.283636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Attempting to bind port 56c8174f-1729-44dc-ac74-e921f21a7c80 on network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:04.307195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.307574 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Added segment 34d8f0e8-e3d6-40bc-b847-7d7f67df846a of type vlan for network 07ff3faf-843a-4742-9187-25d89db7c71b Nov 24 13:55:04.341646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.352341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:01Z', 'revision_number': 3, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:04.376538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.412276 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 3.3248122 Nov 24 13:55:04.424529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35512) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:04.425304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Pushing event updated for resources: {'Network': ['ID=0f154df6-6b04-4807-adee-84221a46d1bb,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:04.429540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] For port 399145cf-58a5-43fb-99bf-ae9950ebfae1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:04.431317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.432404 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-021a55de-a193-4527-8073-fb1fcfe3befc tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "DELETE /v2.0/routers/d511bc53-8c8d-4da9-bd05-ed496ba24691 HTTP/1.1" status: 204 len: 168 time: 2.8963845 Nov 24 13:55:04.435156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:04.438021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] For port 399145cf-58a5-43fb-99bf-ae9950ebfae1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=399145cf-58a5-43fb-99bf-ae9950ebfae1,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:04.438282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.250s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:04.452572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.457087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35516) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:04.458326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:04.458915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Checking segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:04.459166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.459492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Bound using segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:04.463060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Bound port: 56c8174f-1729-44dc-ac74-e921f21a7c80, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:04.463060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.471485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Request body: {'router': {'name': 'tempest-router-1043743966', 'distributed': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:04.490604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:04.518063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Checking router: 29faa878-433b-448f-ae89-9e61ec9daefb for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:55:04.518430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Updating router 29faa878-433b-448f-ae89-9e61ec9daefb port 728c9c54-618b-4a75-a8c2-ed9801e1b27b binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:55:04.537537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.588800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 0f154df6-6b04-4807-adee-84221a46d1bb details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:04.606405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Usage tracker for resource:router and tenant:e1ede394fd824630a46bbb7f80e6b61f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:04.610184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:04.617475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:04.630256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.654483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:04.664805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:04.688074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event updated for resources: {'SecurityGroup': ['ID=62d9358e-c9f3-489d-80ff-de8ddf737a69,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:04.698032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:04.699880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.700837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.711468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'network': {'name': 'tempest-network--811857762', 'router:external': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:04.716000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.716860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.718325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.723685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 4f186f8f-1323-42d7-929a-6a3cde55f1b7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4f186f8f-1323-42d7-929a-6a3cde55f1b7,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:04.734163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:04.747415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:04.748756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.764058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.769439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:04.779616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.784701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:network and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:04.798063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f8440ef-458d-4961-89e5-b9e73fcdfaad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:04.820287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:04.850130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.888839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:04.902885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:04.924909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:04.927817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Port': ['ID=512b95c4-8165-4b51-b9ea-ccc73e977a5d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:04.935156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:04.945670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:04.948877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:04.970044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b575557e-a22b-48bd-a0e0-f8956f28d793 None None] Provisioning complete for port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:04.970523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b575557e-a22b-48bd-a0e0-f8956f28d793 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.004681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 3.1568570 Nov 24 13:55:05.020678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35522) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:05.025884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event updated for resources: {'Network': ['ID=07ff3faf-843a-4742-9187-25d89db7c71b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:05.035173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Request body: {'subnet': {'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:05.070183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.071414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Made reservation on behalf of d5e5db1178c84db6bb49f66d53f08e95 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:05.077990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.089841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.321s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:05.141720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 07ff3faf-843a-4742-9187-25d89db7c71b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:05.161465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e8f8917d-9594-4d5f-93db-365790f34888 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:05.189002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.343668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.366792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.373237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.384518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:05.470566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Pushing event updated for resources: {'Port': ['ID=ffcc651d-e6cc-48c1-8eec-9cb38e2b6148,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:05.477440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:05.478183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:05.498760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Usage tracker for resource:subnet and tenant:923f8529d9624346aaf18120477bb30c is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:05.504445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:05.526090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:05.540015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:05.540642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.541143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port e8f8917d-9594-4d5f-93db-365790f34888 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:05.566092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Pushing event updated for resources: {'Port': ['ID=399145cf-58a5-43fb-99bf-ae9950ebfae1,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:05.570223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.905s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:05.582410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.649s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:05.605253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:security_group_rule and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:05.610779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:05.620321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.621507 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2080ff4b-1ed8-42df-8a40-d332af239d0b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 1.1622963 Nov 24 13:55:05.633644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:05.640315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35526) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:05.664225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e8f8917d-9594-4d5f-93db-365790f34888 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:05.664604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.695614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.697172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] For port 56c8174f-1729-44dc-ac74-e921f21a7c80, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:05.704458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Made reservation on behalf of 923f8529d9624346aaf18120477bb30c for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:05.734662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.738852 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.3258817 Nov 24 13:55:05.747044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35530) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:05.756056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-1751266105', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'fixed_ips': [{'ip_address': '172.26.4.59'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:05.759566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] For port 56c8174f-1729-44dc-ac74-e921f21a7c80, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=56c8174f-1729-44dc-ac74-e921f21a7c80,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:05.764192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:05.802729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Usage tracker for resource:port and tenant:5fe9003122c04c1187cb252031eccf56 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:05.808778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.817520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:05.830123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.856972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:05.867470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd06f739-4ba0-4eb5-b847-247b99eddf23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.891668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Made reservation on behalf of 5fe9003122c04c1187cb252031eccf56 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:05.894017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.960777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:05.968627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=4f186f8f-1323-42d7-929a-6a3cde55f1b7,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:05.973325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.391s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:05.979336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.030s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.012781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.175324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.183810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:06.193635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Pushing event updated for resources: {'Port': ['ID=56c8174f-1729-44dc-ac74-e921f21a7c80,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:06.197127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:06.198501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.216401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Usage tracker for resource:security_group_rule and tenant:5fe9003122c04c1187cb252031eccf56 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:06.227195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:06.233220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port e8f8917d-9594-4d5f-93db-365790f34888, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e8f8917d-9594-4d5f-93db-365790f34888,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:06.250631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.254307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.259302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:06.275683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.278686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.325854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Transition to ACTIVE for port object 728c9c54-618b-4a75-a8c2-ed9801e1b27b will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:06.394737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.415791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=e8f8917d-9594-4d5f-93db-365790f34888,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:06.433344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:06.440701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.036s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.552061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Attempting to bind port 728c9c54-618b-4a75-a8c2-ed9801e1b27b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:06.553336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Attempting to bind port 728c9c54-618b-4a75-a8c2-ed9801e1b27b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:06.554762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Attempting to bind port 728c9c54-618b-4a75-a8c2-ed9801e1b27b on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:06.563053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039fc478-97ab-418a-b825-58e17fed5a40 None None] Pushing event updated for resources: {'Port': ['ID=728c9c54-618b-4a75-a8c2-ed9801e1b27b,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:06.570476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.573606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-039fc478-97ab-418a-b825-58e17fed5a40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:06.575104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:06.575548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:06.576139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.576799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:06.577357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Bound port: 728c9c54-618b-4a75-a8c2-ed9801e1b27b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:06.577827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.598103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.637129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:06.664221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-55614129-f44c-478a-b30c-cc52b2fcab46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.665243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.667011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.669090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.693016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d39bdaa-2102-41d8-af37-c541aacf03f1 None None] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:06.695374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.696139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.699409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ba166b3-ab40-4d59-9ee4-796643b8e379,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:06.714918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:06.715507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.745217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] device_id is not set on port aba365ed-14c5-4a82-b46b-22fda0d63ade yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:06.787526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] For port 728c9c54-618b-4a75-a8c2-ed9801e1b27b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:06.808336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] For port 728c9c54-618b-4a75-a8c2-ed9801e1b27b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=728c9c54-618b-4a75-a8c2-ed9801e1b27b,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:06.823996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.836023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 881} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:06.845202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-039fc478-97ab-418a-b825-58e17fed5a40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.853152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.910154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-04cf6a96-4f32-42eb-ba32-1ac2cc094574 None None] Provisioning for port 399145cf-58a5-43fb-99bf-ae9950ebfae1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:06.912204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Port': ['ID=512b95c4-8165-4b51-b9ea-ccc73e977a5d,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:06.930087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:06.932519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.189s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:06.958011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.958011 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Added segment 62abafd4-82a3-4a60-aed6-728458f5bcad of type vlan for network 77570738-f410-4f05-9aa4-a78a9cd1d236 Nov 24 13:55:06.989910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:06.994434 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.4450078 Nov 24 13:55:07.004602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Allocated IP 172.20.0.1 (a9f12bbb-ee13-42dd-8eed-cf94fa9dada5/8c839c3b-21dc-400b-8b56-739bd37025c8/b47a3021-ab27-448e-bbc9-296c441891bc) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:07.009385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35534) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:07.026326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039fc478-97ab-418a-b825-58e17fed5a40 None None] Pushing event updated for resources: {'Port': ['ID=728c9c54-618b-4a75-a8c2-ed9801e1b27b,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:07.032576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-039fc478-97ab-418a-b825-58e17fed5a40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:07.040092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:07.040641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:07.044103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-1365985531'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:07.072523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f7b4dbf-60e8-4781-9c71-0c2987c39648,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:07.093209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:07.097442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:07.150423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Usage tracker for resource:network and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:07.177935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:07.196781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:07.303639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Made reservation on behalf of 823115d55e2a491398adfedf32ca655a for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:07.314673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.342975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.356645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 399145cf-58a5-43fb-99bf-ae9950ebfae1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:07.357672 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 24 13:55:07.358637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:55:07.365137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.374715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.400177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.405239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.412999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 409 len: 371 time: 1.6647794 Nov 24 13:55:07.421419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35538) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:07.424722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc8f92f5-1361-4956-a5e6-ab35dafd6953 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:07.448210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.451791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:07.461242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.462748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Usage tracker for resource:security_group_rule and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:07.468037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:07.478934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:07.481484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Transition to ACTIVE for port object b47a3021-ab27-448e-bbc9-296c441891bc will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:07.571440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:55:07.587930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.590082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.591788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3293c483-7575-4fb9-92a3-42605f18f902 None None] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:07.598522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:07.635605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.658104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 866} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:07.667890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.668291 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Added segment 7c582684-b3cb-40c9-a7f8-fd5b89300ce3 of type vlan for network 6a5d65c8-6152-4e88-aa78-9b953c042568 Nov 24 13:55:07.671874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.680309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:07.700015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:07.700599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.700865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.715738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event updated for resources: {'Subnet': ['ID=f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:07.727849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 399145cf-58a5-43fb-99bf-ae9950ebfae1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:07.750459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:07.750826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 399145cf-58a5-43fb-99bf-ae9950ebfae1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:07.751208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.753889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:07.756315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:07.757303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.768310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.779327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:07.779984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:07.804639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Pushing event updated for resources: {'Port': ['ID=b47a3021-ab27-448e-bbc9-296c441891bc,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:07.808667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:07.811528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:07.831419 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.8172975 Nov 24 13:55:07.836635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35544) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:07.855651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Request body: {'subnet': {'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:07.889468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'SecurityGroup': ['ID=50fa97d9-9a61-4231-941e-80425d19f852,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:07.892457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:07.896512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54d7d1c0-e408-4a49-9845-08f69b9b5d69 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.093s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:07.904240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e76de7c6-14fc-4d81-92f2-83e6963d130e None None] Provisioning for port 56c8174f-1729-44dc-ac74-e921f21a7c80 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:07.941962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.517s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:07.964475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Deleting port ffcc651d-e6cc-48c1-8eec-9cb38e2b6148 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:07.965297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.002513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.287s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:08.083087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.083509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 2ec9603a-8246-4e1d-b5cf-6b8210782041 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:55:08.115673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Network': ['ID=6a5d65c8-6152-4e88-aa78-9b953c042568,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:08.119124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:08.123033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:08.143255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.159642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Usage tracker for resource:subnet and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:08.164570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:08.172940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:08.174791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:08.233769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Network': ['ID=77570738-f410-4f05-9aa4-a78a9cd1d236,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:08.236626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:08.260082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Made reservation on behalf of 823115d55e2a491398adfedf32ca655a for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:08.279583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.280988 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bfd80c22-f634-4067-adf2-142e4b151951 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "DELETE /v2.0/routers/2ec9603a-8246-4e1d-b5cf-6b8210782041 HTTP/1.1" status: 204 len: 168 time: 2.6372008 Nov 24 13:55:08.296699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Checking segment: {'id': '34d8f0e8-e3d6-40bc-b847-7d7f67df846a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:08.297327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Network hostable DHCP agents. Network: 07ff3faf-843a-4742-9187-25d89db7c71b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:55:08.304425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35548) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:08.310750 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 862 time: 3.8813055 Nov 24 13:55:08.337823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35552) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:08.347152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Request body: {'router': {'name': 'tempest-router-135010015', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': '5a0e962471ac45b79763a40e686af141'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:08.369234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 77570738-f410-4f05-9aa4-a78a9cd1d236 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:08.382808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:08.389000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.471751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Usage tracker for resource:router and tenant:5a0e962471ac45b79763a40e686af141 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:08.482166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:08.486323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.592225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:08.628357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.659230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-10fac686-66d5-41f0-af83-19ea1f43c2a5 None None] Provisioning complete for port 399145cf-58a5-43fb-99bf-ae9950ebfae1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:08.659230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-10fac686-66d5-41f0-af83-19ea1f43c2a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.719613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.720914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.726215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 399145cf-58a5-43fb-99bf-ae9950ebfae1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=399145cf-58a5-43fb-99bf-ae9950ebfae1,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:08.726506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.732400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.737022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Network 07ff3faf-843a-4742-9187-25d89db7c71b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:08.748572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.748807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.749656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e8f8917d-9594-4d5f-93db-365790f34888 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:08.751672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.756110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.756502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.759466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:08.779327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Allocated IP 172.20.0.1 (192cb388-42c9-4352-94b7-0d42c68d3b4b/fdef5004-cb01-46c8-ad07-7ca2196a0189/edb84025-b225-44f1-a2bb-577394c19988) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:08.784373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5647e0d8-9776-4ea3-8559-fd7be8741e4b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:08.838577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 07ff3faf-843a-4742-9187-25d89db7c71b) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:08.843011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:08.843480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.882817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cefca050-b6a1-4e5e-8d31-3ea2c3552b29 None None] Network 07ff3faf-843a-4742-9187-25d89db7c71b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:08.912181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Calling delete_port for ffcc651d-e6cc-48c1-8eec-9cb38e2b6148 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:08.920002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Pushing event updated for resources: {'Port': ['ID=b47a3021-ab27-448e-bbc9-296c441891bc,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:08.924194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:08.937397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:08.949362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:09.013296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:01Z', 'revision_number': 3, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:09.022507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=399145cf-58a5-43fb-99bf-ae9950ebfae1,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:09.030059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:09.035427 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5288d517-a18f-46ff-b216-bd7f9c088c94 None None] The sync data for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv is: [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:01Z', 'revision_number': 3, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:09.077493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:09.082400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:09.084693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Subnet': ['ID=4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:09.103649 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 4.0817857 Nov 24 13:55:09.104024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e8f8917d-9594-4d5f-93db-365790f34888 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:09.104122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.159523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Checking segment: {'id': '7c582684-b3cb-40c9-a7f8-fd5b89300ce3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:09.159924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network hostable DHCP agents. Network: 6a5d65c8-6152-4e88-aa78-9b953c042568, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:55:09.164825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35556) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:09.169201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.191961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Request body: {'port': {'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b', 'name': 'tempest-DHCPAgentSchedulersTestJSON-1705875500'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:09.207344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:09.411812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4995df07-3dc7-4710-9efe-db6bfaa97253 None None] Provisioning for port b47a3021-ab27-448e-bbc9-296c441891bc completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:09.455117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4995df07-3dc7-4710-9efe-db6bfaa97253 None None] Provisioning complete for port b47a3021-ab27-448e-bbc9-296c441891bc triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:09.457363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4995df07-3dc7-4710-9efe-db6bfaa97253 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.512250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:09.551346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-07ff3faf-843a-4742-9187-25d89db7c71b', 'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b', 'tenant_id': '923f8529d9624346aaf18120477bb30c', 'fixed_ips': [{'subnet_id': 'f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:55:09.554659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.557677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:09.561806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Usage tracker for resource:port and tenant:923f8529d9624346aaf18120477bb30c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:09.564752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:09.569152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6a5d65c8-6152-4e88-aa78-9b953c042568) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:09.574897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:09.580513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:09.581092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.598598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.606847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68d97249-9b3e-46ec-8566-49581fb63cdf None None] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:09.625538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.666442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Made reservation on behalf of 923f8529d9624346aaf18120477bb30c for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:09.669673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.681788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4995df07-3dc7-4710-9efe-db6bfaa97253 None None] Port b47a3021-ab27-448e-bbc9-296c441891bc cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:09.703968 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8647351 Nov 24 13:55:09.704784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35560) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:09.705477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > segment before_delete 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.705879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] device_id is not set on port 66118d4b-b3dc-408d-919f-5791c512f16c yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:09.706055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.706693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.708351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > port after_create 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.708745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > port after_delete 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.709165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > port after_update 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.710066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > segment after_delete 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.710462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.710872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.711245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet after_update 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.746811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-710516319', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:09.759333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:09.778091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Usage tracker for resource:router and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:09.784310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:09.810329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:09.811920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 56c8174f-1729-44dc-ac74-e921f21a7c80 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:09.902959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet after_create 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.903524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet after_delete 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.903638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet before_create 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.904822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Subscribe: > subnet before_update 55550000 {{(pid=83525) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:09.905193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['77570738-f410-4f05-9aa4-a78a9cd1d236']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:09.920516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '62abafd4-82a3-4a60-aed6-728458f5bcad') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:09.920881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '62abafd4-82a3-4a60-aed6-728458f5bcad') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:09.940311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.948113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.949043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.958181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.967104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Releasing vlan 881 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:09.967917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:09.994657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Allocated IP 172.20.0.14 (07ff3faf-843a-4742-9187-25d89db7c71b/f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1/66118d4b-b3dc-408d-919f-5791c512f16c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:10.019543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.037474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9f52b08-f797-4755-b16b-007d6e6f516a None None] Provisioning complete for port b47a3021-ab27-448e-bbc9-296c441891bc triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:10.038560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9f52b08-f797-4755-b16b-007d6e6f516a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1993: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn_limited( Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1993: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn_limited( Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:10.068608 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:10.118748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 56c8174f-1729-44dc-ac74-e921f21a7c80 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:10.123090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:10.129292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 56c8174f-1729-44dc-ac74-e921f21a7c80 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:10.129866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.131142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.135569 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7a50d8b5-1776-4817-a5eb-e4e951da2c6b tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 1.8244605 Nov 24 13:55:10.138072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35564) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:10.148425 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Sync routers for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:10.161373 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:10.161981 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:10.197624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Request body: {'router': {'distributed': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:10.253306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a9f52b08-f797-4755-b16b-007d6e6f516a None None] Port b47a3021-ab27-448e-bbc9-296c441891bc cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:10.254826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.256188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.306097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.312951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:10.375356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9f52b08-f797-4755-b16b-007d6e6f516a None None] Provisioning complete for port 56c8174f-1729-44dc-ac74-e921f21a7c80 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:10.375846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9f52b08-f797-4755-b16b-007d6e6f516a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.402316 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:10.413851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.414695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-6a5d65c8-6152-4e88-aa78-9b953c042568', 'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568', 'tenant_id': '823115d55e2a491398adfedf32ca655a', 'fixed_ips': [{'subnet_id': '4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:55:10.416507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.430887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Transition to ACTIVE for port object 66118d4b-b3dc-408d-919f-5791c512f16c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:10.469177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.483787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:10.498650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 77570738-f410-4f05-9aa4-a78a9cd1d236 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:55:10.505595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Pushing event deleted for resources: {'Port': ['ID=ffcc651d-e6cc-48c1-8eec-9cb38e2b6148,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:10.522779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.525511 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/networks/77570738-f410-4f05-9aa4-a78a9cd1d236 HTTP/1.1" status: 204 len: 168 time: 2.1851017 Nov 24 13:55:10.534812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.542460 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64d67619-93cc-4381-b620-66e20738165f admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 10.8209136 Nov 24 13:55:10.543661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35570) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:10.544424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35572) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:10.546518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Transition to ACTIVE for port object edb84025-b225-44f1-a2bb-577394c19988 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:10.578232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Allocated IP 172.20.0.2 (07ff3faf-843a-4742-9187-25d89db7c71b/f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1/7eb9da47-48fd-417d-88e1-1f4872807f2e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:10.683472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'network': {'router:external': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:10.718227 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:03Z', 'revision_number': 3, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:10.722284 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Checking router: 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:55:10.722642 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Updating router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 port 82103695-e509-4b3b-acea-f6a9415b56f1 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:55:10.774594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Router 29faa878-433b-448f-ae89-9e61ec9daefb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:55:10.781661 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.820909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.829344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:10.830203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.835744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Network 07ff3faf-843a-4742-9187-25d89db7c71b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:10.842712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Transition to ACTIVE for port object 7eb9da47-48fd-417d-88e1-1f4872807f2e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:10.848655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:10.856866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:10.860933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:10.861543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.865075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Transition to ACTIVE for port object 7eb9da47-48fd-417d-88e1-1f4872807f2e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:10.868514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.882481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event updated for resources: {'Port': ['ID=66118d4b-b3dc-408d-919f-5791c512f16c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:10.891198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.407s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:10.913957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:10.925506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:10.962451 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 939 time: 1.7807059 Nov 24 13:55:10.989584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35578) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:11.000749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.003535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.005884 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] 10.222.0.70 "DELETE /v2.0/floatingips/744f8f1e-fd86-4e94-8e46-81cc90c9d9f1 HTTP/1.1" status: 204 len: 168 time: 3.5484195 Nov 24 13:55:11.008151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:network and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:11.019576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.707s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:11.044669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.550s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:11.080202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:11.162602 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.175696 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Transition to ACTIVE for port object 82103695-e509-4b3b-acea-f6a9415b56f1 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:11.184495 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.197158 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:11.212157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Pushing event updated for resources: {'Port': ['ID=7eb9da47-48fd-417d-88e1-1f4872807f2e,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:11.231961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:11.259708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:11.268684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Network': ['ID=77570738-f410-4f05-9aa4-a78a9cd1d236,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:11.301074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 56c8174f-1729-44dc-ac74-e921f21a7c80, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=56c8174f-1729-44dc-ac74-e921f21a7c80,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:11.302109 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a8cec9-8bb4-4f33-a459-a5d45971164c None None] Pushing event updated for resources: {'Port': ['ID=82103695-e509-4b3b-acea-f6a9415b56f1,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:11.305140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Deleting port 66118d4b-b3dc-408d-919f-5791c512f16c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:11.305787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.307354 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8a8cec9-8bb4-4f33-a459-a5d45971164c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:11.308185 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Attempting to bind port 82103695-e509-4b3b-acea-f6a9415b56f1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:11.308634 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Attempting to bind port 82103695-e509-4b3b-acea-f6a9415b56f1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:11.309036 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Attempting to bind port 82103695-e509-4b3b-acea-f6a9415b56f1 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:11.313881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Network 07ff3faf-843a-4742-9187-25d89db7c71b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:11.316628 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:11.317223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:11.317827 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.318216 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:11.318758 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Bound port: 82103695-e509-4b3b-acea-f6a9415b56f1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:11.320576 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.342738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:11.353210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:11.362442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.365111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4f186f8f-1323-42d7-929a-6a3cde55f1b7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:11.420193 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] For port 82103695-e509-4b3b-acea-f6a9415b56f1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:11.423885 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] For port 82103695-e509-4b3b-acea-f6a9415b56f1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=82103695-e509-4b3b-acea-f6a9415b56f1,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:11.431618 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.440502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:11.443226 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:11.527395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:11.537318 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a8cec9-8bb4-4f33-a459-a5d45971164c None None] Pushing event updated for resources: {'Port': ['ID=82103695-e509-4b3b-acea-f6a9415b56f1,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:11.541026 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8a8cec9-8bb4-4f33-a459-a5d45971164c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:11.547281 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:11.547903 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:11.573344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Made reservation on behalf of d5e5db1178c84db6bb49f66d53f08e95 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:11.577615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.582469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35586) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:11.612836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.614767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.619932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.621126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.634912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Allocated IP 172.20.0.2 (6a5d65c8-6152-4e88-aa78-9b953c042568/4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e/f42aaaee-bb93-40ae-b744-19a1a944e02f) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:11.673972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.771975 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:11.790148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Attempting to bind port 7eb9da47-48fd-417d-88e1-1f4872807f2e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:11.790505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Attempting to bind port 7eb9da47-48fd-417d-88e1-1f4872807f2e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '34d8f0e8-e3d6-40bc-b847-7d7f67df846a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:11.790853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Attempting to bind port 7eb9da47-48fd-417d-88e1-1f4872807f2e on network 07ff3faf-843a-4742-9187-25d89db7c71b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:11.813530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=56c8174f-1729-44dc-ac74-e921f21a7c80,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:11.848765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:11.890566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.911518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:11.919039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:11.919435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Checking segment: {'id': '34d8f0e8-e3d6-40bc-b847-7d7f67df846a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:11.919798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:11.919917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.920258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Bound using segment: {'id': '34d8f0e8-e3d6-40bc-b847-7d7f67df846a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:11.920737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Bound port: 7eb9da47-48fd-417d-88e1-1f4872807f2e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '34d8f0e8-e3d6-40bc-b847-7d7f67df846a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '07ff3faf-843a-4742-9187-25d89db7c71b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:11.921111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.944572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc004d5d-4a26-4cd1-8654-e2dc4ab5fdda admin admin] 10.222.0.70 "PUT /v2.0/routers/29faa878-433b-448f-ae89-9e61ec9daefb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.7877882 Nov 24 13:55:11.981364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 893} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:11.993397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:11.994898 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Added segment 144fd7d7-f768-49b3-a076-1ea9e7f16259 of type vlan for network 1383a1b1-2ce7-45df-bc46-9ddd671720aa Nov 24 13:55:12.007194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:12.013393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:12.013656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.021032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Usage tracker for resource:security_group_rule and tenant:cd9f5279c5494beebe92fa9b90e89621 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:12.025657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Allocated IP 172.26.4.92 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/4bda95c0-1760-4168-a890-c838cf8226a1) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:12.029146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:12.037350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.040097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:12.220515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] For port 7eb9da47-48fd-417d-88e1-1f4872807f2e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:12.227782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:12.250842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:12.256037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] For port 7eb9da47-48fd-417d-88e1-1f4872807f2e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7eb9da47-48fd-417d-88e1-1f4872807f2e,segment=NetworkSegment(34d8f0e8-e3d6-40bc-b847-7d7f67df846a),segment_id=34d8f0e8-e3d6-40bc-b847-7d7f67df846a)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:12.263298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.266278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:12.270402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:12.311950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.353153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e19711c8-01b9-40ae-a15e-28a4822e7bf2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:12.394493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.407718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.417801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.423308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Transition to ACTIVE for port object f42aaaee-bb93-40ae-b744-19a1a944e02f will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:12.433035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=83525) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:155}} Nov 24 13:55:12.433366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Router 6bcf3dd1-bd59-438d-889a-72b13be63128 migrating from provider to provider. {{(pid=83525) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:162}} Nov 24 13:55:12.433808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.440652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.455088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:12.455472 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:03Z', 'revision_number': 3, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:12.462681 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0db70ed6-8e6e-4b64-9b82-7039a0678f6f None None] The sync data for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv is: [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:03Z', 'revision_number': 3, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:12.532039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Transition to ACTIVE for port object f42aaaee-bb93-40ae-b744-19a1a944e02f will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:12.549402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e84a878-f464-4c35-8a1b-4b4fb166e043,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:12.553805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:12.557776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Synchronizing usage tracker for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:12.566989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.593332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Unset dirty status for tenant:a44d14c3167c4641ac2aa61f6ebe89e6 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:12.593526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Pushing event updated for resources: {'Port': ['ID=7eb9da47-48fd-417d-88e1-1f4872807f2e,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:12.595383 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=cd9f5279c5494beebe92fa9b90e89621&name=default HTTP/1.1" status: 200 len: 2647 time: 1.0061755 Nov 24 13:55:12.598447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35604) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:12.603030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:12.603498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.023s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:12.615964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.632648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.655945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:12.667627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.685539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Pushing event updated for resources: {'Port': ['ID=edb84025-b225-44f1-a2bb-577394c19988,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:12.756207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:12.765730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:12.770419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:12.799878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:12.807961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:12.840968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.921s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:12.851304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:12.890734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Pushing event updated for resources: {'Port': ['ID=f42aaaee-bb93-40ae-b744-19a1a944e02f,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:12.894677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1d9133e0-21be-4d06-87f4-8a6878e3f537 None None] Provisioning for port edb84025-b225-44f1-a2bb-577394c19988 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:12.911401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:12.912433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1d9133e0-21be-4d06-87f4-8a6878e3f537 None None] Provisioning complete for port edb84025-b225-44f1-a2bb-577394c19988 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:12.914687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1d9133e0-21be-4d06-87f4-8a6878e3f537 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.954289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:12.973306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 399145cf-58a5-43fb-99bf-ae9950ebfae1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:12.997651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.005798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.024996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:13.025310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.044016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:13.065745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Port': ['ID=4bda95c0-1760-4168-a890-c838cf8226a1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:13.078555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.423s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:13.080419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.091160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:13.105272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e84a878-f464-4c35-8a1b-4b4fb166e043,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:13.115367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:13.123989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.127577 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/3e84a878-f464-4c35-8a1b-4b4fb166e043 HTTP/1.1" status: 204 len: 168 time: 0.5248010 Nov 24 13:55:13.137742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.138632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.216445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Network': ['ID=1383a1b1-2ce7-45df-bc46-9ddd671720aa,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:13.220357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:13.267087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.280478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Attempting to bind port f42aaaee-bb93-40ae-b744-19a1a944e02f on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:13.281436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Attempting to bind port f42aaaee-bb93-40ae-b744-19a1a944e02f by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '7c582684-b3cb-40c9-a7f8-fd5b89300ce3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:13.281742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Attempting to bind port f42aaaee-bb93-40ae-b744-19a1a944e02f on network 6a5d65c8-6152-4e88-aa78-9b953c042568 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:13.300628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 1383a1b1-2ce7-45df-bc46-9ddd671720aa details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:13.361502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:13.362046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Checking segment: {'id': '7c582684-b3cb-40c9-a7f8-fd5b89300ce3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:13.362580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.363104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Bound using segment: {'id': '7c582684-b3cb-40c9-a7f8-fd5b89300ce3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:13.363686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Bound port: f42aaaee-bb93-40ae-b744-19a1a944e02f, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c582684-b3cb-40c9-a7f8-fd5b89300ce3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:13.364235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.452353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 399145cf-58a5-43fb-99bf-ae9950ebfae1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:13.453133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.479161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1d9133e0-21be-4d06-87f4-8a6878e3f537 None None] Port edb84025-b225-44f1-a2bb-577394c19988 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:13.602392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.616364 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 3.0633819 Nov 24 13:55:13.633470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35614) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:13.639744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Calling delete_port for 66118d4b-b3dc-408d-919f-5791c512f16c owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:13.660321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'subnet': {'network_id': '1383a1b1-2ce7-45df-bc46-9ddd671720aa', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:13.682916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:13.700612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:subnet and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:13.716038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:13.741430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:13.788019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 56c8174f-1729-44dc-ac74-e921f21a7c80 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:13.829392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] For port f42aaaee-bb93-40ae-b744-19a1a944e02f, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:13.846748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Made reservation on behalf of d5e5db1178c84db6bb49f66d53f08e95 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:13.856627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] For port f42aaaee-bb93-40ae-b744-19a1a944e02f, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f42aaaee-bb93-40ae-b744-19a1a944e02f,segment=NetworkSegment(7c582684-b3cb-40c9-a7f8-fd5b89300ce3),segment_id=7c582684-b3cb-40c9-a7f8-fd5b89300ce3)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:13.872267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.886436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:13.911666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:14.035586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.040491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:14.063477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1520669266', 'description': 'tempest-description--1392919522'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:14.071325 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING neutron.scheduler.l3_agent_scheduler [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] No L3 agents can host the router 6bcf3dd1-bd59-438d-889a-72b13be63128 Nov 24 13:55:14.074130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.083872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:14.096217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 56c8174f-1729-44dc-ac74-e921f21a7c80 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:14.101219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.136002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:14.174561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35622) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:14.175198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Router 2a5d4c0d-28ee-4bd1-84a1-38649345f24d is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:55:14.213673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f48d496a-e67b-4040-a768-80bf7f5f1fbc None None] Network 07ff3faf-843a-4742-9187-25d89db7c71b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:14.257423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Usage tracker for resource:security_group and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:14.286019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:14.294341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Pushing event updated for resources: {'Port': ['ID=f42aaaee-bb93-40ae-b744-19a1a944e02f,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:14.332282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:14.355133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Pushing event updated for resources: {'Port': ['ID=edb84025-b225-44f1-a2bb-577394c19988,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:14.357707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:14.432269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.520s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:14.495972 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-28cfe965-534a-44ac-90cf-3ae384420714 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=5fe9003122c04c1187cb252031eccf56&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3182905 Nov 24 13:55:14.517171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35626) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:14.519107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d2779730-26eb-4e28-aed3-f81239440d23 None None] Provisioning for port 7eb9da47-48fd-417d-88e1-1f4872807f2e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:14.627585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.652561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.705689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 728c9c54-618b-4a75-a8c2-ed9801e1b27b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:14.806437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.867655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 728c9c54-618b-4a75-a8c2-ed9801e1b27b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:14.879996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 728c9c54-618b-4a75-a8c2-ed9801e1b27b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:14.879996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:14.939236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.034921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:15.047400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:15.051830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:15.054259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.095694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.117340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:15.122437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 728c9c54-618b-4a75-a8c2-ed9801e1b27b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=728c9c54-618b-4a75-a8c2-ed9801e1b27b,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:15.132405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] Sync routers for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:15.147231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.150395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:15.151133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:15.197195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.253610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7458f141-9d63-4e93-a496-e591bcb2c4ee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:15.253829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:15.308163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.309543 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/8f7b4dbf-60e8-4781-9c71-0c2987c39648 HTTP/1.1" status: 204 len: 168 time: 0.7912025 Nov 24 13:55:15.311563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f7b4dbf-60e8-4781-9c71-0c2987c39648,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:15.379772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.380958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 890 time: 5.6409161 Nov 24 13:55:15.382730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:15.399792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35632) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:15.409592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:15.501954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Usage tracker for resource:security_group_rule and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:15.504501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=728c9c54-618b-4a75-a8c2-ed9801e1b27b,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:15.508689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:15.514720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:15.516247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:15.519836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:15.549259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:15.553016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:55:15.553650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.609007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:15.643662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7eb9da47-48fd-417d-88e1-1f4872807f2e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:15.655290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.718598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3a53c6c8-4944-466b-a2df-67bdb20aa193 None None] Could not find standard attr ID for object 66118d4b-b3dc-408d-919f-5791c512f16c. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:55:15.727220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:15.727638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3af2b608-f6e9-4f8c-b133-f7d54400ddf9 None None] The sync data for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:15.753229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.770720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:15.789099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3a53c6c8-4944-466b-a2df-67bdb20aa193 None None] Provisioning complete for port edb84025-b225-44f1-a2bb-577394c19988 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:15.789642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a53c6c8-4944-466b-a2df-67bdb20aa193 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.838244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 7eb9da47-48fd-417d-88e1-1f4872807f2e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:15.855292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7eb9da47-48fd-417d-88e1-1f4872807f2e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:15.855979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:15.897697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Subnet': ['ID=29e6353d-0ae4-45f5-81f7-f5e9ed3c014f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:15.907474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:15.915227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Checking segment: {'id': '144fd7d7-f768-49b3-a076-1ea9e7f16259', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '1383a1b1-2ce7-45df-bc46-9ddd671720aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:15.915585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Network hostable DHCP agents. Network: 1383a1b1-2ce7-45df-bc46-9ddd671720aa, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:55:15.929081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Hosts for router 6bcf3dd1-bd59-438d-889a-72b13be63128: [] {{(pid=83525) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Nov 24 13:55:15.958528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffdb4c44-92ff-40ac-8336-1b7fe1b47a87 None None] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:16.004929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Network 1383a1b1-2ce7-45df-bc46-9ddd671720aa is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:16.011105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event deleted for resources: {'Port': ['ID=66118d4b-b3dc-408d-919f-5791c512f16c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:16.034532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:16.048154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:16.071090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Hosts for other DVR routers connected to router 6bcf3dd1-bd59-438d-889a-72b13be63128: set() {{(pid=83525) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Nov 24 13:55:16.076189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3a53c6c8-4944-466b-a2df-67bdb20aa193 None None] Port edb84025-b225-44f1-a2bb-577394c19988 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:16.135795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 1383a1b1-2ce7-45df-bc46-9ddd671720aa) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:16.143584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:16.144226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.156396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.160549 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1614 time: 2.1063654 Nov 24 13:55:16.164068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35642) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:16.169891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.171592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Request body: {'security_group_rule': {'security_group_id': '37727a31-8a03-487d-8622-0afcf6d8e970', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:16.174009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-79266dab-dd41-4ca2-bd74-c72199457eb8 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "PUT /v2.0/routers/6bcf3dd1-bd59-438d-889a-72b13be63128 HTTP/1.1" status: 200 len: 716 time: 6.0332575 Nov 24 13:55:16.174865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35646) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:16.178111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:16.183055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Usage tracker for resource:security_group_rule and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:16.186191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:16.193663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:16.208671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.248374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9d19292-5687-40e9-b668-180caaf581ff None None] Network 1383a1b1-2ce7-45df-bc46-9ddd671720aa requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:16.265710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.307516 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.6725330 Nov 24 13:55:16.310853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35652) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:16.319317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'floatingip': {'floating_network_id': '1383a1b1-2ce7-45df-bc46-9ddd671720aa'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:16.339444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:16.432776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:floatingip and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:16.460609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:16.479198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:16.486267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event updated for resources: {'SecurityGroup': ['ID=37727a31-8a03-487d-8622-0afcf6d8e970,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:16.491043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.442s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:16.495458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0ec80fc4-4978-4960-bbc9-b4d9d0e4009f None None] Provisioning for port f42aaaee-bb93-40ae-b744-19a1a944e02f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:16.511539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.513598 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "DELETE /v2.0/ports/66118d4b-b3dc-408d-919f-5791c512f16c HTTP/1.1" status: 204 len: 168 time: 5.4763091 Nov 24 13:55:16.520724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35658) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:16.535156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.559823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.580217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7eb9da47-48fd-417d-88e1-1f4872807f2e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7eb9da47-48fd-417d-88e1-1f4872807f2e,segment=NetworkSegment(34d8f0e8-e3d6-40bc-b847-7d7f67df846a),segment_id=34d8f0e8-e3d6-40bc-b847-7d7f67df846a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:16.612802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.652522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:16.653764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f42aaaee-bb93-40ae-b744-19a1a944e02f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:16.687060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c0d32f81-11a2-430a-b848-242f06e6b3d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:16.727049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0ec80fc4-4978-4960-bbc9-b4d9d0e4009f None None] Could not find standard attr ID for object 66118d4b-b3dc-408d-919f-5791c512f16c. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:55:16.744726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9e94fada-07f5-45eb-ad93-7fadd854474e tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "GET /v2.0/routers/6bcf3dd1-bd59-438d-889a-72b13be63128 HTTP/1.1" status: 200 len: 716 time: 0.5629938 Nov 24 13:55:16.747980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35666) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:16.770619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:16.821609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cee899ae-7885-4b5c-9fb4-e2a0a40ede1d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:16.826463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:16.859539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Router 6fb934fe-8876-4ad1-8081-30b7959413d2 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:55:16.871641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7eb9da47-48fd-417d-88e1-1f4872807f2e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:16.876693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:16.897063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23161be5-4869-45d4-bc4f-bc575ea3f7fd None None] Network 1383a1b1-2ce7-45df-bc46-9ddd671720aa requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:16.986556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f42aaaee-bb93-40ae-b744-19a1a944e02f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:16.996453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f42aaaee-bb93-40ae-b744-19a1a944e02f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:16.996944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.006523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.010507 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.8422592 Nov 24 13:55:17.026484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35674) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:17.036052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0dba40bd-4fc6-455a-bef1-3793a9c21a2e tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4310 time: 0.5071383 Nov 24 13:55:17.045912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35680) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:17.056068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Request body: {'security_group_rule': {'security_group_id': '37727a31-8a03-487d-8622-0afcf6d8e970', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:17.076631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1567901358'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:17.077797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:17.089302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:17.093406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Usage tracker for resource:network and tenant:923f8529d9624346aaf18120477bb30c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:17.096588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:17.104071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:17.105913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Usage tracker for resource:security_group_rule and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:17.118119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:17.143487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:17.145947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Made reservation on behalf of 923f8529d9624346aaf18120477bb30c for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:17.150191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.174385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.328545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 889} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:17.481358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.481358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Added segment 2fffd934-3541-49f1-b379-ff2bcf0b0660 of type vlan for network f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0 Nov 24 13:55:17.497290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.605072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Allocated IP 172.20.0.6 (1383a1b1-2ce7-45df-bc46-9ddd671720aa/29e6353d-0ae4-45f5-81f7-f5e9ed3c014f/66274b8e-1d66-4cd7-8282-1e4f5737ab76) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:17.627057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.652153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.657100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6f6d528b-7eec-40ea-9aed-6b4406a5da46 None None] Provisioning complete for port f42aaaee-bb93-40ae-b744-19a1a944e02f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:17.658044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f6d528b-7eec-40ea-9aed-6b4406a5da46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.740288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.761432 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a0071b05-537d-4fb0-9613-61de71434688 tempest-RoutersTestDVR-1351844758 tempest-RoutersTestDVR-1351844758-project] 10.222.0.70 "GET /v2.0/routers/6bcf3dd1-bd59-438d-889a-72b13be63128 HTTP/1.1" status: 200 len: 682 time: 1.0067656 Nov 24 13:55:17.768389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f42aaaee-bb93-40ae-b744-19a1a944e02f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f42aaaee-bb93-40ae-b744-19a1a944e02f,segment=NetworkSegment(7c582684-b3cb-40c9-a7f8-fd5b89300ce3),segment_id=7c582684-b3cb-40c9-a7f8-fd5b89300ce3)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:17.770255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35688) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:17.781098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.786246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-039fc478-97ab-418a-b825-58e17fed5a40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:17.793802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.835800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:17.835800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:17.845337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afebff26-f8fb-4238-a0d5-8fb2c88c1102 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:17.975958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f42aaaee-bb93-40ae-b744-19a1a944e02f,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:17.988141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:18.075980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 728c9c54-618b-4a75-a8c2-ed9801e1b27b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:18.153351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.167159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:18.177553 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Sync routers for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:18.179057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.200234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 728c9c54-618b-4a75-a8c2-ed9801e1b27b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:18.200755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.226457 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:18.228752 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:18.278982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event updated for resources: {'Network': ['ID=f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:18.318415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:18.323929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.479s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:18.330992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 1.2660253 Nov 24 13:55:18.358232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35698) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:18.363714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.411049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.429233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.665010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 82103695-e509-4b3b-acea-f6a9415b56f1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:18.719289 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:18.720904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:18.733758 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] 10.222.0.70 "PUT /v2.0/routers/6fb934fe-8876-4ad1-8081-30b7959413d2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 17.4129972 Nov 24 13:55:18.784012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f94ea30-0253-4a6f-b60b-a0b6ba9286b0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:18.802605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:18.817037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.818348 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 1.7950590 Nov 24 13:55:18.821970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.824586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35708) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:18.826529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 82103695-e509-4b3b-acea-f6a9415b56f1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:18.827713 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c432fbaf-4a34-4a2f-9b0d-a90a0640f402 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/agents/42153128-35a0-4d6f-8610-1ec654ed3b07/dhcp-networks HTTP/1.1" status: 200 len: 7033 time: 0.4683297 Nov 24 13:55:18.837715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35710) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:18.843622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:18.845376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 82103695-e509-4b3b-acea-f6a9415b56f1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:18.845376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:18.852741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:18.857650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Usage tracker for resource:floatingip and tenant:8253655cf6fe49d7881f39cdb1344ce7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:18.863628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:18.876142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:19.045965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.008s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:19.175486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.194592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 82103695-e509-4b3b-acea-f6a9415b56f1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=82103695-e509-4b3b-acea-f6a9415b56f1,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:19.201021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.202610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7eb9da47-48fd-417d-88e1-1f4872807f2e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:19.236467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.274342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Network 1383a1b1-2ce7-45df-bc46-9ddd671720aa is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:19.294296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:19.295973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:19.345465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:19.353748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35730) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:19.376205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Allocated IP 172.20.0.1 (7c23cefd-d4e1-4241-a3d2-42622a5131e3/d04c57a1-6813-42f8-932e-ab9506091c4e/7cb017e9-125d-45ba-8dd7-703fb83b1b7e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:19.377071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Port': ['ID=66274b8e-1d66-4cd7-8282-1e4f5737ab76,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:19.408497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:19.492454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=82103695-e509-4b3b-acea-f6a9415b56f1,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:19.501002 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 2, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:19.506594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:19.512468 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Checking router: 6fb934fe-8876-4ad1-8081-30b7959413d2 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:55:19.512834 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Updating router 6fb934fe-8876-4ad1-8081-30b7959413d2 port edb84025-b225-44f1-a2bb-577394c19988 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:55:19.526749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7eb9da47-48fd-417d-88e1-1f4872807f2e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:19.527132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.587522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.626787 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.636614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.652081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Transition to ACTIVE for port object 7cb017e9-125d-45ba-8dd7-703fb83b1b7e will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:19.688715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.803891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:19.875935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-542898517'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:19.880761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:19.885119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Usage tracker for resource:network and tenant:b2e6bfd3378b4b6ea010c8a84f8ef289 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:19.888530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:19.894767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:19.921945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Made reservation on behalf of b2e6bfd3378b4b6ea010c8a84f8ef289 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:19.924931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.962686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:19.968801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 82103695-e509-4b3b-acea-f6a9415b56f1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:20.009091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:20.013838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Usage tracker for resource:security_group_rule and tenant:b2e6bfd3378b4b6ea010c8a84f8ef289 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:20.018262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:20.024337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Pushing event updated for resources: {'Port': ['ID=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:20.035946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:20.080710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 82103695-e509-4b3b-acea-f6a9415b56f1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:20.081435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.107817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.116669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.125702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.145592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.342s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:20.172236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:20.172691 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.174202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:20.186257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.195003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:20.196859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.217669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:20.236323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.236679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Added segment 034868c9-f7f3-491b-82ff-dba28a69eb0d of type vlan for network 25c95b38-7da1-4d5b-a600-feaf61be7793 Nov 24 13:55:20.274719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f42aaaee-bb93-40ae-b744-19a1a944e02f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:20.282483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.287341 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Transition to ACTIVE for port object edb84025-b225-44f1-a2bb-577394c19988 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:20.298446 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.302688 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:20.312838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.313486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 6bcf3dd1-bd59-438d-889a-72b13be63128 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:55:20.326947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4d054ee6-bfa8-496d-953a-19172828b98c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:20.339998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d72b93e-4321-4380-bd36-8249c3d9aa01 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] Network f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:20.373464 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5d72b93e-4321-4380-bd36-8249c3d9aa01 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "POST /v2.0/agents/42153128-35a0-4d6f-8610-1ec654ed3b07/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 1.5324152 Nov 24 13:55:20.375612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35740) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:20.380282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2bbe69c-e104-4543-95fb-1c2eb423a2e5 None None] Network f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:20.380882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.382096 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a633ddc4-f85e-4d8e-b0cb-fec478e30907 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "DELETE /v2.0/routers/6bcf3dd1-bd59-438d-889a-72b13be63128 HTTP/1.1" status: 204 len: 168 time: 2.6026826 Nov 24 13:55:20.394078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35744) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:20.402319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Request body: {'router': {'name': 'tempest-router-1174122871', 'distributed': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:20.408693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:20.414654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Usage tracker for resource:router and tenant:e1ede394fd824630a46bbb7f80e6b61f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:20.418386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:20.425240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:20.441742 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c7f8f9a-bd7d-4ce7-a827-1ee49ba2af67 None None] Pushing event updated for resources: {'Port': ['ID=edb84025-b225-44f1-a2bb-577394c19988,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:20.447537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.449243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.450095 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8c7f8f9a-bd7d-4ce7-a827-1ee49ba2af67 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:20.458852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Pushing event updated for resources: {'SecurityGroup': ['ID=368f3608-0ff1-4cdf-887d-ca349ba37c31,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:20.478301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:20.481927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.510805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.540177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.599639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.672276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f42aaaee-bb93-40ae-b744-19a1a944e02f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:20.672661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.723737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.732048 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-780bc92c-d0fa-4b69-9b8a-dddde81555cf tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.3366768 Nov 24 13:55:20.732852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35748) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:20.733288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35750) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:20.744114 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Attempting to bind port edb84025-b225-44f1-a2bb-577394c19988 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:20.745040 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Attempting to bind port edb84025-b225-44f1-a2bb-577394c19988 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:20.745556 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Attempting to bind port edb84025-b225-44f1-a2bb-577394c19988 on network 192cb388-42c9-4352-94b7-0d42c68d3b4b {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:20.752944 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:20.753575 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Checking segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:20.754121 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.754648 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Bound using segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:20.755296 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Bound port: edb84025-b225-44f1-a2bb-577394c19988, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:20.755869 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.822566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:20.830072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.832894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Request body: {'security_group': {'name': 'tempest-securitygroup--579130463', 'description': 'tempest-description--1652364616'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:20.852901 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] For port edb84025-b225-44f1-a2bb-577394c19988, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:20.856799 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] For port edb84025-b225-44f1-a2bb-577394c19988, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=edb84025-b225-44f1-a2bb-577394c19988,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:20.861913 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.868231 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-9bf66563-98c0-4502-8add-dfa096a86ffe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:20.922465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:20.951365 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c7f8f9a-bd7d-4ce7-a827-1ee49ba2af67 None None] Pushing event updated for resources: {'Port': ['ID=edb84025-b225-44f1-a2bb-577394c19988,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:20.964819 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8c7f8f9a-bd7d-4ce7-a827-1ee49ba2af67 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:20.969244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:20.973272 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-91963485-1ab2-469a-bff9-f3cadbec71ab tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/agents/42153128-35a0-4d6f-8610-1ec654ed3b07/dhcp-networks HTTP/1.1" status: 200 len: 7778 time: 0.5962274 Nov 24 13:55:20.996197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9ca78e95-ad10-4a6c-860d-9a6b706f10f1 None None] Provisioning for port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:21.007595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35756) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:21.009768 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:21.011802 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:21.013609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9ca78e95-ad10-4a6c-860d-9a6b706f10f1 None None] Provisioning complete for port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:21.014063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ca78e95-ad10-4a6c-860d-9a6b706f10f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:21.035678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Usage tracker for resource:security_group and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:21.046156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:21.067697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:21.111325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9ca78e95-ad10-4a6c-860d-9a6b706f10f1 None None] Port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:21.116129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:21.142217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:21.142818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:21.158083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Allocated IP 172.26.4.76 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/eae84203-4712-4756-b9e1-83c91d8b25cf) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:21.160649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:21.190780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:21.276728 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:21.320966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:21.521346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:21.532158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Usage tracker for resource:security_group_rule and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:21.541269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:21.552336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:21.553028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 802 time: 2.1981678 Nov 24 13:55:21.553931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Pushing event updated for resources: {'Network': ['ID=25c95b38-7da1-4d5b-a600-feaf61be7793,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:21.567833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 25c95b38-7da1-4d5b-a600-feaf61be7793 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:21.597581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.437s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:21.611657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-38d2314e-379e-4da1-a186-79e66f43be45 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "DELETE /v2.0/agents/42153128-35a0-4d6f-8610-1ec654ed3b07/dhcp-networks/f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0 HTTP/1.1" status: 204 len: 168 time: 0.6029162 Nov 24 13:55:21.615857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35766) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:21.691178 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:21.696912 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86425da5-5ef7-40ec-9a6c-5cab8194b43f None None] The sync data for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv is: [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:21.737562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Allocated IP 172.20.0.1 (6a5d65c8-6152-4e88-aa78-9b953c042568/4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e/913c803c-a1a8-4bf1-9343-f2966b5ac131) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:21.812847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35770) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:21.949835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] It took 0.40 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:21.954710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device edb84025-b225-44f1-a2bb-577394c19988 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:21.975191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.016614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:22.032474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.052465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Request body: {'port': {'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793', 'binding:host_id': 'hv-neutron-8181', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1404128613'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:22.055039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port edb84025-b225-44f1-a2bb-577394c19988 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:22.065591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port edb84025-b225-44f1-a2bb-577394c19988 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:22.066226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.076061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.081928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:22.089369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.100728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.104532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Usage tracker for resource:port and tenant:266ef7dcf3394ff78002f75a07b4a9a1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:22.140105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:22.142906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.195717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:22.209737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.229577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.273840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port edb84025-b225-44f1-a2bb-577394c19988, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=edb84025-b225-44f1-a2bb-577394c19988,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:22.279114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.281263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.309945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.316108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Made reservation on behalf of 266ef7dcf3394ff78002f75a07b4a9a1 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:22.318436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.325552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.355023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.360838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.367137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=edb84025-b225-44f1-a2bb-577394c19988,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:22.370822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:22.380363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Port': ['ID=66274b8e-1d66-4cd7-8282-1e4f5737ab76,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:22.389139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Pushing event updated for resources: {'Port': ['ID=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:22.396190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.401895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.405656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:22.407532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.411207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.412108 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 6.0987074 Nov 24 13:55:22.412730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35774) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:22.426262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:22.453450 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-909a06e1-b05e-417c-9c79-4ee3b5bb3c57 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/agents/42153128-35a0-4d6f-8610-1ec654ed3b07/dhcp-networks HTTP/1.1" status: 200 len: 7033 time: 0.8342621 Nov 24 13:55:22.462982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35778) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:22.468114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Transition to ACTIVE for port object 913c803c-a1a8-4bf1-9343-f2966b5ac131 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:22.483656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.492356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:22.503359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Usage tracker for resource:security_group_rule and tenant:266ef7dcf3394ff78002f75a07b4a9a1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:22.512359 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f380ec6-c12b-436c-92e4-fddef8220773 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/networks/07ff3faf-843a-4742-9187-25d89db7c71b/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.0433943 Nov 24 13:55:22.512359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.512359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:22.514178 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:55:22.515420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35782) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:22.518653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.524476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:22.527831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fbc58853-a5fa-4ac9-8fc3-0e4e114456c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.622095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:22.630613 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2c6ac2a9-261f-4567-ac84-0558d7086a1c tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "GET /v2.0/floatingips?floating_network_id=1383a1b1-2ce7-45df-bc46-9ddd671720aa HTTP/1.1" status: 200 len: 689 time: 0.2167153 Nov 24 13:55:22.633944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:22.639227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35786) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:22.644642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:22.647306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.647817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Fanout notify agent at l3_agent the message router_deleted on router ad2dcdf7-0262-4e90-9f33-8f2d6b4c0a98 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:55:22.653921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:22.655006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:22.665294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event updated for resources: {'Port': ['ID=eae84203-4712-4756-b9e1-83c91d8b25cf,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:22.668007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.670151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:22.680356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.692785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.694120 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1613 time: 1.9559412 Nov 24 13:55:22.710962 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c54c5e3c-791b-47be-92a6-3bb2b076b201 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/networks/07ff3faf-843a-4742-9187-25d89db7c71b/dhcp-agents HTTP/1.1" status: 200 len: 808 time: 0.1881034 Nov 24 13:55:22.712801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35790) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:22.712801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35792) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:22.713811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.714966 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1c44441f-fcd1-489d-bd38-ee4aa42e5733 tempest-RoutersTestDVR-1688528442 tempest-RoutersTestDVR-1688528442-project-admin] 10.222.0.70 "DELETE /v2.0/routers/ad2dcdf7-0262-4e90-9f33-8f2d6b4c0a98 HTTP/1.1" status: 204 len: 168 time: 1.9751093 Nov 24 13:55:22.739581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Request body: {'security_group_rule': {'security_group_id': 'ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:22.807381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Port': ['ID=913c803c-a1a8-4bf1-9343-f2966b5ac131,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:22.810904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:22.816047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.817156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:22.818225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:22.822334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:22.822806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.826575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:22.833197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:22.844646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port c5001ac6-01dc-44cf-a497-a5ed566d7649 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:22.862539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:22.883175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:22.897716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Usage tracker for resource:security_group_rule and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:22.904506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:23.045825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:23.068208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:23.069097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c656b0b0-5a47-4864-b80a-f755a06cfb7e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:23.104380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:23.132214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.272104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.282839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.296613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35802) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:23.315887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Provisioning complete for port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:23.316415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.377891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.404343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:23.420917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Provisioning for port 913c803c-a1a8-4bf1-9343-f2966b5ac131 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:23.426546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Provisioning complete for port 913c803c-a1a8-4bf1-9343-f2966b5ac131 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:23.426860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.470505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.493765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-843aa115-075d-4642-a506-50ff1f5c3707 None None] Port 913c803c-a1a8-4bf1-9343-f2966b5ac131 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:23.530680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.566323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Deleting port 66274b8e-1d66-4cd7-8282-1e4f5737ab76 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:23.566661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.699531 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-deac15c2-6b7e-4638-b968-fd3020bc7e04 tempest-DHCPAgentSchedulersTestJSON-619072014 tempest-DHCPAgentSchedulersTestJSON-619072014-project-admin] 10.222.0.70 "GET /v2.0/agents/42153128-35a0-4d6f-8610-1ec654ed3b07/dhcp-networks HTTP/1.1" status: 200 len: 7033 time: 0.9815540 Nov 24 13:55:23.707553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35808) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:23.828238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port c5001ac6-01dc-44cf-a497-a5ed566d7649 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:23.835166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:23.853938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.888019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.905457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.907971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Usage tracker for resource:security_group_rule and tenant:5a0e962471ac45b79763a40e686af141 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:23.914723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4bcae95f-4b8c-4dc0-ac06-bb01790ec22a tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:23.917709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device edb84025-b225-44f1-a2bb-577394c19988 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:23.933278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:23.955048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:23.957736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Transition to ACTIVE for port object c5001ac6-01dc-44cf-a497-a5ed566d7649 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:23.960145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:23.999485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port edb84025-b225-44f1-a2bb-577394c19988 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:23.999889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.005668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.018205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a2b3458f-3978-42e3-be6f-3728e9d969d2,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:24.029900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:24.032326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.032653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.045914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:24.046939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.048141 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 1.3318629 Nov 24 13:55:24.053192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35812) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:24.182466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Calling delete_port for 66274b8e-1d66-4cd7-8282-1e4f5737ab76 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:24.210178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Request body: {'security_group_rule': {'security_group_id': 'ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:24.224029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:24.234510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Usage tracker for resource:security_group_rule and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:24.254465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=c5001ac6-01dc-44cf-a497-a5ed566d7649,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:24.257841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:24.267289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:24.269825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:24.304186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.308255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:24.330630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.344596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.354194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:24.381444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Checking segment: {'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:24.381787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Network hostable DHCP agents. Network: 25c95b38-7da1-4d5b-a600-feaf61be7793, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:55:24.399407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.424585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.440991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.462012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.484138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event updated for resources: {'Port': ['ID=eae84203-4712-4756-b9e1-83c91d8b25cf,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:24.503835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:24.506729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.078s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:24.509876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:24.522692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.535173 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=5a0e962471ac45b79763a40e686af141&name=default HTTP/1.1" status: 200 len: 2647 time: 1.2306993 Nov 24 13:55:24.541064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35816) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:24.542598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2fffd934-3541-49f1-b379-ff2bcf0b0660') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:24.542883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2fffd934-3541-49f1-b379-ff2bcf0b0660') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:24.547591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.556241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.561402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Network 25c95b38-7da1-4d5b-a600-feaf61be7793 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:24.565568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92b1be8f-7da7-4323-8d5a-9d84a070f6cf,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:24.568013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.569216 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.7342334 Nov 24 13:55:24.572449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:24.574816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82afdcf2-2e15-4681-ad4e-de615e5c1a84 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.014s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:24.600741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.622659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 25c95b38-7da1-4d5b-a600-feaf61be7793) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:24.634317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbc74924-7477-4d39-bf0f-c08e6b3c77fc None None] Network 25c95b38-7da1-4d5b-a600-feaf61be7793 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:24.639118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:55:24.648030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.654669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:24.667875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.672641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Releasing vlan 889 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:24.673241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:24.693299 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:24.723142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:24.742882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:24.743439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:24.743926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:24.754107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:24.754567 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:24.759338 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 2 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:24.769809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Port': ['ID=913c803c-a1a8-4bf1-9343-f2966b5ac131,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:24.784264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:24.792402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:24.792821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:24.793248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:24.793811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.813493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:24.813916 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:24.816065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 3 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:24.845220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:24.845847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:24.845847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:24.847487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Port': ['ID=66274b8e-1d66-4cd7-8282-1e4f5737ab76,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:24.857872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:24.858209 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:24.859994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:24.860667 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 4 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:24.869686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:24.871039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:24.876870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:24.900079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:24.961932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:24.962621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:24.963346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:24.986181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:24.986429 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:24.989113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 5 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:25.031656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.062368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.074393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b3310e33-1f5d-49fb-9a38-2701d246d5de,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:25.109128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35832) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:25.116707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:25.122600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.013s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:25.146575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.149220 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "DELETE /v2.0/networks/f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0 HTTP/1.1" status: 204 len: 168 time: 1.4407198 Nov 24 13:55:25.150120 dv-neutron-818151-2-hyperv neutron-server[83525]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 13:55:25.151878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35836) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:25.162650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:25.163234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:25.163544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:25.182827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:25.183065 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:25.185723 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 6 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:25.208374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:25.208701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:25.209052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:25.226585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:25.227123 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:25.227894 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 7 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:25.232322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9b5fd85-4036-4c90-81a8-b19bf12b868d None None] Provisioning complete for port 913c803c-a1a8-4bf1-9343-f2966b5ac131 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:25.232953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9b5fd85-4036-4c90-81a8-b19bf12b868d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.295585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a9b5fd85-4036-4c90-81a8-b19bf12b868d None None] Port 913c803c-a1a8-4bf1-9343-f2966b5ac131 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:25.299178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.309953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.311130 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 1.1978972 Nov 24 13:55:25.312065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event deleted for resources: {'Network': ['ID=f257af2d-5f93-45cb-a9e8-6d9d3a17dcc0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:25.315959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35840) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:25.320553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:25.320930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:25.321266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:25.326948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:25.332292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:25.336666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:25.344192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Usage tracker for resource:floatingip and tenant:cec6d7377f6a459a8b7de61e6d2b631f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:25.346565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:25.346893 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:25.348260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:25.350705 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 8 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:25.350829 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-977108ee-3caf-429d-bb0e-3f3a2a31c663 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] DELETE failed (client error): The resource could not be found. Nov 24 13:55:25.351319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-977108ee-3caf-429d-bb0e-3f3a2a31c663 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:55:25.352981 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-977108ee-3caf-429d-bb0e-3f3a2a31c663 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "DELETE /v2.0/ports/66118d4b-b3dc-408d-919f-5791c512f16c HTTP/1.1" status: 404 len: 333 time: 0.1882453 Nov 24 13:55:25.353854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.361507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35844) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:25.368909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:25.414403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:25.414740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:25.415070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:25.443996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.471644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-6e904a2c-2b73-480e-bb88-9ea4575b6021 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Synchronizing usage tracker for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:25.472968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:25.473303 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:25.476325 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 9 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:25.541693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.583156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:25.583453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:25.583731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:25.584475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.597572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-075b9074-383f-4fe1-8d3b-dc17e32012e4 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:25.610196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-6e904a2c-2b73-480e-bb88-9ea4575b6021 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Unset dirty status for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:25.618663 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-6e904a2c-2b73-480e-bb88-9ea4575b6021 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--1520669266&fields=id&tenant_id=8253655cf6fe49d7881f39cdb1344ce7 HTTP/1.1" status: 200 len: 267 time: 0.5071771 Nov 24 13:55:25.630199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92b1be8f-7da7-4323-8d5a-9d84a070f6cf,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:25.637297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:25.669299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.670403 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/92b1be8f-7da7-4323-8d5a-9d84a070f6cf HTTP/1.1" status: 204 len: 168 time: 1.1139553 Nov 24 13:55:25.696753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:25.697087 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:25.700009 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 10 to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 Nov 24 13:55:25.738146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:25.738567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:25.738936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:25.793188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port c5001ac6-01dc-44cf-a497-a5ed566d7649 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:25.793601 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port c5001ac6-01dc-44cf-a497-a5ed566d7649 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:25.793952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.819879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Deleting subnet f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:55:25.825838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.832259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.847094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fb27547e-6676-4fc6-8295-9f9afca69489 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:25.885783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=29e6353d-0ae4-45f5-81f7-f5e9ed3c014f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:25.891473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-475d0d57-efbf-4de4-8aa1-ec9ce4a4b809 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:25.892316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-475d0d57-efbf-4de4-8aa1-ec9ce4a4b809 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Synchronizing usage tracker for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:25.900798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:25.902878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:25.943821 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] 10.222.0.70 "PUT /v2.0/routers/0cae4fcd-f667-49b0-8c04-a43cca4a8dc1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 15.3870423 Nov 24 13:55:25.945028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:25.999872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-475d0d57-efbf-4de4-8aa1-ec9ce4a4b809 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Unset dirty status for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:26.006421 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-475d0d57-efbf-4de4-8aa1-ec9ce4a4b809 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/networks?id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 HTTP/1.1" status: 200 len: 806 time: 0.3866844 Nov 24 13:55:26.034063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.043020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Router 2a5d4c0d-28ee-4bd1-84a1-38649345f24d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:55:26.048422 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-cbc27e17-03a5-4196-ab55-51ddb62073e8 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/quotas/8253655cf6fe49d7881f39cdb1344ce7 HTTP/1.1" status: 200 len: 375 time: 0.0406139 Nov 24 13:55:26.059703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] For port c5001ac6-01dc-44cf-a497-a5ed566d7649, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:26.060129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempted to set empty binding levels {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 13:55:26.072743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.080263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:26.101267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1383a1b1-2ce7-45df-bc46-9ddd671720aa']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:26.114298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.141576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '144fd7d7-f768-49b3-a076-1ea9e7f16259') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:26.141791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '144fd7d7-f768-49b3-a076-1ea9e7f16259') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:26.161283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.171073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:26.186315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.215052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.227220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.250531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Releasing vlan 893 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:26.251186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:26.265444 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:26.292103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.345035 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-b776d50f-6a70-4096-86ea-03db9eaab42c tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2877755 Nov 24 13:55:26.347090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=c5001ac6-01dc-44cf-a497-a5ed566d7649,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:26.362220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:26.368705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:26.373825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Usage tracker for resource:security_group_rule and tenant:e1ede394fd824630a46bbb7f80e6b61f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:26.380424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:26.396147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:26.397817 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 986 time: 4.5809927 Nov 24 13:55:26.399335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35868) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:26.407614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.436381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.447390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-213336d9-1962-48e3-9292-cc627f5b6dd6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:26.455377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:26.475591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 1383a1b1-2ce7-45df-bc46-9ddd671720aa {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:55:26.481267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.506242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event deleted for resources: {'Subnet': ['ID=f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:26.511362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Network': ['ID=1383a1b1-2ce7-45df-bc46-9ddd671720aa,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:26.524255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:26.534636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Deleting port c5001ac6-01dc-44cf-a497-a5ed566d7649 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:26.535486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.544632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:26.553343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.566293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f809500-b108-4233-935e-504c3af56ef0 None None] Network 07ff3faf-843a-4742-9187-25d89db7c71b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:26.572800 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/networks/1383a1b1-2ce7-45df-bc46-9ddd671720aa HTTP/1.1" status: 204 len: 168 time: 3.9230328 Nov 24 13:55:26.576193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35872) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:26.701027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Allocated IP 172.26.4.200 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/6da3b5a5-9d45-4123-9e45-8dc0a0748ea5) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:26.716201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:26.767479 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "DELETE /v2.0/subnets/f6c417a1-3123-4ddd-9b61-0a5ee5be1cd1 HTTP/1.1" status: 204 len: 168 time: 1.4039378 Nov 24 13:55:26.771495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35878) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:26.961824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b2a54cda-721d-44d8-a08a-e8ba4b4bed0f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Synchronizing usage tracker for tenant:d5e5db1178c84db6bb49f66d53f08e95 on resource:floatingip {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:27.021139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.044061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-252703a8-3366-401e-99e0-9b3c6fb0f503 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:55:27.045208 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-252703a8-3366-401e-99e0-9b3c6fb0f503 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.3626757 Nov 24 13:55:27.143567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.148854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b2a54cda-721d-44d8-a08a-e8ba4b4bed0f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Unset dirty status for tenant:d5e5db1178c84db6bb49f66d53f08e95 on resource:floatingip {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:27.150228 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b2a54cda-721d-44d8-a08a-e8ba4b4bed0f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 1169 time: 0.5695276 Nov 24 13:55:27.152044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] DHCP port deletion for 07ff3faf-843a-4742-9187-25d89db7c71b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:55:27.155114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35882) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.157445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Deleting port 7eb9da47-48fd-417d-88e1-1f4872807f2e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:27.157884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.296099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Deleting port 7eb9da47-48fd-417d-88e1-1f4872807f2e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:27.296444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.299665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:27.313892 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=e1ede394fd824630a46bbb7f80e6b61f&name=default HTTP/1.1" status: 200 len: 2647 time: 1.1397512 Nov 24 13:55:27.324751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35886) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.325163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-383eb014-f3ce-4c6a-880e-64ccac84683a service neutron] 10.222.0.70 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2313490 Nov 24 13:55:27.374225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.423730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.424358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.424937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.425544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.426583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.426767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.427373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:27.430264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Synchronizing usage tracker for tenant:d5e5db1178c84db6bb49f66d53f08e95 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:27.437118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] For port 7eb9da47-48fd-417d-88e1-1f4872807f2e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7eb9da47-48fd-417d-88e1-1f4872807f2e,segment=NetworkSegment(34d8f0e8-e3d6-40bc-b847-7d7f67df846a),segment_id=34d8f0e8-e3d6-40bc-b847-7d7f67df846a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:27.437619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35890) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.437732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.457947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] For port c5001ac6-01dc-44cf-a497-a5ed566d7649, host hv-neutron-8181, got binding levels [] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:27.458216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.458331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:27.465664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1560843332', 'description': 'tempest-description--648749479'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:27.481086 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "PUT /v2.0/routers/2a5d4c0d-28ee-4bd1-84a1-38649345f24d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.0802472 Nov 24 13:55:27.483903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35894) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.504866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] Sync routers for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:27.518273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:27.536797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Usage tracker for resource:security_group and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:27.542637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:27.554378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Unset dirty status for tenant:d5e5db1178c84db6bb49f66d53f08e95 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:27.558470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b124ffc-2f21-4732-88aa-1012abb60900 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 4607 time: 0.3983192 Nov 24 13:55:27.558470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:27.567093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35898) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.591407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Calling delete_port for 7eb9da47-48fd-417d-88e1-1f4872807f2e owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:27.626767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Request body: {'port': {'network_id': '6a5d65c8-6152-4e88-aa78-9b953c042568', 'name': 'tempest-FloatingIPAdminTestJSON-854329597'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:27.632891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:27.633589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:27.642472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7543cd9-0c49-4ee3-804c-6253bf4dccfc,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:27.646951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.347s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:27.689736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.699641 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-b3525c59-9322-4d22-aa9a-e4b393078914 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] delete failed (client error): The resource could not be found. Nov 24 13:55:27.703341 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3525c59-9322-4d22-aa9a-e4b393078914 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/floatingips/40843b41-36fe-4b67-a371-d5c253ae38ca HTTP/1.1" status: 404 len: 345 time: 0.1326015 Nov 24 13:55:27.705427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.705612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:27.709159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35902) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.723132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Calling delete_port for c5001ac6-01dc-44cf-a497-a5ed566d7649 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:27.753833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.777857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:27.802423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:27.803879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:27.855699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.872335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:27.884096 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-a95859b1-740c-477b-9b73-2b100fc269f2 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] DELETE failed (client error): The resource could not be found. Nov 24 13:55:27.884539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a95859b1-740c-477b-9b73-2b100fc269f2 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:55:27.891348 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a95859b1-740c-477b-9b73-2b100fc269f2 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/networks/1383a1b1-2ce7-45df-bc46-9ddd671720aa HTTP/1.1" status: 404 len: 339 time: 0.1342492 Nov 24 13:55:27.891841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35906) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:27.902075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'network': {'name': 'tempest-network--1704086395', 'router:external': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:27.909995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.910211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] No DVR routers for this DVR port 7eb9da47-48fd-417d-88e1-1f4872807f2e on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:55:27.911025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:27.911127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:27.911419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d46f1757-48a2-46bd-8ff8-17809a7c6224 None None] The sync data for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:27.916448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:network and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:27.920426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Pushing event deleted for resources: {'Port': ['ID=7eb9da47-48fd-417d-88e1-1f4872807f2e,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:27.920759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:27.923507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:27.938135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:27.946678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] For port 7eb9da47-48fd-417d-88e1-1f4872807f2e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7eb9da47-48fd-417d-88e1-1f4872807f2e,segment=NetworkSegment(34d8f0e8-e3d6-40bc-b847-7d7f67df846a),segment_id=34d8f0e8-e3d6-40bc-b847-7d7f67df846a)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:27.947099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.954728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7eb9da47-48fd-417d-88e1-1f4872807f2e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:55:27.963559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:27.964998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event updated for resources: {'Port': ['ID=6da3b5a5-9d45-4123-9e45-8dc0a0748ea5,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:27.965997 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-d4b8685d-88f6-453e-b446-2009587f5d20 service neutron] 10.222.0.70 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6398151 Nov 24 13:55:27.973076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:27.976209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:27.982683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Made reservation on behalf of d5e5db1178c84db6bb49f66d53f08e95 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:27.982877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:27.985281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:27.993819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 7eb9da47-48fd-417d-88e1-1f4872807f2e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:55:27.994398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7eb9da47-48fd-417d-88e1-1f4872807f2e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:55:28.031870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.036678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Usage tracker for resource:security_group_rule and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:28.047179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:28.047324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 865} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:28.050601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db696077-c952-40d5-86e0-9294c7ac889d tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:28.105794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:28.109915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:28.111148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event deleted for resources: {'Port': ['ID=c5001ac6-01dc-44cf-a497-a5ed566d7649,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:28.119052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:28.120135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Usage tracker for resource:port and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:28.123545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Calling delete_port for 7eb9da47-48fd-417d-88e1-1f4872807f2e owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:28.125434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:28.133128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.137024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.137024 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Added segment 09ac7e2a-cea2-49e3-aec2-a61f47a7603e of type vlan for network 20a0344f-a7d9-4900-b92a-d7a9a9573224 Nov 24 13:55:28.141816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:28.158411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:28.167262 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "DELETE /v2.0/ports/c5001ac6-01dc-44cf-a497-a5ed566d7649 HTTP/1.1" status: 204 len: 168 time: 1.7642684 Nov 24 13:55:28.168639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Made reservation on behalf of 823115d55e2a491398adfedf32ca655a for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:28.169248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35910) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:28.171390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.243682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.267253 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-ba6b11e2-9b29-4825-8123-8d9aab269804 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:55:28.267778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ba6b11e2-9b29-4825-8123-8d9aab269804 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Synchronizing usage tracker for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:28.275960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] device_id is not set on port ea9add32-f613-40a9-b5a1-b539c5657dc8 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:28.279707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35922) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:28.397876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.404803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.409847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:28.410510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.421838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-681b6f99-b4bc-49e9-bcc1-e082e92f43ba tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:28.422467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4ac8a9f3-5221-4fb2-b8ca-9de77a2295e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:28.439877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7543cd9-0c49-4ee3-804c-6253bf4dccfc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:28.441685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ba6b11e2-9b29-4825-8123-8d9aab269804 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Unset dirty status for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:28.448202 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ba6b11e2-9b29-4825-8123-8d9aab269804 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "GET /v2.0/ports/c5001ac6-01dc-44cf-a497-a5ed566d7649 HTTP/1.1" status: 404 len: 333 time: 0.2740157 Nov 24 13:55:28.449364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35936) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:28.450178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:28.466152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:55:28.466396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:55:28.471881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Request body: {'port': {'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-323892046'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:28.479730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:28.493932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:28.516301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.522032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Made reservation on behalf of 266ef7dcf3394ff78002f75a07b4a9a1 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:28.525473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.547724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.551607 dv-neutron-818151-2-hyperv neutron-server[83526]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 13:55:28.588885 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.6929309 Nov 24 13:55:28.597840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:28.608022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35942) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:28.625281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-4ab6e4e6-b823-437a-a493-0c42263aa657 req-c546051b-98ba-4c6d-9bb3-8db2b175a3e5 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Synchronizing usage tracker for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:28.655038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Network': ['ID=20a0344f-a7d9-4900-b92a-d7a9a9573224,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:28.667933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 20a0344f-a7d9-4900-b92a-d7a9a9573224 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:28.691857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port b2feb838-0522-4e76-85fe-2e93f51e8cb7 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:28.706329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:28.746695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Allocated IP 172.20.0.13 (6a5d65c8-6152-4e88-aa78-9b953c042568/4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e/ea9add32-f613-40a9-b5a1-b539c5657dc8) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:28.767580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.769041 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/b7543cd9-0c49-4ee3-804c-6253bf4dccfc HTTP/1.1" status: 204 len: 168 time: 1.4348114 Nov 24 13:55:28.781925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.783368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event updated for resources: {'SecurityGroup': ['ID=749ded37-2936-483e-baa9-fad3a456a1a6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:28.797128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:28.802150 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1613 time: 1.3564830 Nov 24 13:55:28.805017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:28.809228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 35952) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:28.822484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:28.826904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:28.831375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:28.836631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:28.837754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Synchronizing usage tracker for tenant:30281dee68af4552a511789e5f1b3d06 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:28.845904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Request body: {'security_group_rule': {'security_group_id': '749ded37-2936-483e-baa9-fad3a456a1a6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:28.852040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-4ab6e4e6-b823-437a-a493-0c42263aa657 req-c546051b-98ba-4c6d-9bb3-8db2b175a3e5 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Unset dirty status for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:28.853414 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ab6e4e6-b823-437a-a493-0c42263aa657 req-c546051b-98ba-4c6d-9bb3-8db2b175a3e5 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.4930787 Nov 24 13:55:28.926471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Unset dirty status for tenant:30281dee68af4552a511789e5f1b3d06 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:28.928591 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-60ca61e7-67b3-48d6-9663-3c2800618e5d tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2453 time: 0.3189828 Nov 24 13:55:28.934998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35962) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:28.985482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:28.989693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Deleting port 7eb9da47-48fd-417d-88e1-1f4872807f2e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:28.990300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.045673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Usage tracker for resource:security_group_rule and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:29.054505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:29.103650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:29.116916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.147001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.158518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] The port '7eb9da47-48fd-417d-88e1-1f4872807f2e' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:55:29.239415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.331732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.337740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Transition to ACTIVE for port object ea9add32-f613-40a9-b5a1-b539c5657dc8 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:29.346310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.383728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['20a0344f-a7d9-4900-b92a-d7a9a9573224']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:29.402375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '09ac7e2a-cea2-49e3-aec2-a61f47a7603e') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:29.402842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '09ac7e2a-cea2-49e3-aec2-a61f47a7603e') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:29.419001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.440141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.447718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.451084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-acfee976-d7c7-43a7-a1a1-49bcb647e3b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:29.492100 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Sync routers for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:29.516028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Releasing vlan 865 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:29.516028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.523711 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:29.524568 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:29.529660 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:29.655207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.669841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.703423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event updated for resources: {'Port': ['ID=ea9add32-f613-40a9-b5a1-b539c5657dc8,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:29.769255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:29.773620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.321s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:29.774712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:29.784179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:29.791616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > segment before_delete 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.792013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.792721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.793045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > port after_create 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.793367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > port after_delete 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.793717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > port after_update 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.794038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > segment after_delete 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.794390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet after_create 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.795122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet after_delete 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.795122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet after_update 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:29.796386 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:29.801813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:30.053960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:30.054834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.063840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 20a0344f-a7d9-4900-b92a-d7a9a9573224 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:55:30.066583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.075809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:30.105012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Network': ['ID=20a0344f-a7d9-4900-b92a-d7a9a9573224,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:30.112188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:30.131961 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/networks/20a0344f-a7d9-4900-b92a-d7a9a9573224 HTTP/1.1" status: 204 len: 168 time: 1.1937206 Nov 24 13:55:30.133470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35994) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:30.143338 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6569948 Nov 24 13:55:30.153777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'network': {'name': 'tempest-network--1839390012', 'router:external': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:30.163554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 35998) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:30.168665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:30.190040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:network and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:30.196367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:30.219350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet after_create 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:30.219939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet after_delete 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:30.220105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet before_create 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:30.220447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Subscribe: > subnet before_update 55550000 {{(pid=83526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 13:55:30.220811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07ff3faf-843a-4742-9187-25d89db7c71b']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:30.259701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f62dd368-d8a2-4f03-b4e0-3e9aaab2daf7 None None] Provisioning for port ea9add32-f613-40a9-b5a1-b539c5657dc8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:30.270754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f62dd368-d8a2-4f03-b4e0-3e9aaab2daf7 None None] Provisioning complete for port ea9add32-f613-40a9-b5a1-b539c5657dc8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:30.272465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f62dd368-d8a2-4f03-b4e0-3e9aaab2daf7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.281690 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-75983ab1-7ec7-4c74-acd3-ec017bcaef7a req-0ed9ba83-8a02-4fc7-93ba-6b36f21b52c6 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.0863626 Nov 24 13:55:30.282682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:30.308916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Made reservation on behalf of d5e5db1178c84db6bb49f66d53f08e95 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:30.312356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.315603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '34d8f0e8-e3d6-40bc-b847-7d7f67df846a') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:30.315943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '34d8f0e8-e3d6-40bc-b847-7d7f67df846a') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:30.411197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:30.414746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.431616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.431987 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Added segment e495dd12-7735-477b-bce2-3062a98a7c85 of type vlan for network 6fcd3d4f-4f61-4045-a830-e078bede82b0 Nov 24 13:55:30.434771 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f62dd368-d8a2-4f03-b4e0-3e9aaab2daf7 None None] Port ea9add32-f613-40a9-b5a1-b539c5657dc8 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:30.445253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.465144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.469775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.485771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9276769d-3536-4bb6-ba04-3c412bc1ba46 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:30.486273 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:08Z', 'revision_number': 2, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:30.496519 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Checking router: 29faa878-433b-448f-ae89-9e61ec9daefb for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:55:30.497269 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Updating router 29faa878-433b-448f-ae89-9e61ec9daefb port b47a3021-ab27-448e-bbc9-296c441891bc binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:55:30.515161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.520929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.533558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Releasing vlan 882 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:30.534288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1993: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn_limited( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1993: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn_limited( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:30.552363 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:30.575384 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.606766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=447b25c7-5ac7-4e3c-96a4-f0e2be8baf60,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:30.610980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:30.618959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.621797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:30.622187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:30.623045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.641152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:30.684363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36006) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:30.836749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.47', 52464) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:30.840030 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.7041950 Nov 24 13:55:30.862538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ea77f638-df43-4d62-9c04-4c0a69715d14 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'default'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:30.863177 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-ea77f638-df43-4d62-9c04-4c0a69715d14 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 13:55:30.868474 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea77f638-df43-4d62-9c04-4c0a69715d14 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1788659 Nov 24 13:55:30.869296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36014) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:30.869619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36016) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:30.874852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'project_id': '823115d55e2a491398adfedf32ca655a', 'port_id': 'ea9add32-f613-40a9-b5a1-b539c5657dc8'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:30.913581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--299290529'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:30.920226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:30.924526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:30.929621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:30.930454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] It took 0.40 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:30.936210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:30.946434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:30.975927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.987205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:30.989281 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 2.1551216 Nov 24 13:55:30.996195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Network 25c95b38-7da1-4d5b-a600-feaf61be7793 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:30.997228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36022) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:31.017053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.034329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:31.047340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Request body: {'security_group_rule': {'security_group_id': '749ded37-2936-483e-baa9-fad3a456a1a6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:31.067101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:31.068863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:31.070196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.080492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:31.097552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.098909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d5825c7-3174-4a08-9409-d46f7d83a882 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:31.101520 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1d5825c7-3174-4a08-9409-d46f7d83a882 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] 10.222.0.70 "GET /v2.0/networks/6fcd3d4f-4f61-4045-a830-e078bede82b0 HTTP/1.1" status: 200 len: 757 time: 0.2020874 Nov 24 13:55:31.107680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.108259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=b2feb838-0522-4e76-85fe-2e93f51e8cb7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:31.111539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Usage tracker for resource:security_group_rule and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:31.118147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36026) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:31.119030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Network': ['ID=6fcd3d4f-4f61-4045-a830-e078bede82b0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:31.122080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Usage tracker for resource:floatingip and tenant:823115d55e2a491398adfedf32ca655a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:31.122583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.500s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:31.125035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:31.129267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.489s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:31.130269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.074s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:31.134030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6fcd3d4f-4f61-4045-a830-e078bede82b0 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:31.141568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:31.234159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:31.235728 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.248595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.250651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] 10.222.0.70 "DELETE /v2.0/networks/07ff3faf-843a-4742-9187-25d89db7c71b HTTP/1.1" status: 204 len: 168 time: 4.4668655 Nov 24 13:55:31.261123 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 2.7974322 Nov 24 13:55:31.262105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36034) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:31.281934 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Transition to ACTIVE for port object b47a3021-ab27-448e-bbc9-296c441891bc will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:31.293613 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.299481 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8a8cec9-8bb4-4f33-a459-a5d45971164c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:31.382728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:31.398514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.424236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:31.533368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.553352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.590538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event updated for resources: {'Port': ['ID=6da3b5a5-9d45-4123-9e45-8dc0a0748ea5,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:31.593428 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bed834e-06e6-402a-9281-69fdfd13e096 None None] Pushing event updated for resources: {'Port': ['ID=b47a3021-ab27-448e-bbc9-296c441891bc,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:31.603363 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0bed834e-06e6-402a-9281-69fdfd13e096 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.301s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:31.611115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.481s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:31.611237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-29ab41d5-1506-45b9-8e56-e527f61c84f0 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:31.612054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b8793b24-3aee-4d94-b104-c9d099051cbd tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.375s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:31.618725 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-29ab41d5-1506-45b9-8e56-e527f61c84f0 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.47 "GET /v2.0/networks?id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 HTTP/1.1" status: 200 len: 806 time: 0.7805808 Nov 24 13:55:31.643898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:31.651416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:31.667653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-960d88e9-e107-4ef8-afaf-9185ecac6fd5 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:31.674155 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-960d88e9-e107-4ef8-afaf-9185ecac6fd5 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] 10.222.0.70 "GET /v2.0/networks/0f154df6-6b04-4807-adee-84221a46d1bb HTTP/1.1" status: 200 len: 767 time: 0.5537601 Nov 24 13:55:31.675179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.738317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36046) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:31.738998 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Attempting to bind port b47a3021-ab27-448e-bbc9-296c441891bc on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:31.739451 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Attempting to bind port b47a3021-ab27-448e-bbc9-296c441891bc by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:31.741610 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Attempting to bind port b47a3021-ab27-448e-bbc9-296c441891bc on network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:31.746667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:31.757846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:31.760501 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:31.760889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Pushing event deleted for resources: {'Network': ['ID=07ff3faf-843a-4742-9187-25d89db7c71b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:31.770250 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Checking segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:31.770675 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.771234 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Bound using segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:31.772527 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Bound port: b47a3021-ab27-448e-bbc9-296c441891bc, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:31.772929 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.823398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.824842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 6.5074208 Nov 24 13:55:31.828423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:31.839437 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5377c25-7f4b-47fd-9704-b80a8f8ec0c7 req-3d5e761e-0e20-43dc-aacf-78a51b5f0b2b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.1909192 Nov 24 13:55:31.849753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36054) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:31.943308 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-b06b0a27-01c7-4771-9b5b-035904c33590 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8253655cf6fe49d7881f39cdb1344ce7 HTTP/1.1" status: 200 len: 380 time: 0.1924331 Nov 24 13:55:31.949324 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] For port b47a3021-ab27-448e-bbc9-296c441891bc, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:31.954478 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] For port b47a3021-ab27-448e-bbc9-296c441891bc, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b47a3021-ab27-448e-bbc9-296c441891bc,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:31.962477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Request body: {'port': {'device_id': 'af78c682-bb4f-46ed-a904-9540354133ba', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'admin_state_up': True, 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'security_groups': ['37727a31-8a03-487d-8622-0afcf6d8e970']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:31.964709 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:31.970221 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8a8cec9-8bb4-4f33-a459-a5d45971164c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:32.056754 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bed834e-06e6-402a-9281-69fdfd13e096 None None] Pushing event updated for resources: {'Port': ['ID=b47a3021-ab27-448e-bbc9-296c441891bc,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:32.062954 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0bed834e-06e6-402a-9281-69fdfd13e096 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:32.063697 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:32.064355 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:32.184407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.226161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.236872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.405446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.436762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.443960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.477084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:32.477330 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:32.479830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.555925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c8f43146-1388-4baa-85e9-00fd21510294 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:32.578195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:32.582859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:32.586081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:32.612076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:32.626053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:32.668589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.712384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:32.723998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3d66381f-7930-4f25-a1d7-debc50794098,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:32.730200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:32.759432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Made reservation on behalf of 8253655cf6fe49d7881f39cdb1344ce7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:32.762476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.806965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7a05ada1-7f03-4b83-92fc-c25c7eb32457,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:32.862464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port b2feb838-0522-4e76-85fe-2e93f51e8cb7 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:32.872202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.891086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Transition to ACTIVE for port object b2feb838-0522-4e76-85fe-2e93f51e8cb7 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:32.909259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6fcd3d4f-4f61-4045-a830-e078bede82b0']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:32.924646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e495dd12-7735-477b-bce2-3062a98a7c85') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:32.924893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e495dd12-7735-477b-bce2-3062a98a7c85') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:32.927163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.371s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:32.936142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-21a6e139-24e4-4599-9f6d-d5a16d8fa141 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Synchronizing usage tracker for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:32.939408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.956239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.957433 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 1.9590666 Nov 24 13:55:32.965578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.965807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36086) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:32.979096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:32.981386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9317bc3f-3944-4efc-b19b-337a6d8797c0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:33.010029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:33.024662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:33.034241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Usage tracker for resource:floatingip and tenant:a6e6213b81eb4772a787ef2b41ed785b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:33.040969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:33.046090 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:31Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:33.057159 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-689e5524-4a11-4a8b-8bbb-53067cd15377 None None] The sync data for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv is: [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:31Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:33.058905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:33.059028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=b2feb838-0522-4e76-85fe-2e93f51e8cb7,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:33.071849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:33.082302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:33.084899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:33.128119 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:33.143463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d40d4a30-fca7-4ec3-a902-f502f36ca3b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.191230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.237003 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ba805da4-dba1-4dae-b43e-1be5559af9a8 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=923f8529d9624346aaf18120477bb30c&name=default HTTP/1.1" status: 200 len: 2647 time: 1.3810894 Nov 24 13:55:33.262543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36090) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:33.343485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Allocated IP 172.26.4.36 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/a677b3cb-d318-4e97-9ba9-ad890cd016a2) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:33.363399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.398186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.442813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:33.474425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-21a6e139-24e4-4599-9f6d-d5a16d8fa141 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Unset dirty status for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:33.488440 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-21a6e139-24e4-4599-9f6d-d5a16d8fa141 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--579130463&fields=id&tenant_id=cec6d7377f6a459a8b7de61e6d2b631f HTTP/1.1" status: 200 len: 267 time: 1.0915899 Nov 24 13:55:33.508506 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-496e988a-c890-4aaf-80dc-70f850bffabd req-df9c4107-d9d6-4152-acde-9de63e5cee54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.3646410 Nov 24 13:55:33.540772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.772562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:33.773453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:33.774102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:33.797376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:33.798298 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:33.798764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 2 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:33.835594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:33.836182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:33.836743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:33.868802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.874494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:33.874828 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:33.876976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 3 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:33.907335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:33.943744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 6fcd3d4f-4f61-4045-a830-e078bede82b0 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:55:33.960663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:33.963339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:33.963673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:33.964034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:33.966155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Network': ['ID=6fcd3d4f-4f61-4045-a830-e078bede82b0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:33.983390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:33.986628 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/networks/6fcd3d4f-4f61-4045-a830-e078bede82b0 HTTP/1.1" status: 204 len: 168 time: 2.2472062 Nov 24 13:55:34.002336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36096) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:34.017276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'network': {'name': 'tempest-network--676130789'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:34.021711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.022041 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.023432 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 4 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.037858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.042395 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 3.1410170 Nov 24 13:55:34.059418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36100) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:34.060613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:34.085168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '2441e8b3-69e3-4ea0-8cee-c04d978d3d93', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:34.092688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Usage tracker for resource:network and tenant:d5e5db1178c84db6bb49f66d53f08e95 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:34.101426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:34.107425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:34.112045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:34.113244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b47a3021-ab27-448e-bbc9-296c441891bc up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:34.117966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:34.118300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:34.118674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:34.121634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:34.123745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:34.138132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:34.145218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.145548 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.148115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 5 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.163428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Made reservation on behalf of d5e5db1178c84db6bb49f66d53f08e95 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:34.166341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.195914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:34.196250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:34.196581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:34.204424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.255874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.256142 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.258242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 6 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.311589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 851} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:34.366287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:34.366619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:34.366957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:34.373304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.373846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Added segment 55983519-960b-49d7-b972-043919809fb0 of type vlan for network b7dad99f-0c24-4652-b793-e1cdf6447347 Nov 24 13:55:34.388706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.390070 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.393548 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 7 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.440086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port b47a3021-ab27-448e-bbc9-296c441891bc completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:34.448119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:34.448679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:34.449163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:34.453089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.456126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b47a3021-ab27-448e-bbc9-296c441891bc triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:34.456906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.463917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.472338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.475595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.476166 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.478867 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 8 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.494393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:34.520558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.562904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:34.564260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:34.564978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:34.570215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f47ed2fe-0901-4249-bc44-ec6d91f4ec9e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:34.577099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-dd9db975-145c-4f39-bfa1-7fe79880910d tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:34.581798 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-dd9db975-145c-4f39-bfa1-7fe79880910d tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/networks?id=192cb388-42c9-4352-94b7-0d42c68d3b4b HTTP/1.1" status: 200 len: 812 time: 1.0921788 Nov 24 13:55:34.589508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:34.594222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.597206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:34.598365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.600412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Allocated IP 172.20.0.4 (a9f12bbb-ee13-42dd-8eed-cf94fa9dada5/8c839c3b-21dc-400b-8b56-739bd37025c8/b3bbfa33-7150-4f61-a354-9054fb0fbcda) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:34.606515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:34.623380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2441e8b3-69e3-4ea0-8cee-c04d978d3d93,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:34.626296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.626859 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.632478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.190s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:34.639356 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 9 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.657823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.658018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.661864 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.5960147 Nov 24 13:55:34.667331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36106) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:34.742689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.748534 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-a9c5b047-3408-4c00-bdb6-99c6a4ab6dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/quotas/cec6d7377f6a459a8b7de61e6d2b631f HTTP/1.1" status: 200 len: 375 time: 0.1067390 Nov 24 13:55:34.754197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.772553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:34.804132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '2441e8b3-69e3-4ea0-8cee-c04d978d3d93', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:34.829274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:34.829707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:34.830118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:34.832742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:34.839379 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.8360498 Nov 24 13:55:34.844843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36110) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:34.845361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port b47a3021-ab27-448e-bbc9-296c441891bc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b47a3021-ab27-448e-bbc9-296c441891bc,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:34.850731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Network': ['ID=b7dad99f-0c24-4652-b793-e1cdf6447347,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:34.853696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:34.871285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:34.871513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Request body: {'network': {'router:external': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:34.875039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:34.893625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:34.894573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:34.902775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:34.903198 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:34.947865 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 10 to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 Nov 24 13:55:34.973600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:35.013010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=b47a3021-ab27-448e-bbc9-296c441891bc,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:35.036068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b7dad99f-0c24-4652-b793-e1cdf6447347 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:35.037430 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c9ac2181-4ce8-45f7-a8f3-00622de7f755 req-64990d22-a280-4163-9c5c-f147767427c3 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.1701691 Nov 24 13:55:35.131365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:35.131724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:35.132171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:35.155157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:35.196079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.196673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.216310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:35.216649 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:35.217107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.396603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Pushing event updated for resources: {'Port': ['ID=a677b3cb-d318-4e97-9ba9-ad890cd016a2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:35.410553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.639s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:35.436525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.439588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:35.542623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:35.555155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:35.572944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:35.637207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62d9358e-c9f3-489d-80ff-de8ddf737a69,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:35.660033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:35.712782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-00bfaab8-247b-4720-8538-55e9087122ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.722150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.725788 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/62d9358e-c9f3-489d-80ff-de8ddf737a69 HTTP/1.1" status: 204 len: 168 time: 2.4597771 Nov 24 13:55:35.883459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 13:55:35.884684 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cc6c9fd1-d06f-4fd1-a754-dfc3ec7bbb64 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 1.2101827 Nov 24 13:55:35.886479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.891132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-eb15ef54-f798-4dd1-824f-441589b8000c tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Synchronizing usage tracker for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:35.908647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:35.935607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:35.992777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b47a3021-ab27-448e-bbc9-296c441891bc up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:36.004414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] For port b2feb838-0522-4e76-85fe-2e93f51e8cb7, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:36.004882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempted to set empty binding levels {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 13:55:36.008582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.029611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.053223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-360dfae0-860e-4ee0-bf16-60ae730fb3ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:36.102069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Network b7dad99f-0c24-4652-b793-e1cdf6447347 is not hosted by any dhcp agent {{(pid=83526) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:226}} Nov 24 13:55:36.117668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:36.120059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.132296 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "PUT /v2.0/networks/b7dad99f-0c24-4652-b793-e1cdf6447347 HTTP/1.1" status: 200 len: 857 time: 1.2845607 Nov 24 13:55:36.136204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36126) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:36.187802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.194567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b47a3021-ab27-448e-bbc9-296c441891bc triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:36.208384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.330531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-eb15ef54-f798-4dd1-824f-441589b8000c tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Unset dirty status for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:36.343569 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-eb15ef54-f798-4dd1-824f-441589b8000c tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=cec6d7377f6a459a8b7de61e6d2b631f&fields=id HTTP/1.1" status: 200 len: 348 time: 1.3603075 Nov 24 13:55:36.355283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] In _notify_port_updated(), no bound segment for port b2feb838-0522-4e76-85fe-2e93f51e8cb7 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:55:36.373242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.375151 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "PUT /v2.0/ports/b2feb838-0522-4e76-85fe-2e93f51e8cb7 HTTP/1.1" status: 200 len: 980 time: 5.1011918 Nov 24 13:55:36.412675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36130) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:36.468134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Transition to ACTIVE for port object b3bbfa33-7150-4f61-a354-9054fb0fbcda will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:36.565488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event updated for resources: {'Network': ['ID=b7dad99f-0c24-4652-b793-e1cdf6447347,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:36.569611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b21c6a57-a2b8-4ca1-bd15-8b458c6cff06 req-6cb80856-565a-46d2-91d0-11537fb1dc16 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.2157168 Nov 24 13:55:36.582856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.530s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:36.584068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.450s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:36.654289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.658716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36136) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:36.738590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.774168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.786003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.822155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:36.837738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=b2feb838-0522-4e76-85fe-2e93f51e8cb7,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:36.841154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:36.933247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Allocated IP 172.26.4.113 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/98ed9fbb-e948-4054-82c6-6deb00f91272) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:36.950896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:36.966062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Usage tracker for resource:security_group_rule and tenant:c6df6b567b4f41bbae8e245abf09b089 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:36.971740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:36.972134 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-18607e8c-c76a-4c72-8f61-00935c70993b service neutron] 10.222.0.70 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5904684 Nov 24 13:55:37.028427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:37.031132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.058723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.063873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a576f0aa-48aa-45b8-927f-de065976009a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:37.094680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.117798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:37.126662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b7dad99f-0c24-4652-b793-e1cdf6447347']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:37.165956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2441e8b3-69e3-4ea0-8cee-c04d978d3d93,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:37.168508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:37.172451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '55983519-960b-49d7-b972-043919809fb0') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:37.172744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '55983519-960b-49d7-b972-043919809fb0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:37.174405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e51e95de-d66b-4b40-ab9f-8682cb502591 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Synchronizing usage tracker for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:37.211960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.222906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.224100 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/2441e8b3-69e3-4ea0-8cee-c04d978d3d93 HTTP/1.1" status: 204 len: 168 time: 1.3111250 Nov 24 13:55:37.230694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36140) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:37.258881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.285536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Releasing vlan 851 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:37.286003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:37.413578 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:37.418292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.435849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:37.456594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.457931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network b7dad99f-0c24-4652-b793-e1cdf6447347 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:55:37.464026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.485820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] 10.222.0.70 "DELETE /v2.0/networks/b7dad99f-0c24-4652-b793-e1cdf6447347 HTTP/1.1" status: 204 len: 168 time: 1.3353965 Nov 24 13:55:37.487007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:37.491995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.495629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Pushing event deleted for resources: {'Network': ['ID=b7dad99f-0c24-4652-b793-e1cdf6447347,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:37.501425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:37.530765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:37.532923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e51e95de-d66b-4b40-ab9f-8682cb502591 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Unset dirty status for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:37.539323 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e51e95de-d66b-4b40-ab9f-8682cb502591 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 19370 time: 1.0845211 Nov 24 13:55:37.562266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-28ac5274-add7-4b6d-bf45-7dd23b5fcb0f tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] DELETE failed (client error): The resource could not be found. Nov 24 13:55:37.563105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-28ac5274-add7-4b6d-bf45-7dd23b5fcb0f tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:55:37.570188 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-28ac5274-add7-4b6d-bf45-7dd23b5fcb0f tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] 10.222.0.70 "DELETE /v2.0/subnets/29e6353d-0ae4-45f5-81f7-f5e9ed3c014f HTTP/1.1" status: 404 len: 337 time: 0.0766284 Nov 24 13:55:37.571716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36148) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:37.572153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36150) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:37.573101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:37.573718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:37.757003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eea0fa29-cb67-4ebf-a188-c2373a6fee2c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:37.772890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Deleting port b2feb838-0522-4e76-85fe-2e93f51e8cb7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:37.773323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:37.900780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:37.901652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:37.915436 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=c6df6b567b4f41bbae8e245abf09b089&name=default HTTP/1.1" status: 200 len: 2647 time: 1.2472131 Nov 24 13:55:37.916365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36158) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:37.972455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event updated for resources: {'Port': ['ID=b3bbfa33-7150-4f61-a354-9054fb0fbcda,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:37.992748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.929s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:38.034072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bbfac900-33b6-4bb9-8ebb-dd33f0d60ea0 None None] Provisioning for port b3bbfa33-7150-4f61-a354-9054fb0fbcda completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:38.040088 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-78b22a5a-ac4d-403e-a4fd-6bc7641d6476 service neutron] 10.222.0.70 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0481191 Nov 24 13:55:38.052659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bbfac900-33b6-4bb9-8ebb-dd33f0d60ea0 None None] Provisioning complete for port b3bbfa33-7150-4f61-a354-9054fb0fbcda triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:38.053292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bbfac900-33b6-4bb9-8ebb-dd33f0d60ea0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.143073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:38.144006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.271488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-90874c78-48f0-4229-b8c3-417388c25dd8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:38.291549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.333784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-bbfac900-33b6-4bb9-8ebb-dd33f0d60ea0 None None] Port b3bbfa33-7150-4f61-a354-9054fb0fbcda cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:38.353239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.420249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-90874c78-48f0-4229-b8c3-417388c25dd8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:38.421999 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-90874c78-48f0-4229-b8c3-417388c25dd8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 1.0698738 Nov 24 13:55:38.431425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.441349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36166) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:38.443747 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 6.4864295 Nov 24 13:55:38.473937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--763694038'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:38.480739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:38.512676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:38.622723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.641752 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e97bbd1e-76ad-43a0-81e3-fb1726e0b3fc req-2144a45f-7603-43d2-96c9-29ea020c53db tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1486702 Nov 24 13:55:38.677966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.696655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:38.767294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:38.840702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:38.861708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:38.869359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:38.984633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event updated for resources: {'Port': ['ID=98ed9fbb-e948-4054-82c6-6deb00f91272,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:38.994664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:38.999845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.062563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1bf8039-3202-401f-b470-05a7299bf0dd req-771171d3-26d4-4871-bec7-4be913cdb618 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:39.069562 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b1bf8039-3202-401f-b470-05a7299bf0dd req-771171d3-26d4-4871-bec7-4be913cdb618 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 931 time: 0.9793513 Nov 24 13:55:39.103488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] For port b2feb838-0522-4e76-85fe-2e93f51e8cb7, host hv-neutron-8181, got binding levels [] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:39.104087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.132317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.157919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.180981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:39.214962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.417032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:39.427780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:39.588428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Calling delete_port for b2feb838-0522-4e76-85fe-2e93f51e8cb7 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:39.681961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0f154df6-6b04-4807-adee-84221a46d1bb']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:39.696389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:39.730778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '307bf85f-6ea6-4d4f-8d0d-94793a3e3cac') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:39.730778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '307bf85f-6ea6-4d4f-8d0d-94793a3e3cac') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:39.814867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.823069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-42a0eb3a-80d9-4f69-bf62-e0daba410e70 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:55:39.824544 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-42a0eb3a-80d9-4f69-bf62-e0daba410e70 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.2251532 Nov 24 13:55:39.870969 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b1bf8039-3202-401f-b470-05a7299bf0dd req-5fc5c6fd-872d-4611-b0e4-e6694498cfe7 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7936158 Nov 24 13:55:39.893231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.916564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.923077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Releasing vlan 890 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:39.923479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:39.942391 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:39.966166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:39.976262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.022331 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b0acf3ad-aa92-4640-a14b-adc9b838411d req-fa79eda3-1175-40be-ade6-24c7f0314690 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1931975 Nov 24 13:55:40.029730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.055367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:40.145367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:40.155641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.163547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.176099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.179732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eea0fa29-cb67-4ebf-a188-c2373a6fee2c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:40.198262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:40.198985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:40.228609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.285101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Pushing event updated for resources: {'Port': ['ID=a677b3cb-d318-4e97-9ba9-ad890cd016a2,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:40.295806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.325079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.346429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.359250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d4f86f1e-c01d-4083-8ee0-d894dd13fa57,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:40.380111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:40.381377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79c874b6-3c5a-4af1-aabb-ceb4f879611b tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.205s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:40.448128 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] 10.222.0.70 "DELETE /v2.0/networks/0f154df6-6b04-4807-adee-84221a46d1bb HTTP/1.1" status: 204 len: 168 time: 2.8228269 Nov 24 13:55:40.449631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.458322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 2.0149143 Nov 24 13:55:40.487229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.488398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d2e93fc2-7ec0-4118-bd87-c3f5b0f000a4 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/eea0fa29-cb67-4ebf-a188-c2373a6fee2c HTTP/1.1" status: 204 len: 168 time: 2.3601236 Nov 24 13:55:40.489470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36202) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:40.490894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event deleted for resources: {'Port': ['ID=b2feb838-0522-4e76-85fe-2e93f51e8cb7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:40.502818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:40.513187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-240f73ac-4e43-49ed-ac3e-01142492b895 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': 'd4f86f1e-c01d-4083-8ee0-d894dd13fa57', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:40.513877 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-240f73ac-4e43-49ed-ac3e-01142492b895 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:40.514850 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-240f73ac-4e43-49ed-ac3e-01142492b895 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0168519 Nov 24 13:55:40.521689 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "DELETE /v2.0/ports/b2feb838-0522-4e76-85fe-2e93f51e8cb7 HTTP/1.1" status: 204 len: 168 time: 2.8994606 Nov 24 13:55:40.522340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.229s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:40.551451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36208) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:40.551811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36210) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:40.615676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Request body: {'port': {'device_id': 'af78c682-bb4f-46ed-a904-9540354133ba', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:40.683205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.628s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:40.688381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.693718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Pushing event deleted for resources: {'Network': ['ID=0f154df6-6b04-4807-adee-84221a46d1bb,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:40.701924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:40.720841 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-deee7a52-353f-4c2f-ad65-6e9439e6eb0f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:55:40.721757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-deee7a52-353f-4c2f-ad65-6e9439e6eb0f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Synchronizing usage tracker for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:40.781483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-deee7a52-353f-4c2f-ad65-6e9439e6eb0f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Unset dirty status for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:40.784438 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-deee7a52-353f-4c2f-ad65-6e9439e6eb0f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "GET /v2.0/ports/b2feb838-0522-4e76-85fe-2e93f51e8cb7 HTTP/1.1" status: 404 len: 333 time: 0.2155197 Nov 24 13:55:40.792667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36216) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:40.811376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-121109019', 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:40.822260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:40.829207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.856892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:40.903414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:40.939261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Made reservation on behalf of 266ef7dcf3394ff78002f75a07b4a9a1 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:40.946093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:41.050369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:41.058506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36226) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:41.206964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port 22f012ef-58ac-4d6f-8a83-1a1c6f44946a yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:41.389757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.47', 52471) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:41.498785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:41.625477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:41.767954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4f86f1e-c01d-4083-8ee0-d894dd13fa57,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:41.775307 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5427dd66-dc1c-4936-b428-f43f80daa0a5 req-aa083f52-224a-4816-af05-527efc6b87b3 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1307948 Nov 24 13:55:41.809062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:41.836045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:41.962002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-293ccd0e-dc4b-4fec-b176-437816747a01 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=30281dee68af4552a511789e5f1b3d06&name=default HTTP/1.1" status: 200 len: 2647 time: 0.9000778 Nov 24 13:55:41.972068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b3bbfa33-7150-4f61-a354-9054fb0fbcda {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 13:55:41.973918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36250) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:41.982639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-922088f3-3f0a-4aec-9d6c-ad42e5048256 req-c1112e10-0233-484b-8356-2300a700ad36 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:41.985177 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-922088f3-3f0a-4aec-9d6c-ad42e5048256 req-c1112e10-0233-484b-8356-2300a700ad36 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 931 time: 0.6046052 Nov 24 13:55:41.998298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.036234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.040856 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/d4f86f1e-c01d-4083-8ee0-d894dd13fa57 HTTP/1.1" status: 204 len: 168 time: 1.4847126 Nov 24 13:55:42.043838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36256) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:42.079690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Transition to ACTIVE for port object b3bbfa33-7150-4f61-a354-9054fb0fbcda will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:42.093532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.096980 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Floating IP 80df6b55-91e7-4ce4-ad2c-77c854a50731 associated. External IP: 172.26.4.36, port: ea9add32-f613-40a9-b5a1-b539c5657dc8. Nov 24 13:55:42.118805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-cd3aef13-1f5e-4df4-be9f-ec652e675b5b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:42.119523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-cd3aef13-1f5e-4df4-be9f-ec652e675b5b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Synchronizing usage tracker for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:42.187164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:42.241732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.345798 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-922088f3-3f0a-4aec-9d6c-ad42e5048256 req-662c4d25-ad0f-415e-a4ba-3ab5f035f488 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3023634 Nov 24 13:55:42.350950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-acbdf2de-7e42-4e9c-a967-b1e4289765de tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:42.372082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-cd3aef13-1f5e-4df4-be9f-ec652e675b5b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Unset dirty status for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:42.374074 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-cd3aef13-1f5e-4df4-be9f-ec652e675b5b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.47 "GET /v2.0/networks?id=192cb388-42c9-4352-94b7-0d42c68d3b4b HTTP/1.1" status: 200 len: 812 time: 0.9887309 Nov 24 13:55:42.375355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] It took 0.29 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:42.377965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-acbdf2de-7e42-4e9c-a967-b1e4289765de tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:42.379621 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acbdf2de-7e42-4e9c-a967-b1e4289765de tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.3095558 Nov 24 13:55:42.385162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36262) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:42.388388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Pushing event updated for resources: {'Port': ['ID=b3bbfa33-7150-4f61-a354-9054fb0fbcda,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:42.409874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36266) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:42.433784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--337408879'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:42.460287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:42.465937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3de4755-318e-450a-8bc1-e2f01f105a4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.508239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3de4755-318e-450a-8bc1-e2f01f105a4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.517433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:42.538543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:42.544605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.583090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.600155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-18692cf7-0f12-4d8c-a7d6-84ace284a0ab tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Synchronizing usage tracker for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:42.613473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d52a113-3ecc-4f84-ac8b-95b5401a3476 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:42.636208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.696515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-18692cf7-0f12-4d8c-a7d6-84ace284a0ab tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Unset dirty status for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:42.697992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-18692cf7-0f12-4d8c-a7d6-84ace284a0ab tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=cec6d7377f6a459a8b7de61e6d2b631f HTTP/1.1" status: 200 len: 379 time: 0.2870555 Nov 24 13:55:42.699236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:42.729964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:42.855067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-1656345045'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:42.870450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:42.875969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:network and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:42.880662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:42.890338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:42.935426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:42.939438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.056128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.159918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.239706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c125988e-2f6d-48e9-9428-997cb1bbbe18 req-02ca2634-74b2-4421-bec4-8e0b5fc935e8 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1739874 Nov 24 13:55:43.240560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event updated for resources: {'Port': ['ID=98ed9fbb-e948-4054-82c6-6deb00f91272,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:43.253568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:43.255912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.643s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:43.268436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:security_group_rule and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:43.272788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Attempting to bind port b3bbfa33-7150-4f61-a354-9054fb0fbcda on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:43.274411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:43.274953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Attempting to bind port b3bbfa33-7150-4f61-a354-9054fb0fbcda by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:43.275851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Attempting to bind port b3bbfa33-7150-4f61-a354-9054fb0fbcda on network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:43.278866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=22f012ef-58ac-4d6f-8a83-1a1c6f44946a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:43.308066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:43.311161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Port b3bbfa33-7150-4f61-a354-9054fb0fbcda on network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:43.311724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Attempting to bind port b3bbfa33-7150-4f61-a354-9054fb0fbcda on network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:43.316735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.317733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Network 25c95b38-7da1-4d5b-a600-feaf61be7793 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:43.318254 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 10.3417039 Nov 24 13:55:43.319439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.590s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:43.343144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:43.343859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Checking segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:43.344636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Bound using segment: {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:43.345886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Bound port: b3bbfa33-7150-4f61-a354-9054fb0fbcda, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5c305207-8a12-478f-bc44-f5b3813baa70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:43.346346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:43.346702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.349711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:43.371169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:43.374468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:43.375216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.463523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:43.466965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:43.474725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:43.564764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.573560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3de4755-318e-450a-8bc1-e2f01f105a4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.621639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.670316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:43.680309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3de4755-318e-450a-8bc1-e2f01f105a4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.685058 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f3de4755-318e-450a-8bc1-e2f01f105a4c admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/a30af0bf-d00a-41a9-bac5-40e772658925 HTTP/1.1" status: 204 len: 168 time: 1.7093492 Nov 24 13:55:43.698055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] For port b3bbfa33-7150-4f61-a354-9054fb0fbcda, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:43.705960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] For port b3bbfa33-7150-4f61-a354-9054fb0fbcda, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:43.713216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.725848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3de4755-318e-450a-8bc1-e2f01f105a4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a30af0bf-d00a-41a9-bac5-40e772658925,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:43.766146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 963 time: 2.9710495 Nov 24 13:55:43.780127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36288) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:43.808451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:43.824742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.826078 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 1.4096220 Nov 24 13:55:43.839993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36292) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:43.868614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6bafde40-8cee-4f96-bb06-af8ab284d504 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '44a2a2bc-9a20-498a-8df8-88a9a8bd8549', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:43.869305 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-6bafde40-8cee-4f96-bb06-af8ab284d504 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:43.873188 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6bafde40-8cee-4f96-bb06-af8ab284d504 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0236945 Nov 24 13:55:43.877249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36296) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:43.889723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=44a2a2bc-9a20-498a-8df8-88a9a8bd8549,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:43.907065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:43.918444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.239s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:43.918754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:43.922425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:43.923784 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] 10.222.0.47 "PUT /v2.0/ports/b3bbfa33-7150-4f61-a354-9054fb0fbcda HTTP/1.1" status: 200 len: 1093 time: 3.7497845 Nov 24 13:55:43.924301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:55:43.950607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14027ae-b3c1-4791-ac45-d32a4347159a req-6676abbc-2738-47ec-bc59-d488c46ef6b9 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:43.951424 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d14027ae-b3c1-4791-ac45-d32a4347159a req-6676abbc-2738-47ec-bc59-d488c46ef6b9 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 943 time: 0.3767800 Nov 24 13:55:43.966781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1b23c7ad-4516-4616-beb5-b1cfeff35049 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Synchronizing usage tracker for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:43.984350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Pushing event updated for resources: {'Port': ['ID=b3bbfa33-7150-4f61-a354-9054fb0fbcda,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:43.998333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:44.022304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.041474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.047205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:44.077384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1b23c7ad-4516-4616-beb5-b1cfeff35049 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Unset dirty status for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:44.078870 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1b23c7ad-4516-4616-beb5-b1cfeff35049 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "GET /v2.0/ports/22f012ef-58ac-4d6f-8a83-1a1c6f44946a HTTP/1.1" status: 200 len: 958 time: 0.2972696 Nov 24 13:55:44.095251 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d14027ae-b3c1-4791-ac45-d32a4347159a req-b90b08d7-2cc0-44f6-ae45-04853eb9165e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1331711 Nov 24 13:55:44.101183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36306) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:44.106995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 883} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:44.107131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.140922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-8dc7828c-66d9-4100-9dcf-33aceb3771e0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Synchronizing usage tracker for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:44.158343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b81981ad-4d83-41c2-8617-9abdfc592eb3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:44.162756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.165262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:44.181641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.181982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Added segment a71af3eb-5c71-482f-abbe-b95985671d7d of type vlan for network 6f791889-bb28-41c6-bdd5-71e28ee97eae Nov 24 13:55:44.282098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Sync routers for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:44.313443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.321847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-8dc7828c-66d9-4100-9dcf-33aceb3771e0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Unset dirty status for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:44.322090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:44.323419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:44.329274 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-8dc7828c-66d9-4100-9dcf-33aceb3771e0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--1560843332&fields=id&tenant_id=a6e6213b81eb4772a787ef2b41ed785b HTTP/1.1" status: 200 len: 267 time: 0.4085920 Nov 24 13:55:44.362458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Deleting port 22f012ef-58ac-4d6f-8a83-1a1c6f44946a {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:44.362758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.450924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.457256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:44.457944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.489011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.497689 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'status': 'completed', 'code': 200} Nov 24 13:55:44.522441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-431875ac-305c-4158-a2ba-c761f3324a7a tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:44.552873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=44a2a2bc-9a20-498a-8df8-88a9a8bd8549,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:44.563553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:44.575996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d1270b84-99a2-4cf8-914b-3ca5c18c9fe0 tempest-ExternalNetworksTestJSON-2047436222 tempest-ExternalNetworksTestJSON-2047436222-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:44.595061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae862812-c607-474b-b01f-961414e23aa1 req-fd08ca0c-4411-4c26-93b6-00195a1c7bd3 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:44.595737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-fd08ca0c-4411-4c26-93b6-00195a1c7bd3 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Synchronizing usage tracker for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:44.596414 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 2.2088201 Nov 24 13:55:44.602246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.603069 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/44a2a2bc-9a20-498a-8df8-88a9a8bd8549 HTTP/1.1" status: 204 len: 168 time: 0.7223125 Nov 24 13:55:44.604977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36320) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:44.609029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36322) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:44.618604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'subnet': {'network_id': '6f791889-bb28-41c6-bdd5-71e28ee97eae', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:44.636483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36328) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:44.726980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:44.729075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-fd08ca0c-4411-4c26-93b6-00195a1c7bd3 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Unset dirty status for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:44.736422 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-fd08ca0c-4411-4c26-93b6-00195a1c7bd3 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 811 time: 0.4058995 Nov 24 13:55:44.767409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Router 2a5d4c0d-28ee-4bd1-84a1-38649345f24d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:55:44.811541 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-7e236bcc-f46f-4e4d-884d-43ce11e74b0f tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/quotas/a6e6213b81eb4772a787ef2b41ed785b HTTP/1.1" status: 200 len: 375 time: 0.0739570 Nov 24 13:55:44.817189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-426625c2-be76-4aa3-aa74-7e69374a820c req-f13e7ca5-abd9-4f7a-b8a3-1e8938471d6a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1723387 Nov 24 13:55:44.834242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:44.846329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Network': ['ID=6f791889-bb28-41c6-bdd5-71e28ee97eae,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:44.853421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:44.861995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.286s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:44.890407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:subnet and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:44.899654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:44.902918 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ac984c04-f1a7-4030-afba-fb2a15c8be6d admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=d5e5db1178c84db6bb49f66d53f08e95&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2605596 Nov 24 13:55:44.903568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36332) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:44.904423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:44.922337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b5ca780c-e281-4632-86de-450ff4a4c44a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:44.973141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:44.989508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Calling delete_port for 22f012ef-58ac-4d6f-8a83-1a1c6f44946a owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:45.018444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:45.041953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b5ca780c-e281-4632-86de-450ff4a4c44a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:45.046959 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b5ca780c-e281-4632-86de-450ff4a4c44a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.4358354 Nov 24 13:55:45.049146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36336) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.054606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--97465930'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.065773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:45.087650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:45.098745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.117128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe3d749f-b127-4c9c-9f99-4454d377d6b5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:45.144974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.178467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event deleted for resources: {'Port': ['ID=22f012ef-58ac-4d6f-8a83-1a1c6f44946a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:45.181896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.184569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:45.195564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.211245 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "DELETE /v2.0/ports/22f012ef-58ac-4d6f-8a83-1a1c6f44946a HTTP/1.1" status: 204 len: 168 time: 1.1089835 Nov 24 13:55:45.224032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36342) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.226799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:21Z', 'revision_number': 2, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:45.232637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Checking router: 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:55:45.233300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Updating router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:55:45.236480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:45.239738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-417f6c3b-773b-483e-bb61-9778a4bbe4c2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Synchronizing usage tracker for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:45.247563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.304125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.307710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:45.320747 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-2b0daf47-aee6-44ca-9783-0e837c67ef75 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:55:45.321379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2b0daf47-aee6-44ca-9783-0e837c67ef75 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Synchronizing usage tracker for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:45.328839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:45.338653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:45.412262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.413264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2b0daf47-aee6-44ca-9783-0e837c67ef75 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Unset dirty status for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:45.416368 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2b0daf47-aee6-44ca-9783-0e837c67ef75 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "GET /v2.0/ports/22f012ef-58ac-4d6f-8a83-1a1c6f44946a HTTP/1.1" status: 404 len: 333 time: 0.1886802 Nov 24 13:55:45.424061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36346) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.438451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-417f6c3b-773b-483e-bb61-9778a4bbe4c2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Unset dirty status for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:45.440206 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-417f6c3b-773b-483e-bb61-9778a4bbe4c2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.6116755 Nov 24 13:55:45.441044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Request body: {'port': {'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1030324252'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.448342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:45.476601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:45.501904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Request body: {'port': {'device_id': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'admin_state_up': True, 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'security_groups': ['ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.527195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.546135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.556488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b83b202-b582-49dd-9cc8-8e79117eef42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:45.564107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Made reservation on behalf of 266ef7dcf3394ff78002f75a07b4a9a1 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:45.566572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.694086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7e357e-cbbf-439c-9afb-4dc4060cd59b req-a41a7117-9e40-4cf3-b1de-24570d4a6f65 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:45.695698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3a7e357e-cbbf-439c-9afb-4dc4060cd59b req-a41a7117-9e40-4cf3-b1de-24570d4a6f65 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 943 time: 0.3407614 Nov 24 13:55:45.715164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d6fda406-1c68-4677-89d7-bf8fc96371d7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:45.721319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:45.757376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.771368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:45.776250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Transition to ACTIVE for port object 7cb017e9-125d-45ba-8dd7-703fb83b1b7e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:45.787716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.789426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.793642 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 0.7406130 Nov 24 13:55:45.794966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:45.800105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36350) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.848906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bd8637b4-789a-48d2-a192-d0d079f30de2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': 'd6fda406-1c68-4677-89d7-bf8fc96371d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.849846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-bd8637b4-789a-48d2-a192-d0d079f30de2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:45.854674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd8637b4-789a-48d2-a192-d0d079f30de2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0400879 Nov 24 13:55:45.862151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36354) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.883859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7a0eba51-edab-4bee-8dd0-e26b37ca6fe0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': 'd6fda406-1c68-4677-89d7-bf8fc96371d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.885996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-7a0eba51-edab-4bee-8dd0-e26b37ca6fe0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:45.889640 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7a0eba51-edab-4bee-8dd0-e26b37ca6fe0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0238762 Nov 24 13:55:45.892791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36360) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.913996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:45.920508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e387d9e9-2988-40d6-a4a7-cb5723bde69d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': 'd6fda406-1c68-4677-89d7-bf8fc96371d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.921247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-e387d9e9-2988-40d6-a4a7-cb5723bde69d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:45.924888 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e387d9e9-2988-40d6-a4a7-cb5723bde69d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0271351 Nov 24 13:55:45.933039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36364) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.937424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce5e86b-0c92-4113-9557-66792d70f5ca None None] Pushing event updated for resources: {'Port': ['ID=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:45.940509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7ce5e86b-0c92-4113-9557-66792d70f5ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:45.955368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:45.975097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dc4c6dad-e021-4148-a820-6eed0dff2e26 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': 'd6fda406-1c68-4677-89d7-bf8fc96371d7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:45.975950 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-dc4c6dad-e021-4148-a820-6eed0dff2e26 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:45.979594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dc4c6dad-e021-4148-a820-6eed0dff2e26 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0316367 Nov 24 13:55:45.990589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:45.997543 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-e956a0d9-d657-4d03-b7f4-23df3a2cdd29 service neutron] 10.222.0.70 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5259233 Nov 24 13:55:46.029923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ba166b3-ab40-4d59-9ee4-796643b8e379,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:46.050603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Attempting to bind port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:46.051446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Attempting to bind port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:46.052368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Attempting to bind port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e on network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:46.052803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:46.067021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:46.079876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:46.080286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Checking segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:46.080701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.081344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Bound using segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:46.081714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Bound port: 7cb017e9-125d-45ba-8dd7-703fb83b1b7e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:46.082105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.092548 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76e99628-3092-43b1-add2-4c5076627856 req-adb9fb04-5865-4905-9f67-a53e5225e94d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 1096 time: 0.5625269 Nov 24 13:55:46.096425 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3a7e357e-cbbf-439c-9afb-4dc4060cd59b req-6dd12833-9c8d-4868-8fbd-6cb0802574d8 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3892097 Nov 24 13:55:46.097414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:46.219662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] For port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:46.222857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] For port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:46.229180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.234189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:46.235195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.237302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/8ba166b3-ab40-4d59-9ee4-796643b8e379 HTTP/1.1" status: 204 len: 168 time: 1.3280554 Nov 24 13:55:46.269613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:46.281545 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] Sync routers for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:46.293026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Made reservation on behalf of cec6d7377f6a459a8b7de61e6d2b631f for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:46.296383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.303102 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:46.304506 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:46.373185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce5e86b-0c92-4113-9557-66792d70f5ca None None] Pushing event updated for resources: {'Port': ['ID=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:46.375928 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a273ba0d-8e04-40fd-8b07-bfa18f03c121 req-a487e919-49e8-4d52-b6ce-2dbef4e59e15 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1065445 Nov 24 13:55:46.397221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7ce5e86b-0c92-4113-9557-66792d70f5ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:46.404436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.467676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.486861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:46.487905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:46.513954 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:46.529988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f8a8180d-d563-4129-9573-bedbe6c29ae2 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:46.539309 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:46.540190 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:46.576298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.641359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.658343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4799f15a-707f-484b-8ca1-5128fe377887 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:46.686176 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:46.686592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd8c6032-d6e2-4223-9b71-fa2cba75cf05 None None] The sync data for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:46.727964 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-c453791c-3b0b-4ca5-a810-f853ff2a1afa service neutron] 10.222.0.70 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7191031 Nov 24 13:55:46.728687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.830084 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 987 time: 16.6634848 Nov 24 13:55:46.840829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Allocated IP 172.20.0.10 (192cb388-42c9-4352-94b7-0d42c68d3b4b/fdef5004-cb01-46c8-ad07-7ca2196a0189/86d44079-75ac-4666-8917-6680359065f3) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:46.843791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36378) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:46.855780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Subnet': ['ID=d79c3e0a-e48a-43fd-b2f3-134c860e3935,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:46.866146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.335s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:46.881287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:55:46.883119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:46.907863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e99628-3092-43b1-add2-4c5076627856 req-7eca6a6f-3c9d-4a0a-b7f0-dd02d1b01976 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:46.909772 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76e99628-3092-43b1-add2-4c5076627856 req-7eca6a6f-3c9d-4a0a-b7f0-dd02d1b01976 service neutron] 10.222.0.47 "GET /v2.0/networks?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&shared=False HTTP/1.1" status: 200 len: 907 time: 0.7958558 Nov 24 13:55:46.941442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Network 25c95b38-7da1-4d5b-a600-feaf61be7793 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:46.956885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=d23ea8fb-94a8-48c7-98a7-d5291a7d7f42,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:46.964310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:46.966842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:46.971860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:46.973128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:46.974952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.009849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Checking segment: {'id': 'a71af3eb-5c71-482f-abbe-b95985671d7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6f791889-bb28-41c6-bdd5-71e28ee97eae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:47.010743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network hostable DHCP agents. Network: 6f791889-bb28-41c6-bdd5-71e28ee97eae, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:55:47.053770 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-424bd815-dafa-4c3e-b85c-5163439fd9a1 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] 10.222.0.70 "GET /v2.0/floatingips/80df6b55-91e7-4ce4-ad2c-77c854a50731 HTTP/1.1" status: 200 len: 982 time: 0.2083111 Nov 24 13:55:47.060352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36384) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:47.149032 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 1.7172658 Nov 24 13:55:47.173381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36396) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:47.186598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:47.267341 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e194a867-6590-496e-8663-86149aba01dd req-56d32c26-c861-4145-a78c-6a0b16c30082 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 210 time: 0.1217303 Nov 24 13:55:47.297746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.353602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:47.462926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d6fda406-1c68-4677-89d7-bf8fc96371d7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:47.497578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:47.499153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:47.558687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.563214 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/d6fda406-1c68-4677-89d7-bf8fc96371d7 HTTP/1.1" status: 204 len: 168 time: 1.5654185 Nov 24 13:55:47.570592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e99628-3092-43b1-add2-4c5076627856 req-2c395b76-2946-4f3c-87f6-69c4ab8b036b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:47.572141 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76e99628-3092-43b1-add2-4c5076627856 req-2c395b76-2946-4f3c-87f6-69c4ab8b036b service neutron] 10.222.0.47 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.6553302 Nov 24 13:55:47.572606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36410) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:47.572735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.581668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6f791889-bb28-41c6-bdd5-71e28ee97eae) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:47.586559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:46Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:47.598458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.606771 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69f2ebaa-98c9-4ae6-a0b2-871ba5ed5f8f None None] The sync data for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv is: [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:46Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:47.608358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20115f90-85ff-4130-82e7-a8f7e9310b68 None None] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:47.621522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:47.622120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.632136 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cad55c0d-593c-4ca9-9adf-70db07e6d926 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] 10.222.0.70 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 2904 time: 0.5670488 Nov 24 13:55:47.639153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.644937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36414) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:47.827391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Transition to ACTIVE for port object 86d44079-75ac-4666-8917-6680359065f3 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:47.837941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6cba174d-91f2-4bf6-a371-1a4aaeb946a5 req-6f91a688-b66c-4e5a-a2f9-b3ddcb8a611c tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Synchronizing usage tracker for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:47.888841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6cba174d-91f2-4bf6-a371-1a4aaeb946a5 req-6f91a688-b66c-4e5a-a2f9-b3ddcb8a611c tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Unset dirty status for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:47.890019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6cba174d-91f2-4bf6-a371-1a4aaeb946a5 req-6f91a688-b66c-4e5a-a2f9-b3ddcb8a611c tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.2039704 Nov 24 13:55:47.916964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:47.923060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d316a7eb-08d7-4c41-b4c1-1ad6a2f9f635 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:47.951624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 3.3411167 Nov 24 13:55:47.960989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36424) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:48.115531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:48.129244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:48.134774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:48.167471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7cb017e9-125d-45ba-8dd7-703fb83b1b7e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:48.233479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting port a677b3cb-d318-4e97-9ba9-ad890cd016a2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:48.233848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:48.249612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event updated for resources: {'Port': ['ID=86d44079-75ac-4666-8917-6680359065f3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:48.258520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:48.330193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:48.330851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:48.338224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b73cf0e-845f-45f0-8069-723946791ac1 None None] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:48.362885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-159916502', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:48.382194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.8962474 Nov 24 13:55:48.385452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:48.393698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Request body: {'port': {'device_id': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:48.398823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:router and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:48.533293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:48.580231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:48.650733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3cbcfef-8239-4c34-afb6-349eddc85337 req-4b3aa343-234d-4edc-ace4-925e4ebe3c0f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:48.651902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-f3cbcfef-8239-4c34-afb6-349eddc85337 req-4b3aa343-234d-4edc-ace4-925e4ebe3c0f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Synchronizing usage tracker for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:48.678204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:48.714761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:48.714985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:48.718190 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-58512ad4-4135-4301-bc51-0e1bcaa6ffe6 req-9315d99e-35ac-4881-98d4-0c19083686f5 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 210 time: 0.1181548 Nov 24 13:55:48.751801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:48.825116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d5426f9-19a6-48e0-ae31-8de1912d19f5 None None] Provisioning for port 86d44079-75ac-4666-8917-6680359065f3 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:48.836416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d5426f9-19a6-48e0-ae31-8de1912d19f5 None None] Provisioning complete for port 86d44079-75ac-4666-8917-6680359065f3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:48.836799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d5426f9-19a6-48e0-ae31-8de1912d19f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:48.940123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f5ecc15f-ac2b-4247-aee8-b5646638bb83 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:48.953531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:48.954484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.046253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6d5426f9-19a6-48e0-ae31-8de1912d19f5 None None] Port 86d44079-75ac-4666-8917-6680359065f3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:49.110285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.47', 52478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:49.147157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.187624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:49.199905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.203013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:49.253168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] device_id is not set on port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:49.351086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.351493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.384188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:49.401145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:49.545027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.566103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Calling delete_port for a677b3cb-d318-4e97-9ba9-ad890cd016a2 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:49.637926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-f3cbcfef-8239-4c34-afb6-349eddc85337 req-4b3aa343-234d-4edc-ace4-925e4ebe3c0f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Unset dirty status for tenant:8253655cf6fe49d7881f39cdb1344ce7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:49.647456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f3cbcfef-8239-4c34-afb6-349eddc85337 req-4b3aa343-234d-4edc-ace4-925e4ebe3c0f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 943 time: 2.1763475 Nov 24 13:55:49.710758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f5ecc15f-ac2b-4247-aee8-b5646638bb83 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:49.712366 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f5ecc15f-ac2b-4247-aee8-b5646638bb83 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 2.1354132 Nov 24 13:55:49.713791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Transition to ACTIVE for port object d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:49.733747 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-41702b13-2c97-4175-a19b-3f6f420892ec service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 1096 time: 2.0899405 Nov 24 13:55:49.734282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36450) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:49.752985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.785071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae862812-c607-474b-b01f-961414e23aa1 req-86cc126c-e425-4719-9290-5159b530080b tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:49.787127 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-86cc126c-e425-4719-9290-5159b530080b tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 811 time: 0.6754658 Nov 24 13:55:49.798603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 86d44079-75ac-4666-8917-6680359065f3 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 13:55:49.808478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6808e4f1-1085-4236-957e-1bf0541e55cb req-39074675-1e96-4dc3-b3af-04dfe7779abc tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:49.809946 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6808e4f1-1085-4236-957e-1bf0541e55cb req-39074675-1e96-4dc3-b3af-04dfe7779abc tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 932 time: 0.6185577 Nov 24 13:55:49.828998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.835525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--949024822'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:49.841869 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-2df7d354-daf6-44c6-b6a9-7279485d29a0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda HTTP/1.1" status: 200 len: 217 time: 0.0936272 Nov 24 13:55:49.858919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.860588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:49.862732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:49.877277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Transition to ACTIVE for port object 86d44079-75ac-4666-8917-6680359065f3 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:49.896010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:49.898162 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f3cbcfef-8239-4c34-afb6-349eddc85337 req-166b8dc4-8abf-4e17-8f6c-1351d2e3df95 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2496910 Nov 24 13:55:49.903140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-98353b17-edc7-4ab0-bd81-d9510cf10553 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:49.968009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-4da2d6c2-8e32-400e-8f08-c9c8c5674ee8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Synchronizing usage tracker for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:49.992535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:50.000627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6808e4f1-1085-4236-957e-1bf0541e55cb req-c0428102-9683-43b0-bd1e-81e6b98350c7 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1688235 Nov 24 13:55:50.020341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7cb017e9-125d-45ba-8dd7-703fb83b1b7e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:50.081593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ae862812-c607-474b-b01f-961414e23aa1 req-4da2d6c2-8e32-400e-8f08-c9c8c5674ee8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Unset dirty status for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:50.083560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-4da2d6c2-8e32-400e-8f08-c9c8c5674ee8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a6e6213b81eb4772a787ef2b41ed785b HTTP/1.1" status: 200 len: 380 time: 0.2721953 Nov 24 13:55:50.089912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Pushing event updated for resources: {'Port': ['ID=86d44079-75ac-4666-8917-6680359065f3,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:50.107100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:50.111353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Request body: {'port': {'device_id': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'admin_state_up': True, 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'security_groups': ['749ded37-2936-483e-baa9-fad3a456a1a6']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:50.194833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:50.195213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.216068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-6f0aa53e-2dd3-4dce-bc5d-eb00dadc386c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:50.217539 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-6f0aa53e-2dd3-4dce-bc5d-eb00dadc386c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=8c839c3b-21dc-400b-8b56-739bd37025c8 HTTP/1.1" status: 200 len: 845 time: 0.3116314 Nov 24 13:55:50.218320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.338942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36460) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:50.383485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:50.398742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:50.420323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=d23ea8fb-94a8-48c7-98a7-d5291a7d7f42,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:50.440677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.577s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:50.454253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Made reservation on behalf of a6e6213b81eb4772a787ef2b41ed785b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:50.457365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.504302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7186e67c-a99f-49e9-80a7-c8bf21a72efb req-f0a0abc4-6cad-4837-8975-1e00d224a5fa tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 210 time: 0.2907002 Nov 24 13:55:50.557703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-2088085313', 'router:external': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:50.564621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:50.566755 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Attempting to bind port 86d44079-75ac-4666-8917-6680359065f3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:50.567061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Attempting to bind port 86d44079-75ac-4666-8917-6680359065f3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:50.567409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Attempting to bind port 86d44079-75ac-4666-8917-6680359065f3 on network 192cb388-42c9-4352-94b7-0d42c68d3b4b {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:50.581402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:network and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:50.585973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:50.598071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:50.603640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Port 86d44079-75ac-4666-8917-6680359065f3 on network 192cb388-42c9-4352-94b7-0d42c68d3b4b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:50.604066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Attempting to bind port 86d44079-75ac-4666-8917-6680359065f3 on network 192cb388-42c9-4352-94b7-0d42c68d3b4b {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:50.611279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:50.611870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:50.611976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:50.629695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:50.632875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:50.633210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Checking segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:50.633739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Bound using segment: {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:50.634196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Bound port: 86d44079-75ac-4666-8917-6680359065f3, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '423ee2bc-a1dd-4d07-afe8-56278dd019a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:50.634534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.642482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:50.643052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Made reservation on behalf of 3872d6d57b1a42eb979825c2f5fab10d for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:50.645576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.647953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:50.654573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:50.654958 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:50.656930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.661558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:50.664014 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 2 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:50.685004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.703554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.704819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:50.742734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:50.743067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:50.743399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:50.760235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Port': ['ID=a677b3cb-d318-4e97-9ba9-ad890cd016a2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:50.764499 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-787d9f17-9635-4102-bfe2-14e8a01830c1 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.5219269 Nov 24 13:55:50.768563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:50.803168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Allocated IP 172.20.0.6 (7c23cefd-d4e1-4241-a3d2-42622a5131e3/d04c57a1-6813-42f8-932e-ab9506091c4e/75f93e3f-615e-466c-8cd6-bd38c07aa8a9) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:50.838604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:50.841071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:50.841395 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:50.851698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:security_group_rule and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:50.861011 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 3 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:50.866569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:50.886805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:50.889919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] For port 86d44079-75ac-4666-8917-6680359065f3, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:50.930979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] For port 86d44079-75ac-4666-8917-6680359065f3, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=86d44079-75ac-4666-8917-6680359065f3,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:50.952711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:50.960546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:51.103502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:51.103502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:51.103502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:51.157007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.158537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] 10.222.0.47 "PUT /v2.0/ports/86d44079-75ac-4666-8917-6680359065f3 HTTP/1.1" status: 200 len: 1094 time: 2.7695005 Nov 24 13:55:51.172876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'tag': '86d44079-75ac-4666-8917-6680359065f3'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:55:51.206453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.270496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:51.270929 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:51.281168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 4 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:51.315431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:51.315951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:51.316394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:51.322990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.338941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:51.339567 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:51.340002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Pushing event updated for resources: {'Port': ['ID=86d44079-75ac-4666-8917-6680359065f3,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:51.345679 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 5 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:51.349716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.389s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:51.373191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:51.398046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.408932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.438131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.454017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb8176-d7e5-4628-bd89-a6aeb7b1f4ab req-2fefdcf9-344a-4960-a021-a02529d15f38 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:51.456592 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50eb8176-d7e5-4628-bd89-a6aeb7b1f4ab req-2fefdcf9-344a-4960-a021-a02529d15f38 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 943 time: 0.3895402 Nov 24 13:55:51.464234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Transition to ACTIVE for port object 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:51.465527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.471052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:51.480912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:51.481248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:51.481590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:51.509076 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-bde97e2f-019f-4ef5-9ae3-8c084d2b45e9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=cec6d7377f6a459a8b7de61e6d2b631f&device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 1097 time: 0.2905803 Nov 24 13:55:51.512691 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-cb5105c0-57e3-4a9e-aadd-6c490d9c9bac service neutron] 10.222.0.47 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7235351 Nov 24 13:55:51.545149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=65b6a99c-c69b-4147-bc2f-26dc2a037d82,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:51.579915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:51.588229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:51.588910 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:51.593080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:55:51.599712 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 6 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:51.617470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0c40d6d-7345-4cf9-b746-0e768711c7b1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:51.620507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:51.640544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.640884 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Added segment b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0 of type vlan for network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e Nov 24 13:55:51.643580 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-b7c94705-7b5d-4621-8a92-9ab6b48c97cc service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=86d44079-75ac-4666-8917-6680359065f3 HTTP/1.1" status: 200 len: 217 time: 0.1148019 Nov 24 13:55:51.670204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.671305 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 1.9258871 Nov 24 13:55:51.677583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237b8b60-e938-43fc-b257-3eeff48317c0 req-1cdab0c1-7e1d-45cf-b839-81aae218cf58 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:51.679009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-237b8b60-e938-43fc-b257-3eeff48317c0 req-1cdab0c1-7e1d-45cf-b839-81aae218cf58 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 944 time: 0.4637156 Nov 24 13:55:51.686047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:51.693877 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50eb8176-d7e5-4628-bd89-a6aeb7b1f4ab req-f8722472-72e5-4824-9fe8-91329eecd4bd tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2246244 Nov 24 13:55:51.699386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:51.699731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:51.700277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:51.705054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-89d30190-b379-4adf-8a87-b2ef5fd24994 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:51.705708 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-89d30190-b379-4adf-8a87-b2ef5fd24994 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:51.710605 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-89d30190-b379-4adf-8a87-b2ef5fd24994 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0164816 Nov 24 13:55:51.714339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.730877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36482) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:51.736206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:51.783186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:51.783504 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:51.795910 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 7 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:51.877956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:51.896274 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'tag': '86d44079-75ac-4666-8917-6680359065f3', 'status': 'completed', 'code': 200} Nov 24 13:55:51.910476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:51.920633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:51.920889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:51.921219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:51.930323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:51.934746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.940559 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-e821e862-5301-479f-88d9-b94a4ba72f59 service neutron] 10.222.0.47 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4027269 Nov 24 13:55:51.946090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:51.950296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ba310d8a-30a2-424b-a57e-c1055bf9cd80 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:51.950457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.952119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-ba310d8a-30a2-424b-a57e-c1055bf9cd80 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fdef5004-cb01-46c8-ad07-7ca2196a0189 HTTP/1.1" status: 200 len: 851 time: 0.2993853 Nov 24 13:55:51.967057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:51.968692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:51.971066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event updated for resources: {'Port': ['ID=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:51.975157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:51.985434 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-237b8b60-e938-43fc-b257-3eeff48317c0 req-8070482d-d4d8-4d26-8a26-015369f75d99 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2941141 Nov 24 13:55:51.988342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:51.990257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:51.990737 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:51.992721 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 8 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:52.010726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:52.026549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:52.058926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:52.059556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:52.060113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:52.091415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:52.091746 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:52.094837 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 9 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:52.127202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:55:52.163903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:52.164229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:52.164566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:52.189330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:52.189520 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:52.193150 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempt 10 to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 Nov 24 13:55:52.202469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:52.203536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.216172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:52.218815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.110 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/3252a8a9-8979-468e-b728-319a92b95878) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:52.221576 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-60fa28b1-7b80-476d-914d-bc3cbfe83998 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.3736284 Nov 24 13:55:52.222477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36488) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.227919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:52.228252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:52.228585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempting to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:52.243889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.249449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cda9cec9-023a-4d6d-bd49-88d8606d9b75 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.250070 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-cda9cec9-023a-4d6d-bd49-88d8606d9b75 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:52.254295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cda9cec9-023a-4d6d-bd49-88d8606d9b75 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0179975 Nov 24 13:55:52.264970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36492) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.267105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:52.267981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.277036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.278981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-05f014c6-e4a1-47b1-8692-f33c7b30287f None None] Provisioning for port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:52.280573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f20576e-5ba2-418a-bf99-41f0d3dfc9fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:52.284546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:52.284894 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Failed to bind port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on host hv-neutron-8181 for vnic_type normal using segments [{'id': '034868c9-f7f3-491b-82ff-dba28a69eb0d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '25c95b38-7da1-4d5b-a600-feaf61be7793'}] Nov 24 13:55:52.285180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.294182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-05f014c6-e4a1-47b1-8692-f33c7b30287f None None] Provisioning complete for port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:52.295561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-05f014c6-e4a1-47b1-8692-f33c7b30287f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.300209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:52.376128 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-9ad8bd73-c364-4647-bf8c-a0d75bec1f49 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=192cb388-42c9-4352-94b7-0d42c68d3b4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4118614 Nov 24 13:55:52.387407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16300ec0-55fe-48f2-8ad5-3a94c6b2c0a8 req-8d754953-dced-4fb2-b268-defbbb2058f6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:52.388139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16300ec0-55fe-48f2-8ad5-3a94c6b2c0a8 req-8d754953-dced-4fb2-b268-defbbb2058f6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Synchronizing usage tracker for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:52.400188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-05f014c6-e4a1-47b1-8692-f33c7b30287f None None] Port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:55:52.410457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:52.420013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:52.432318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:52.466359 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3731921 Nov 24 13:55:52.485578 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 871 time: 2.1421096 Nov 24 13:55:52.496598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36496) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.498734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Request body: {'port': {'device_id': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.514494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'subnet': {'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.550626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:52.572003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:subnet and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:52.585499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Network': ['ID=50013eb6-6ef1-40a7-9bf6-6494180c6c4e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:52.592331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:52.595091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16300ec0-55fe-48f2-8ad5-3a94c6b2c0a8 req-8d754953-dced-4fb2-b268-defbbb2058f6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Unset dirty status for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:52.595398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16300ec0-55fe-48f2-8ad5-3a94c6b2c0a8 req-8d754953-dced-4fb2-b268-defbbb2058f6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 931 time: 0.5824583 Nov 24 13:55:52.597005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:52.603233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:55:52.618715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:52.620827 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:52.621848 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aff729ab-1266-4d69-9e28-604b1c030e92 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.3519516 Nov 24 13:55:52.630299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36500) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.646501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-039b93e4-af09-4dbb-8574-45a82387fecc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.647537 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-039b93e4-af09-4dbb-8574-45a82387fecc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:52.648672 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-039b93e4-af09-4dbb-8574-45a82387fecc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0153911 Nov 24 13:55:52.651887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.654186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.656055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] For port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:52.656585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Attempted to set empty binding levels {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 13:55:52.667538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Made reservation on behalf of 3872d6d57b1a42eb979825c2f5fab10d for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:52.670284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.688272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.698743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.701385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87c2f7ed-03b5-4682-aca1-b96c3bd60b1e tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:52.713536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:52.745825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:52.754854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:52.772079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:52.775367 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-16d36e26-575a-46cb-b30f-b50170b7c7c5 service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3802242 Nov 24 13:55:52.816509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16300ec0-55fe-48f2-8ad5-3a94c6b2c0a8 req-eadaaa75-80d1-466d-a56a-36afca2769cc tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2114735 Nov 24 13:55:52.827327 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Project bf36aba1c1a64f39996dc2ab4bfb8266 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 13:55:52.830701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:52.941073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:52.945622 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9fd0fb23-a4ce-4e50-a381-e56d62cc3f76 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2869809 Nov 24 13:55:52.949292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36510) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.969435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d781afe9-7972-46a5-ae40-790228bf843b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:52.970033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-d781afe9-7972-46a5-ae40-790228bf843b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:52.974775 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d781afe9-7972-46a5-ae40-790228bf843b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0138876 Nov 24 13:55:52.977228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36514) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:52.994098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:53.005002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:53.033443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:53.039154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:53.048987 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ab86850-87d0-4113-9003-991f2bb7cdcb req-5cf5a9f2-8029-428b-b6a4-d55d2e51e8ef service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2577255 Nov 24 13:55:53.049767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:53.058845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] In _notify_port_updated(), no bound segment for port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 on network 25c95b38-7da1-4d5b-a600-feaf61be7793 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:55:53.059942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.064480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "PUT /v2.0/ports/d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 HTTP/1.1" status: 200 len: 981 time: 5.8868816 Nov 24 13:55:53.066785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36520) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:53.076256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event updated for resources: {'Port': ['ID=d23ea8fb-94a8-48c7-98a7-d5291a7d7f42,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:53.086649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.385s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:53.153095 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Project bf36aba1c1a64f39996dc2ab4bfb8266 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 13:55:53.153359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.162641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:53.234536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Deleting port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:53.234880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.307300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:53.308998 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3e9c367-69ec-4b06-a4d0-84daddf4adc2 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.3305783 Nov 24 13:55:53.315123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36524) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:53.320570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:53.338404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '65b6a99c-c69b-4147-bc2f-26dc2a037d82', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:53.355246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:53.362588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:53.372293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=3252a8a9-8979-468e-b728-319a92b95878,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:53.372988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:53.377769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:53.377982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:53.394010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:53.413104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:53.425084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05d469f-877f-4a4e-a7de-8246b9940e39 req-45ebc9be-7542-4ef0-b93c-b39171e1b961 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:53.427472 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e05d469f-877f-4a4e-a7de-8246b9940e39 req-45ebc9be-7542-4ef0-b93c-b39171e1b961 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 943 time: 0.4458194 Nov 24 13:55:53.436955 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Project bf36aba1c1a64f39996dc2ab4bfb8266 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 13:55:53.449458 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-eb13109b-0aa0-4e5b-8ed0-a2ab9e60bab5 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=cec6d7377f6a459a8b7de61e6d2b631f&device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 1097 time: 0.3296485 Nov 24 13:55:53.467992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc5c2fd-bcf0-4a17-9cbb-ee34969e6b9a req-25ebe1a0-1bf2-4ab0-b212-39ee69d081ba tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:53.469411 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0cc5c2fd-bcf0-4a17-9cbb-ee34969e6b9a req-25ebe1a0-1bf2-4ab0-b212-39ee69d081ba tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 944 time: 0.3125281 Nov 24 13:55:53.528305 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:55:53.531926 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cfe25d48-0b6b-4539-a106-1916b920eca0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.2125862 Nov 24 13:55:53.535444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36528) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:53.652112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Router 2a5d4c0d-28ee-4bd1-84a1-38649345f24d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:55:53.697265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 13:55:53.772074 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e05d469f-877f-4a4e-a7de-8246b9940e39 req-9cc79fa3-5e08-4f2b-951c-740eafdf40a8 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3337314 Nov 24 13:55:53.803438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] For port d23ea8fb-94a8-48c7-98a7-d5291a7d7f42, host hv-neutron-8181, got binding levels [] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:53.803438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.805268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.812315 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0cc5c2fd-bcf0-4a17-9cbb-ee34969e6b9a req-f3b3ab3d-7c96-4fe3-b1e0-6d8d9b918220 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3201933 Nov 24 13:55:53.857552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Transition to ACTIVE for port object 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:55:53.859704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-b6f31f8f-2d8e-4617-964b-9986a8cba7a1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:53.861207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-b6f31f8f-2d8e-4617-964b-9986a8cba7a1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=192cb388-42c9-4352-94b7-0d42c68d3b4b HTTP/1.1" status: 200 len: 913 time: 0.4017265 Nov 24 13:55:53.865596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.871348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:53.993423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:53.999557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Calling delete_port for d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:54.001466 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-a3514627-9977-4ffb-86bd-265ca0acff00 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=86d44079-75ac-4666-8917-6680359065f3 HTTP/1.1" status: 200 len: 217 time: 0.1310191 Nov 24 13:55:54.140831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Pushing event updated for resources: {'Port': ['ID=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:54.148881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:54.150320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.226181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-209875a1-6915-4452-bb27-274e7c571241 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:54.228446 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-209875a1-6915-4452-bb27-274e7c571241 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fdef5004-cb01-46c8-ad07-7ca2196a0189 HTTP/1.1" status: 200 len: 851 time: 0.2132821 Nov 24 13:55:54.247985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.268480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:54.344704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.354213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:54.380955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b06db7b-385b-4168-8d57-5e4e4030779b req-016e43a8-bfb1-4088-8725-7bcd7be8ae6d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:54.383045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4b06db7b-385b-4168-8d57-5e4e4030779b req-016e43a8-bfb1-4088-8725-7bcd7be8ae6d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 943 time: 0.3529119 Nov 24 13:55:54.384157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Pushing event deleted for resources: {'Port': ['ID=d23ea8fb-94a8-48c7-98a7-d5291a7d7f42,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:54.390152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=65b6a99c-c69b-4147-bc2f-26dc2a037d82,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:54.396037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:54.397902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:54.398509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Attempting to bind port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:55:54.398814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Attempting to bind port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:55:54.399134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Attempting to bind port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 on network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:54.409602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.414064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/65b6a99c-c69b-4147-bc2f-26dc2a037d82 HTTP/1.1" status: 204 len: 168 time: 0.8462148 Nov 24 13:55:54.418024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36534) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:54.422511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 on network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:55:54.422511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Attempting to bind port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 on network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:55:54.432127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.453632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-c67a0c55-891d-4a62-a3c3-1cc386e6f1ad service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=192cb388-42c9-4352-94b7-0d42c68d3b4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1870718 Nov 24 13:55:54.456296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 55, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:55:54.456624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Checking segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:54.456999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Bound using segment: {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:55:54.457437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Bound port: 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '294894e1-7345-4c10-ab6b-ce6e04e017bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 877, 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:55:54.458451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.491168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "DELETE /v2.0/ports/d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 HTTP/1.1" status: 204 len: 168 time: 1.4163604 Nov 24 13:55:54.492243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.492941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.495296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36538) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:54.501657 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4b06db7b-385b-4168-8d57-5e4e4030779b req-bed40f1b-fe0c-49fc-8eeb-d0055a9196d6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1045663 Nov 24 13:55:54.651233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-a4499473-6981-4280-b38f-c269994e2330 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:55:54.651738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a4499473-6981-4280-b38f-c269994e2330 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Synchronizing usage tracker for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:54.726427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-df35b27a-3c12-4505-96f7-5abb306f5b36 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:54.749352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:55:54.749815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.758415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a4499473-6981-4280-b38f-c269994e2330 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Unset dirty status for tenant:266ef7dcf3394ff78002f75a07b4a9a1 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:54.759438 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4499473-6981-4280-b38f-c269994e2330 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] 10.222.0.70 "GET /v2.0/ports/d23ea8fb-94a8-48c7-98a7-d5291a7d7f42 HTTP/1.1" status: 404 len: 333 time: 0.2592206 Nov 24 13:55:54.762641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:54.764553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] For port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:55:54.771822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36542) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:54.779023 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-4027075c-67c6-40fb-8690-09eaf8f0dff6 service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3078587 Nov 24 13:55:54.801983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-df35b27a-3c12-4505-96f7-5abb306f5b36 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:54.803143 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-df35b27a-3c12-4505-96f7-5abb306f5b36 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.3823082 Nov 24 13:55:54.808042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36548) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:54.823825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--929678524'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:54.826018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] For port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:55:54.847464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:54.877898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Subnet': ['ID=29d8a545-ee5b-481a-85fe-598ef2379466,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:54.881314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:54.885215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:54.885379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.888210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:54.899471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] Sync routers for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:54.901863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:54.907389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:54.922398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:54.923035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:54.994546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:55.008105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:55.009071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:55.050698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.071221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:55.071619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04aa9f48-b6d1-4148-9549-66e822007783 None None] The sync data for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:55.090578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.112280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.113634 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] 10.222.0.47 "PUT /v2.0/ports/75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1093 time: 2.6267068 Nov 24 13:55:55.115445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:55:55.149196 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "DELETE /v2.0/floatingips/80df6b55-91e7-4ce4-ad2c-77c854a50731 HTTP/1.1" status: 204 len: 168 time: 7.4950955 Nov 24 13:55:55.162997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Checking segment: {'id': 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:55:55.163342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network hostable DHCP agents. Network: 50013eb6-6ef1-40a7-9bf6-6494180c6c4e, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:55:55.167567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36556) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:55.209336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:55.233767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:55.242826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:55.251883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:55.260227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Pushing event updated for resources: {'Port': ['ID=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:55.264192 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8cac433-70eb-44d0-add3-7be8a5869d4a req-0f68004b-f458-405d-827f-3ba47de9b142 service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4672399 Nov 24 13:55:55.265035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.358s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:55.268949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:55.297379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Usage tracker for resource:floatingip and tenant:261983d304094f0e9fff2de3d67d3b39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:55.301526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:55.308004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:55.309346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:55.317815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:55:55.343742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5acdaa07-3f6e-4354-9296-a10cbe05181a req-f93bfd00-cc72-4741-89fb-218d6b0d5219 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:55.345287 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5acdaa07-3f6e-4354-9296-a10cbe05181a req-f93bfd00-cc72-4741-89fb-218d6b0d5219 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 944 time: 0.3045318 Nov 24 13:55:55.352537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 50013eb6-6ef1-40a7-9bf6-6494180c6c4e) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:55.362171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80002295-4f90-4400-9b53-8e9d8713d4b2 None None] Network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:55.377545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:55.378059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.410038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.441610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.455173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff86fbc-4c54-42bf-b600-59ebf021990e req-eb030c61-8370-4ab2-84ee-6bc3fc568db9 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:55.456898 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ff86fbc-4c54-42bf-b600-59ebf021990e req-eb030c61-8370-4ab2-84ee-6bc3fc568db9 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 943 time: 0.4629192 Nov 24 13:55:55.486419 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.9864979 Nov 24 13:55:55.490749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['25c95b38-7da1-4d5b-a600-feaf61be7793']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:55.492342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.494232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36562) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:55.507471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-378812961', 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:55.512297 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5acdaa07-3f6e-4354-9296-a10cbe05181a req-0b281487-5a29-469b-869e-121b894886f5 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1563671 Nov 24 13:55:55.514412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.515492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:55.529350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:port and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:55.531932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:55.547981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:55.579825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:55.607238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2f139e97-0f9f-4575-81b4-e64582a4effa,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:55.612516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:55.613407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.619165 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.8077495 Nov 24 13:55:55.620494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36568) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:55.626638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '2f139e97-0f9f-4575-81b4-e64582a4effa', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:55.632038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:55:55.636336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Made reservation on behalf of 3872d6d57b1a42eb979825c2f5fab10d for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:55:55.638711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.649193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:55.651283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b07821fe-304f-43e4-948d-3d9f3ec89214 None None] Network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:55:55.659052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:55.663397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:55.674148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:55.681024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] device_id is not set on port dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:55:55.701961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'status': 'completed', 'code': 200} Nov 24 13:55:55.704560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '034868c9-f7f3-491b-82ff-dba28a69eb0d') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:55.704851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '034868c9-f7f3-491b-82ff-dba28a69eb0d') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:55.733203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.748068 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-2dc8b704-9458-488c-8bcb-8d772bb5524c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1096 time: 0.5794342 Nov 24 13:55:55.820486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.840413 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ff86fbc-4c54-42bf-b600-59ebf021990e req-a0d98059-085a-4d9b-a3f3-87552579e73f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3747432 Nov 24 13:55:55.843871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Releasing vlan 880 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:55:55.844266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:55:55.860784 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:55:55.867976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-dff46984-7174-4986-94f5-9f46453fb0d3 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 217 time: 0.1084354 Nov 24 13:55:55.975066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Allocated IP 172.20.0.4 (50013eb6-6ef1-40a7-9bf6-6494180c6c4e/29d8a545-ee5b-481a-85fe-598ef2379466/dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:55.988144 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The resource could not be found. Nov 24 13:55:55.989431 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-95f69915-9645-4679-8d16-1610bee2ebb0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.3673532 Nov 24 13:55:55.994317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36576) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:56.011480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '2f139e97-0f9f-4575-81b4-e64582a4effa', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': '539c7a21-3992-4bf6-822c-e64c26e3c78b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:56.022421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:56.028880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:56.033385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.035848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:56.040168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae862812-c607-474b-b01f-961414e23aa1 req-4700cd3b-ed36-42f5-821f-69dddcd44883 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:56.041610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-4700cd3b-ed36-42f5-821f-69dddcd44883 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.1594028 Nov 24 13:55:56.055580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:56.104071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:56.109775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f12c209a-b0d3-4ac7-a727-34694638e768 req-35de96d1-435c-426e-a26b-a18e91935255 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:56.111382 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f12c209a-b0d3-4ac7-a727-34694638e768 req-35de96d1-435c-426e-a26b-a18e91935255 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 943 time: 0.2555280 Nov 24 13:55:56.128394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.148211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Pushing event deleted for resources: {'Network': ['ID=25c95b38-7da1-4d5b-a600-feaf61be7793,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:56.158149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device b3bbfa33-7150-4f61-a354-9054fb0fbcda details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 13:55:56.159747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:56.164588 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] 10.222.0.70 "DELETE /v2.0/networks/25c95b38-7da1-4d5b-a600-feaf61be7793 HTTP/1.1" status: 204 len: 168 time: 1.3872838 Nov 24 13:55:56.171848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.245397 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The resource could not be found. Nov 24 13:55:56.246440 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7d4e829d-a143-4c6b-9f7d-f6119aa58fdb tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.2494512 Nov 24 13:55:56.254261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36582) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:56.290050 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f12c209a-b0d3-4ac7-a727-34694638e768 req-52347e02-e036-4a56-ac85-eb251c2337fc tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1687696 Nov 24 13:55:56.385743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port b3bbfa33-7150-4f61-a354-9054fb0fbcda, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:56.390940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.394344 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-2d6c9876-9513-412b-83c7-12443f9c169f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3407099 Nov 24 13:55:56.408219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:55:56.414316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'port_id': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'mac_address': 'fa:16:3e:c9:8e:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 13:55:56.418890 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:55:56.450329 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:56.451368 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:56.452219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.453491 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 8.4746704 Nov 24 13:55:56.460441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36586) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:56.509546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.530002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b3bbfa33-7150-4f61-a354-9054fb0fbcda {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 13:55:56.535013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Allocated IP 172.26.4.59 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/82a55e3e-ad06-422d-8bc5-282bc743e5b2) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:55:56.543300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.552404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port b3bbfa33-7150-4f61-a354-9054fb0fbcda, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:56.560938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.562872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7ce5e86b-0c92-4113-9557-66792d70f5ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:56.564249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.578494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:56.594284 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:56.616559 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:55:56.617474 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:56.651838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=b3bbfa33-7150-4f61-a354-9054fb0fbcda,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:56.655527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:56.676406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Port': ['ID=dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:56.682724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:56.693087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:56.696912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:56.704730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.705303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:56.730096 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:55:56.730749 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63d757e0-6397-44e4-bcd7-a53b02079fa8 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:55:56.733331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-08bb06b9-50ed-436d-a3a2-61de8507ac7d service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3282936 Nov 24 13:55:56.824067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:56.850145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:56.850745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:56.877265 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1022 time: 1.3785954 Nov 24 13:55:56.877466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36600) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:56.918378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['b3bbfa33-7150-4f61-a354-9054fb0fbcda'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 13:55:57.029643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.044369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:57.080808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f139e97-0f9f-4575-81b4-e64582a4effa,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:57.105530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:57.126292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.153856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting port dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:55:57.154932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.163397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.166893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/2f139e97-0f9f-4575-81b4-e64582a4effa HTTP/1.1" status: 204 len: 168 time: 0.9078803 Nov 24 13:55:57.169514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36608) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:57.172408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae862812-c607-474b-b01f-961414e23aa1 req-6225ad99-27fe-490e-a10b-2234e79b84fb service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3850517 Nov 24 13:55:57.205850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829f0b52-467a-4748-b8b4-cc88c32c146d req-70a65d38-cedc-4bf5-aed2-40c0bd90feff tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:57.207303 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-829f0b52-467a-4748-b8b4-cc88c32c146d req-70a65d38-cedc-4bf5-aed2-40c0bd90feff tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 944 time: 0.4220710 Nov 24 13:55:57.313310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.319606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:57.367901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-93496482-bb07-4023-a1bf-77bee614c454 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:55:57.406506 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-88bae0ad-80c4-4698-9888-7b013af04967 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=b2e6bfd3378b4b6ea010c8a84f8ef289&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5789473 Nov 24 13:55:57.411544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36614) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:57.421236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98cf290-f120-4ec4-b5ee-55f7c29e6e9d req-f8a2ae8e-7bf3-4833-ba34-25e6f07be840 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:57.422685 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e98cf290-f120-4ec4-b5ee-55f7c29e6e9d req-f8a2ae8e-7bf3-4833-ba34-25e6f07be840 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 944 time: 0.3727269 Nov 24 13:55:57.423595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:55:57.430756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:55:57.434377 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-829f0b52-467a-4748-b8b4-cc88c32c146d req-92231263-44cb-4591-899d-1ff0b12c191d tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2163677 Nov 24 13:55:57.435058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:55:57.464949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Pushing event updated for resources: {'Port': ['ID=82a55e3e-ad06-422d-8bc5-282bc743e5b2,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:57.469752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-93496482-bb07-4023-a1bf-77bee614c454 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:55:57.476467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-93496482-bb07-4023-a1bf-77bee614c454 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.2976859 Nov 24 13:55:57.478715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36618) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:57.487614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '9a27e23d-86e8-489a-927c-0a07c7b77c4c', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:57.501736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:57.515284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.515653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.516046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.516404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.516753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.517094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.517444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.517788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.518263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.518610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.518954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:57.528413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:57.532849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:57.539038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:57.550256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:57.559095 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-3ac40585-d8b9-46c4-8b52-fdcd34931e91 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1096 time: 0.3119938 Nov 24 13:55:57.682254 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e98cf290-f120-4ec4-b5ee-55f7c29e6e9d req-9c11c545-250d-4c04-ab30-cc6ba958f5ee tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2423460 Nov 24 13:55:57.713067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.768449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.789613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.822353 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The resource could not be found. Nov 24 13:55:57.823501 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9eb31bf3-edaa-4259-ad8e-a94f133422c8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.3448029 Nov 24 13:55:57.829201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36622) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:57.843586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--1910747997'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:57.859709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:57.914435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Calling delete_port for dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:55:57.939118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:57.979726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fac619ea-33f1-4a42-ad0a-92387dfa7911 req-26ed46a0-3aff-472c-be16-2cca3acf7d5c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:57.981188 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fac619ea-33f1-4a42-ad0a-92387dfa7911 req-26ed46a0-3aff-472c-be16-2cca3acf7d5c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 943 time: 0.4168262 Nov 24 13:55:57.982100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8993919b-9595-46ca-ba23-2d6431df7975 req-149bed00-3633-4f94-9223-9eea87c63acd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:57.983287 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-149bed00-3633-4f94-9223-9eea87c63acd service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.3871694 Nov 24 13:55:57.986170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:57.987143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.076857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.093796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f28440f-7004-43dc-b069-a864a856a7cd tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:58.125207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-f76c12cb-fd7a-4cf5-b799-c09f60936af0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 217 time: 0.1279471 Nov 24 13:55:58.134026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 86d44079-75ac-4666-8917-6680359065f3 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 13:55:58.173015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device b3bbfa33-7150-4f61-a354-9054fb0fbcda up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:55:58.179844 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=368f3608-0ff1-4cdf-887d-ca349ba37c31,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:58.191904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:58.199022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.218725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.221243 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/368f3608-0ff1-4cdf-887d-ca349ba37c31 HTTP/1.1" status: 204 len: 168 time: 0.8073626 Nov 24 13:55:58.256691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.274575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:58.280442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3bf1ef72-8ae0-4f54-8964-4158243b77f5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:58.296334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fac619ea-33f1-4a42-ad0a-92387dfa7911 req-6ef839ba-a5d5-4d26-8e1c-cc1e44626db2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2470706 Nov 24 13:55:58.302097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8993919b-9595-46ca-ba23-2d6431df7975 req-8e043011-bdca-4060-846a-151f2e4aefd0 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:58.303707 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-8e043011-bdca-4060-846a-151f2e4aefd0 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.1686890 Nov 24 13:55:58.318656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:58.376582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:58.385844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 86d44079-75ac-4666-8917-6680359065f3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=86d44079-75ac-4666-8917-6680359065f3,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:58.389151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:58.419190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '86d44079-75ac-4666-8917-6680359065f3', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'port_id': '86d44079-75ac-4666-8917-6680359065f3', 'mac_address': 'fa:16:3e:bb:5e:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 896, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 13:55:58.467343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event deleted for resources: {'Port': ['ID=dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:58.468690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port b3bbfa33-7150-4f61-a354-9054fb0fbcda completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:55:58.484100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port b3bbfa33-7150-4f61-a354-9054fb0fbcda triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:55:58.484897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.519221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.520210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.520210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.520523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.520844 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.521116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.521541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.521939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.522264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.522566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.522891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:55:58.533112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:58.549095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.550955 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/ports/dd8b9a9d-6cc5-401c-8e34-b2f097e3ec98 HTTP/1.1" status: 204 len: 168 time: 1.6726172 Nov 24 13:55:58.560206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36632) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:58.570144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e', 'external_fixed_ips': [{'subnet_id': '29d8a545-ee5b-481a-85fe-598ef2379466', 'ip_address': '172.20.0.4'}]}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:58.580829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:58.592003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:router and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:58.600287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:58.601204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.620380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:58.664735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.676368 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-41125a91-eb1e-4429-885c-dc19c902c217 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3540437 Nov 24 13:55:58.682486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.708479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 86d44079-75ac-4666-8917-6680359065f3 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 13:55:58.708671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:58.752243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.763460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 86d44079-75ac-4666-8917-6680359065f3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=86d44079-75ac-4666-8917-6680359065f3,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:58.772761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.773268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.774994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.777418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:58.805145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.839522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:55:58.892880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36638) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:58.899940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.908744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fd21afb5-d7fe-4250-bb12-0228bb1b10ef,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:58.914026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:58.923456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port b3bbfa33-7150-4f61-a354-9054fb0fbcda, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:55:58.937938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:58.947308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=86d44079-75ac-4666-8917-6680359065f3,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:58.950513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:58.950970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.009s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:59.019467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-eeaaaec6-4195-41f5-991a-37baf5884877 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3290167 Nov 24 13:55:59.024145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=b3bbfa33-7150-4f61-a354-9054fb0fbcda,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:59.027726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.028365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:59.038964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:59.066778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.068039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 1.2352397 Nov 24 13:55:59.094218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36648) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:59.119150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--1510269004'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:59.132061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['86d44079-75ac-4666-8917-6680359065f3'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 13:55:59.178951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:59.216214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:59.240995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:59.257636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80e18d26-1029-44bd-b21b-ad7b5e97df63 req-103b4669-8dd8-42c5-8608-efaef3f2add1 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:59.259657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:59.259847 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-80e18d26-1029-44bd-b21b-ad7b5e97df63 req-103b4669-8dd8-42c5-8608-efaef3f2add1 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 944 time: 0.6313794 Nov 24 13:55:59.271373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Pushing event updated for resources: {'Port': ['ID=82a55e3e-ad06-422d-8bc5-282bc743e5b2,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:59.292505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:59.313881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.318603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.385876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.403871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8993919b-9595-46ca-ba23-2d6431df7975 req-643f853d-5260-4529-b6c5-7f11b9f847d8 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3723493 Nov 24 13:55:59.404337 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f96441f9-ba50-4bea-b753-eec75c0f2024 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=266ef7dcf3394ff78002f75a07b4a9a1&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5083072 Nov 24 13:55:59.404624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.408200 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.2338846 Nov 24 13:55:59.409761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36654) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:59.412026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36656) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:59.417929 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-80e18d26-1029-44bd-b21b-ad7b5e97df63 req-162b7e20-c9a7-4895-8edf-c6e1b6e650b2 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1386778 Nov 24 13:55:59.419517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.451101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5e4dc70-72a6-4304-b617-4f3e8432d833 req-7564e81d-2d7b-4ae8-8e2e-bb31c0b04521 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:55:59.452629 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d5e4dc70-72a6-4304-b617-4f3e8432d833 req-7564e81d-2d7b-4ae8-8e2e-bb31c0b04521 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.5452192 Nov 24 13:55:59.464287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:59.496503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:59.507009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:59.513758 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:55:59.522043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:59.573641 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d5e4dc70-72a6-4304-b617-4f3e8432d833 req-f2e6232b-c05a-4fbf-a40b-05252920b810 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1106672 Nov 24 13:55:59.587667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.639280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.674853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.678372 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'code': 200} Nov 24 13:55:59.709150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.739572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2551375d-c719-4118-8e69-f6ac344019aa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:55:59.854377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:59.859940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:59.883732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Usage tracker for resource:floatingip and tenant:3ae02f41bbe94fff98ea593b087edf7a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:55:59.920242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:55:59.932282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2bdaf5b1-f2ee-414d-9828-dabf088a0dab,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:55:59.937218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:55:59.947238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.951530 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.8477380 Nov 24 13:55:59.951530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:55:59.951728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36666) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:55:59.958631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': 'fd21afb5-d7fe-4250-bb12-0228bb1b10ef', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '2bdaf5b1-f2ee-414d-9828-dabf088a0dab'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:55:59.969642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:55:59.977330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:55:59.994415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:00.001006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:00.042800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:00.063741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.1 (6f791889-bb28-41c6-bdd5-71e28ee97eae/d79c3e0a-e48a-43fd-b2f3-134c860e3935/4af53af9-692f-41be-b166-26c1d45921f8) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:00.082727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.092950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6569d2af-5ab6-4616-99c7-1704e4b1dec9 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:00.119484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c656b0b0-5a47-4864-b80a-f755a06cfb7e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:00.122965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:00.124435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.142680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.147218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/c656b0b0-5a47-4864-b80a-f755a06cfb7e HTTP/1.1" status: 204 len: 168 time: 0.7303197 Nov 24 13:56:00.152253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 86d44079-75ac-4666-8917-6680359065f3 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:00.153712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3fc8e9-6683-40b0-8987-bf4a8d7462a0 req-bcc670d3-2137-4e5b-8dfb-370cc4d2d129 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:00.160385 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c3fc8e9-6683-40b0-8987-bf4a8d7462a0 req-bcc670d3-2137-4e5b-8dfb-370cc4d2d129 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 943 time: 0.3614058 Nov 24 13:56:00.166315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.239938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 86d44079-75ac-4666-8917-6680359065f3 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:00.249155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 86d44079-75ac-4666-8917-6680359065f3 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:00.249557 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-63b165a2-5102-4bf2-9eb7-311b7ee9443d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 1098 time: 0.3699596 Nov 24 13:56:00.250603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.260094 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:56:00.262743 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-08a98189-008d-4e1b-ad65-c76e40fc3671 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 360 time: 0.3087358 Nov 24 13:56:00.274663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36672) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:00.291270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.333401 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c3fc8e9-6683-40b0-8987-bf4a8d7462a0 req-fd4d43fc-7ddb-46e4-9620-844be4ae4b27 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1709340 Nov 24 13:56:00.381698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:00.391179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Usage tracker for resource:security_group_rule and tenant:53046dc139354dfca48228ba5c115035 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:00.402437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:00.412969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:00.430825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.467295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.513320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 86d44079-75ac-4666-8917-6680359065f3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=86d44079-75ac-4666-8917-6680359065f3,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:00.521959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.525343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:00.566529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.575406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.593628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Allocated IP 172.20.0.4 (50013eb6-6ef1-40a7-9bf6-6494180c6c4e/29d8a545-ee5b-481a-85fe-598ef2379466/c01d26e7-44df-4247-a288-afbaf59ce979) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:00.604930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=86d44079-75ac-4666-8917-6680359065f3,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:00.610805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-339143fa-5aae-40d1-b0c2-d8869b0660f6 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:00.614861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.626042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.626725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.627269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.629279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.630390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.636369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.637008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.637574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.638121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.638680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.639337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:00.647010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:00.666371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.670557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=8ffaa932-d947-4cc2-82a2-0fa88b0a2e7d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:00.676827 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34d695ad-c19a-451a-b9d5-14ff8851faff req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4141431 Nov 24 13:56:00.681007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:00.702926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Allocated IP 172.26.4.27 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/2277e283-2579-443b-b6b6-ea7e36e61a8c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:00.714570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6c134205-f73d-4803-9753-7190ca983d6f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:00.795189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.936488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:00.950603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bffc509-c73a-44ef-95f5-bff77cafc6a9 req-49633e63-3c5d-4450-9d18-68a5788f0a53 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:00.952057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5bffc509-c73a-44ef-95f5-bff77cafc6a9 req-49633e63-3c5d-4450-9d18-68a5788f0a53 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.1499565 Nov 24 13:56:00.965652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:00.986131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:01.005075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:01.015391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.021398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7b095e66-6175-4e36-a13c-e7d9a5f8e949 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:01.054519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.063249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=4af53af9-692f-41be-b166-26c1d45921f8,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:01.072651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5bffc509-c73a-44ef-95f5-bff77cafc6a9 req-3ee46d67-be43-45a4-acb2-577eeb171e36 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1078074 Nov 24 13:56:01.081613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:01.105516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Pushing event updated for resources: {'Port': ['ID=2277e283-2579-443b-b6b6-ea7e36e61a8c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:01.116903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:01.118701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:01.120669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:01.124435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:01.152477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.174648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae0fa963-ac22-48cf-bfb5-9c697609b578 req-080c641d-8ebd-40cc-a901-c66aeb3d3be1 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:01.176336 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae0fa963-ac22-48cf-bfb5-9c697609b578 req-080c641d-8ebd-40cc-a901-c66aeb3d3be1 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.5207307 Nov 24 13:56:01.253970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.258768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.280322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:01.311097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2bdaf5b1-f2ee-414d-9828-dabf088a0dab,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:01.319110 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae0fa963-ac22-48cf-bfb5-9c697609b578 req-ae70dee7-e7e9-4dbb-a205-f36fd259ba64 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1174426 Nov 24 13:56:01.319981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:01.368879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.401912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.405935 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/2bdaf5b1-f2ee-414d-9828-dabf088a0dab HTTP/1.1" status: 204 len: 168 time: 1.1276734 Nov 24 13:56:01.406734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36696) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:01.427699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.448731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.456958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:01.462554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.613840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Port': ['ID=c01d26e7-44df-4247-a288-afbaf59ce979,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:01.616359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:01.619463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36702) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:01.678987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86d44079-75ac-4666-8917-6680359065f3'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:56:01.682564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:01.683436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:01.686161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6eeb838-3a74-4b54-b58e-cddaca830dbb req-75c3cd4f-418a-4502-b8b7-a96f7e2a2c12 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:01.687610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b6eeb838-3a74-4b54-b58e-cddaca830dbb req-75c3cd4f-418a-4502-b8b7-a96f7e2a2c12 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 943 time: 0.1941247 Nov 24 13:56:01.704657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:01.744491 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '86d44079-75ac-4666-8917-6680359065f3', 'code': 200} Nov 24 13:56:01.805702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b6eeb838-3a74-4b54-b58e-cddaca830dbb req-19fc7e60-e343-4ed1-ab40-6457b29906a4 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0994971 Nov 24 13:56:01.816603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-97a714d0-1419-49e6-8ffd-814ef6df2f0f tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:01.847930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.854708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:01.859442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:01.863465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-2059832594'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:01.886839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:01.924828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Usage tracker for resource:network and tenant:0f244d63cdd64512861db0138e2e0fa8 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:01.930357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-97a714d0-1419-49e6-8ffd-814ef6df2f0f tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:01.931802 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-97a714d0-1419-49e6-8ffd-814ef6df2f0f tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4007 time: 0.5239859 Nov 24 13:56:01.932573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:01.939269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36710) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:01.956115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:02.007995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Pushing event updated for resources: {'Port': ['ID=2277e283-2579-443b-b6b6-ea7e36e61a8c,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:02.012559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Made reservation on behalf of 0f244d63cdd64512861db0138e2e0fa8 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:02.015474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.020870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:02.058895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.085246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.109714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.113564 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.6954181 Nov 24 13:56:02.115072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36716) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:02.159695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 13:56:02.185458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:02.194009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Usage tracker for resource:security_group_rule and tenant:0f244d63cdd64512861db0138e2e0fa8 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:02.199223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:02.204655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.208266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-73dfe8c7-2453-4297-8f8b-1ad6f76c449e tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Synchronizing usage tracker for tenant:261983d304094f0e9fff2de3d67d3b39 on resource:floatingip {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:02.212053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:02.250612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7ad176c7-7641-4cf2-b469-138c9080eb21 req-37da648f-6307-45e7-b6e9-b6d548a44c00 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 1099 time: 0.3033583 Nov 24 13:56:02.257024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.288647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.306765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.330365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7ad176c7-7641-4cf2-b469-138c9080eb21 req-73cbf5be-e8a6-43aa-8a69-e30625198620 service neutron] Synchronizing usage tracker for tenant:53046dc139354dfca48228ba5c115035 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:02.341643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:02.347711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.353559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c97703e8-7194-42ce-be49-8a40a50e600b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:02.361329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:02.364001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7ad176c7-7641-4cf2-b469-138c9080eb21 req-73cbf5be-e8a6-43aa-8a69-e30625198620 service neutron] Unset dirty status for tenant:53046dc139354dfca48228ba5c115035 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:02.365381 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7ad176c7-7641-4cf2-b469-138c9080eb21 req-73cbf5be-e8a6-43aa-8a69-e30625198620 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0997601 Nov 24 13:56:02.371425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd21afb5-d7fe-4250-bb12-0228bb1b10ef,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:02.373723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:02.388691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.389872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/fd21afb5-d7fe-4250-bb12-0228bb1b10ef HTTP/1.1" status: 204 len: 168 time: 0.4415169 Nov 24 13:56:02.392572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36722) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:02.398962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'port_id': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'mac_address': 'fa:16:3e:db:60:f9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 877, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 13:56:02.449985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.450725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.467719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=4af53af9-692f-41be-b166-26c1d45921f8,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:02.485685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.495520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.499644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:02.521302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 13:56:02.545556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:02.550140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.554514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:02.599127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1e9584-8753-412f-b062-bbf73e5b26d7 req-9e2a5f4b-2437-4b99-8fd8-aa8fb5581af7 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:02.600735 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ff1e9584-8753-412f-b062-bbf73e5b26d7 req-9e2a5f4b-2437-4b99-8fd8-aa8fb5581af7 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.3939667 Nov 24 13:56:02.623706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:02.624871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.626861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:02.641894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3bff815-f994-400c-be39-8e52af50fcf8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:02.660530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.663486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-73dfe8c7-2453-4297-8f8b-1ad6f76c449e tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Unset dirty status for tenant:261983d304094f0e9fff2de3d67d3b39 on resource:floatingip {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:02.668039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-73dfe8c7-2453-4297-8f8b-1ad6f76c449e tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] 10.222.0.70 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3088 time: 0.5519991 Nov 24 13:56:02.669748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36726) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:02.713316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d124ce9-22b4-486e-a647-73ebdb23738e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:02.736148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3bff815-f994-400c-be39-8e52af50fcf8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:02.744829 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3bff815-f994-400c-be39-8e52af50fcf8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.3512392 Nov 24 13:56:02.757285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36730) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:02.766247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--1535136078'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:02.778571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:02.781651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 881} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:56:02.798387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9596cd79-fa5c-4606-877d-31409b859813,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:02.799013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b0f665df-0146-4a5e-8cad-f54769828ccd tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Synchronizing usage tracker for tenant:823115d55e2a491398adfedf32ca655a on resource:floatingip {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:02.802854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:02.807805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:02.830767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4113ef3-a876-41ed-baac-0901ed14f2c2 req-5185ebf6-472a-4728-ae54-c2b57b6325c7 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:02.839016 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4113ef3-a876-41ed-baac-0901ed14f2c2 req-5185ebf6-472a-4728-ae54-c2b57b6325c7 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.2666979 Nov 24 13:56:02.861530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.889581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b0f665df-0146-4a5e-8cad-f54769828ccd tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Unset dirty status for tenant:823115d55e2a491398adfedf32ca655a on resource:floatingip {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:02.890670 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b0f665df-0146-4a5e-8cad-f54769828ccd tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.2171707 Nov 24 13:56:02.899400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36736) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:02.927456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:02.927814 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Added segment 7ca019be-b995-432f-8fbb-1c5cba9f0be9 of type vlan for network b3f066d0-c4cc-4326-ad49-52314226718d Nov 24 13:56:02.949088 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ff1e9584-8753-412f-b062-bbf73e5b26d7 req-6b303392-c144-4a1f-a0a6-609fd56c2c2f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3228028 Nov 24 13:56:02.950158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['75f93e3f-615e-466c-8cd6-bd38c07aa8a9'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 13:56:02.989876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.047511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:03.058741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:03.088344 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4113ef3-a876-41ed-baac-0901ed14f2c2 req-cdce19df-b5e0-4fd6-9312-8493ef17ec2b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2483606 Nov 24 13:56:03.118134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:03.125827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:03.129072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:03.133317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Deleting port 2277e283-2579-443b-b6b6-ea7e36e61a8c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:03.133655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.139123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da21934d-62b2-4198-8305-335d98f74114 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.172514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:03.287165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.297769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:03.298702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.307528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:03.350068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.362413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.369912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b17a541-46d7-4b7b-a583-d566569550ed tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:03.383567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.384241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.468238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event updated for resources: {'Network': ['ID=b3f066d0-c4cc-4326-ad49-52314226718d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:03.474990 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 796 time: 1.8520055 Nov 24 13:56:03.478915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:03.481526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b3f066d0-c4cc-4326-ad49-52314226718d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:56:03.481949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36740) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:03.491735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Request body: {'subnet': {'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:03.527801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61285d30-cf7d-4077-8f7d-1863c81c26ad req-8bd01a97-814a-4b15-aa98-bab4962d5472 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:03.529293 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-61285d30-cf7d-4077-8f7d-1863c81c26ad req-8bd01a97-814a-4b15-aa98-bab4962d5472 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 944 time: 0.3924513 Nov 24 13:56:03.540684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Calling delete_port for 2277e283-2579-443b-b6b6-ea7e36e61a8c owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:03.565290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.577154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5657fb60-fc2a-4fbd-9679-7edfa1ac465f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:03.579907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:03.601317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.606098 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.8471534 Nov 24 13:56:03.609292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36744) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:03.621186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '5657fb60-fc2a-4fbd-9679-7edfa1ac465f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:03.627576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:03.641374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:03.651582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:03.658307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:03.737505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:03.752069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Usage tracker for resource:subnet and tenant:0f244d63cdd64512861db0138e2e0fa8 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:03.756970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:03.766503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.771539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:03.774743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:03.776782 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-61285d30-cf7d-4077-8f7d-1863c81c26ad req-70fe308f-5731-4ac4-82c0-9ec765430017 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1868935 Nov 24 13:56:03.806850 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:56:03.807967 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a9e25aa5-3e76-4c00-8e2b-7c4c8fc8624b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.1974618 Nov 24 13:56:03.826987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36748) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:03.829594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Pushing event deleted for resources: {'Port': ['ID=2277e283-2579-443b-b6b6-ea7e36e61a8c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:03.835838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group_rule': {'security_group_id': '5657fb60-fc2a-4fbd-9679-7edfa1ac465f', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:03.844500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:03.847294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:03.851792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:03.852363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Made reservation on behalf of 0f244d63cdd64512861db0138e2e0fa8 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:03.854913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:03.883623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Router 63743c78-85de-481c-92fb-9b8e1e49bac2 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:56:03.896974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:03.974789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.984961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:56:03.986033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ca2c37fc-410a-41d9-ba4e-46c6523d5e8b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.1579077 Nov 24 13:56:03.987617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.989530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:03.990712 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] 10.222.0.70 "DELETE /v2.0/floatingips/b27a630a-d966-4aa5-a5a3-9422ff2335c9 HTTP/1.1" status: 204 len: 168 time: 1.0900881 Nov 24 13:56:03.991409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36752) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.002142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36756) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.056874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.086243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.182275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:04.206844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.214723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b4bd013-ed9c-46cb-ae0f-da86bc50032e tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:04.235393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5657fb60-fc2a-4fbd-9679-7edfa1ac465f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:04.237902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:04.247389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b39e1c01-e4ff-4dcd-a863-50295e98e654 req-b19f7e6e-b84b-4b29-96ae-70ac8d2f3ab7 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:04.249584 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b39e1c01-e4ff-4dcd-a863-50295e98e654 req-b19f7e6e-b84b-4b29-96ae-70ac8d2f3ab7 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.1248531 Nov 24 13:56:04.274626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.276045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/5657fb60-fc2a-4fbd-9679-7edfa1ac465f HTTP/1.1" status: 204 len: 168 time: 0.2835894 Nov 24 13:56:04.279958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36764) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.318874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:04.329094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:04.329825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.361850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76a993de-1744-4740-b885-68159a234809 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:04.366562 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b39e1c01-e4ff-4dcd-a863-50295e98e654 req-39ac1586-6cb9-419b-9dfa-57d60b7cc3a9 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1114328 Nov 24 13:56:04.381979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76a993de-1744-4740-b885-68159a234809 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:04.383848 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-76a993de-1744-4740-b885-68159a234809 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.1025715 Nov 24 13:56:04.388357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36768) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.397380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'tempest-secgroup--1761591089'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:04.404438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:04.417310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:04.433368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.475511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.480828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:04.485393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Usage tracker for resource:security_group_rule and tenant:bf36aba1c1a64f39996dc2ab4bfb8266 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:04.492588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:04.501789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:04.509836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Deleting port 82a55e3e-ad06-422d-8bc5-282bc743e5b2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:04.510423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.512501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:56:04.524263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:04.529453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.531259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:04.620153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:04.622907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:04.636597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.641374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.646236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:04.674661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90139d7a-9df1-4154-830b-2d19371e7f29 req-100202a4-fcd7-4793-aca8-f029d8c98457 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:04.676266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-90139d7a-9df1-4154-830b-2d19371e7f29 req-100202a4-fcd7-4793-aca8-f029d8c98457 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.1575081 Nov 24 13:56:04.690509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36776) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.699487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Request body: {'floatingip': {'port_id': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:04.746171 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'code': 200} Nov 24 13:56:04.811805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:04.813156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event updated for resources: {'SecurityGroup': ['ID=30826ff6-fb63-4b51-8542-19410325e945,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:04.828300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:04.831789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.836762 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.4473796 Nov 24 13:56:04.838191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36782) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.845286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b8ca3967-5ba7-4432-be8a-58583c2c6a2f tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Request body: {'security_group': {'name': 'default'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:04.845757 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-b8ca3967-5ba7-4432-be8a-58583c2c6a2f tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] update failed (client error): There was a conflict when trying to complete your request. Nov 24 13:56:04.852334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b8ca3967-5ba7-4432-be8a-58583c2c6a2f tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "PUT /v2.0/security-groups/30826ff6-fb63-4b51-8542-19410325e945 HTTP/1.1" status: 409 len: 330 time: 0.0062680 Nov 24 13:56:04.852334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.855446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36786) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:04.927819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302feb4a-d223-4518-a7fa-6325e6833e5e req-0a2194f2-8501-4dd7-98a3-2e1d6de537d0 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:04.928846 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-302feb4a-d223-4518-a7fa-6325e6833e5e req-0a2194f2-8501-4dd7-98a3-2e1d6de537d0 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.5189459 Nov 24 13:56:04.969106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:04.969431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.197759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.206601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Calling delete_port for 82a55e3e-ad06-422d-8bc5-282bc743e5b2 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:05.247536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e84c0945-b69f-4a3f-8e7c-adcd9dee9ff5 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:05.265111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c76b69b-548c-41f9-8300-a1caf0fc8371 req-73e39f84-863d-4630-80dd-2263aa86c318 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:05.266895 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3c76b69b-548c-41f9-8300-a1caf0fc8371 req-73e39f84-863d-4630-80dd-2263aa86c318 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.2913101 Nov 24 13:56:05.272915 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5aaaf1e7-d8d9-450e-aa71-10d61505fcdd req-f3b1409f-425d-4e21-9701-87334cb17760 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.2902789 Nov 24 13:56:05.383479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.387650 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-302feb4a-d223-4518-a7fa-6325e6833e5e req-ccc76a8b-8d9c-4fe9-a02c-a38b38ab667e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4399099 Nov 24 13:56:05.413305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event updated for resources: {'Subnet': ['ID=e20d668c-ee3e-4921-b29d-8a4a962897a0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:05.420361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:05.455409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:05.474116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Sync routers for ids ['63743c78-85de-481c-92fb-9b8e1e49bac2'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:05.487862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.502317 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3c76b69b-548c-41f9-8300-a1caf0fc8371 req-8d9df6d5-3928-461b-b572-3e6d4d515284 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2284398 Nov 24 13:56:05.513005 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5aaaf1e7-d8d9-450e-aa71-10d61505fcdd req-0436b46e-449d-4a40-8149-eb0421b06ac0 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2148550 Nov 24 13:56:05.518062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Routers {'63743c78-85de-481c-92fb-9b8e1e49bac2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:05.521271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:55:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63743c78-85de-481c-92fb-9b8e1e49bac2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:05.672313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Checking segment: {'id': '7ca019be-b995-432f-8fbb-1c5cba9f0be9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 881, 'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:05.672959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Network hostable DHCP agents. Network: b3f066d0-c4cc-4326-ad49-52314226718d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:56:05.722601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.724656 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 875 time: 7.1608465 Nov 24 13:56:05.728502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36792) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:05.741905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d7c3155d-efc9-4fbf-ba17-0c231019528e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.759977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.766155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:05.768155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Set router 63743c78-85de-481c-92fb-9b8e1e49bac2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:05.794675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.831310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Pushing event deleted for resources: {'Port': ['ID=82a55e3e-ad06-422d-8bc5-282bc743e5b2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:05.839781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:05.844091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Network b3f066d0-c4cc-4326-ad49-52314226718d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:56:05.845874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa6f488d-1f72-4201-80cb-db98f3887bd3 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:05.875656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=30826ff6-fb63-4b51-8542-19410325e945,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:05.904237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:05.907901 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/30826ff6-fb63-4b51-8542-19410325e945 HTTP/1.1" status: 204 len: 168 time: 1.0464671 Nov 24 13:56:05.911662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:05.912113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36796) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:05.924043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, b3f066d0-c4cc-4326-ad49-52314226718d) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:05.958385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a170364-f43e-4d90-8928-90c894807731 None None] Network b3f066d0-c4cc-4326-ad49-52314226718d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:05.960379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:05.960977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.024023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c933f3c-e74d-4402-ae2c-ff37226ce31b req-bddee13f-9041-46e9-84e3-597f25c152ff tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:06.025505 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2c933f3c-e74d-4402-ae2c-ff37226ce31b req-bddee13f-9041-46e9-84e3-597f25c152ff tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.4204588 Nov 24 13:56:06.047220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36800) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.062202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Request body: {'floatingip': {'port_id': '86d44079-75ac-4666-8917-6680359065f3'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:06.222356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.225541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.256910 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.7707670 Nov 24 13:56:06.271930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36804) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.278389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Request body: {'port': {'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-817920020'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:06.281612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:06.297693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.298097 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/routers/dae4f7ce-8421-4823-9021-9def9cbc7bdd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.8352022 Nov 24 13:56:06.299441 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:06.305907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36808) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.311036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.313367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.314501 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] 10.222.0.70 "DELETE /v2.0/floatingips/ec041843-bf11-4fc0-9ec8-a1c313635098 HTTP/1.1" status: 204 len: 168 time: 2.3075056 Nov 24 13:56:06.317073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.340026 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:06.340919 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:06.343261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-b3f066d0-c4cc-4326-ad49-52314226718d', 'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d', 'tenant_id': '0f244d63cdd64512861db0138e2e0fa8', 'fixed_ips': [{'subnet_id': 'e20d668c-ee3e-4921-b29d-8a4a962897a0'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:56:06.349235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.357644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36812) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.382727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63743c78-85de-481c-92fb-9b8e1e49bac2', 'name': '', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e', 'external_fixed_ips': [{'subnet_id': '29d8a545-ee5b-481a-85fe-598ef2379466', 'ip_address': '172.20.0.4'}], 'enable_snat': True}, 'gw_port_id': 'c01d26e7-44df-4247-a288-afbaf59ce979', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:55:58Z', 'updated_at': '2021-11-24T13:56:01Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': 'c01d26e7-44df-4247-a288-afbaf59ce979', 'name': '', 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:48:2b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63743c78-85de-481c-92fb-9b8e1e49bac2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '29d8a545-ee5b-481a-85fe-598ef2379466', 'ip_address': '172.20.0.4', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:00Z', 'updated_at': '2021-11-24T13:56:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '29d8a545-ee5b-481a-85fe-598ef2379466', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:06.386068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'port': {'network_id': '6f791889-bb28-41c6-bdd5-71e28ee97eae', 'name': 'tempest-FloatingIPTestJSON-41712924'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:06.424080 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:06.430546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9b2e30f4-4d45-4131-a1e5-587a53c11a4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Synchronizing usage tracker for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:06.432476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Checking router: 63743c78-85de-481c-92fb-9b8e1e49bac2 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:06.432983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Updating router 63743c78-85de-481c-92fb-9b8e1e49bac2 port c01d26e7-44df-4247-a288-afbaf59ce979 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:56:06.441272 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:06.442181 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:06.523204 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:06.523639 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e82cbc9-675c-4c2e-8d63-0d3fe314d2df None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:06.525021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting port ea9add32-f613-40a9-b5a1-b539c5657dc8 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:06.525495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.534935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.586545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9b2e30f4-4d45-4131-a1e5-587a53c11a4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Unset dirty status for tenant:bf36aba1c1a64f39996dc2ab4bfb8266 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:06.588285 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9b2e30f4-4d45-4131-a1e5-587a53c11a4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.6673448 Nov 24 13:56:06.600919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36818) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.659197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.690891 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-0c79fcfe-c2c2-4b7b-88d1-a6561b170a54 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] delete failed (client error): The resource could not be found. Nov 24 13:56:06.696676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0c79fcfe-c2c2-4b7b-88d1-a6561b170a54 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "DELETE /v2.0/security-groups/825a3a68-c1d1-4433-90c0-ce80ae5ec9dc HTTP/1.1" status: 404 len: 347 time: 0.0944264 Nov 24 13:56:06.697272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36822) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.729835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:06.735368 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-3e0d4e38-cf26-4ac9-b550-588b7e631d4b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] show failed (client error): The resource could not be found. Nov 24 13:56:06.741203 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3e0d4e38-cf26-4ac9-b550-588b7e631d4b tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-groups/17282903-7a01-49aa-b921-9b4ab305ba03 HTTP/1.1" status: 404 len: 347 time: 0.0353866 Nov 24 13:56:06.748358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36826) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:06.753773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:06.757890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Allocated IP 2001:db8::2 (b3f066d0-c4cc-4326-ad49-52314226718d/e20d668c-ee3e-4921-b29d-8a4a962897a0/d92f1e80-ba40-45d1-a563-53c85f2add3c) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:06.758702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:port and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:06.761694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:06.767652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:06.794038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Usage tracker for resource:port and tenant:0f244d63cdd64512861db0138e2e0fa8 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:06.815459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:06.820391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:06.836423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:06.859817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:06.897535 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-d73c0129-0514-48ef-9f43-be5ccc24a3ce tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] show failed (client error): The resource could not be found. Nov 24 13:56:06.898656 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d73c0129-0514-48ef-9f43-be5ccc24a3ce tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] 10.222.0.70 "GET /v2.0/security-group-rules/8fd73306-7acf-4775-ac4d-9e1339f94333 HTTP/1.1" status: 404 len: 356 time: 0.1216624 Nov 24 13:56:06.980997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Made reservation on behalf of 0f244d63cdd64512861db0138e2e0fa8 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:06.984077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.090271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] device_id is not set on port 772a041b-4565-45ec-abf8-aafe0c72e29e yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:07.110516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] device_id is not set on port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:07.194366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ab6a54-b4eb-4b23-a6c6-b7ad2cece3cf req-39e9cde3-1c3d-4270-92e2-432a81d6400b tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:07.201577 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67ab6a54-b4eb-4b23-a6c6-b7ad2cece3cf req-39e9cde3-1c3d-4270-92e2-432a81d6400b tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5328121 Nov 24 13:56:07.224911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.248201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Transition to ACTIVE for port object d92f1e80-ba40-45d1-a563-53c85f2add3c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:07.277631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Transition to ACTIVE for port object d92f1e80-ba40-45d1-a563-53c85f2add3c will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:07.337484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.356513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-359491fd-11f5-4cce-b38b-4838556d2abd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:07.380478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.430743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Network b3f066d0-c4cc-4326-ad49-52314226718d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:07.436232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Pushing event updated for resources: {'Port': ['ID=d92f1e80-ba40-45d1-a563-53c85f2add3c,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:07.439073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:07.444028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:07.447084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:07.449021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.14 (6f791889-bb28-41c6-bdd5-71e28ee97eae/d79c3e0a-e48a-43fd-b2f3-134c860e3935/772a041b-4565-45ec-abf8-aafe0c72e29e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:07.461801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36838) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:07.496323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.551626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Transition to ACTIVE for port object c01d26e7-44df-4247-a288-afbaf59ce979 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:07.563999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Attempting to bind port d92f1e80-ba40-45d1-a563-53c85f2add3c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:07.564948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Attempting to bind port d92f1e80-ba40-45d1-a563-53c85f2add3c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '7ca019be-b995-432f-8fbb-1c5cba9f0be9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 881, 'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:07.564948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Attempting to bind port d92f1e80-ba40-45d1-a563-53c85f2add3c on network b3f066d0-c4cc-4326-ad49-52314226718d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:07.570959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.571901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Calling delete_port for ea9add32-f613-40a9-b5a1-b539c5657dc8 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:07.576930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-48fdf6b4-6148-41bf-b4cb-0687fc222ab6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:07.630834 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67ab6a54-b4eb-4b23-a6c6-b7ad2cece3cf req-ec6a01f8-3e4d-4995-8faf-e57d32536519 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4280651 Nov 24 13:56:07.637492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.681303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting port c01d26e7-44df-4247-a288-afbaf59ce979 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:07.681303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.689514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f92e066-6206-4b34-916f-2540bdae786d None None] Pushing event updated for resources: {'Port': ['ID=c01d26e7-44df-4247-a288-afbaf59ce979,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:07.700532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f92e066-6206-4b34-916f-2540bdae786d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:07.703115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:07.703783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Checking segment: {'id': '7ca019be-b995-432f-8fbb-1c5cba9f0be9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 881, 'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:07.704399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.704935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Bound using segment: {'id': '7ca019be-b995-432f-8fbb-1c5cba9f0be9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 881, 'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:07.705517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Bound port: d92f1e80-ba40-45d1-a563-53c85f2add3c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7ca019be-b995-432f-8fbb-1c5cba9f0be9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 881, 'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:07.705992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.708815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Allocated IP 2001:db8::fe (b3f066d0-c4cc-4326-ad49-52314226718d/e20d668c-ee3e-4921-b29d-8a4a962897a0/6bf8fd81-bc0f-4714-b211-e5f3d5eede76) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:07.715989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Floating IP 0ba2da75-3fb3-40ba-8176-d82ea40ba82d associated. External IP: 172.26.4.76, port: b3bbfa33-7150-4f61-a354-9054fb0fbcda. Nov 24 13:56:07.764476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.788941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Attempting to bind port c01d26e7-44df-4247-a288-afbaf59ce979 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:07.789302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Attempting to bind port c01d26e7-44df-4247-a288-afbaf59ce979 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:07.790103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Attempting to bind port c01d26e7-44df-4247-a288-afbaf59ce979 on network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:07.818826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:07.819235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Checking segment: {'id': 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:07.819611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.820032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Bound using segment: {'id': 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:07.820530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Bound port: c01d26e7-44df-4247-a288-afbaf59ce979, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '50013eb6-6ef1-40a7-9bf6-6494180c6c4e'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:07.820914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.877351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] For port d92f1e80-ba40-45d1-a563-53c85f2add3c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:07.898598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] For port d92f1e80-ba40-45d1-a563-53c85f2add3c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92f1e80-ba40-45d1-a563-53c85f2add3c,segment=NetworkSegment(7ca019be-b995-432f-8fbb-1c5cba9f0be9),segment_id=7ca019be-b995-432f-8fbb-1c5cba9f0be9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:07.905510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.911405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:07.948903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] For port c01d26e7-44df-4247-a288-afbaf59ce979, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:07.969043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] For port c01d26e7-44df-4247-a288-afbaf59ce979, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c01d26e7-44df-4247-a288-afbaf59ce979,segment=NetworkSegment(b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0),segment_id=b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:07.988939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:07.993061 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f993aae3-831a-48ff-8d3e-544dff9b6543 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=bf36aba1c1a64f39996dc2ab4bfb8266&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5253353 Nov 24 13:56:08.000517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.003439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36844) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:08.011740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Pushing event updated for resources: {'Port': ['ID=d92f1e80-ba40-45d1-a563-53c85f2add3c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:08.012032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee20d816-742f-4699-bfbe-e9a718b47993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:08.015436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:08.015866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.020s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:08.063276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.073317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.112873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Routers {'63743c78-85de-481c-92fb-9b8e1e49bac2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:08.114341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63743c78-85de-481c-92fb-9b8e1e49bac2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:08.163925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:08.168638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:08.171013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:08.202436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=772a041b-4565-45ec-abf8-aafe0c72e29e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:08.206149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f92e066-6206-4b34-916f-2540bdae786d None None] Pushing event updated for resources: {'Port': ['ID=c01d26e7-44df-4247-a288-afbaf59ce979,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:08.232477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:08.316386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.331532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f92e066-6206-4b34-916f-2540bdae786d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:08.392917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.413404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] Set router 63743c78-85de-481c-92fb-9b8e1e49bac2 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:08.437418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf531aa7-a583-4bce-ab9a-3ff7dc760d0c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:08.477427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:08.478150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.511534 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 2.2045269 Nov 24 13:56:08.515828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36848) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:08.522148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Port': ['ID=ea9add32-f613-40a9-b5a1-b539c5657dc8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:08.523073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'port': {'network_id': '6f791889-bb28-41c6-bdd5-71e28ee97eae', 'name': 'tempest-FloatingIPTestJSON-1531737674'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:08.538700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:08.542135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] For port c01d26e7-44df-4247-a288-afbaf59ce979, host dv-neutron-818151-2-hyperv, got binding levels [] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:08.542524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.551924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63743c78-85de-481c-92fb-9b8e1e49bac2', 'name': '', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:55:58Z', 'updated_at': '2021-11-24T13:56:07Z', 'revision_number': 4, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:08.556858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a53b2498-8194-447d-8d83-bd45ebaf3e41 None None] The sync data for ids ['63743c78-85de-481c-92fb-9b8e1e49bac2'] in dv-neutron-818151-2-hyperv is: [{'id': '63743c78-85de-481c-92fb-9b8e1e49bac2', 'name': '', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:55:58Z', 'updated_at': '2021-11-24T13:56:07Z', 'revision_number': 4, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:08.572046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.694120 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Floating IP 6ea898a1-1d36-44eb-8158-de32875963cc associated. External IP: 172.26.4.200, port: 86d44079-75ac-4666-8917-6680359065f3. Nov 24 13:56:08.704630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:08.773845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:08.802938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:port and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:08.809902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:08.825948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:08.873812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Calling delete_port for c01d26e7-44df-4247-a288-afbaf59ce979 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:08.904664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:08.907850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.005005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] device_id is not set on port 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:09.008626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.025879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.028769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:09.172065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c71b0030-6aba-4fd0-946e-6318dbf035a0 req-805ba159-71e7-47d7-ac64-8a3863d2cbfd tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:09.174552 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c71b0030-6aba-4fd0-946e-6318dbf035a0 req-805ba159-71e7-47d7-ac64-8a3863d2cbfd tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.2758403 Nov 24 13:56:09.175396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83970efb-6234-43a9-a945-a45f41a11d74 None None] Network b3f066d0-c4cc-4326-ad49-52314226718d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:09.194543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a05ada1-7f03-4b83-92fc-c25c7eb32457,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:09.201583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Transition to ACTIVE for port object 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:09.217986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:09.236180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.7 (6f791889-bb28-41c6-bdd5-71e28ee97eae/d79c3e0a-e48a-43fd-b2f3-134c860e3935/547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:09.250304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.270359 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c71b0030-6aba-4fd0-946e-6318dbf035a0 req-464ad03d-9234-4cde-974d-ebfdafb241fc tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0868552 Nov 24 13:56:09.283289 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "DELETE /v2.0/ports/ea9add32-f613-40a9-b5a1-b539c5657dc8 HTTP/1.1" status: 204 len: 168 time: 2.9218707 Nov 24 13:56:09.285286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36854) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:09.296362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.299699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/7a05ada1-7f03-4b83-92fc-c25c7eb32457 HTTP/1.1" status: 204 len: 168 time: 1.2792413 Nov 24 13:56:09.387199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e17d9ac4-b427-4f82-a170-3691bf374322 None None] Provisioning for port d92f1e80-ba40-45d1-a563-53c85f2add3c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:09.642173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.655502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:09.703198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:56:09.703427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:56:09.774449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.777761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Network b3f066d0-c4cc-4326-ad49-52314226718d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:09.795587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:09.807587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:09.812024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:09.812190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.849441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Router 6fb934fe-8876-4ad1-8081-30b7959413d2 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:09.912674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:09.923103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-847c4bd4-8a3a-4ccd-9fe3-a25c3f617976 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:09.936940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event updated for resources: {'Port': ['ID=6bf8fd81-bc0f-4714-b211-e5f3d5eede76,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:09.947696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:09.967953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 940 time: 3.6925986 Nov 24 13:56:09.972066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36870) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:09.973184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3751b30-f57a-4286-8df7-919ae0e56cdb tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:09.973550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3751b30-f57a-4286-8df7-919ae0e56cdb tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Synchronizing usage tracker for tenant:823115d55e2a491398adfedf32ca655a on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:09.983710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33127616-f209-45ca-9741-5664608b8408 req-4578bb46-5764-4cf2-9b13-37aade054d61 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:09.985352 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-33127616-f209-45ca-9741-5664608b8408 req-4578bb46-5764-4cf2-9b13-37aade054d61 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.3991120 Nov 24 13:56:09.995967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36874) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:10.006038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Request body: {'floatingip': {'port_id': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:10.006974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Request body: {'port': {'network_id': 'b3f066d0-c4cc-4326-ad49-52314226718d', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-462906543', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:10.007795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] bootfile-name is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:10.008154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] tftp-server is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:10.008461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] server-ip-address is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:10.064495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92f1e80-ba40-45d1-a563-53c85f2add3c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:10.131745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3751b30-f57a-4286-8df7-919ae0e56cdb tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Unset dirty status for tenant:823115d55e2a491398adfedf32ca655a on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:10.135790 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f3751b30-f57a-4286-8df7-919ae0e56cdb tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "GET /v2.0/ports?device_id=2a5d4c0d-28ee-4bd1-84a1-38649345f24d HTTP/1.1" status: 200 len: 913 time: 0.8457298 Nov 24 13:56:10.136456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36880) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:10.142303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.162355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:10.173924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:10.177559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:10.186501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d92f1e80-ba40-45d1-a563-53c85f2add3c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:10.193700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d92f1e80-ba40-45d1-a563-53c85f2add3c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:10.194324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.200723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:10.206569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:10.283794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting port c01d26e7-44df-4247-a288-afbaf59ce979 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:10.284141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.433758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.483104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d92f1e80-ba40-45d1-a563-53c85f2add3c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92f1e80-ba40-45d1-a563-53c85f2add3c,segment=NetworkSegment(7ca019be-b995-432f-8fbb-1c5cba9f0be9),segment_id=7ca019be-b995-432f-8fbb-1c5cba9f0be9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:10.484977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad7a86fb-6086-4978-9692-90f65c5db33b None None] Provisioning for port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:10.494912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.496763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad7a86fb-6086-4978-9692-90f65c5db33b None None] Provisioning complete for port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:10.497128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad7a86fb-6086-4978-9692-90f65c5db33b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.524992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7b24e46-98f9-453f-9742-7ca226d712e0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:10.552340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:10.552799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.569427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:10.579505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Usage tracker for resource:port and tenant:0f244d63cdd64512861db0138e2e0fa8 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:10.586643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:10.594139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:10.609741 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.0928142 Nov 24 13:56:10.614475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ad7a86fb-6086-4978-9692-90f65c5db33b None None] Port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:10.615291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36890) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:10.625185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d92f1e80-ba40-45d1-a563-53c85f2add3c,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:10.627741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f', 'fixed_ip_address': '172.20.0.7'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:10.628162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:10.634771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Made reservation on behalf of 0f244d63cdd64512861db0138e2e0fa8 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:10.637762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.648675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:10.663569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:floatingip and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:10.667934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:10.679467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:10.688651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] device_id is not set on port ca60a95e-d9db-4d03-ae4a-97a07fc43cec yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:10.714401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] For port c01d26e7-44df-4247-a288-afbaf59ce979, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c01d26e7-44df-4247-a288-afbaf59ce979,segment=NetworkSegment(b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0),segment_id=b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:10.714997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.720746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36894) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:10.724220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Router 29faa878-433b-448f-ae89-9e61ec9daefb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:10.744833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.784968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:10.809220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] Sync routers for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:10.814344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:10.827018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:10.828166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:10.951028 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e0220882-b003-46ac-916c-cba8341d8443 tempest-ServiceProvidersTest-1293352643 tempest-ServiceProvidersTest-1293352643-project] 10.222.0.70 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.2227139 Nov 24 13:56:10.966270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Calling delete_port for c01d26e7-44df-4247-a288-afbaf59ce979 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:10.986213 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9d04564b-56d6-4fea-acb5-5ea640172788 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "PUT /v2.0/floatingips/6ea898a1-1d36-44eb-8158-de32875963cc HTTP/1.1" status: 200 len: 992 time: 4.9364712 Nov 24 13:56:11.016529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'tag': '86d44079-75ac-4666-8917-6680359065f3'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:56:11.068130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:11.133629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Allocated IP 2001:db8::181 (b3f066d0-c4cc-4326-ad49-52314226718d/e20d668c-ee3e-4921-b29d-8a4a962897a0/ca60a95e-d9db-4d03-ae4a-97a07fc43cec) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:11.167664 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'tag': '86d44079-75ac-4666-8917-6680359065f3', 'status': 'completed', 'code': 200} Nov 24 13:56:11.257724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:11.499030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36910) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:11.559953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:11.573321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.91 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/93fe8b77-a109-4acd-a00c-3309caecb3a2) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:11.592525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Transition to ACTIVE for port object ca60a95e-d9db-4d03-ae4a-97a07fc43cec will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:11.712540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '6ea898a1-1d36-44eb-8158-de32875963cc', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'floating_ip_address': '172.26.4.200', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'port_id': '86d44079-75ac-4666-8917-6680359065f3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'mac_address': 'fa:16:3e:bb:5e:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:28Z', 'updated_at': '2021-11-24T13:56:07Z', 'revision_number': 1, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:22Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:11.716594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] Checking router: 6fb934fe-8876-4ad1-8081-30b7959413d2 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:11.729211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:11.729953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:11.737816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:11.749058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9db966ad-1b17-4969-b2c7-6301468ff8ec tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:11.779936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:11.813699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-2e2703ae-e324-4016-b098-58bd795f08db service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=cec6d7377f6a459a8b7de61e6d2b631f&device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 1099 time: 0.4473782 Nov 24 13:56:11.866617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Network b3f066d0-c4cc-4326-ad49-52314226718d is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:11.882495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:11.886472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:11.898370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:11.902245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:11.902881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:11.907099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:11.912999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event updated for resources: {'Port': ['ID=ca60a95e-d9db-4d03-ae4a-97a07fc43cec,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:11.919515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:11.924738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Usage tracker for resource:security_group_rule and tenant:c69aa6f6455c4915ade2317ff0b49b03 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:11.931454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:11.942264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:11.951061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:11.974481 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1149 time: 1.9837306 Nov 24 13:56:11.978431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36916) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:12.064631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92f1e80-ba40-45d1-a563-53c85f2add3c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:12.070772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.077725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4820cccb-6748-4a78-8428-6b37b885503a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:12.092925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.109530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:12.163565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.181405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event deleted for resources: {'Port': ['ID=c01d26e7-44df-4247-a288-afbaf59ce979,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:12.183521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:12.185241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.195436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:12.204106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:12.228902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=93fe8b77-a109-4acd-a00c-3309caecb3a2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:12.243852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d92f1e80-ba40-45d1-a563-53c85f2add3c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:12.244392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:12.244576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.256837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-1d5f4998-61e2-4d38-b6dc-3a667db0341b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:12.258288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-1d5f4998-61e2-4d38-b6dc-3a667db0341b service neutron] 10.222.0.47 "GET /v2.0/networks?id=192cb388-42c9-4352-94b7-0d42c68d3b4b HTTP/1.1" status: 200 len: 913 time: 0.4331720 Nov 24 13:56:12.260647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:12.263156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.068s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:12.268213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:56:12.346536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33efdf64-5f33-40f3-82ba-85b434d3c9a8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:12.351592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33efdf64-5f33-40f3-82ba-85b434d3c9a8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:12.355605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33efdf64-5f33-40f3-82ba-85b434d3c9a8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:12.356564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-33efdf64-5f33-40f3-82ba-85b434d3c9a8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Synchronizing usage tracker for tenant:0f244d63cdd64512861db0138e2e0fa8 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:12.365405 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=c69aa6f6455c4915ade2317ff0b49b03&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8656635 Nov 24 13:56:12.368639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23f58b77-d635-489c-923a-0400aab5ada6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:12.370872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36920) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:12.379848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:12.449094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-71fc62bf-74d3-4bd2-8463-f5ad326e3f87 None None] Provisioning for port ca60a95e-d9db-4d03-ae4a-97a07fc43cec completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:12.495666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-71fc62bf-74d3-4bd2-8463-f5ad326e3f87 None None] Provisioning complete for port ca60a95e-d9db-4d03-ae4a-97a07fc43cec triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:12.496073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-71fc62bf-74d3-4bd2-8463-f5ad326e3f87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.520481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-33efdf64-5f33-40f3-82ba-85b434d3c9a8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Unset dirty status for tenant:0f244d63cdd64512861db0138e2e0fa8 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:12.524504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-33efdf64-5f33-40f3-82ba-85b434d3c9a8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2621 time: 0.5400109 Nov 24 13:56:12.536197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36928) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:12.547288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:12.562066 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] Sync routers for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:12.574741 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:12.576205 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:12.592142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.596188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.636865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-71fc62bf-74d3-4bd2-8463-f5ad326e3f87 None None] Port ca60a95e-d9db-4d03-ae4a-97a07fc43cec cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:12.672409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.679883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '6ea898a1-1d36-44eb-8158-de32875963cc', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'floating_ip_address': '172.26.4.200', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'port_id': '86d44079-75ac-4666-8917-6680359065f3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'mac_address': 'fa:16:3e:bb:5e:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:28Z', 'updated_at': '2021-11-24T13:56:07Z', 'revision_number': 1, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:22Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:12.686002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4951e7-933e-4113-a567-aed29176fd04 None None] The sync data for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv is: [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '6ea898a1-1d36-44eb-8158-de32875963cc', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'floating_ip_address': '172.26.4.200', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'port_id': '86d44079-75ac-4666-8917-6680359065f3', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'mac_address': 'fa:16:3e:bb:5e:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:28Z', 'updated_at': '2021-11-24T13:56:07Z', 'revision_number': 1, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:22Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:12.692295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-215ac2dd-9921-467a-9e9f-c399f571bbe3 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=86d44079-75ac-4666-8917-6680359065f3 HTTP/1.1" status: 200 len: 1000 time: 0.3638878 Nov 24 13:56:12.704337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.755185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Deleting port ca60a95e-d9db-4d03-ae4a-97a07fc43cec {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:12.755514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.794797 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:12.795598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:12.957007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6577d36b-ecc7-419c-8fcf-075b96cd042b None None] New status for floating IP 6ea898a1-1d36-44eb-8158-de32875963cc: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 13:56:13.059236 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-079fb0cb-f904-44de-9129-7fe2d1a0353f tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "PUT /v2.0/floatingips/0ba2da75-3fb3-40ba-8176-d82ea40ba82d HTTP/1.1" status: 200 len: 990 time: 8.3653448 Nov 24 13:56:13.059236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.190410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:56:13.211214 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '0ba2da75-3fb3-40ba-8176-d82ea40ba82d', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'floating_ip_address': '172.26.4.76', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'port_id': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'mac_address': 'fa:16:3e:c9:8e:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af78c682-bb4f-46ed-a904-9540354133ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:22Z', 'updated_at': '2021-11-24T13:56:05Z', 'revision_number': 1, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:34Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:13.221480 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] Checking router: 29faa878-433b-448f-ae89-9e61ec9daefb for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:13.245699 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:13.246322 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:13.279802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-32c01fd5-b62b-418e-9041-2388537e7719 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:13.281442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-32c01fd5-b62b-418e-9041-2388537e7719 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fdef5004-cb01-46c8-ad07-7ca2196a0189 HTTP/1.1" status: 200 len: 851 time: 0.5227587 Nov 24 13:56:13.353607 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'status': 'completed', 'code': 200} Nov 24 13:56:13.373473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.383685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18530ff6-5606-4956-9ed0-c66d0b781dca tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:13.423381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.469038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23f58b77-d635-489c-923a-0400aab5ada6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:13.479455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:13.490503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.491701 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/23f58b77-d635-489c-923a-0400aab5ada6 HTTP/1.1" status: 204 len: 168 time: 1.1178217 Nov 24 13:56:13.533124 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:13.569608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.590961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.665108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.759842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Calling delete_port for ca60a95e-d9db-4d03-ae4a-97a07fc43cec owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:13.871234 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-d630549b-f53e-4f0d-a22e-f410f0831f89 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 1098 time: 0.5194817 Nov 24 13:56:13.938175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:13.938713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 63743c78-85de-481c-92fb-9b8e1e49bac2 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:14.009013 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-b6ac5e01-93d0-406e-8879-acee2436191a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=192cb388-42c9-4352-94b7-0d42c68d3b4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.6584456 Nov 24 13:56:14.073889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.102381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.103641 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/routers/63743c78-85de-481c-92fb-9b8e1e49bac2 HTTP/1.1" status: 204 len: 168 time: 8.3738868 Nov 24 13:56:14.132846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7a0cac88-e5e1-4c8d-8c5a-e0382b0b8b51 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:14.175231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36946) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:14.216006 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '0ba2da75-3fb3-40ba-8176-d82ea40ba82d', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'floating_ip_address': '172.26.4.76', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'port_id': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'mac_address': 'fa:16:3e:c9:8e:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af78c682-bb4f-46ed-a904-9540354133ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:22Z', 'updated_at': '2021-11-24T13:56:05Z', 'revision_number': 1, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:34Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:14.227561 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67787cf5-b976-48e9-8f3a-4487fc28f4ee None None] The sync data for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv is: [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '0ba2da75-3fb3-40ba-8176-d82ea40ba82d', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'floating_ip_address': '172.26.4.76', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'port_id': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'mac_address': 'fa:16:3e:c9:8e:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af78c682-bb4f-46ed-a904-9540354133ba', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:22Z', 'updated_at': '2021-11-24T13:56:05Z', 'revision_number': 1, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:34Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:14.231836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event deleted for resources: {'Port': ['ID=ca60a95e-d9db-4d03-ae4a-97a07fc43cec,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:14.234743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:14.331118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.373232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.392160 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "DELETE /v2.0/ports/ca60a95e-d9db-4d03-ae4a-97a07fc43cec HTTP/1.1" status: 204 len: 168 time: 1.8505275 Nov 24 13:56:14.393968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36956) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:14.470292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Floating IP 587378fb-8bc8-4a56-b90e-06f47db6479a associated. External IP: 172.26.4.113, port: 75f93e3f-615e-466c-8cd6-bd38c07aa8a9. Nov 24 13:56:14.484915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting subnet 29d8a545-ee5b-481a-85fe-598ef2379466 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:56:14.503679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Request body: {'port': {'name': 'tempest-new-port-name-1373207687', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:14.505342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] bootfile-name is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:14.505852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] tftp-server is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:14.506513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] server-ip-address is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:14.542437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.581342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afb659b-78db-408b-9242-5169de6040da req-62b99fb2-7d1e-464a-909c-a22447ba4e07 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:14.583567 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-62b99fb2-7d1e-464a-909c-a22447ba4e07 service neutron] 10.222.0.47 "GET /v2.0/networks?id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 HTTP/1.1" status: 200 len: 907 time: 0.6465628 Nov 24 13:56:14.638688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.676320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.824006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.870558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:14.934283 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-2dd9523f-c3c8-4c9f-892c-557a6e329f9c service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8972871 Nov 24 13:56:14.991003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36968) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:15.108021 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-5054ba13-1f5f-41a7-a74a-874bdcfdd1d1 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda HTTP/1.1" status: 200 len: 998 time: 0.4920895 Nov 24 13:56:15.210311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.226342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:15.325928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=29d8a545-ee5b-481a-85fe-598ef2379466,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:15.338510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:15.343477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:56:15.376581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.396771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.404250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d7db6eca-b241-44ee-8d45-d132d55b3966 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-832392438', 'prefixes': ['172.20.0.0/16']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:15.405912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afb659b-78db-408b-9242-5169de6040da req-28300bea-a9fd-4e85-a786-5a4fc64937e9 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:15.407347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-28300bea-a9fd-4e85-a786-5a4fc64937e9 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=8c839c3b-21dc-400b-8b56-739bd37025c8 HTTP/1.1" status: 200 len: 845 time: 0.2877157 Nov 24 13:56:15.417127 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/subnets/29d8a545-ee5b-481a-85fe-598ef2379466 HTTP/1.1" status: 204 len: 168 time: 1.2300754 Nov 24 13:56:15.417127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d7db6eca-b241-44ee-8d45-d132d55b3966 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:15.420359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.421393 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-789a3ac4-ff38-48ce-a969-012c3c9cbcce req-4a255244-3981-4cdd-ad89-be6870accb7a service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4769444 Nov 24 13:56:15.424453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 36974) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:15.435380 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0a482c9-8b56-4da5-8759-49576c8a65d0 None None] New status for floating IP 0ba2da75-3fb3-40ba-8176-d82ea40ba82d: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 13:56:15.438370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c890e463-3898-43c7-881a-1f65aa1d7bd1 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536 tempest-ExternalNetworksAdminNegativeTestJSON-2055811536-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:15.595507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=93fe8b77-a109-4acd-a00c-3309caecb3a2,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:15.600511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:15.658798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.661033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.720838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.733421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.741461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32a475ae-4df6-4a2e-8524-2ef477b89726 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:15.758474 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-c746a0be-0792-4056-99bf-887cada3922c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3413854 Nov 24 13:56:15.808268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] In _notify_port_updated(), no bound segment for port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 on network b3f066d0-c4cc-4326-ad49-52314226718d {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:56:15.812319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:15.812990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:15.817311 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "PUT /v2.0/ports/6bf8fd81-bc0f-4714-b211-e5f3d5eede76 HTTP/1.1" status: 200 len: 1129 time: 1.4144800 Nov 24 13:56:15.828305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36980) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:15.880573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event updated for resources: {'Port': ['ID=6bf8fd81-bc0f-4714-b211-e5f3d5eede76,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:15.882813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:15.963242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29f3d488-a444-48df-b3ff-083739301b37 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:15.963901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-29f3d488-a444-48df-b3ff-083739301b37 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Synchronizing usage tracker for tenant:0f244d63cdd64512861db0138e2e0fa8 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:16.033938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.038422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7db6eca-b241-44ee-8d45-d132d55b3966 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] Notify callbacks [] for subnetpool, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.041994 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d7db6eca-b241-44ee-8d45-d132d55b3966 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] 10.222.0.70 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 736 time: 1.0458543 Nov 24 13:56:16.045026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36986) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:16.074387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-29f3d488-a444-48df-b3ff-083739301b37 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Unset dirty status for tenant:0f244d63cdd64512861db0138e2e0fa8 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:16.078624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-29f3d488-a444-48df-b3ff-083739301b37 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "GET /v2.0/ports/6bf8fd81-bc0f-4714-b211-e5f3d5eede76 HTTP/1.1" status: 200 len: 1129 time: 0.2465227 Nov 24 13:56:16.080283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36990) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:16.096414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['50013eb6-6ef1-40a7-9bf6-6494180c6c4e']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:16.126067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:16.126757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b1d0bd1c-ae1a-40c4-89b3-bb6c43f5a8f0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:16.151515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-57865255-5dc2-44ff-ae54-09c359ac84d5 None None] Provisioning complete for port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:16.152610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57865255-5dc2-44ff-ae54-09c359ac84d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.153509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.172870 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6b676a60-4d02-4779-bc6b-b0e252f1fdc5 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] 10.222.0.70 "GET /v2.0/subnetpools/210c9fd7-4d8b-4e6b-ab1e-721d6fcb48c2 HTTP/1.1" status: 200 len: 731 time: 0.1206858 Nov 24 13:56:16.174840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36994) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:16.180856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Deleting port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:16.181196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.209472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-57865255-5dc2-44ff-ae54-09c359ac84d5 None None] Port 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:16.225166 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-faa6f929-2eb3-44e0-afac-57b96da84c32 service neutron] 10.222.0.47 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4327173 Nov 24 13:56:16.228056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.235738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-df6af8e7-acd3-4231-bfec-0fbf28d76c53 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-458183157'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:16.300010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Releasing vlan 854 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:56:16.300413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:56:16.322832 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:56:16.347738 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP 0f72fe11-cd9e-4e26-a586-d310727c47ff associated. External IP: 172.26.4.91, port: 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f. Nov 24 13:56:16.559864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-df6af8e7-acd3-4231-bfec-0fbf28d76c53 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] Notify callbacks [] for subnetpool, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.561010 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-df6af8e7-acd3-4231-bfec-0fbf28d76c53 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] 10.222.0.70 "PUT /v2.0/subnetpools/210c9fd7-4d8b-4e6b-ab1e-721d6fcb48c2 HTTP/1.1" status: 200 len: 683 time: 0.3851376 Nov 24 13:56:16.570310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 36998) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:16.648152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.657214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.708273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b7356fac-e5ed-4933-99d1-920b3aabcf12 tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:16.721725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 50013eb6-6ef1-40a7-9bf6-6494180c6c4e {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:56:16.733382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.736983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3afb659b-78db-408b-9242-5169de6040da req-d37071e0-f1a8-4554-8fcd-605b8efd0589 service neutron] 10.222.0.47 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5005960 Nov 24 13:56:16.743163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event deleted for resources: {'Network': ['ID=50013eb6-6ef1-40a7-9bf6-6494180c6c4e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:16.751746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:16.764914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/networks/50013eb6-6ef1-40a7-9bf6-6494180c6c4e HTTP/1.1" status: 204 len: 168 time: 1.2997675 Nov 24 13:56:16.773148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting port 913c803c-a1a8-4bf1-9343-f2966b5ac131 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:16.773523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:16.846076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:16.900822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Calling delete_port for 6bf8fd81-bc0f-4714-b211-e5f3d5eede76 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:17.068475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.202209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8103a52-fc59-448e-9d70-7e0848511400 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] Notify callbacks [] for subnetpool, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.210251 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a8103a52-fc59-448e-9d70-7e0848511400 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] 10.222.0.70 "DELETE /v2.0/subnetpools/210c9fd7-4d8b-4e6b-ab1e-721d6fcb48c2 HTTP/1.1" status: 204 len: 168 time: 0.6360579 Nov 24 13:56:17.216850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Calling delete_port for 913c803c-a1a8-4bf1-9343-f2966b5ac131 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:17.224279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:17.290817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37016) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:17.308751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'name': 'tempest-router--2074568269', 'project_id': 'ecd9583a5a7e4b07bbd9897f543b2d39'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:17.319142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:17.322974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:router and tenant:ecd9583a5a7e4b07bbd9897f543b2d39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:17.340406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:17.357635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:17.373980 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-b998e903-066d-4486-87a6-44bf621f1e52 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] show failed (client error): The resource could not be found. Nov 24 13:56:17.377346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b998e903-066d-4486-87a6-44bf621f1e52 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] 10.222.0.70 "GET /v2.0/subnetpools/210c9fd7-4d8b-4e6b-ab1e-721d6fcb48c2 HTTP/1.1" status: 404 len: 346 time: 0.1367376 Nov 24 13:56:17.382080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.383223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.387051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37020) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:17.431047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:17.435602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.476504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-ba34ffc6-4c21-4f7d-af20-a78754f47fe2 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] delete failed (client error): The resource could not be found. Nov 24 13:56:17.481635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ba34ffc6-4c21-4f7d-af20-a78754f47fe2 tempest-SubnetPoolsTestJSON-1798859365 tempest-SubnetPoolsTestJSON-1798859365-project] 10.222.0.70 "DELETE /v2.0/subnetpools/210c9fd7-4d8b-4e6b-ab1e-721d6fcb48c2 HTTP/1.1" status: 404 len: 346 time: 0.0848413 Nov 24 13:56:17.483533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] Sync routers for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:17.511517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:17.512514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:17.548925 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-67cb3d57-ddd7-4422-8576-e87c2b07fc06 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "PUT /v2.0/floatingips/587378fb-8bc8-4a56-b90e-06f47db6479a HTTP/1.1" status: 200 len: 991 time: 7.5506423 Nov 24 13:56:17.552774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:56:17.573729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.578050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74da203a-f97b-4b4a-8a48-6762126b1ac8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:17.632607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Port': ['ID=913c803c-a1a8-4bf1-9343-f2966b5ac131,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:17.636981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:17.667290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.689307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'status': 'completed', 'code': 200} Nov 24 13:56:17.720823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.728580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:17.776821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.794733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event deleted for resources: {'Port': ['ID=6bf8fd81-bc0f-4714-b211-e5f3d5eede76,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:17.802289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:17.818459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:17.874501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:17.996270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.045344 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "DELETE /v2.0/ports/6bf8fd81-bc0f-4714-b211-e5f3d5eede76 HTTP/1.1" status: 204 len: 168 time: 1.9600384 Nov 24 13:56:18.051731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37034) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:18.059073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.060634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37038) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:18.060840 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1b4dad39-9882-42f3-9fc1-0b6e4f3c61ba tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.7625663 Nov 24 13:56:18.063493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37040) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:18.086924 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-dd481f84-5c8a-4f07-bcd9-157a48a8dd35 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.3824496 Nov 24 13:56:18.390697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '587378fb-8bc8-4a56-b90e-06f47db6479a', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'floating_ip_address': '172.26.4.113', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'port_id': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'mac_address': 'fa:16:3e:db:60:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:39Z', 'updated_at': '2021-11-24T13:56:12Z', 'revision_number': 1, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:49Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:18.395963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] Checking router: 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:18.408307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:18.409096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:18.432136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.506748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.523152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:18.534155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Usage tracker for resource:security_group_rule and tenant:a33b787becaa47fa91fcb0dac2edbf6c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:18.539003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:18.541943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-04cd5847-b867-4830-99fe-6e5791db06b4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:18.543393 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-04cd5847-b867-4830-99fe-6e5791db06b4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.4423630 Nov 24 13:56:18.552294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:18.608591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:18.658956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Deleting subnet e20d668c-ee3e-4921-b29d-8a4a962897a0 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:56:18.659486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.666643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.702597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:18.750820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.802719 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-98fd7222-eccd-4b8a-91a0-11906217ca33 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 999 time: 0.2397232 Nov 24 13:56:18.884389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.930475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:18.960983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-da5946cd-b1eb-4906-851d-70e325e83aca tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:18.968935 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=a33b787becaa47fa91fcb0dac2edbf6c&name=default HTTP/1.1" status: 200 len: 2647 time: 0.9061801 Nov 24 13:56:18.975733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37052) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:19.056869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '587378fb-8bc8-4a56-b90e-06f47db6479a', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'floating_ip_address': '172.26.4.113', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'port_id': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'mac_address': 'fa:16:3e:db:60:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:39Z', 'updated_at': '2021-11-24T13:56:12Z', 'revision_number': 1, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:49Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:19.061565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4691ee28-5243-4a29-af2e-d3e8b901e422 None None] The sync data for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv is: [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '587378fb-8bc8-4a56-b90e-06f47db6479a', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'floating_ip_address': '172.26.4.113', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'port_id': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'mac_address': 'fa:16:3e:db:60:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T13:55:39Z', 'updated_at': '2021-11-24T13:56:12Z', 'revision_number': 1, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:49Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:19.142342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-3814db13-6d18-4cc3-916e-a9cf755d214f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:19.143717 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-3814db13-6d18-4cc3-916e-a9cf755d214f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.3281496 Nov 24 13:56:19.154752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ecd2365d-d7a2-43a3-97f0-4229472ca420,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:19.162484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:19.251262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.310766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.320336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-c1d12a1e-6986-4982-a672-04cae0d5b072 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3398998 Nov 24 13:56:19.360534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.381266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-b46043be-2bb4-4ed0-9d74-878fefc04835 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2142973 Nov 24 13:56:19.433843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.465641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.543159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.543159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 604a040b-187b-442c-8a8e-1a178a1a1849 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:19.610369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.611484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5772911a-104a-44bd-b38a-fab6608395f8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/routers/604a040b-187b-442c-8a8e-1a178a1a1849 HTTP/1.1" status: 204 len: 168 time: 1.4373388 Nov 24 13:56:19.641288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.648299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-457c701d-5be9-4906-931a-1211bab157f7 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:19.661859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.664778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-acd9f0ab-d34f-4010-a784-abd3d5fdf309 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:19.689963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event deleted for resources: {'Subnet': ['ID=e20d668c-ee3e-4921-b29d-8a4a962897a0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:19.693504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecd2365d-d7a2-43a3-97f0-4229472ca420,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:19.698988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:19.701498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:19.710674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.720545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a83d604b-e040-4edb-8842-569ed68e7e26 None None] Network b3f066d0-c4cc-4326-ad49-52314226718d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:19.726629 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "DELETE /v2.0/subnets/e20d668c-ee3e-4921-b29d-8a4a962897a0 HTTP/1.1" status: 204 len: 168 time: 1.6736133 Nov 24 13:56:19.727283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37064) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:19.804628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.805720 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/ecd2365d-d7a2-43a3-97f0-4229472ca420 HTTP/1.1" status: 204 len: 168 time: 0.8278537 Nov 24 13:56:19.827247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-d48d25a0-9819-4edb-8cc0-3a833032b909 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3890383 Nov 24 13:56:19.839337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:19.843634 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-8340dba2-a4af-4134-bdd0-212ec9034633 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 1098 time: 0.4065402 Nov 24 13:56:19.859834 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:19.883790 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:19.884512 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:19.921425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.930282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:19.976353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37070) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:20.043021 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:20.050504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 9.4346020 Nov 24 13:56:20.062928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37078) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:20.063617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Deleting port d92f1e80-ba40-45d1-a563-53c85f2add3c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:20.063991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.083531 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:20.084237 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:20.096288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] DHCP port deletion for b3f066d0-c4cc-4326-ad49-52314226718d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:56:20.102085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Deleting port d92f1e80-ba40-45d1-a563-53c85f2add3c {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:20.102730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.264276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'port_id': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:20.270457 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:20.270889 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68da8deb-e40c-42f6-b78e-248cebcdd16e None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:20.386306 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-345c2a0f-3251-4cc5-9428-0c2458f75647 req-117d0c7a-bd1f-4306-ac34-d9e5632c5745 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5467377 Nov 24 13:56:20.393946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-5d6e4a1d-d556-40cf-aa2e-57d0dd156a42 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:20.396154 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-5d6e4a1d-d556-40cf-aa2e-57d0dd156a42 service neutron] 10.222.0.47 "GET /v2.0/networks?id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 HTTP/1.1" status: 200 len: 907 time: 0.5083919 Nov 24 13:56:20.589170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] For port d92f1e80-ba40-45d1-a563-53c85f2add3c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92f1e80-ba40-45d1-a563-53c85f2add3c,segment=NetworkSegment(7ca019be-b995-432f-8fbb-1c5cba9f0be9),segment_id=7ca019be-b995-432f-8fbb-1c5cba9f0be9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:20.589651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.604148 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-25af600d-113c-4ffa-9381-07075850e9c1 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda HTTP/1.1" status: 200 len: 1000 time: 0.1572599 Nov 24 13:56:20.695968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-22364979', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:20.705384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.742152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Calling delete_port for d92f1e80-ba40-45d1-a563-53c85f2add3c owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:20.769723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:20.774896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-0ce115e5-5570-4b4f-9a03-fc90b9af9f87 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:20.776760 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-0ce115e5-5570-4b4f-9a03-fc90b9af9f87 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=8c839c3b-21dc-400b-8b56-739bd37025c8 HTTP/1.1" status: 200 len: 845 time: 0.1378741 Nov 24 13:56:20.783010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Router 2a5d4c0d-28ee-4bd1-84a1-38649345f24d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:20.787033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Usage tracker for resource:router and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:20.809017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:20.818449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:20.833589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] For port d92f1e80-ba40-45d1-a563-53c85f2add3c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92f1e80-ba40-45d1-a563-53c85f2add3c,segment=NetworkSegment(7ca019be-b995-432f-8fbb-1c5cba9f0be9),segment_id=7ca019be-b995-432f-8fbb-1c5cba9f0be9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:20.833956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.848558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.866479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:20.912405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Pushing event deleted for resources: {'Port': ['ID=d92f1e80-ba40-45d1-a563-53c85f2add3c,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:20.914743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] No DVR routers for this DVR port d92f1e80-ba40-45d1-a563-53c85f2add3c on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:56:20.916296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:20.979858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.980806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:20.993866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Calling delete_port for d92f1e80-ba40-45d1-a563-53c85f2add3c owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:21.061158 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-73ac593a-e3d2-47b5-8d79-33173ce4c153 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2673588 Nov 24 13:56:21.171482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.188346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:56:21.188691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:56:21.228804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:21.234913 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "PUT /v2.0/routers/2a5d4c0d-28ee-4bd1-84a1-38649345f24d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.0964870 Nov 24 13:56:21.237390 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-b0562d3f-9b52-4d53-aae2-d53ccf9ca127 service neutron] 10.222.0.47 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672406 Nov 24 13:56:21.238000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37104) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:21.242963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] Sync routers for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:21.269922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:21.270745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:21.282073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37108) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:21.390583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:21.401799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] Routers {'2a5d4c0d-28ee-4bd1-84a1-38649345f24d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:21.403227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:21.474335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:21.474868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17a9ea51-8fcf-45ed-b51c-cdace99cb39a None None] The sync data for ids ['2a5d4c0d-28ee-4bd1-84a1-38649345f24d'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:21.492947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.507295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.507486 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP 0f72fe11-cd9e-4e26-a586-d310727c47ff disassociated. External IP: 172.26.4.91, port: 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f. Nov 24 13:56:21.569360 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-310969fc-1249-42ae-8de7-dbf813e498a7 req-03579f9a-5771-4c58-9244-e89df74bdbad service neutron] 10.222.0.47 "GET /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3176348 Nov 24 13:56:21.615875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-492757465'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:21.632291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:21.641830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Usage tracker for resource:network and tenant:e1c0868a017e403699c0ebf881c3c729 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:21.648387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:21.657356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:21.674599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.675291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.685131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Made reservation on behalf of e1c0868a017e403699c0ebf881c3c729 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:21.688093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.699891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Deleting port d92f1e80-ba40-45d1-a563-53c85f2add3c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:21.701659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.746799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.795309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] The port 'd92f1e80-ba40-45d1-a563-53c85f2add3c' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:56:21.881407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.893725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting port 4bda95c0-1760-4168-a890-c838cf8226a1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:21.894100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:21.981405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92f1e80-ba40-45d1-a563-53c85f2add3c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:56:21.995273 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82363a2c-c177-4a3b-8ef9-cdf133c3c10f None None] New status for floating IP 587378fb-8bc8-4a56-b90e-06f47db6479a: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 13:56:22.018060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d92f1e80-ba40-45d1-a563-53c85f2add3c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:56:22.018413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92f1e80-ba40-45d1-a563-53c85f2add3c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:56:22.062311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.073251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:22.095120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Usage tracker for resource:security_group_rule and tenant:e1c0868a017e403699c0ebf881c3c729 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:22.099541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:22.113029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:22.115688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b3f066d0-c4cc-4326-ad49-52314226718d']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:22.182071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7ca019be-b995-432f-8fbb-1c5cba9f0be9') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:22.182371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7ca019be-b995-432f-8fbb-1c5cba9f0be9') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:22.194835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.216255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.249350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.287849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Releasing vlan 881 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:56:22.288329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:56:22.312503 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:56:22.326212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Calling delete_port for 4bda95c0-1760-4168-a890-c838cf8226a1 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:22.446197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.452775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.455552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.460873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ba4e9a35-b183-4d08-b644-33e75fd89c1d tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:22.497568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.502281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ed8e0609-6459-4bc9-8d46-2f7e3c6fe110 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:22.545107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Port': ['ID=4bda95c0-1760-4168-a890-c838cf8226a1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:22.545581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.549153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:22.581661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 860} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:56:22.602133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f059a01f-fa72-48a7-ba6f-d358cc38c562,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:22.641493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:22.646330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.093s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:22.659875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.660209 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Added segment 318ba845-d068-4e4f-b1bc-1338cc7de118 of type vlan for network eacb409b-6eec-4ae4-970a-2fffbb887f9c Nov 24 13:56:22.681531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.724612 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] 10.222.0.70 "DELETE /v2.0/networks/b3f066d0-c4cc-4326-ad49-52314226718d HTTP/1.1" status: 204 len: 168 time: 2.9951048 Nov 24 13:56:22.728094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.731211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Pushing event deleted for resources: {'Network': ['ID=b3f066d0-c4cc-4326-ad49-52314226718d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:22.735322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:22.791538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:22.814013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.044318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.063700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:23.064587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.073760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.075924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae223669-ad76-4f75-8ff0-609ae8aec586 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:23.078101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.100704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37128) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:23.111909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.112668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Fanout notify agent at l3_agent the message router_deleted on router 2a5d4c0d-28ee-4bd1-84a1-38649345f24d {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:23.131689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.135201 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "DELETE /v2.0/routers/2a5d4c0d-28ee-4bd1-84a1-38649345f24d HTTP/1.1" status: 204 len: 168 time: 1.8934891 Nov 24 13:56:23.135445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37134) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:23.301416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Allocated IP 172.26.4.175 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/462e8ffa-b6d8-4827-b4dc-d2c7b48eb24c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:23.323090 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 2.0387602 Nov 24 13:56:23.328791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37138) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:23.346580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Request body: {'subnet': {'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:23.359243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event updated for resources: {'Network': ['ID=eacb409b-6eec-4ae4-970a-2fffbb887f9c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:23.365549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.290s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:23.380654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:56:23.442412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:23.558682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting subnet 4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:56:23.564497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cbbaa1a3-e4ec-419f-95ff-aa39f21d9447 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=0f244d63cdd64512861db0138e2e0fa8&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4603577 Nov 24 13:56:23.564663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.567095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37142) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:23.567708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.660217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:23.663831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.686449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.695773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:23.703315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Usage tracker for resource:subnet and tenant:e1c0868a017e403699c0ebf881c3c729 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:23.713835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:23.724219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:23.757580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:23.761399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:23.762495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Made reservation on behalf of e1c0868a017e403699c0ebf881c3c729 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:23.770870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:23.814275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event updated for resources: {'Port': ['ID=462e8ffa-b6d8-4827-b4dc-d2c7b48eb24c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:23.821276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:23.849596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.906139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.914379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:23.919066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.927032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:23.928510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.939691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:23.940650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:23.943703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:23.992718 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a0281e0e-ab76-47c1-85e0-c40e61859fca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/floatingips/0f72fe11-cd9e-4e26-a586-d310727c47ff HTTP/1.1" status: 200 len: 687 time: 3.8225667 Nov 24 13:56:23.995252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37150) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:24.024124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:24.040351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:24.041282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:24.137991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.145594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:24.146741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:24.148430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64957495-1a69-4685-b358-ac49fb2fdde4 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:24.169863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 93fe8b77-a109-4acd-a00c-3309caecb3a2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:24.170201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.188204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.200705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Subnet': ['ID=4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:24.205282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:24.206064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e62e12df-8335-421f-bd52-771677d42501 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.009s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:24.217931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9596cd79-fa5c-4606-877d-31409b859813,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:24.226944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:24.228977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.255048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.255262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aac367da-165e-4caa-9aef-bc864bd36c95 None None] Network 6a5d65c8-6152-4e88-aa78-9b953c042568 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:24.255783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.282262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.287029 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/9596cd79-fa5c-4606-877d-31409b859813 HTTP/1.1" status: 204 len: 168 time: 0.6889184 Nov 24 13:56:24.289876 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "DELETE /v2.0/subnets/4600d9eb-f9ec-4b27-ac69-7ab27bcb1f2e HTTP/1.1" status: 204 len: 168 time: 1.1511340 Nov 24 13:56:24.290446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37158) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:24.422098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.422308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.458967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.471895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting port f42aaaee-bb93-40ae-b744-19a1a944e02f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:24.472423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.514680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.523330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e4b0083c-3df5-43d6-9167-d44b140a1514 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:24.553089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 93fe8b77-a109-4acd-a00c-3309caecb3a2 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:24.662224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] DHCP port deletion for 6a5d65c8-6152-4e88-aa78-9b953c042568 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:56:24.672866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Deleting port f42aaaee-bb93-40ae-b744-19a1a944e02f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:24.673763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.696230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event updated for resources: {'Subnet': ['ID=5e349693-d8b8-442a-9363-29a7735b64e0,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:24.747548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:24.791909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] For port f42aaaee-bb93-40ae-b744-19a1a944e02f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f42aaaee-bb93-40ae-b744-19a1a944e02f,segment=NetworkSegment(7c582684-b3cb-40c9-a7f8-fd5b89300ce3),segment_id=7c582684-b3cb-40c9-a7f8-fd5b89300ce3)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:24.792273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.801355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Checking segment: {'id': '318ba845-d068-4e4f-b1bc-1338cc7de118', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:24.802461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Network hostable DHCP agents. Network: eacb409b-6eec-4ae4-970a-2fffbb887f9c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:56:24.929587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:24.935330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8747b872-281c-4f99-9e79-3cb90258b40f tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:24.977962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Calling delete_port for f42aaaee-bb93-40ae-b744-19a1a944e02f owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:24.986658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=93fe8b77-a109-4acd-a00c-3309caecb3a2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:24.990806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:25.026975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] For port f42aaaee-bb93-40ae-b744-19a1a944e02f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f42aaaee-bb93-40ae-b744-19a1a944e02f,segment=NetworkSegment(7c582684-b3cb-40c9-a7f8-fd5b89300ce3),segment_id=7c582684-b3cb-40c9-a7f8-fd5b89300ce3)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:25.028198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.038404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:56:25.064186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, eacb409b-6eec-4ae4-970a-2fffbb887f9c) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:25.070243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:25.071881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.094927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Router deacee55-7559-4620-abe5-d5721c599d46 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:56:25.101012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.105829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-262c4c21-b6fa-4598-85d0-4e07168d7c03 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:25.111648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.182293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.187446 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/floatingips/0f72fe11-cd9e-4e26-a586-d310727c47ff HTTP/1.1" status: 204 len: 168 time: 1.1871395 Nov 24 13:56:25.189981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37178) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:25.199015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '772a041b-4565-45ec-abf8-aafe0c72e29e'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:25.204495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:25.210426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:floatingip and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:25.214571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:25.216722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Port': ['ID=f42aaaee-bb93-40ae-b744-19a1a944e02f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:25.224684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:25.226138 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.8964021 Nov 24 13:56:25.232178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37182) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:25.232966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] No DVR routers for this DVR port f42aaaee-bb93-40ae-b744-19a1a944e02f on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:56:25.236110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:25.264373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Calling delete_port for f42aaaee-bb93-40ae-b744-19a1a944e02f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:25.278296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.385283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.390157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:56:25.390793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:56:25.393170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-072bc969-1520-40c0-9a37-70c68869baeb None None] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:25.419132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a5d65c8-6152-4e88-aa78-9b953c042568']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.437102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7c582684-b3cb-40c9-a7f8-fd5b89300ce3') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.437296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7c582684-b3cb-40c9-a7f8-fd5b89300ce3') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.449786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.507958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:25.521058 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] Sync routers for ids ['deacee55-7559-4620-abe5-d5721c599d46'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:25.538984 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] Routers {'deacee55-7559-4620-abe5-d5721c599d46'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:25.539968 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['deacee55-7559-4620-abe5-d5721c599d46'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.580320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.583082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.590095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Releasing vlan 866 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:56:25.590508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.666692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Request body: {'port': {'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c', 'name': 'tempest-TagsExtTest-1487159330'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:25.681517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:56:25.688531 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:56:25.697370 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] Routers {'deacee55-7559-4620-abe5-d5721c599d46'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:25.698437 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['deacee55-7559-4620-abe5-d5721c599d46'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.759497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37192) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:25.766126 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:25.766611 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aca30e2d-20b5-4ad8-a8fa-d7e202799cf1 None None] The sync data for ids ['deacee55-7559-4620-abe5-d5721c599d46'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:25.775422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.776624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 5.7953355 Nov 24 13:56:25.779511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37196) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:25.786517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-eacb409b-6eec-4ae4-970a-2fffbb887f9c', 'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c', 'tenant_id': 'e1c0868a017e403699c0ebf881c3c729', 'fixed_ips': [{'subnet_id': '5e349693-d8b8-442a-9363-29a7735b64e0'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:56:25.789555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.789959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.807162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.34 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/6e65761a-32cd-44b9-a872-f7b2807fc253) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:25.870078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.881268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:25.900617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "DELETE /v2.0/networks/6a5d65c8-6152-4e88-aa78-9b953c042568 HTTP/1.1" status: 204 len: 168 time: 1.6074755 Nov 24 13:56:25.904359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Deleting port f42aaaee-bb93-40ae-b744-19a1a944e02f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:25.905791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37202) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:25.906169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:25.919650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Network': ['ID=6a5d65c8-6152-4e88-aa78-9b953c042568,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:25.922198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:26.015552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-1219627206'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:26.022145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd626c1e-b8cb-455d-967d-327745a60ced None None] The port 'f42aaaee-bb93-40ae-b744-19a1a944e02f' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:56:26.027857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f42aaaee-bb93-40ae-b744-19a1a944e02f no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:56:26.041513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:26.054360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:26.062094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Usage tracker for resource:network and tenant:aea3485fe4554db6b307070cf1fecc65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:26.063664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Usage tracker for resource:port and tenant:e1c0868a017e403699c0ebf881c3c729 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:26.069280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:26.076487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:26.079584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f42aaaee-bb93-40ae-b744-19a1a944e02f {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:56:26.079832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f42aaaee-bb93-40ae-b744-19a1a944e02f not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:56:26.101518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Allocated IP 172.20.0.2 (eacb409b-6eec-4ae4-970a-2fffbb887f9c/5e349693-d8b8-442a-9363-29a7735b64e0/ec09109d-a576-4bad-b5c2-9bf70e7144e3) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:26.115384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Made reservation on behalf of e1c0868a017e403699c0ebf881c3c729 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:26.118857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.141822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:26.150670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] device_id is not set on port 82177d74-ba1d-4219-97ed-0b9322301ba0 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:26.168741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:26.201991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Deleting port 512b95c4-8165-4b51-b9ea-ccc73e977a5d {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:26.202294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.222665 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-739cdd62-8018-418e-aa4f-913d0322fcdf tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/deacee55-7559-4620-abe5-d5721c599d46 HTTP/1.1" status: 200 len: 919 time: 0.4395390 Nov 24 13:56:26.223989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37208) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:26.256110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Made reservation on behalf of aea3485fe4554db6b307070cf1fecc65 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:26.263230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.289915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.295153 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-24b297f0-4d8d-4e70-b07b-db3811653a7a tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=deacee55-7559-4620-abe5-d5721c599d46 HTTP/1.1" status: 200 len: 205 time: 0.0678465 Nov 24 13:56:26.296955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37212) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:26.301446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.372949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.385530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Transition to ACTIVE for port object ec09109d-a576-4bad-b5c2-9bf70e7144e3 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:26.400675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:26.407523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Transition to ACTIVE for port object ec09109d-a576-4bad-b5c2-9bf70e7144e3 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:26.409443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Usage tracker for resource:security_group_rule and tenant:aea3485fe4554db6b307070cf1fecc65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:26.414648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:26.416238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.420992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:26.422604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:26.496235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Pushing event updated for resources: {'Port': ['ID=ec09109d-a576-4bad-b5c2-9bf70e7144e3,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:26.500319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:26.501351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:26.502291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:26.504310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.504310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.504580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:26.516190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.570590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Allocated IP 172.20.0.11 (eacb409b-6eec-4ae4-970a-2fffbb887f9c/5e349693-d8b8-442a-9363-29a7735b64e0/82177d74-ba1d-4219-97ed-0b9322301ba0) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:26.619165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Attempting to bind port ec09109d-a576-4bad-b5c2-9bf70e7144e3 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:26.621219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Attempting to bind port ec09109d-a576-4bad-b5c2-9bf70e7144e3 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '318ba845-d068-4e4f-b1bc-1338cc7de118', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:26.622256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Attempting to bind port ec09109d-a576-4bad-b5c2-9bf70e7144e3 on network eacb409b-6eec-4ae4-970a-2fffbb887f9c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:26.624463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bd482066-c8fc-4038-bdde-c4ad05eb10ea tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:26.635629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:26.636295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Checking segment: {'id': '318ba845-d068-4e4f-b1bc-1338cc7de118', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:26.637481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.638105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Bound using segment: {'id': '318ba845-d068-4e4f-b1bc-1338cc7de118', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:26.638743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Bound port: ec09109d-a576-4bad-b5c2-9bf70e7144e3, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '318ba845-d068-4e4f-b1bc-1338cc7de118', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': 'eacb409b-6eec-4ae4-970a-2fffbb887f9c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:26.639405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.685928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.748790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Calling delete_port for 512b95c4-8165-4b51-b9ea-ccc73e977a5d owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:26.756737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] For port ec09109d-a576-4bad-b5c2-9bf70e7144e3, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:26.759997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] For port ec09109d-a576-4bad-b5c2-9bf70e7144e3, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ec09109d-a576-4bad-b5c2-9bf70e7144e3,segment=NetworkSegment(318ba845-d068-4e4f-b1bc-1338cc7de118),segment_id=318ba845-d068-4e4f-b1bc-1338cc7de118)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:26.765520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.769743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:26.854958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Pushing event updated for resources: {'Port': ['ID=ec09109d-a576-4bad-b5c2-9bf70e7144e3,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:26.859604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:26.903035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:26.913483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:26.929921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:26.973984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=6e65761a-32cd-44b9-a872-f7b2807fc253,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:26.974794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:26.992363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.368s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:26.996339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Transition to ACTIVE for port object 82177d74-ba1d-4219-97ed-0b9322301ba0 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:27.015005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.041770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.043036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:27.070714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.083202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13aca00f-46c1-4f58-b5a6-72a5aebc3b12 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:27.131491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:56:27.143283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event updated for resources: {'SecurityGroup': ['ID=59e44f79-81ef-43ab-93db-ba79b228892f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:27.150588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:27.156707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.164340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.164682 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Added segment 832d5bd7-6294-40a4-8412-88f87acd1805 of type vlan for network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 Nov 24 13:56:27.204550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event updated for resources: {'Port': ['ID=82177d74-ba1d-4219-97ed-0b9322301ba0,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:27.218382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:27.220454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:27.221435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Deleting port 462e8ffa-b6d8-4827-b4dc-d2c7b48eb24c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:27.221954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.260625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:27.264983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:27.328315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.355809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.412116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-97777bcd-1c61-4130-a030-1f642a19ec41 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:27.448167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:56:27.480020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Pushing event deleted for resources: {'Port': ['ID=512b95c4-8165-4b51-b9ea-ccc73e977a5d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:27.486575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:27.527813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.531086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:27.531693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.577630 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.3428533 Nov 24 13:56:27.580597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37222) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:27.593681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:27.594262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.595839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-447992072', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:27.604921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:27.605928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:27.610438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.617916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Usage tracker for resource:router and tenant:e1c0868a017e403699c0ebf881c3c729 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:27.623081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:27.675970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:27.746990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Calling delete_port for 462e8ffa-b6d8-4827-b4dc-d2c7b48eb24c owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:27.814221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event updated for resources: {'Network': ['ID=2204bcd4-4bc7-4ca5-9b7d-8259eb286b52,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:27.826091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:27.827926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.829649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:56:27.830388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.832322 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] 10.222.0.70 "DELETE /v2.0/floatingips/93a22cfd-c84a-46f5-88de-0c2d83ffb05e HTTP/1.1" status: 204 len: 168 time: 1.9246957 Nov 24 13:56:27.836265 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 2.0740623 Nov 24 13:56:27.839675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37232) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:27.846792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Request body: {'subnet': {'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:27.887677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.889177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:27.932043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.017425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:28.024930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Usage tracker for resource:subnet and tenant:aea3485fe4554db6b307070cf1fecc65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:28.029305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:28.045909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:28.048127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.084799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Made reservation on behalf of aea3485fe4554db6b307070cf1fecc65 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:28.102111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.105961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-15843aa5-47d6-408d-8b30-8ac6f053e6be tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.5218372 Nov 24 13:56:28.106249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37236) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:28.112849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8d40543c-a50b-45a4-94a1-629ee8778742 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-758806124', 'prefixes': ['172.20.0.0/16']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:28.127327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.135867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ec09109d-a576-4bad-b5c2-9bf70e7144e3 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:28.141282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8d40543c-a50b-45a4-94a1-629ee8778742 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:28.146701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c1cfa3a-abc3-4b3d-922d-f2af5b4e04bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:28.211884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.240094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port ec09109d-a576-4bad-b5c2-9bf70e7144e3 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:28.244930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event deleted for resources: {'Port': ['ID=462e8ffa-b6d8-4827-b4dc-d2c7b48eb24c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:28.248726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:28.314425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13246e62-1a8e-4b20-a30a-6f906c25871b None None] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:28.463606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37244) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:28.507683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.527879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.592565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.690341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Provisioning for port ec09109d-a576-4bad-b5c2-9bf70e7144e3 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:28.704094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Provisioning complete for port ec09109d-a576-4bad-b5c2-9bf70e7144e3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:28.704567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.820625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.823211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d40543c-a50b-45a4-94a1-629ee8778742 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for subnetpool, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.824539 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8d40543c-a50b-45a4-94a1-629ee8778742 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 747 time: 0.7174098 Nov 24 13:56:28.827842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.829322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37250) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:28.836425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-2f94d8d0-7df9-4d2d-9990-32cd46601e0b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-237811902') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:28.856854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.905275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] For port ec09109d-a576-4bad-b5c2-9bf70e7144e3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ec09109d-a576-4bad-b5c2-9bf70e7144e3,segment=NetworkSegment(318ba845-d068-4e4f-b1bc-1338cc7de118),segment_id=318ba845-d068-4e4f-b1bc-1338cc7de118)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:28.912398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.919204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:28.966234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:28.966772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Fanout notify agent at l3_agent the message router_deleted on router deacee55-7559-4620-abe5-d5721c599d46 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:28.996678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.002392 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-78415ce4-b689-4281-9569-029230a5a8c5 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=823115d55e2a491398adfedf32ca655a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5378425 Nov 24 13:56:29.006190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37258) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.006584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37260) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.009886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/deacee55-7559-4620-abe5-d5721c599d46 HTTP/1.1" status: 204 len: 168 time: 2.7117279 Nov 24 13:56:29.016510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1817374928', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': False}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:29.020475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Pushing event updated for resources: {'Port': ['ID=ec09109d-a576-4bad-b5c2-9bf70e7144e3,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:29.033746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:29.042074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:29.047905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.056265 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2f94d8d0-7df9-4d2d-9990-32cd46601e0b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-237811902 HTTP/1.1" status: 201 len: 201 time: 0.2247479 Nov 24 13:56:29.058701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37266) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.061367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:router and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:29.065763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-b6a985a1-0c38-4a8c-820a-528da2d90ead tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-919422794') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:29.080422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:29.114765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:29.129118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:29.158024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da93b8cb-3068-4c7a-a461-05e6f1cba90f None None] Provisioning complete for port ec09109d-a576-4bad-b5c2-9bf70e7144e3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:29.158599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da93b8cb-3068-4c7a-a461-05e6f1cba90f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.192859 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b6a985a1-0c38-4a8c-820a-528da2d90ead tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-919422794 HTTP/1.1" status: 201 len: 201 time: 0.1327145 Nov 24 13:56:29.193690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37270) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.198507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.199326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.200616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-82a44605-0430-419b-9abc-597a8b47af87 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-189511563') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:29.232559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event updated for resources: {'Subnet': ['ID=630b82ae-f40d-42fb-8939-97d02e0ddd0a,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:29.257903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:29.277268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.280668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.301197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Checking segment: {'id': '832d5bd7-6294-40a4-8412-88f87acd1805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:29.301825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Network hostable DHCP agents. Network: 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:56:29.313387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.337539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:29.353387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da93b8cb-3068-4c7a-a461-05e6f1cba90f None None] Provisioning for port 82177d74-ba1d-4219-97ed-0b9322301ba0 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:29.361902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da93b8cb-3068-4c7a-a461-05e6f1cba90f None None] Provisioning complete for port 82177d74-ba1d-4219-97ed-0b9322301ba0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:29.362293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da93b8cb-3068-4c7a-a461-05e6f1cba90f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.386316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.423092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.484155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-da93b8cb-3068-4c7a-a461-05e6f1cba90f None None] Port 82177d74-ba1d-4219-97ed-0b9322301ba0 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:29.531786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=6e65761a-32cd-44b9-a872-f7b2807fc253,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:29.538306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:29.572697 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-82a44605-0430-419b-9abc-597a8b47af87 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-189511563 HTTP/1.1" status: 201 len: 201 time: 0.3775091 Nov 24 13:56:29.574035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37274) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.580410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-e3c82512-82bc-4ff2-9bf3-86ec57eaa76e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-2073122721') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:29.634326 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e3c82512-82bc-4ff2-9bf3-86ec57eaa76e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-2073122721 HTTP/1.1" status: 201 len: 201 time: 0.0566723 Nov 24 13:56:29.634882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37280) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.642246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-857c6009-6f6f-4d43-a885-57cb3b2cd27d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:29.644661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ac32124c-07db-4384-abf8-5be7a8cfe811 None None] Provisioning complete for port 82177d74-ba1d-4219-97ed-0b9322301ba0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:29.645741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ac32124c-07db-4384-abf8-5be7a8cfe811 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.663773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:56:29.718359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.720132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ac32124c-07db-4384-abf8-5be7a8cfe811 None None] Port 82177d74-ba1d-4219-97ed-0b9322301ba0 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:29.731806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-857c6009-6f6f-4d43-a885-57cb3b2cd27d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags HTTP/1.1" status: 200 len: 240 time: 0.0937595 Nov 24 13:56:29.733510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37284) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.739684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-e45e9b85-fbc8-4f44-902b-2eecd8b4909a tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-237811902') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:29.781102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:29.782683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.790148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f241b6c8-1dd0-4d90-aa61-7d8ef1df2daf None None] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:29.795556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6da06011-886c-4aa8-a54a-844805f23ca6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:29.807433 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e45e9b85-fbc8-4f44-902b-2eecd8b4909a tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-237811902 HTTP/1.1" status: 204 len: 168 time: 0.0704069 Nov 24 13:56:29.807648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:29.807648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.807825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37288) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.814713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-b6828507-f4e9-4fe6-bb11-a816fb797e8b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-237811902') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:29.824911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50fa97d9-9a61-4231-941e-80425d19f852,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:29.832060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:29.847987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.866601 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0231524 Nov 24 13:56:29.866601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:29.870067 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/50fa97d9-9a61-4231-941e-80425d19f852 HTTP/1.1" status: 204 len: 168 time: 0.8572607 Nov 24 13:56:29.870067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37292) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.873920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Request body: {'port': {'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52', 'name': 'tempest-ExtraDHCPOptionsTestJSON-194737608'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:29.919087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b6828507-f4e9-4fe6-bb11-a816fb797e8b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-237811902 HTTP/1.1" status: 204 len: 168 time: 0.1095393 Nov 24 13:56:29.921933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37298) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:29.932411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-b11de8cd-e15d-44b7-9c3a-d9d7cc93e69d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.035576 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b11de8cd-e15d-44b7-9c3a-d9d7cc93e69d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags HTTP/1.1" status: 200 len: 205 time: 0.1125536 Nov 24 13:56:30.039968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37302) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.049450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-b1b82325-ca9d-4760-b14a-a8e99cf791c1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.056515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ec09109d-a576-4bad-b5c2-9bf70e7144e3 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:30.161082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-2204bcd4-4bc7-4ca5-9b7d-8259eb286b52', 'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52', 'tenant_id': 'aea3485fe4554db6b307070cf1fecc65', 'fixed_ips': [{'subnet_id': '630b82ae-f40d-42fb-8939-97d02e0ddd0a'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:56:30.161841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.204268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:30.223688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Usage tracker for resource:port and tenant:aea3485fe4554db6b307070cf1fecc65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:30.230028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:30.230372 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b1b82325-ca9d-4760-b14a-a8e99cf791c1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags HTTP/1.1" status: 200 len: 240 time: 0.1859515 Nov 24 13:56:30.231455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37312) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.239024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:30.253810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-c00298c9-afdb-4992-85df-8367beda76c1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-919422794') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.276190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Made reservation on behalf of aea3485fe4554db6b307070cf1fecc65 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:30.279068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.326695 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP ebc16790-a305-4a13-9145-bc26603e8b92 associated. External IP: 172.26.4.34, port: 772a041b-4565-45ec-abf8-aafe0c72e29e. Nov 24 13:56:30.352865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port ec09109d-a576-4bad-b5c2-9bf70e7144e3 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:30.353240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.389530 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c00298c9-afdb-4992-85df-8367beda76c1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-919422794 HTTP/1.1" status: 204 len: 168 time: 0.1569793 Nov 24 13:56:30.392466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37316) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.411403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] device_id is not set on port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:30.412856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-095dc29c-b0d1-45aa-a281-debedbdb2658 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-919422794') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.542388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Allocated IP 172.20.0.2 (2204bcd4-4bc7-4ca5-9b7d-8259eb286b52/630b82ae-f40d-42fb-8939-97d02e0ddd0a/c0f08257-47ad-41f6-a678-2ffa51a61345) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:30.554420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37320) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.575169 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-095dc29c-b0d1-45aa-a281-debedbdb2658 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-919422794 HTTP/1.1" status: 204 len: 168 time: 0.1814053 Nov 24 13:56:30.577467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37324) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.583601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-ccb02755-0584-461f-94f7-d273ef7222ca tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.600823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.613164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.650693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.657439 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ccb02755-0584-461f-94f7-d273ef7222ca tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags HTTP/1.1" status: 200 len: 205 time: 0.0787992 Nov 24 13:56:30.659832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37328) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.667535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-0d5f1e9e-801e-44c2-9a2b-2912bd347a8d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.776863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.790159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Transition to ACTIVE for port object c0f08257-47ad-41f6-a678-2ffa51a61345 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:30.814141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Transition to ACTIVE for port object c0f08257-47ad-41f6-a678-2ffa51a61345 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:30.824519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:30.832652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:30.849798 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0d5f1e9e-801e-44c2-9a2b-2912bd347a8d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags HTTP/1.1" status: 200 len: 240 time: 0.1884665 Nov 24 13:56:30.850432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37334) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:30.856864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-a83932e7-932f-4532-b5d4-ad129b937d4b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-189511563') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:30.952636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:30.959394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:30.964609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:30.968263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Usage tracker for resource:security_group_rule and tenant:3ae02f41bbe94fff98ea593b087edf7a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:30.974933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:30.979216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:31.004954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:31.006229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Pushing event updated for resources: {'Port': ['ID=c0f08257-47ad-41f6-a678-2ffa51a61345,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:31.021468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Allocated IP 172.20.0.6 (2204bcd4-4bc7-4ca5-9b7d-8259eb286b52/630b82ae-f40d-42fb-8939-97d02e0ddd0a/5bf11288-863b-4b6d-b3bf-7be2a3ad281b) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:31.036058 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a83932e7-932f-4532-b5d4-ad129b937d4b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-189511563 HTTP/1.1" status: 204 len: 168 time: 0.1810927 Nov 24 13:56:31.036442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37338) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.041459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:31.042273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-fad5e4b4-deaf-4948-b003-968b87147f92 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-189511563') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.113498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Attempting to bind port c0f08257-47ad-41f6-a678-2ffa51a61345 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:31.113865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Attempting to bind port c0f08257-47ad-41f6-a678-2ffa51a61345 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '832d5bd7-6294-40a4-8412-88f87acd1805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:31.114230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Attempting to bind port c0f08257-47ad-41f6-a678-2ffa51a61345 on network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:31.121846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:31.122232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Checking segment: {'id': '832d5bd7-6294-40a4-8412-88f87acd1805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:31.122640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.123044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Bound using segment: {'id': '832d5bd7-6294-40a4-8412-88f87acd1805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:31.123583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Bound port: c0f08257-47ad-41f6-a678-2ffa51a61345, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '832d5bd7-6294-40a4-8412-88f87acd1805', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:31.123911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.170746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Allocated IP 172.26.4.74 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/458d4bdc-5269-4447-9d67-d54b8dfcaf23) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:31.202037 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fad5e4b4-deaf-4948-b003-968b87147f92 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-189511563 HTTP/1.1" status: 204 len: 168 time: 0.1626608 Nov 24 13:56:31.202360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37342) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.209631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-ed43b6a8-c625-4fda-afe7-16f6efb68a8c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.232046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] For port c0f08257-47ad-41f6-a678-2ffa51a61345, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:31.235987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] For port c0f08257-47ad-41f6-a678-2ffa51a61345, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c0f08257-47ad-41f6-a678-2ffa51a61345,segment=NetworkSegment(832d5bd7-6294-40a4-8412-88f87acd1805),segment_id=832d5bd7-6294-40a4-8412-88f87acd1805)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:31.241830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.247942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:31.348290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Pushing event updated for resources: {'Port': ['ID=c0f08257-47ad-41f6-a678-2ffa51a61345,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:31.358137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:31.387519 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ed43b6a8-c625-4fda-afe7-16f6efb68a8c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags HTTP/1.1" status: 200 len: 205 time: 0.1819558 Nov 24 13:56:31.387735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37348) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.394570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-5f761485-8843-42b4-a836-6cf9a15a86ed tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.418666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.422635 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f761485-8843-42b4-a836-6cf9a15a86ed tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags HTTP/1.1" status: 200 len: 241 time: 0.0315363 Nov 24 13:56:31.422909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37352) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.430928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-d93debd3-312e-4483-b99f-5eb67bbee5a2 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-2073122721') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.468191 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d93debd3-312e-4483-b99f-5eb67bbee5a2 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-2073122721 HTTP/1.1" status: 204 len: 168 time: 0.0440273 Nov 24 13:56:31.469383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37356) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.476401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-b7b9bc8e-1529-4c61-b7a1-2c5737a20ddd tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-2073122721') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.487900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.528146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b7b9bc8e-1529-4c61-b7a1-2c5737a20ddd tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-2073122721 HTTP/1.1" status: 204 len: 168 time: 0.0574703 Nov 24 13:56:31.535423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37362) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.546205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-df2c64cb-b532-4a84-8fd6-d4d6aca7539e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.549435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-271ff8a3-8853-4247-8b94-bdc3a83b4016 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:31.578044 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-df2c64cb-b532-4a84-8fd6-d4d6aca7539e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags HTTP/1.1" status: 200 len: 205 time: 0.0386245 Nov 24 13:56:31.580360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37366) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.590855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-98804b4a-8431-407b-b698-8e508987e589 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.632026 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-98804b4a-8431-407b-b698-8e508987e589 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags HTTP/1.1" status: 204 len: 168 time: 0.0505545 Nov 24 13:56:31.634580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37370) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.640769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-c7c16b0c-510b-4f0a-8272-b6945157389b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.646235 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=3ae02f41bbe94fff98ea593b087edf7a&name=default HTTP/1.1" status: 200 len: 2647 time: 1.0900624 Nov 24 13:56:31.647036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd145ee8-d0e9-49b3-8df8-b31df6211bc0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:31.660398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37374) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.680020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:31.781332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.811647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.832966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Transition to ACTIVE for port object 5bf11288-863b-4b6d-b3bf-7be2a3ad281b will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:31.890072 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c7c16b0c-510b-4f0a-8272-b6945157389b tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags HTTP/1.1" status: 204 len: 168 time: 0.2545083 Nov 24 13:56:31.892611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37378) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.899302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-49c4617b-1679-4d79-b698-54d9f19186d8 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.906906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.963360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:31.979418 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-49c4617b-1679-4d79-b698-54d9f19186d8 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags HTTP/1.1" status: 204 len: 168 time: 0.0835769 Nov 24 13:56:31.980070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37382) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:31.986140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-e3290acb-d90b-4d81-b825-e1a5beb3d2df tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:31.997374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:32.014412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-97fe6e4b-901b-4add-bdf9-97397b005155 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:32.016053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c0f08257-47ad-41f6-a678-2ffa51a61345 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:32.044467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:32.082182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e3290acb-d90b-4d81-b825-e1a5beb3d2df tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags HTTP/1.1" status: 204 len: 168 time: 0.1007166 Nov 24 13:56:32.086592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37388) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.094537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-2f20bad1-46d8-48f6-97d1-1d57ad3313b7 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-776496422') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.114890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c0f08257-47ad-41f6-a678-2ffa51a61345 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:32.156867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:32.167710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:32.171494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:32.176708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:32.181247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:32.207400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:32.232585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event updated for resources: {'Port': ['ID=5bf11288-863b-4b6d-b3bf-7be2a3ad281b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:32.241490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:32.247494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d05cf8cd-3b99-48df-be40-797a2c015b30 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.199s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:32.311147 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2f20bad1-46d8-48f6-97d1-1d57ad3313b7 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-776496422 HTTP/1.1" status: 201 len: 201 time: 0.2227859 Nov 24 13:56:32.313550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37392) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.316573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:32.322253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-7ad93b4f-701c-4959-abbb-e0a0652f9bc0 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-717719319') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.377539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:32.414023 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7ad93b4f-701c-4959-abbb-e0a0652f9bc0 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-717719319 HTTP/1.1" status: 201 len: 201 time: 0.0992944 Nov 24 13:56:32.414312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:32.414956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:32.416635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37396) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.424679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-8cd4f12d-cd00-4665-88fe-f74d93a7acd2 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-1473215591') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.428757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Port': ['ID=458d4bdc-5269-4447-9d67-d54b8dfcaf23,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:32.443210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:32.446472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dc6efb5a-039b-4024-800d-f14eab9b5309 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.126s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:32.468380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:32.469518 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/bd145ee8-d0e9-49b3-8df8-b31df6211bc0 HTTP/1.1" status: 204 len: 168 time: 0.7987351 Nov 24 13:56:32.475677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7907c9f3-c63e-4aa1-9bb6-44d51075f775 None None] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:32.478028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd145ee8-d0e9-49b3-8df8-b31df6211bc0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:32.483036 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6138473 Nov 24 13:56:32.485637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:32.490594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37402) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.500320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Request body: {'port': {'network_id': '2204bcd4-4bc7-4ca5-9b7d-8259eb286b52', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1881118230', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:32.500801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] bootfile-name is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:32.501133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] tftp-server is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:32.501457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] server-ip-address is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:32.598989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8cd4f12d-cd00-4665-88fe-f74d93a7acd2 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-1473215591 HTTP/1.1" status: 201 len: 201 time: 0.1799448 Nov 24 13:56:32.601509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37408) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.608112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-c150a0b4-76a5-4206-bef0-0797017c31e2 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-624973257') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.661875 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c150a0b4-76a5-4206-bef0-0797017c31e2 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-624973257 HTTP/1.1" status: 201 len: 201 time: 0.0561645 Nov 24 13:56:32.662056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37412) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.669860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-d452c25e-251a-4089-a9f1-33cc589a2a6f tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', {'tags': ['tempest-TagsExtTest-Tag-1474776117', 'tempest-TagsExtTest-Tag-92307248', 'tempest-TagsExtTest-Tag-713784412']}) {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.709340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Provisioning for port c0f08257-47ad-41f6-a678-2ffa51a61345 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:32.761569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Provisioning complete for port c0f08257-47ad-41f6-a678-2ffa51a61345 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:32.762052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:32.800622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:32.806140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Usage tracker for resource:port and tenant:aea3485fe4554db6b307070cf1fecc65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:32.810939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:32.819192 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d452c25e-251a-4089-a9f1-33cc589a2a6f tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags HTTP/1.1" status: 200 len: 315 time: 0.1523604 Nov 24 13:56:32.819906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37418) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.835010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-a163c1b5-47a1-422b-821f-d4fe416fde98 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.958136 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a163c1b5-47a1-422b-821f-d4fe416fde98 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags HTTP/1.1" status: 204 len: 168 time: 0.1342750 Nov 24 13:56:32.958394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37424) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:32.964258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-df8b1c65-a304-4efb-8b28-c2227460c8f1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-1474776117') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:32.994079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.035677 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-df8b1c65-a304-4efb-8b28-c2227460c8f1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:33.037117 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-df8b1c65-a304-4efb-8b28-c2227460c8f1 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-1474776117 HTTP/1.1" status: 404 len: 329 time: 0.0778034 Nov 24 13:56:33.040175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37428) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.043589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] For port c0f08257-47ad-41f6-a678-2ffa51a61345, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c0f08257-47ad-41f6-a678-2ffa51a61345,segment=NetworkSegment(832d5bd7-6294-40a4-8412-88f87acd1805),segment_id=832d5bd7-6294-40a4-8412-88f87acd1805)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:33.046749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-09024dd7-b36c-49e1-9ba9-21c45db8ced3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-92307248') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.052396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:33.055989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.064016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-253ad03c-ae56-44d0-91f9-8ef012f57d14 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:33.094328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Made reservation on behalf of aea3485fe4554db6b307070cf1fecc65 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:33.097955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.140558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.141348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.155094 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-09024dd7-b36c-49e1-9ba9-21c45db8ced3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:33.159267 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-09024dd7-b36c-49e1-9ba9-21c45db8ced3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-92307248 HTTP/1.1" status: 404 len: 327 time: 0.1179953 Nov 24 13:56:33.160169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37432) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.165753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-81f4b3c9-d201-405a-afc5-2a14054390dd tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0', 'tempest-TagsExtTest-Tag-713784412') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.172901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37436) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.184050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Pushing event updated for resources: {'Port': ['ID=c0f08257-47ad-41f6-a678-2ffa51a61345,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:33.187794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae6505a7-fa1f-469f-9c9b-35746a512e49 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.189469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:33.209864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] device_id is not set on port 525eee95-98a6-4007-841a-3cfea8d6e6b4 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:33.251336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-81f4b3c9-d201-405a-afc5-2a14054390dd tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:33.254442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-81f4b3c9-d201-405a-afc5-2a14054390dd tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags/tempest-TagsExtTest-Tag-713784412 HTTP/1.1" status: 404 len: 328 time: 0.0914185 Nov 24 13:56:33.256318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37442) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.262891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-69a00cae-e678-45d8-a5bf-12223664f8e7 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', {'tags': ['tempest-TagsExtTest-Tag-1593639990', 'tempest-TagsExtTest-Tag-436466067', 'tempest-TagsExtTest-Tag-377524804']}) {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.336352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.381350 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-69a00cae-e678-45d8-a5bf-12223664f8e7 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags HTTP/1.1" status: 200 len: 316 time: 0.1215186 Nov 24 13:56:33.381785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37446) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.390537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-0b98855a-7688-4b4b-8dcb-d6d97f48465a tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.396928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5316e594-c570-4a3f-8913-6c9a5e70b9eb None None] Provisioning complete for port c0f08257-47ad-41f6-a678-2ffa51a61345 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:33.397365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5316e594-c570-4a3f-8913-6c9a5e70b9eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.427965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:33.450565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:33.501095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:33.501713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:33.502336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.502859 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b98855a-7688-4b4b-8dcb-d6d97f48465a tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags HTTP/1.1" status: 204 len: 168 time: 0.1175380 Nov 24 13:56:33.505069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37450) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.513149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-cc92e4f8-059e-471a-9d0d-c7cc63250403 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-1593639990') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.518991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Usage tracker for resource:security_group_rule and tenant:261983d304094f0e9fff2de3d67d3b39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:33.537242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:33.583788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-cc92e4f8-059e-471a-9d0d-c7cc63250403 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:33.584759 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cc92e4f8-059e-471a-9d0d-c7cc63250403 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-1593639990 HTTP/1.1" status: 404 len: 329 time: 0.0776730 Nov 24 13:56:33.588160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37454) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.591501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.593362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-1b051c30-1321-4f1f-bc4e-00b46715cc94 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-436466067') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.608394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:33.619351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.629408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.657420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:33.658074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.666655 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-1b051c30-1321-4f1f-bc4e-00b46715cc94 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:33.670310 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1b051c30-1321-4f1f-bc4e-00b46715cc94 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-436466067 HTTP/1.1" status: 404 len: 328 time: 0.0787346 Nov 24 13:56:33.670957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37458) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.677415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-c213ac2f-02a9-4505-a376-213feaa6bbd9 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0', 'tempest-TagsExtTest-Tag-377524804') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.696045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Allocated IP 172.20.0.12 (2204bcd4-4bc7-4ca5-9b7d-8259eb286b52/630b82ae-f40d-42fb-8939-97d02e0ddd0a/525eee95-98a6-4007-841a-3cfea8d6e6b4) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:33.726341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.726759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204e4f6a-83fd-4b9a-87ba-7265d052c1ba None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:33.730740 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 981 time: 8.5397310 Nov 24 13:56:33.734122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37462) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.757106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5316e594-c570-4a3f-8913-6c9a5e70b9eb None None] Provisioning for port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:33.763098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5316e594-c570-4a3f-8913-6c9a5e70b9eb None None] Provisioning complete for port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:33.763541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5316e594-c570-4a3f-8913-6c9a5e70b9eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.840607 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-c213ac2f-02a9-4505-a376-213feaa6bbd9 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:33.841758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c213ac2f-02a9-4505-a376-213feaa6bbd9 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags/tempest-TagsExtTest-Tag-377524804 HTTP/1.1" status: 404 len: 328 time: 0.1700790 Nov 24 13:56:33.845484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5316e594-c570-4a3f-8913-6c9a5e70b9eb None None] Port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:33.853232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37468) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:33.858474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.859707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-2ba1ff26-09d9-4ae6-bbdd-2a29b95430ce tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', {'tags': ['tempest-TagsExtTest-Tag-1020281602', 'tempest-TagsExtTest-Tag-2116306103', 'tempest-TagsExtTest-Tag-1873188915']}) {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:33.870741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.880317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:33.980283 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3f567219-eb4e-49c7-9ba8-2578fcfc6ac6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/floatingips/ebc16790-a305-4a13-9145-bc26603e8b92 HTTP/1.1" status: 200 len: 976 time: 0.2423167 Nov 24 13:56:33.985621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-36522865-9e73-4a78-b973-4011b74f6961 None None] Provisioning complete for port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:33.986007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36522865-9e73-4a78-b973-4011b74f6961 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:33.986826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.007693 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=261983d304094f0e9fff2de3d67d3b39&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8273311 Nov 24 13:56:34.014956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c0f08257-47ad-41f6-a678-2ffa51a61345 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:34.040769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.089021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-36522865-9e73-4a78-b973-4011b74f6961 None None] Port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:34.110777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c0f08257-47ad-41f6-a678-2ffa51a61345 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:34.111402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.116317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.150734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7948e262-930d-4e1d-99ce-244cbc8ddb9b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:34.154652 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2ba1ff26-09d9-4ae6-bbdd-2a29b95430ce tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags HTTP/1.1" status: 200 len: 318 time: 0.2972925 Nov 24 13:56:34.154652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37482) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.160269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:34.161550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Transition to ACTIVE for port object 525eee95-98a6-4007-841a-3cfea8d6e6b4 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:34.161903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-0d7e3a5c-1825-43e8-a668-1f820d484257 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:34.193662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Router 86320247-2ce6-427c-8ed9-e67eb36549db is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:56:34.208908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.215548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7c2767a9-9afb-4142-98eb-f39b299365ed tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:34.317806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8b5f7976-3398-4298-ab83-04f3394a5339 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 979 time: 0.3300073 Nov 24 13:56:34.324796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37486) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.375264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:34.380535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event updated for resources: {'Port': ['ID=525eee95-98a6-4007-841a-3cfea8d6e6b4,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:34.383102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:34.385041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:34.387043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:34.394809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'port_id': '547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:34.466360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:34.467270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.484138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.540066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.564984 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1153 time: 2.0720422 Nov 24 13:56:34.566384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37492) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.593427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.618996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-79623d49-91b7-4f9f-85e1-9bc25245e34c None None] Provisioning for port 525eee95-98a6-4007-841a-3cfea8d6e6b4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:34.624533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-79623d49-91b7-4f9f-85e1-9bc25245e34c None None] Provisioning complete for port 525eee95-98a6-4007-841a-3cfea8d6e6b4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:34.625086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-79623d49-91b7-4f9f-85e1-9bc25245e34c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.687622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-79623d49-91b7-4f9f-85e1-9bc25245e34c None None] Port 525eee95-98a6-4007-841a-3cfea8d6e6b4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:34.701597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9e4773a-4756-4fa2-9763-14014a034169 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:34.705573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9e4773a-4756-4fa2-9763-14014a034169 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:34.710605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9e4773a-4756-4fa2-9763-14014a034169 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:34.711535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d9e4773a-4756-4fa2-9763-14014a034169 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Synchronizing usage tracker for tenant:aea3485fe4554db6b307070cf1fecc65 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:34.717742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:34.721314 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0d7e3a5c-1825-43e8-a668-1f820d484257 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags HTTP/1.1" status: 204 len: 168 time: 0.5662835 Nov 24 13:56:34.724989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37496) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.733544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.tag.tag_plugin [None req-0a9b650d-8ae7-4576-838f-540b895eac4e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-1020281602') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:34.735661 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Sync routers for ids ['86320247-2ce6-427c-8ed9-e67eb36549db'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:34.752289 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Routers {'86320247-2ce6-427c-8ed9-e67eb36549db'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:34.754141 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['86320247-2ce6-427c-8ed9-e67eb36549db'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:34.777334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.785321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:34.811284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7948e262-930d-4e1d-99ce-244cbc8ddb9b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:34.818238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:34.824338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.825521 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/7948e262-930d-4e1d-99ce-244cbc8ddb9b HTTP/1.1" status: 204 len: 168 time: 0.7815166 Nov 24 13:56:34.879334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d9e4773a-4756-4fa2-9763-14014a034169 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Unset dirty status for tenant:aea3485fe4554db6b307070cf1fecc65 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:34.880574 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d9e4773a-4756-4fa2-9763-14014a034169 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2618 time: 0.3071771 Nov 24 13:56:34.883579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:34.884088 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 907 time: 5.8752167 Nov 24 13:56:34.884737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37502) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.890163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37504) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:34.949986 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Set router 86320247-2ce6-427c-8ed9-e67eb36549db gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:35.149516 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-0a9b650d-8ae7-4576-838f-540b895eac4e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:35.150588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a9b650d-8ae7-4576-838f-540b895eac4e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-1020281602 HTTP/1.1" status: 404 len: 329 time: 0.4246240 Nov 24 13:56:35.165409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Deleting port 525eee95-98a6-4007-841a-3cfea8d6e6b4 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:35.165749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.201562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37514) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:35.214283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.tag.tag_plugin [None req-9536badf-2b18-4bc3-abd9-9be785c8ab72 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-2116306103') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:35.324500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86320247-2ce6-427c-8ed9-e67eb36549db', 'name': 'tempest-snat-router-1817374928', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.74'}], 'enable_snat': False}, 'gw_port_id': '458d4bdc-5269-4447-9d67-d54b8dfcaf23', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:29Z', 'updated_at': '2021-11-24T13:56:32Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': '458d4bdc-5269-4447-9d67-d54b8dfcaf23', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:c9:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86320247-2ce6-427c-8ed9-e67eb36549db', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:30Z', 'updated_at': '2021-11-24T13:56:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:35.332863 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Checking router: 86320247-2ce6-427c-8ed9-e67eb36549db for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:35.333563 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Updating router 86320247-2ce6-427c-8ed9-e67eb36549db port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:56:35.415160 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.585837 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-9536badf-2b18-4bc3-abd9-9be785c8ab72 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:35.586869 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9536badf-2b18-4bc3-abd9-9be785c8ab72 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-2116306103 HTTP/1.1" status: 404 len: 329 time: 0.3844032 Nov 24 13:56:35.591046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37528) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:35.601244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.tag.tag_plugin [None req-55fd6c41-d701-4140-87ee-90395f96e436 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2', 'tempest-TagsExtTest-Tag-1873188915') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:35.607228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.615025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.709112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1fc0cf48-3251-475c-8940-6f1a8fcbc411 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.844890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.887490 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP ebc16790-a305-4a13-9145-bc26603e8b92 associated. External IP: 172.26.4.34, port: 772a041b-4565-45ec-abf8-aafe0c72e29e. Nov 24 13:56:35.916724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-55fd6c41-d701-4140-87ee-90395f96e436 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:35.920325 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-55fd6c41-d701-4140-87ee-90395f96e436 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags/tempest-TagsExtTest-Tag-1873188915 HTTP/1.1" status: 404 len: 329 time: 0.3256819 Nov 24 13:56:35.936413 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.950743 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Transition to ACTIVE for port object 458d4bdc-5269-4447-9d67-d54b8dfcaf23 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:35.958116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37538) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:35.960183 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:35.967278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-092dedaf-8e0c-4032-8e0f-abbc4780783d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', {'tags': ['tempest-TagsExtTest-Tag-1641696928', 'tempest-TagsExtTest-Tag-1353282374', 'tempest-TagsExtTest-Tag-1026041657']}) {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:35.974713 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:35.981272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Calling delete_port for 525eee95-98a6-4007-841a-3cfea8d6e6b4 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:36.051568 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Pushing event updated for resources: {'Port': ['ID=458d4bdc-5269-4447-9d67-d54b8dfcaf23,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:36.058400 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-49ec4fcb-f8da-4408-9957-281f780cd068 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/86320247-2ce6-427c-8ed9-e67eb36549db HTTP/1.1" status: 200 len: 908 time: 1.1671679 Nov 24 13:56:36.060824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37544) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.077377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1817374928', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': True}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:36.083776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:36.087395 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.088127 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.088336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Usage tracker for resource:router and tenant:3872d6d57b1a42eb979825c2f5fab10d is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:36.088858 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.089399 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.090068 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.090700 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.091223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.091343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Quota usage for router was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:36.091930 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.092439 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.093084 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.093608 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:36.097903 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Attempting to bind port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:36.098060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:36.098642 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Attempting to bind port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:36.099290 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Attempting to bind port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:36.104242 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:36.112206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-092dedaf-8e0c-4032-8e0f-abbc4780783d tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "PUT /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags HTTP/1.1" status: 200 len: 318 time: 0.1515203 Nov 24 13:56:36.113586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37548) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.115324 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:36.115890 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:36.116406 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.117166 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:36.117887 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Bound port: 458d4bdc-5269-4447-9d67-d54b8dfcaf23, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:36.118412 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.149702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.tag.tag_plugin [None req-54b8ab1d-3014-4460-872f-4c650415b2c3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:36.181371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.182334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.203322 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] For port 458d4bdc-5269-4447-9d67-d54b8dfcaf23, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:36.207529 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] For port 458d4bdc-5269-4447-9d67-d54b8dfcaf23, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=458d4bdc-5269-4447-9d67-d54b8dfcaf23,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:36.213832 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.223581 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:36.306598 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-54b8ab1d-3014-4460-872f-4c650415b2c3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags HTTP/1.1" status: 204 len: 168 time: 0.1919653 Nov 24 13:56:36.307607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.317479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.327845 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Pushing event updated for resources: {'Port': ['ID=458d4bdc-5269-4447-9d67-d54b8dfcaf23,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:36.329293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.tag.tag_plugin [None req-4ccb98e1-0a85-4f84-8f8d-6a4b3bccea68 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-1641696928') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:36.334106 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:36.383981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:36.397543 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Routers {'86320247-2ce6-427c-8ed9-e67eb36549db'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:36.399712 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['86320247-2ce6-427c-8ed9-e67eb36549db'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:36.450869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event deleted for resources: {'Port': ['ID=525eee95-98a6-4007-841a-3cfea8d6e6b4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:36.455502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:36.501229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.569394 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:56:36.599635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:36.608475 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-4ccb98e1-0a85-4f84-8f8d-6a4b3bccea68 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:36.612172 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4ccb98e1-0a85-4f84-8f8d-6a4b3bccea68 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-1641696928 HTTP/1.1" status: 404 len: 329 time: 0.2991781 Nov 24 13:56:36.620861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37566) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.635193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-44704c96-0848-42e7-9405-28ff0431d631 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-1353282374') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:36.637982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.742576 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-44704c96-0848-42e7-9405-28ff0431d631 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:36.744698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-44704c96-0848-42e7-9405-28ff0431d631 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-1353282374 HTTP/1.1" status: 404 len: 329 time: 0.1166718 Nov 24 13:56:36.747554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37572) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.751296 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] Set router 86320247-2ce6-427c-8ed9-e67eb36549db gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:36.755806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-49175893-66b2-4d63-b6a7-ff9d045504bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c', 'tempest-TagsExtTest-Tag-1026041657') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:36.810505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-49175893-66b2-4d63-b6a7-ff9d045504bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] show failed (client error): The resource could not be found. Nov 24 13:56:36.815472 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-49175893-66b2-4d63-b6a7-ff9d045504bb tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags/tempest-TagsExtTest-Tag-1026041657 HTTP/1.1" status: 404 len: 329 time: 0.0664759 Nov 24 13:56:36.822146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37580) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.892668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-49ae7c99-a538-4734-8ded-b13281758ab3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:36.912533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:36.940059 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "DELETE /v2.0/ports/525eee95-98a6-4007-841a-3cfea8d6e6b4 HTTP/1.1" status: 204 len: 168 time: 2.0533018 Nov 24 13:56:36.945497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37584) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.952668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Request body: {'port': {'name': 'tempest-new-port-name-1022517155', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:36.953195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] bootfile-name is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:36.953624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] tftp-server is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:36.954038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.api.validators [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] server-ip-address is not in valid_values {{(pid=83525) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:163}} Nov 24 13:56:36.979788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37588) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:36.980136 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-49ae7c99-a538-4734-8ded-b13281758ab3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c/tags HTTP/1.1" status: 204 len: 168 time: 0.0980303 Nov 24 13:56:37.003126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:37.016783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:37.034972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.tag.tag_plugin [None req-db0727d8-7c54-4d80-b477-ed9412987de3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '2f239c99-15b2-42d2-a32f-c9668c006fe2') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.044726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:37.048731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.112802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:37.276318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.289688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:37.290305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.306165 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86320247-2ce6-427c-8ed9-e67eb36549db', 'name': 'tempest-snat-router-1817374928', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.74'}], 'enable_snat': False}, 'gw_port_id': '458d4bdc-5269-4447-9d67-d54b8dfcaf23', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:29Z', 'updated_at': '2021-11-24T13:56:32Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': '458d4bdc-5269-4447-9d67-d54b8dfcaf23', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:c9:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86320247-2ce6-427c-8ed9-e67eb36549db', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:30Z', 'updated_at': '2021-11-24T13:56:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.312766 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6f02eee-a96c-424a-8f30-2b6185cfe348 None None] The sync data for ids ['86320247-2ce6-427c-8ed9-e67eb36549db'] in dv-neutron-818151-2-hyperv is: [{'id': '86320247-2ce6-427c-8ed9-e67eb36549db', 'name': 'tempest-snat-router-1817374928', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.74'}], 'enable_snat': False}, 'gw_port_id': '458d4bdc-5269-4447-9d67-d54b8dfcaf23', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:29Z', 'updated_at': '2021-11-24T13:56:32Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': '458d4bdc-5269-4447-9d67-d54b8dfcaf23', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:c9:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86320247-2ce6-427c-8ed9-e67eb36549db', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.74', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:30Z', 'updated_at': '2021-11-24T13:56:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:37.354750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:37.379046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.379517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19e7aa1f-0792-45e4-8a40-a5acf8761cec None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:37.405789 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-db0727d8-7c54-4d80-b477-ed9412987de3 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2/tags HTTP/1.1" status: 204 len: 168 time: 0.4117429 Nov 24 13:56:37.406707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37596) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:37.415834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-f61f521f-7802-4993-8151-419a1e6c263e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', '82177d74-ba1d-4219-97ed-0b9322301ba0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.584907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f61f521f-7802-4993-8151-419a1e6c263e tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0/tags HTTP/1.1" status: 204 len: 168 time: 0.1712143 Nov 24 13:56:37.585845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37608) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:37.605071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.tag.tag_plugin [None req-df4582fc-64eb-4f0d-a6ea-e7473c6cdacc tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '5e349693-d8b8-442a-9363-29a7735b64e0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:37.724255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:37.737126 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-df4582fc-64eb-4f0d-a6ea-e7473c6cdacc tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0/tags HTTP/1.1" status: 204 len: 168 time: 0.1459303 Nov 24 13:56:37.739332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37612) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:37.818762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37616) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:37.930453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:37.959660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:37.967504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:38.001856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d980ab73-c642-4196-aabf-2b6e6492bb58 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for subnetpool, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.003950 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d980ab73-c642-4196-aabf-2b6e6492bb58 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnetpools/1b9e7adc-8fb0-4c09-bc91-b6b69f18ba3c HTTP/1.1" status: 204 len: 168 time: 0.2601507 Nov 24 13:56:38.008633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37622) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:38.014053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.062413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.077930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 458d4bdc-5269-4447-9d67-d54b8dfcaf23 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:38.078627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b71984c4-059f-4c87-9cbd-e9c98d88f837 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Synchronizing usage tracker for tenant:e1c0868a017e403699c0ebf881c3c729 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:38.113348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b71984c4-059f-4c87-9cbd-e9c98d88f837 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Unset dirty status for tenant:e1c0868a017e403699c0ebf881c3c729 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:38.114599 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b71984c4-059f-4c87-9cbd-e9c98d88f837 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "GET /v2.0/ports?device_id=2f239c99-15b2-42d2-a32f-c9668c006fe2 HTTP/1.1" status: 200 len: 205 time: 0.1049552 Nov 24 13:56:38.117834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37626) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:38.140972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-1326406257', 'router:external': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:38.157518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:38.165075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:38.172344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:38.173192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.228829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event updated for resources: {'Port': ['ID=5bf11288-863b-4b6d-b3bf-7be2a3ad281b,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:38.233040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:38.236321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:network and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:38.249658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:38.261939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:38.307410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] In _notify_port_updated(), no bound segment for port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b on network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:56:38.313226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:38.313226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.317536 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "PUT /v2.0/ports/5bf11288-863b-4b6d-b3bf-7be2a3ad281b HTTP/1.1" status: 200 len: 1136 time: 1.3688228 Nov 24 13:56:38.319410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37632) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:38.351961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.380237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.418248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 458d4bdc-5269-4447-9d67-d54b8dfcaf23, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=458d4bdc-5269-4447-9d67-d54b8dfcaf23,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:38.427145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.431823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:38.440911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Made reservation on behalf of bdc37f91168b4b15811cdc290c7d3b64 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:38.443470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.502437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.559171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=458d4bdc-5269-4447-9d67-d54b8dfcaf23,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:38.571117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:38.576816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4484785b-b250-4150-b9c4-0ff7326cd087 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:38.577774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4484785b-b250-4150-b9c4-0ff7326cd087 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Synchronizing usage tracker for tenant:aea3485fe4554db6b307070cf1fecc65 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:38.595210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cdb989ed-1d67-45f5-a0ef-e97fb9787542 None None] Provisioning complete for port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:38.595210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cdb989ed-1d67-45f5-a0ef-e97fb9787542 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.595471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:38.604535 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:38.617484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:38.619400 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:38.620151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Allocated IP 172.26.4.55 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:38.626559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:security_group_rule and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:38.627071 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:38.630518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.636653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:38.646827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:38.650692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4484785b-b250-4150-b9c4-0ff7326cd087 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Unset dirty status for tenant:aea3485fe4554db6b307070cf1fecc65 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:38.654707 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4484785b-b250-4150-b9c4-0ff7326cd087 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "GET /v2.0/ports/5bf11288-863b-4b6d-b3bf-7be2a3ad281b HTTP/1.1" status: 200 len: 1136 time: 0.3155847 Nov 24 13:56:38.657716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37638) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:38.666017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cdb989ed-1d67-45f5-a0ef-e97fb9787542 None None] Port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:56:38.696246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.775649 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:38.790974 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:38.791594 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:38.859792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Deleting port 5bf11288-863b-4b6d-b3bf-7be2a3ad281b {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:38.860354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:38.892089 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:38.892664 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac24bff1-86dd-49fb-9ffe-30e2f9651880 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:39.054944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.060415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.067349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.080735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4300acc4-a05d-4493-aa51-9571488691c6 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:39.100609 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fd863135-5254-4887-aa26-ab5933524f83 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/floatingips/ebc16790-a305-4a13-9145-bc26603e8b92 HTTP/1.1" status: 200 len: 977 time: 4.7692769 Nov 24 13:56:39.120653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37644) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:39.124229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 862} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:56:39.147307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'port_id': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:39.238497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.243518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.270837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.271839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Fanout notify agent at l3_agent the message router_deleted on router 2f239c99-15b2-42d2-a32f-c9668c006fe2 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:39.283641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.288277 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-28b080bb-6db8-48b6-b2b8-f0cf475721b4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/routers/2f239c99-15b2-42d2-a32f-c9668c006fe2 HTTP/1.1" status: 204 len: 168 time: 1.1672301 Nov 24 13:56:39.288631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37648) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:39.340803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da0f0e44-9b33-42cf-b31b-7b5fefdf1d40,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:39.356481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Deleting port 82177d74-ba1d-4219-97ed-0b9322301ba0 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:39.356826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.387085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.387495 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Added segment b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d of type vlan for network 92817444-52d5-4de8-b61e-69979740df77 Nov 24 13:56:39.395909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:39.491144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.501262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f856a3e2-551f-4e33-b221-463f4af5e8f1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:39.529777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.575506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.616168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.692183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.720989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:39.733954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:39.747600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Calling delete_port for 82177d74-ba1d-4219-97ed-0b9322301ba0 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:39.800436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:56:39.809461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Port': ['ID=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:39.881045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:39.913464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:39.919626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:39.934338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Calling delete_port for 5bf11288-863b-4b6d-b3bf-7be2a3ad281b owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:39.971413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.470s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:39.972305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event deleted for resources: {'Port': ['ID=82177d74-ba1d-4219-97ed-0b9322301ba0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:39.982815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:40.029867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 458d4bdc-5269-4447-9d67-d54b8dfcaf23 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:40.111292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.129992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:40.130343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.132940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.134765 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/ports/82177d74-ba1d-4219-97ed-0b9322301ba0 HTTP/1.1" status: 204 len: 168 time: 0.8445339 Nov 24 13:56:40.138721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37658) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:40.166743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:40.167723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.288967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:40.479188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Network': ['ID=92817444-52d5-4de8-b61e-69979740df77,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:40.490300 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 875 time: 2.6669755 Nov 24 13:56:40.490300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:40.492971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37662) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:40.498515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 92817444-52d5-4de8-b61e-69979740df77 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:56:40.500654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'subnet': {'network_id': '92817444-52d5-4de8-b61e-69979740df77', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:40.515228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:40.523088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:subnet and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:40.526862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:40.531566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Deleting subnet 5e349693-d8b8-442a-9363-29a7735b64e0 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:56:40.536813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:40.538830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.591844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Made reservation on behalf of bdc37f91168b4b15811cdc290c7d3b64 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:40.594278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.621771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.626739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.632803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.633108 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP ebc16790-a305-4a13-9145-bc26603e8b92 disassociated. External IP: 172.26.4.34, port: 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f. Nov 24 13:56:40.702461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.709741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4ea7a215-5941-49f6-8732-d4cfb3e6419f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:40.764716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event deleted for resources: {'Port': ['ID=5bf11288-863b-4b6d-b3bf-7be2a3ad281b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:40.770785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:40.782276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.783006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.825453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:40.993044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.014875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c222bd85-3940-4075-95ad-f2f29e4703ea tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:41.057639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event deleted for resources: {'Subnet': ['ID=5e349693-d8b8-442a-9363-29a7735b64e0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:41.064029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:41.074926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.082192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-307f1419-9267-4466-acdc-1ad7d003a585 None None] Network eacb409b-6eec-4ae4-970a-2fffbb887f9c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:41.136442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/subnets/5e349693-d8b8-442a-9363-29a7735b64e0 HTTP/1.1" status: 204 len: 168 time: 0.9956672 Nov 24 13:56:41.137297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37670) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:41.169753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.221646 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "DELETE /v2.0/ports/5bf11288-863b-4b6d-b3bf-7be2a3ad281b HTTP/1.1" status: 204 len: 168 time: 2.5624869 Nov 24 13:56:41.224194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37676) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:41.272395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.304907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Deleting port ec09109d-a576-4bad-b5c2-9bf70e7144e3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:41.310367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.413563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] DHCP port deletion for eacb409b-6eec-4ae4-970a-2fffbb887f9c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:56:41.417893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Deleting port ec09109d-a576-4bad-b5c2-9bf70e7144e3 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:41.418262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.585562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:56:41.585997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.594804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-76b179ac-7f7e-4b8a-a4ea-eff0c39a099c tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:41.627390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] For port ec09109d-a576-4bad-b5c2-9bf70e7144e3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ec09109d-a576-4bad-b5c2-9bf70e7144e3,segment=NetworkSegment(318ba845-d068-4e4f-b1bc-1338cc7de118),segment_id=318ba845-d068-4e4f-b1bc-1338cc7de118)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:41.627390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.636356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] For port ec09109d-a576-4bad-b5c2-9bf70e7144e3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ec09109d-a576-4bad-b5c2-9bf70e7144e3,segment=NetworkSegment(318ba845-d068-4e4f-b1bc-1338cc7de118),segment_id=318ba845-d068-4e4f-b1bc-1338cc7de118)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:41.636843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.700923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Deleting subnet 630b82ae-f40d-42fb-8939-97d02e0ddd0a {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:56:41.710625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.763162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Calling delete_port for ec09109d-a576-4bad-b5c2-9bf70e7144e3 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:41.775308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Calling delete_port for ec09109d-a576-4bad-b5c2-9bf70e7144e3 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:41.806450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.835352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Subnet': ['ID=9a7f7f35-21b4-47ba-8801-49f36b8871de,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:41.839208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:41.848972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.853368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:41.863448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Checking segment: {'id': 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': '92817444-52d5-4de8-b61e-69979740df77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:41.863920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network hostable DHCP agents. Network: 92817444-52d5-4de8-b61e-69979740df77, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:56:41.893194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Pushing event deleted for resources: {'Port': ['ID=ec09109d-a576-4bad-b5c2-9bf70e7144e3,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:41.897632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:41.900765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] No DVR routers for this DVR port ec09109d-a576-4bad-b5c2-9bf70e7144e3 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:56:41.905437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:56:41.905946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:56:41.911817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 92817444-52d5-4de8-b61e-69979740df77 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:56:41.923295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 92817444-52d5-4de8-b61e-69979740df77) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:41.928752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:41.929675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:41.932758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Router 0e3cc882-6f8f-4df8-a4cb-048360d1452f is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:56:41.942997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ecc15c8-877e-48d2-9c06-e6dc8100fc88 None None] Network 92817444-52d5-4de8-b61e-69979740df77 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:41.972997 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 1.4788876 Nov 24 13:56:41.976287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37682) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:41.984874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-873744163', 'network_id': '92817444-52d5-4de8-b61e-69979740df77'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:41.991231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:41.995524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:port and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:42.000872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:42.008770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:42.027562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Made reservation on behalf of bdc37f91168b4b15811cdc290c7d3b64 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:42.036295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.068024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ec09109d-a576-4bad-b5c2-9bf70e7144e3 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:56:42.070703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] device_id is not set on port ca684401-0644-4213-89b3-0fb117939bc1 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:42.093624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.111848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: ec09109d-a576-4bad-b5c2-9bf70e7144e3 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:56:42.112989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ec09109d-a576-4bad-b5c2-9bf70e7144e3 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:56:42.209070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:42.257299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Allocated IP 2001:db8::c2 (92817444-52d5-4de8-b61e-69979740df77/9a7f7f35-21b4-47ba-8801-49f36b8871de/ca684401-0644-4213-89b3-0fb117939bc1) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:42.263641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2099c3f7-15a4-4712-9371-bebb9cd9b19a None None] Network 92817444-52d5-4de8-b61e-69979740df77 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:42.418294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.437185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-269912a1-2b94-4c6e-b3d2-371c7bbef6bd tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:42.487363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event deleted for resources: {'Subnet': ['ID=630b82ae-f40d-42fb-8939-97d02e0ddd0a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:42.506280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:42.539259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.544214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1817566b-6f4b-4f70-9b01-d4dc264fbfdb None None] Network 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:42.551551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Deleting port ec09109d-a576-4bad-b5c2-9bf70e7144e3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:42.551811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.598396 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "DELETE /v2.0/subnets/630b82ae-f40d-42fb-8939-97d02e0ddd0a HTTP/1.1" status: 204 len: 168 time: 1.3715782 Nov 24 13:56:42.605176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37690) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:42.633309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:42.639211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] The port 'ec09109d-a576-4bad-b5c2-9bf70e7144e3' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:56:42.648568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Sync routers for ids ['0e3cc882-6f8f-4df8-a4cb-048360d1452f'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:42.727107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Routers {'0e3cc882-6f8f-4df8-a4cb-048360d1452f'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:42.727734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0e3cc882-6f8f-4df8-a4cb-048360d1452f'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:42.747414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.751250 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 6.6869731 Nov 24 13:56:42.753267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.754961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37694) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:42.815864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.825612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.854521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eacb409b-6eec-4ae4-970a-2fffbb887f9c']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:42.872114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '318ba845-d068-4e4f-b1bc-1338cc7de118') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:42.872572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '318ba845-d068-4e4f-b1bc-1338cc7de118') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:42.895108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.915510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.930261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Releasing vlan 860 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:56:42.931053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.942862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Set router 0e3cc882-6f8f-4df8-a4cb-048360d1452f gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:56:42.949240 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:56:42.960846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:42.968845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:42.988832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Deleting port c0f08257-47ad-41f6-a678-2ffa51a61345 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:42.989170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.056953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] DHCP port deletion for 2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:56:43.067834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Deleting port c0f08257-47ad-41f6-a678-2ffa51a61345 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:43.068351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.098175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:43.102207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.108867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Port': ['ID=ca684401-0644-4213-89b3-0fb117939bc1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:43.111873 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:43.112436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 92817444-52d5-4de8-b61e-69979740df77 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:43.114358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:43.114972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:43.117543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.131268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:43.136734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.141070 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:43.141194 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:43.144245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:43.145260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:43.145822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.153991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Pushing event deleted for resources: {'Network': ['ID=eacb409b-6eec-4ae4-970a-2fffbb887f9c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:43.161202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:43.168660 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] 10.222.0.70 "DELETE /v2.0/networks/eacb409b-6eec-4ae4-970a-2fffbb887f9c HTTP/1.1" status: 204 len: 168 time: 2.0240219 Nov 24 13:56:43.185734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1028 time: 1.2063117 Nov 24 13:56:43.186737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37702) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:43.215218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-286bfef9-a545-4835-ad05-2ac0937ac9ca tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/floatingips/ebc16790-a305-4a13-9145-bc26603e8b92 HTTP/1.1" status: 200 len: 687 time: 4.0934443 Nov 24 13:56:43.229092 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:43.231823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37706) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:43.241899 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:43.242977 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:43.282806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Deleting port ca684401-0644-4213-89b3-0fb117939bc1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:43.284885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.328470 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:43.329171 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92f59e31-64de-4e19-bae7-341136b2a567 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:43.638832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.639084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] For port c0f08257-47ad-41f6-a678-2ffa51a61345, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c0f08257-47ad-41f6-a678-2ffa51a61345,segment=NetworkSegment(832d5bd7-6294-40a4-8412-88f87acd1805),segment_id=832d5bd7-6294-40a4-8412-88f87acd1805)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:43.639546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.695985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 6e65761a-32cd-44b9-a872-f7b2807fc253 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:43.696315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.740320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37716) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:43.801412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] For port c0f08257-47ad-41f6-a678-2ffa51a61345, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c0f08257-47ad-41f6-a678-2ffa51a61345,segment=NetworkSegment(832d5bd7-6294-40a4-8412-88f87acd1805),segment_id=832d5bd7-6294-40a4-8412-88f87acd1805)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:43.801772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.822770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Calling delete_port for ca684401-0644-4213-89b3-0fb117939bc1 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:43.834619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Calling delete_port for c0f08257-47ad-41f6-a678-2ffa51a61345 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:43.899204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e3cc882-6f8f-4df8-a4cb-048360d1452f', 'name': 'tempest-snat-router-1817374928', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.55'}], 'enable_snat': True}, 'gw_port_id': 'd5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:36Z', 'updated_at': '2021-11-24T13:56:40Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': 'd5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:09:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e3cc882-6f8f-4df8-a4cb-048360d1452f', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:38Z', 'updated_at': '2021-11-24T13:56:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:43.913657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Checking router: 0e3cc882-6f8f-4df8-a4cb-048360d1452f for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:43.914154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Updating router 0e3cc882-6f8f-4df8-a4cb-048360d1452f port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:56:43.973806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.974304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Calling delete_port for c0f08257-47ad-41f6-a678-2ffa51a61345 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:43.980005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:43.983129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:43.985907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:44.022574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c0f08257-47ad-41f6-a678-2ffa51a61345 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:56:44.039000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event deleted for resources: {'Port': ['ID=ca684401-0644-4213-89b3-0fb117939bc1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:44.042984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:44.061205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.088073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.092525 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-55035796-8794-4cd0-b318-6b75920d32ac tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/0e3cc882-6f8f-4df8-a4cb-048360d1452f HTTP/1.1" status: 200 len: 907 time: 1.3288221 Nov 24 13:56:44.095064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37722) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:44.107222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c0f08257-47ad-41f6-a678-2ffa51a61345 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:56:44.107718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c0f08257-47ad-41f6-a678-2ffa51a61345 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:56:44.110822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Pushing event deleted for resources: {'Port': ['ID=c0f08257-47ad-41f6-a678-2ffa51a61345,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:44.113765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:44.118680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] No DVR routers for this DVR port c0f08257-47ad-41f6-a678-2ffa51a61345 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:56:44.170275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/ports/ca684401-0644-4213-89b3-0fb117939bc1 HTTP/1.1" status: 204 len: 168 time: 0.9820011 Nov 24 13:56:44.172722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37726) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:44.178787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '92817444-52d5-4de8-b61e-69979740df77', 'external_fixed_ips': [{'subnet_id': '9a7f7f35-21b4-47ba-8801-49f36b8871de', 'ip_address': '2001:db8::c2'}]}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:44.185351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:44.190777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:router and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:44.195184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:44.204031 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0653e2d6-962b-48f9-a566-aeeea48bee35 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=e1c0868a017e403699c0ebf881c3c729&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4534936 Nov 24 13:56:44.204223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:44.204334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.204334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.204514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37730) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:44.213861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:56:44.214798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:56:44.253548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.254468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.336737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 6e65761a-32cd-44b9-a872-f7b2807fc253 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:44.474799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.485300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.507146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.510499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.511565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-926612e1-dd33-4ef2-9602-877f5556dcca tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:44.527748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Transition to ACTIVE for port object d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:44.528006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.540540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.553828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:44.560203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=6e65761a-32cd-44b9-a872-f7b2807fc253,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:44.562773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:44.630080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Attempting to bind port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:44.630455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Attempting to bind port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:44.630874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Attempting to bind port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:44.655044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:44.655737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:44.655873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.656239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:44.656733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Bound port: d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:44.657110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.667660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.681598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.683021 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/floatingips/ebc16790-a305-4a13-9145-bc26603e8b92 HTTP/1.1" status: 204 len: 168 time: 1.3017104 Nov 24 13:56:44.687589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37738) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:44.745078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.747370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] For port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:44.751625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] For port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:44.761293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.769862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.786956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43934e4e-078f-43cb-a09a-1a3b706a122b None None] Pushing event updated for resources: {'Port': ['ID=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:44.790867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-43934e4e-078f-43cb-a09a-1a3b706a122b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:44.791324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-51e64d2a-2a61-49e2-be4e-2a24a0de6e64 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:44.845070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Routers {'0e3cc882-6f8f-4df8-a4cb-048360d1452f'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:44.845710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0e3cc882-6f8f-4df8-a4cb-048360d1452f'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:44.860990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Deleting port c0f08257-47ad-41f6-a678-2ffa51a61345 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:44.861646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.867347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.879171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3c9dca3-3bd2-4f29-a82d-0e948e230bb2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:44.902950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f059a01f-fa72-48a7-ba6f-d358cc38c562,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:44.910133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:44.913218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-228461a2-b45f-4aad-9d30-32c673ecaaa4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] delete failed (client error): The resource could not be found. Nov 24 13:56:44.914231 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-228461a2-b45f-4aad-9d30-32c673ecaaa4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/floatingips/ebc16790-a305-4a13-9145-bc26603e8b92 HTTP/1.1" status: 404 len: 345 time: 0.2254670 Nov 24 13:56:44.923028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37744) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:44.948609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] The port 'c0f08257-47ad-41f6-a678-2ffa51a61345' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:56:44.970707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:44.975163 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/f059a01f-fa72-48a7-ba6f-d358cc38c562 HTTP/1.1" status: 204 len: 168 time: 0.7674792 Nov 24 13:56:45.041935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43934e4e-078f-43cb-a09a-1a3b706a122b None None] Pushing event updated for resources: {'Port': ['ID=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:45.048502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-43934e4e-078f-43cb-a09a-1a3b706a122b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:45.087987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] Set router 0e3cc882-6f8f-4df8-a4cb-048360d1452f gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:45.090022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.119595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2204bcd4-4bc7-4ca5-9b7d-8259eb286b52']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:45.135003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '832d5bd7-6294-40a4-8412-88f87acd1805') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:45.135581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '832d5bd7-6294-40a4-8412-88f87acd1805') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:45.151435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.173843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.183660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:56:45.184090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.191948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71bd9f48-cbbc-4f98-8647-e74934372c6f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:45.196350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71bd9f48-cbbc-4f98-8647-e74934372c6f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:56:45.201865 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:56:45.209022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71bd9f48-cbbc-4f98-8647-e74934372c6f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:45.211749 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-71bd9f48-cbbc-4f98-8647-e74934372c6f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/ports?network_id=6f791889-bb28-41c6-bdd5-71e28ee97eae HTTP/1.1" status: 200 len: 2357 time: 0.2853253 Nov 24 13:56:45.214375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37752) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:45.382779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.393071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-050fee8e-afd3-431b-b498-957ddf909081 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:45.394656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-050fee8e-afd3-431b-b498-957ddf909081 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Synchronizing usage tracker for tenant:7eb7035f979a46b388c48c890d0ee3b4 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:45.407032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:45.411682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.426613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.443750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Pushing event deleted for resources: {'Network': ['ID=2204bcd4-4bc7-4ca5-9b7d-8259eb286b52,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:45.450942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:45.453616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.454279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] 10.222.0.70 "DELETE /v2.0/networks/2204bcd4-4bc7-4ca5-9b7d-8259eb286b52 HTTP/1.1" status: 204 len: 168 time: 2.8470726 Nov 24 13:56:45.464032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-050fee8e-afd3-431b-b498-957ddf909081 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Unset dirty status for tenant:7eb7035f979a46b388c48c890d0ee3b4 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:45.469963 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-050fee8e-afd3-431b-b498-957ddf909081 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/subnets/d79c3e0a-e48a-43fd-b2f3-134c860e3935 HTTP/1.1" status: 200 len: 797 time: 0.2492654 Nov 24 13:56:45.470189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37762) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:45.488827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0e3cc882-6f8f-4df8-a4cb-048360d1452f', 'name': 'tempest-snat-router-1817374928', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.55'}], 'enable_snat': True}, 'gw_port_id': 'd5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:36Z', 'updated_at': '2021-11-24T13:56:40Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': 'd5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:09:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e3cc882-6f8f-4df8-a4cb-048360d1452f', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:38Z', 'updated_at': '2021-11-24T13:56:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:45.494240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27913f1d-53cd-4bf6-bcae-0b424928458e None None] The sync data for ids ['0e3cc882-6f8f-4df8-a4cb-048360d1452f'] in dv-neutron-818151-2-hyperv is: [{'id': '0e3cc882-6f8f-4df8-a4cb-048360d1452f', 'name': 'tempest-snat-router-1817374928', 'tenant_id': '3872d6d57b1a42eb979825c2f5fab10d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.55'}], 'enable_snat': True}, 'gw_port_id': 'd5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:36Z', 'updated_at': '2021-11-24T13:56:40Z', 'revision_number': 3, 'project_id': '3872d6d57b1a42eb979825c2f5fab10d', 'gw_port': {'id': 'd5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:09:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0e3cc882-6f8f-4df8-a4cb-048360d1452f', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:38Z', 'updated_at': '2021-11-24T13:56:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:45.514685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'port': {'network_id': '6f791889-bb28-41c6-bdd5-71e28ee97eae', 'name': 'tempest-FloatingIPTestJSON-1042291580', 'fixed_ips': [{'ip_address': '172.20.0.13'}, {'ip_address': '172.20.0.12'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:45.550211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.647445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:45.647747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:45.923357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37776) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:45.958235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Allocated IP 2001:db8::c2 (92817444-52d5-4de8-b61e-69979740df77/9a7f7f35-21b4-47ba-8801-49f36b8871de/5889c26d-b771-4a13-b9aa-b1edd1acde62) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:46.108496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:46.153191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.223282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:46.225157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:46.232675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.234052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:46.234529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.259805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-860861b1-21ef-4684-a970-849c5eedf5b3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:46.317669 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b2a586dd-ec37-4bb5-bec3-217abf2814df admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=aea3485fe4554db6b307070cf1fecc65&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3924925 Nov 24 13:56:46.318424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37790) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:46.355479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:port and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:46.365838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:46.394739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:46.421371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.458311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.502095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37794) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:46.507684 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [-] 10.222.0.70 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0042791 Nov 24 13:56:46.510347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.512335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37796) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:46.528807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:46.535810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.540421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:46.553703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.564204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:46.590998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 92817444-52d5-4de8-b61e-69979740df77 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:46.592418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59e44f79-81ef-43ab-93db-ba79b228892f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:46.592951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:46.600741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:46.601386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:46.603020 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/59e44f79-81ef-43ab-93db-ba79b228892f HTTP/1.1" status: 204 len: 168 time: 0.2832472 Nov 24 13:56:46.604329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:46.654863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:46.667320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:46.686854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:46.750292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Port': ['ID=5889c26d-b771-4a13-b9aa-b1edd1acde62,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:46.753281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cad7199b-44ce-43ae-bf71-d45c3e31ad80 tempest-NetworksApiDiscovery-741049037 tempest-NetworksApiDiscovery-741049037-project] 10.222.0.70 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.2390900 Nov 24 13:56:46.804228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.551s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:46.852115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] For port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:46.852607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.023401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Calling delete_port for d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:47.084656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.089973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37818) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:47.141723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] device_id is not set on port a3e3bf0e-62bf-4d6f-8988-b315f36c5998 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:47.249391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.323321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:47.329608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Usage tracker for resource:security_group_rule and tenant:fb7197a3c95b449ebac2cc69509481bd is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:47.335467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:47.351132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:47.361351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.362109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.444928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.450494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.459936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3f23a1ed-f2ab-4a65-8acf-69672b15986e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:47.465455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:56:47.465774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:56:47.499475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.511122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec557e2d-f293-4cf9-abea-cbe1562aca05,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:47.515032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:47.521722 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=fb7197a3c95b449ebac2cc69509481bd&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4269691 Nov 24 13:56:47.522714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37834) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:47.595459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.623076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.689013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.693051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.13 (6f791889-bb28-41c6-bdd5-71e28ee97eae/d79c3e0a-e48a-43fd-b2f3-134c860e3935/a3e3bf0e-62bf-4d6f-8988-b315f36c5998) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:47.695575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc20df16-c5c4-4c62-b0e5-37d832473261 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:47.701575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.12 (6f791889-bb28-41c6-bdd5-71e28ee97eae/d79c3e0a-e48a-43fd-b2f3-134c860e3935/a3e3bf0e-62bf-4d6f-8988-b315f36c5998) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:47.709496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec557e2d-f293-4cf9-abea-cbe1562aca05,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:47.712921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:47.715180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:47.720062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37840) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:47.723779 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/ec557e2d-f293-4cf9-abea-cbe1562aca05 HTTP/1.1" status: 204 len: 168 time: 0.1972516 Nov 24 13:56:47.886601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-555795097'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:47.906057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:47.916347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:network and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:47.928390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:47.949228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:47.980494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:47.980843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.006828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:48.047939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:48.052290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.081919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.099868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:48.101059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.114886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.137994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Router 2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:56:48.300933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:48.326760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:security_group_rule and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:48.330232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:48.344847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:48.397229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.405622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] For port d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:48.405969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.422089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:48.718788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Calling delete_port for d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:48.843749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:48.861463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:48.872748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=a3e3bf0e-62bf-4d6f-8988-b315f36c5998,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:48.883209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:48.915283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.493s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:48.982139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:48.993374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.000815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f347d937-4255-4e10-b917-ff87fa6c568c tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:49.025154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:49.025758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.054237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 878} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:56:49.094215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'SecurityGroup': ['ID=743a3b19-74bf-425a-9fef-c4bda45d1bda,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:49.098518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:49.109602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.109934 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Added segment 5be17c8a-ee48-498e-8842-ab1952d21718 of type vlan for network 26f84c92-a854-4366-b20f-034e36babb08 Nov 24 13:56:49.125708 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1010 time: 3.6545179 Nov 24 13:56:49.129148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37854) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:49.134818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'a3e3bf0e-62bf-4d6f-8988-b315f36c5998', 'fixed_ip_address': '172.20.0.13'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:49.140547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:49.145326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:floatingip and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:49.148276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:49.154124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:49.169952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.188437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.216588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:49.236205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Sync routers for ids ['2ff88eee-a3e4-49a0-a4cb-85d06f0c2470'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:49.256468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Routers {'2ff88eee-a3e4-49a0-a4cb-85d06f0c2470'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:49.256856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.257607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2ff88eee-a3e4-49a0-a4cb-85d06f0c2470'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:49.261814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:49.297430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.310831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:49.311392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.316881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.320653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37862) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:49.320843 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d880de88-cdf3-449d-be44-bc50cec6cd91 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 877 time: 5.1468132 Nov 24 13:56:49.331291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event deleted for resources: {'Port': ['ID=d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:49.339358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:49.340053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1727e82c-51b8-45b4-a779-2cb2b15ce455 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:49.454569 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.7333119 Nov 24 13:56:49.492701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.510211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Set router 2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:49.583130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Network': ['ID=26f84c92-a854-4366-b20f-034e36babb08,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:49.588597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:49.642421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 26f84c92-a854-4366-b20f-034e36babb08 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:56:49.798441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.156 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/90fa5787-2fe4-4d83-8231-c7e4dce36630) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:49.810495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:49.923334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.038814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ff88eee-a3e4-49a0-a4cb-85d06f0c2470', 'name': '', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '92817444-52d5-4de8-b61e-69979740df77', 'external_fixed_ips': [{'subnet_id': '9a7f7f35-21b4-47ba-8801-49f36b8871de', 'ip_address': '2001:db8::c2'}], 'enable_snat': True}, 'gw_port_id': '5889c26d-b771-4a13-b9aa-b1edd1acde62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:44Z', 'updated_at': '2021-11-24T13:56:46Z', 'revision_number': 3, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port': {'id': '5889c26d-b771-4a13-b9aa-b1edd1acde62', 'name': '', 'network_id': '92817444-52d5-4de8-b61e-69979740df77', 'tenant_id': '', 'mac_address': 'fa:16:3e:8e:12:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2ff88eee-a3e4-49a0-a4cb-85d06f0c2470', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '9a7f7f35-21b4-47ba-8801-49f36b8871de', 'ip_address': '2001:db8::c2', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:56:45Z', 'updated_at': '2021-11-24T13:56:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '9a7f7f35-21b4-47ba-8801-49f36b8871de', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:50.043454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Checking router: 2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:56:50.043827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Updating router 2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 port 5889c26d-b771-4a13-b9aa-b1edd1acde62 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:56:50.116631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.196712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.197571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.204092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.274853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.275784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 0e3cc882-6f8f-4df8-a4cb-048360d1452f {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:50.288133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.294021 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/routers/0e3cc882-6f8f-4df8-a4cb-048360d1452f HTTP/1.1" status: 204 len: 168 time: 6.1956325 Nov 24 13:56:50.294528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37868) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:50.323141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.340310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:50.496066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:50.528500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.530018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:50.543226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Transition to ACTIVE for port object 5889c26d-b771-4a13-b9aa-b1edd1acde62 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:50.546565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=90fa5787-2fe4-4d83-8231-c7e4dce36630,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:50.548216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:50.557206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.561309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:50.614201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:50.652849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Attempting to bind port 5889c26d-b771-4a13-b9aa-b1edd1acde62 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:50.653487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Attempting to bind port 5889c26d-b771-4a13-b9aa-b1edd1acde62 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': '92817444-52d5-4de8-b61e-69979740df77'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:50.654140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Attempting to bind port 5889c26d-b771-4a13-b9aa-b1edd1acde62 on network 92817444-52d5-4de8-b61e-69979740df77 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:50.656463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ecab8e-9c30-445f-b5f1-07392afe57e7 None None] Pushing event updated for resources: {'Port': ['ID=5889c26d-b771-4a13-b9aa-b1edd1acde62,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:50.661632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-99ecab8e-9c30-445f-b5f1-07392afe57e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:50.666900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:50.667458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Checking segment: {'id': 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': '92817444-52d5-4de8-b61e-69979740df77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:50.668053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.668601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Bound using segment: {'id': 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': '92817444-52d5-4de8-b61e-69979740df77'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:50.669222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Bound port: 5889c26d-b771-4a13-b9aa-b1edd1acde62, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': '92817444-52d5-4de8-b61e-69979740df77'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:50.669751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.713333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.755101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] For port 5889c26d-b771-4a13-b9aa-b1edd1acde62, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:50.759014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] For port 5889c26d-b771-4a13-b9aa-b1edd1acde62, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5889c26d-b771-4a13-b9aa-b1edd1acde62,segment=NetworkSegment(b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d),segment_id=b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:50.766678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.772202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7ce5e86b-0c92-4113-9557-66792d70f5ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:50.856532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:50.910583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ecab8e-9c30-445f-b5f1-07392afe57e7 None None] Pushing event updated for resources: {'Port': ['ID=5889c26d-b771-4a13-b9aa-b1edd1acde62,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:50.915637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-99ecab8e-9c30-445f-b5f1-07392afe57e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:50.916868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Routers {'2ff88eee-a3e4-49a0-a4cb-85d06f0c2470'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:50.917640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2ff88eee-a3e4-49a0-a4cb-85d06f0c2470'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:50.931524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Deleting port 5889c26d-b771-4a13-b9aa-b1edd1acde62 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:50.931901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:51.099530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] Set router 2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:56:51.163493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:51.190491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Deleting port 458d4bdc-5269-4447-9d67-d54b8dfcaf23 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:51.191430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:51.246779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2ff88eee-a3e4-49a0-a4cb-85d06f0c2470', 'name': '', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:44Z', 'updated_at': '2021-11-24T13:56:50Z', 'revision_number': 4, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:51.251561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e61529-b054-4679-ab50-024ec543dbcf None None] The sync data for ids ['2ff88eee-a3e4-49a0-a4cb-85d06f0c2470'] in dv-neutron-818151-2-hyperv is: [{'id': '2ff88eee-a3e4-49a0-a4cb-85d06f0c2470', 'name': '', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:56:44Z', 'updated_at': '2021-11-24T13:56:50Z', 'revision_number': 4, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:51.370050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] For port 5889c26d-b771-4a13-b9aa-b1edd1acde62, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5889c26d-b771-4a13-b9aa-b1edd1acde62,segment=NetworkSegment(b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d),segment_id=b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:51.370603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:51.506694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] For port 458d4bdc-5269-4447-9d67-d54b8dfcaf23, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=458d4bdc-5269-4447-9d67-d54b8dfcaf23,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:51.509192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:51.541810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Calling delete_port for 5889c26d-b771-4a13-b9aa-b1edd1acde62 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:51.641852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Calling delete_port for 458d4bdc-5269-4447-9d67-d54b8dfcaf23 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:51.927586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:51.933189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5e54e613-3af0-4428-8145-92f1a31469ff tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:51.988483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event deleted for resources: {'Port': ['ID=458d4bdc-5269-4447-9d67-d54b8dfcaf23,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:51.991252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:52.071413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.078739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61e1a0ff-6dbf-4066-b4ff-743e97bf35ac tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:52.222239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.242345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.300337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event deleted for resources: {'Port': ['ID=5889c26d-b771-4a13-b9aa-b1edd1acde62,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:52.303383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:52.460081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.484523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.610373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.614962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.642067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.642892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 86320247-2ce6-427c-8ed9-e67eb36549db {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:52.657332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.662617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "DELETE /v2.0/routers/86320247-2ce6-427c-8ed9-e67eb36549db HTTP/1.1" status: 204 len: 168 time: 2.3631172 Nov 24 13:56:52.662617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37884) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:52.668247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1262985189', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:52.676722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:52.680659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Usage tracker for resource:router and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:52.683558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:52.690290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:52.702901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.703988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.725385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.793384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.864562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.892111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.950141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:52.951227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:52.987511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.001185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.002729 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/routers/2ff88eee-a3e4-49a0-a4cb-85d06f0c2470 HTTP/1.1" status: 204 len: 168 time: 3.6809006 Nov 24 13:56:53.004517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37892) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:53.007594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.011635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37896) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:53.017640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'subnet': {'network_id': '26f84c92-a854-4366-b20f-034e36babb08', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:53.034251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1462309f-57df-4f13-8069-cd8096e16834 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:53.148014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.179592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.261970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Deleting subnet 9a7f7f35-21b4-47ba-8801-49f36b8871de {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:56:53.301592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=90fa5787-2fe4-4d83-8231-c7e4dce36630,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:53.304505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:53.317677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.338102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Allocated IP 172.26.4.222 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/1541f6cf-09be-458f-bd35-14f289a3ebe1) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:53.360970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:53.381086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:subnet and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:53.385253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:53.395099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:53.400164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.427396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.488646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.500832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:53.517226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.521668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-78af4e7e-31fc-46c5-a491-e90ecfc5632e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:53.587803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:53.591305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:53.594250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:53.625168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event updated for resources: {'Port': ['ID=1541f6cf-09be-458f-bd35-14f289a3ebe1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:53.629151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:53.730674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.772806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.773511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.791868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:53.990911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.004696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e04d1865-3081-4849-9343-40ff7dd838d0 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:54.024137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Router 9fe8de26-591f-4828-8726-df1bcece267a is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:56:54.049961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=9a7f7f35-21b4-47ba-8801-49f36b8871de,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:54.060312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:54.070491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.126823 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/subnets/9a7f7f35-21b4-47ba-8801-49f36b8871de HTTP/1.1" status: 204 len: 168 time: 1.0493011 Nov 24 13:56:54.131998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37906) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:54.256757 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP 904f551b-9163-45b9-aeac-28083625f960 associated. External IP: 172.26.4.156, port: a3e3bf0e-62bf-4d6f-8988-b315f36c5998. Nov 24 13:56:54.285735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:54.301190 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] Sync routers for ids ['9fe8de26-591f-4828-8726-df1bcece267a'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:54.324735 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] Routers {'9fe8de26-591f-4828-8726-df1bcece267a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:54.325732 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9fe8de26-591f-4828-8726-df1bcece267a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.336798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.343155 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 1.6773002 Nov 24 13:56:54.344108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37912) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:54.351808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': False}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:54.359128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.422470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.436383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eb2660ac-2abc-4c37-838a-6d2ff8c62646 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:54.453786 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.468201 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] Routers {'9fe8de26-591f-4828-8726-df1bcece267a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:54.469020 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9fe8de26-591f-4828-8726-df1bcece267a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.532879 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.533287 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12a4a765-1533-4b3b-8bbd-2f33ae4316e5 None None] The sync data for ids ['9fe8de26-591f-4828-8726-df1bcece267a'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:54.648732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.668624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Subnet': ['ID=4a14fbf1-a9e7-403d-85aa-bb53582e04b5,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:54.688993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:54.700904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['92817444-52d5-4de8-b61e-69979740df77']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.719265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.719556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b70f2dd3-1b62-49dc-a5b1-6a6c3e3f041d') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:54.738860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.747099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Checking segment: {'id': '5be17c8a-ee48-498e-8842-ab1952d21718', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '26f84c92-a854-4366-b20f-034e36babb08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:54.747855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network hostable DHCP agents. Network: 26f84c92-a854-4366-b20f-034e36babb08, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:56:54.768716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.789002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Releasing vlan 862 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:56:54.789402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:56:54.803930 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:56:54.902099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network 26f84c92-a854-4366-b20f-034e36babb08 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:56:54.907013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.916133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 92817444-52d5-4de8-b61e-69979740df77 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Nov 24 13:56:54.918771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:54.935681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.943470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 26f84c92-a854-4366-b20f-034e36babb08) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:54.947141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event deleted for resources: {'Network': ['ID=92817444-52d5-4de8-b61e-69979740df77,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:54.950048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:54.953501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:54.954078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:54.960919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8deb39a-4950-4185-8d5d-a09e2685b6ac None None] Network 26f84c92-a854-4366-b20f-034e36babb08 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:54.966355 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/networks/92817444-52d5-4de8-b61e-69979740df77 HTTP/1.1" status: 204 len: 168 time: 0.8298104 Nov 24 13:56:55.045018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.0351646 Nov 24 13:56:55.046326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37918) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:55.053034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-606484420'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:55.062711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:55.068599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:network and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:55.073037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:55.081268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:55.107212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:55.110475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.180960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.224475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 861} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:56:55.239014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.239350 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Added segment ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7 of type vlan for network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a Nov 24 13:56:55.283202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.343198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:55.346574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.364761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:55.365455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.383370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a0c8b265-fd69-4df5-bd04-bbc432062208 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:55.423447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-26f84c92-a854-4366-b20f-034e36babb08', 'network_id': '26f84c92-a854-4366-b20f-034e36babb08', 'tenant_id': 'ed4d3f403947472c992ff0a82bb6a2d1', 'fixed_ips': [{'subnet_id': '4a14fbf1-a9e7-403d-85aa-bb53582e04b5'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:56:55.426496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.707923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Allocated IP 2001:db8:0:ffff::2 (26f84c92-a854-4366-b20f-034e36babb08/4a14fbf1-a9e7-403d-85aa-bb53582e04b5/d71f9aa0-0dcd-427a-af4e-d97b88441803) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:55.758503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37932) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:55.769248 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.7218828 Nov 24 13:56:55.775123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37936) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:55.778216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'name': 'tempest-router--1474455845', 'project_id': 'ed1e41baf8fd474ab35c26dbb66f718b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:55.787805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Network': ['ID=6f4eb763-c60f-43f9-9fe6-2a515f31ae4a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:55.790654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:55.795907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'subnet': {'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:55.814345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.431s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:55.821402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:router and tenant:ed1e41baf8fd474ab35c26dbb66f718b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:55.829602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:55.837428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.843019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.899590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:55.942312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.943269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.947726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:55.958532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:55.965141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:subnet and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:55.970880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Transition to ACTIVE for port object d71f9aa0-0dcd-427a-af4e-d97b88441803 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:55.994831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Transition to ACTIVE for port object d71f9aa0-0dcd-427a-af4e-d97b88441803 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:56.005191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:56:56.021204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:56.023918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 458d4bdc-5269-4447-9d67-d54b8dfcaf23 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:56:56.052347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:56.066383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 458d4bdc-5269-4447-9d67-d54b8dfcaf23 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:56:56.066819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 458d4bdc-5269-4447-9d67-d54b8dfcaf23 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:56:56.067238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:56:56.077497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:56.100328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.105869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.110411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-43934e4e-078f-43cb-a09a-1a3b706a122b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:56.115917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Router 9fe8de26-591f-4828-8726-df1bcece267a has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:56:56.142499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:56:56.142499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d5a605d1-cfdb-4cbc-8e38-3cf97a0a3b32 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:56:56.215676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.228168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.241533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Network 26f84c92-a854-4366-b20f-034e36babb08 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:56.257788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:56.264595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:56.329325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.333332 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-51184a06-d640-40c1-961b-6c468031cb03 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.5601985 Nov 24 13:56:56.334899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37940) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:56.341676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Pushing event updated for resources: {'Port': ['ID=d71f9aa0-0dcd-427a-af4e-d97b88441803,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:56.355084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:56.368748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Attempting to bind port d71f9aa0-0dcd-427a-af4e-d97b88441803 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:56.368748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Attempting to bind port d71f9aa0-0dcd-427a-af4e-d97b88441803 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5be17c8a-ee48-498e-8842-ab1952d21718', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '26f84c92-a854-4366-b20f-034e36babb08'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:56.369202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Attempting to bind port d71f9aa0-0dcd-427a-af4e-d97b88441803 on network 26f84c92-a854-4366-b20f-034e36babb08 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:56.376969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:56.377285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Checking segment: {'id': '5be17c8a-ee48-498e-8842-ab1952d21718', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '26f84c92-a854-4366-b20f-034e36babb08'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:56.377786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.378229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Bound using segment: {'id': '5be17c8a-ee48-498e-8842-ab1952d21718', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '26f84c92-a854-4366-b20f-034e36babb08'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:56.378694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Bound port: d71f9aa0-0dcd-427a-af4e-d97b88441803, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5be17c8a-ee48-498e-8842-ab1952d21718', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '26f84c92-a854-4366-b20f-034e36babb08'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:56.379058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.380826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:56.392289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.393752 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-404744dc-57af-45ad-86bd-2d7d7b6ee768 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "PUT /v2.0/routers/9fe8de26-591f-4828-8726-df1bcece267a HTTP/1.1" status: 200 len: 922 time: 2.0484622 Nov 24 13:56:56.396745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37944) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:56.422058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:56:56.435859 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:56.444753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] Sync routers for ids ['9fe8de26-591f-4828-8726-df1bcece267a'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:56:56.451350 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:56.452256 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.486078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] Routers {'9fe8de26-591f-4828-8726-df1bcece267a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:56.487376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9fe8de26-591f-4828-8726-df1bcece267a'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.552804 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.553617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.556753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] For port d71f9aa0-0dcd-427a-af4e-d97b88441803, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:56.570155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] For port d71f9aa0-0dcd-427a-af4e-d97b88441803, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d71f9aa0-0dcd-427a-af4e-d97b88441803,segment=NetworkSegment(5be17c8a-ee48-498e-8842-ab1952d21718),segment_id=5be17c8a-ee48-498e-8842-ab1952d21718)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:56.582073 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:56.582645 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.593959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.597786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] Routers {'9fe8de26-591f-4828-8726-df1bcece267a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:56:56.598416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9fe8de26-591f-4828-8726-df1bcece267a'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.665065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.709732 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.709923 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f60389e3-a6dd-4dd2-8200-e1f6662dc625 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:56.752792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:56.770220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:56.802265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:56:56.802680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7296c5d2-d7b0-4e39-836a-fd9018c11ca4 None None] The sync data for ids ['9fe8de26-591f-4828-8726-df1bcece267a'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:56:56.816967 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-adff48d2-09f1-4b5b-a452-1ae5c0168751 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/9fe8de26-591f-4828-8726-df1bcece267a HTTP/1.1" status: 200 len: 922 time: 0.4176781 Nov 24 13:56:56.819642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37954) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:56.849280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Pushing event updated for resources: {'Port': ['ID=d71f9aa0-0dcd-427a-af4e-d97b88441803,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:56.854105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:56.912368 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f1e30adf-52ae-4d32-b744-28f6ccfe4c98 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=9fe8de26-591f-4828-8726-df1bcece267a&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0913804 Nov 24 13:56:56.914883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37958) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:56.932607 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 984 time: 7.8019657 Nov 24 13:56:56.933623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37962) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:56.957435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'port_id': 'a3e3bf0e-62bf-4d6f-8988-b315f36c5998', 'fixed_ip_address': '172.20.0.12'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:57.087563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb0851a4-c02a-446d-8d7d-c94dffdacd29 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:57.088316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fb0851a4-c02a-446d-8d7d-c94dffdacd29 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Synchronizing usage tracker for tenant:3872d6d57b1a42eb979825c2f5fab10d on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:56:57.106542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fb0851a4-c02a-446d-8d7d-c94dffdacd29 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Unset dirty status for tenant:3872d6d57b1a42eb979825c2f5fab10d on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:56:57.108170 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fb0851a4-c02a-446d-8d7d-c94dffdacd29 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.1921086 Nov 24 13:56:57.110840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37966) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:57.156619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-83097edc-da92-43d8-b3c1-58bf7bbca229 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=9fe8de26-591f-4828-8726-df1bcece267a HTTP/1.1" status: 200 len: 205 time: 0.0440211 Nov 24 13:56:57.158792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37970) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:57.373693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.405727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.593750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.605178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Deleting port 1541f6cf-09be-458f-bd35-14f289a3ebe1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:56:57.605523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.657475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:56:57.673475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.726152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.730887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.760738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5a4bd6c-1078-494c-9c8b-898d952467f0 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:57.825676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:57.842194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9de2c6fa-c6bd-4286-82e4-08619956b07c None None] Network 26f84c92-a854-4366-b20f-034e36babb08 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:57.995552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Calling delete_port for 1541f6cf-09be-458f-bd35-14f289a3ebe1 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:56:58.010951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-80ded44e-7609-4761-a6b7-4607bdc881af None None] Provisioning for port d71f9aa0-0dcd-427a-af4e-d97b88441803 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:58.022642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.023405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 437d9c49-7f81-4df4-9007-96470f7f3bf1 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:58.028165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Subnet': ['ID=f8ca5703-a315-4f64-8d4b-8b6b304bc6a5,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:58.035722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:58.088430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d71f9aa0-0dcd-427a-af4e-d97b88441803 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:56:58.128332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Checking segment: {'id': 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:58.128672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network hostable DHCP agents. Network: 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:56:58.147336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.151122 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-011ba021-6ec3-4ae7-a80a-c5dcf4bcf9fe tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/routers/437d9c49-7f81-4df4-9007-96470f7f3bf1 HTTP/1.1" status: 204 len: 168 time: 1.8126273 Nov 24 13:56:58.209594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.225859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c85dac04-8d06-4aeb-8650-fd9a6ae0e7ce tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:58.254623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:56:58.257593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d71f9aa0-0dcd-427a-af4e-d97b88441803 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:56:58.273290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d71f9aa0-0dcd-427a-af4e-d97b88441803 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:58.275735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.324452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event deleted for resources: {'Port': ['ID=1541f6cf-09be-458f-bd35-14f289a3ebe1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:58.333983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:58.361165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:56:58.361851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.379795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37982) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:58.387330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-caad2697-1a43-47bd-b90e-266363e7adc7 None None] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:56:58.428775 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 2.6453581 Nov 24 13:56:58.432590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 37988) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:58.456270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'port': {'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a', 'name': 'tempest-NetworksIpV6TestAttrs-2144240550'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:58.563635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.693579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-6f4eb763-c60f-43f9-9fe6-2a515f31ae4a', 'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a', 'tenant_id': 'ed4d3f403947472c992ff0a82bb6a2d1', 'fixed_ips': [{'subnet_id': 'f8ca5703-a315-4f64-8d4b-8b6b304bc6a5'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:56:58.694441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.710477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d71f9aa0-0dcd-427a-af4e-d97b88441803, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d71f9aa0-0dcd-427a-af4e-d97b88441803,segment=NetworkSegment(5be17c8a-ee48-498e-8842-ab1952d21718),segment_id=5be17c8a-ee48-498e-8842-ab1952d21718)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:56:58.716665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:58.722368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.723110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.723530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:port and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:58.723831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.724325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.724832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.725331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.725826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.726316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.726828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.727324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.727842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:56:58.731671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:58.739794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:58.742671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.517s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:58.752473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.761837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.769520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f92e066-6206-4b34-916f-2540bdae786d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:58.812097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:56:58.815451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.845318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5607e220-46af-48a5-aeb7-51acbb024d50 None None] Provisioning complete for port d71f9aa0-0dcd-427a-af4e-d97b88441803 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:56:58.845775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5607e220-46af-48a5-aeb7-51acbb024d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.859856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-428192704', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:58.868004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:58.872145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Usage tracker for resource:router and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:58.875363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:58.882171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:58.921443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.922645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:58.961679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] device_id is not set on port dddea5b7-b637-4a3b-927b-e7a2456f8d3d yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:56:58.981516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d71f9aa0-0dcd-427a-af4e-d97b88441803,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:58.985163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:59.046924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.051162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.056056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.058319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.067604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Allocated IP 2001:db8::f816:3eff:fe43:679c (6f4eb763-c60f-43f9-9fe6-2a515f31ae4a/f8ca5703-a315-4f64-8d4b-8b6b304bc6a5/2769dfa3-216d-47c5-b2b3-02f298003915) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:59.099186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.099743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Fanout notify agent at l3_agent the message router_deleted on router 9fe8de26-591f-4828-8726-df1bcece267a {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:56:59.130768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.136417 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/9fe8de26-591f-4828-8726-df1bcece267a HTTP/1.1" status: 204 len: 168 time: 1.9760873 Nov 24 13:56:59.137013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 37998) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:59.142403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1436849320', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:59.150489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:56:59.155440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Usage tracker for resource:router and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:56:59.158873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.159019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:56:59.167139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:56:59.184506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.186291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.210133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.229298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.259832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.265172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9e107671-bb13-4d6d-90e7-a13339e5e139 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.1254001 Nov 24 13:56:59.265172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38002) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:56:59.276282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:56:59.353279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.364584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Transition to ACTIVE for port object 2769dfa3-216d-47c5-b2b3-02f298003915 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:59.394761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Transition to ACTIVE for port object 2769dfa3-216d-47c5-b2b3-02f298003915 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:56:59.404316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.411305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-99ecab8e-9c30-445f-b5f1-07392afe57e7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:59.475550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:56:59.478415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:56:59.486492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:56:59.497210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Pushing event updated for resources: {'Port': ['ID=2769dfa3-216d-47c5-b2b3-02f298003915,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:59.523530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:59.592863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Attempting to bind port 2769dfa3-216d-47c5-b2b3-02f298003915 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:56:59.593252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Attempting to bind port 2769dfa3-216d-47c5-b2b3-02f298003915 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:56:59.593614 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Attempting to bind port 2769dfa3-216d-47c5-b2b3-02f298003915 on network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:56:59.600733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 56, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:56:59.601115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Checking segment: {'id': 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:56:59.601524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.601924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Bound using segment: {'id': 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:56:59.602523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Bound port: 2769dfa3-216d-47c5-b2b3-02f298003915, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '6f4eb763-c60f-43f9-9fe6-2a515f31ae4a'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:56:59.603035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.611964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.622334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Allocated IP 2001:db8::f816:3eff:fef1:2b6b (6f4eb763-c60f-43f9-9fe6-2a515f31ae4a/f8ca5703-a315-4f64-8d4b-8b6b304bc6a5/dddea5b7-b637-4a3b-927b-e7a2456f8d3d) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:56:59.715688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.746149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] For port 2769dfa3-216d-47c5-b2b3-02f298003915, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:56:59.749594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] For port 2769dfa3-216d-47c5-b2b3-02f298003915, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2769dfa3-216d-47c5-b2b3-02f298003915,segment=NetworkSegment(ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7),segment_id=ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:56:59.755353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.760513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6152329a-72a5-4861-9428-94239db2f0d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:56:59.839001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Pushing event updated for resources: {'Port': ['ID=2769dfa3-216d-47c5-b2b3-02f298003915,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:56:59.842349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:56:59.921089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:56:59.957326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.070985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.082793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d71f9aa0-0dcd-427a-af4e-d97b88441803 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:00.110479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Transition to ACTIVE for port object dddea5b7-b637-4a3b-927b-e7a2456f8d3d will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:00.156293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Allocated IP 172.26.4.14 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/aae70a5d-6f7a-4eaa-b478-cbb3fdf30e16) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:00.232250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d71f9aa0-0dcd-427a-af4e-d97b88441803 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:00.232631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.235574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.246901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:00.352062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.384213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.405992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.410251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:00.411195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Port': ['ID=dddea5b7-b637-4a3b-927b-e7a2456f8d3d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:00.433018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.438321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64453476-b351-4794-87eb-ee7baf0bfab2 tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:00.457264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:00.465167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:00.469488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:00.470135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.493133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.493494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.493858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.494218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.494583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.494931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.495280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.495632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.496006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.496352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.496694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:00.509167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:00.556226 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 951 time: 2.1206200 Nov 24 13:57:00.560442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:00.618980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:00.622564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:00.624646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event updated for resources: {'Port': ['ID=aae70a5d-6f7a-4eaa-b478-cbb3fdf30e16,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:00.626781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:00.655358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:00.700185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting subnet f8ca5703-a315-4f64-8d4b-8b6b304bc6a5 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:57:00.703416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:00.714054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Allocated IP 172.26.4.229 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/0c64c0dc-319d-4783-8f46-69157b687e5f) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:00.715951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.802287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.808238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.982364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.986492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:00.998442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-759abe33-9f16-42b7-9def-b882cf6ffce6 None None] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:01.091404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.113152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8a1dc0ea-7ad5-45f4-a6b9-22e5d664b21d None None] Provisioning for port 2769dfa3-216d-47c5-b2b3-02f298003915 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:01.239274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Router dfb7a792-bd06-44c5-b5e1-3f3024f735d2 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:01.338951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.440299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.453669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63b36c0f-551d-440d-9c75-9e38f4b68f1c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:01.549133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:01.562248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:01.570145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.571068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:01.598040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3082ad63-a393-4470-af78-611b2e2bdc9d None None] Provisioning for port dddea5b7-b637-4a3b-927b-e7a2456f8d3d completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:01.603968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3082ad63-a393-4470-af78-611b2e2bdc9d None None] Provisioning complete for port dddea5b7-b637-4a3b-927b-e7a2456f8d3d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:01.604439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3082ad63-a393-4470-af78-611b2e2bdc9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.614823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event updated for resources: {'Port': ['ID=0c64c0dc-319d-4783-8f46-69157b687e5f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:01.625169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:01.625597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:01.638878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:01.662753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] Sync routers for ids ['dfb7a792-bd06-44c5-b5e1-3f3024f735d2'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:01.666549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.668134 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "PUT /v2.0/routers/dfb7a792-bd06-44c5-b5e1-3f3024f735d2 HTTP/1.1" status: 200 len: 879 time: 2.3978944 Nov 24 13:57:01.683953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38022) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:01.684075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Subnet': ['ID=f8ca5703-a315-4f64-8d4b-8b6b304bc6a5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:01.689388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:01.691344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:01.701639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.712241 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:01.717078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:01.719992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] Routers {'dfb7a792-bd06-44c5-b5e1-3f3024f735d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:01.720642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dfb7a792-bd06-44c5-b5e1-3f3024f735d2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.732153 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:01.733072 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.792500 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/f8ca5703-a315-4f64-8d4b-8b6b304bc6a5 HTTP/1.1" status: 204 len: 168 time: 1.2301302 Nov 24 13:57:01.797115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38026) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:01.825303 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.839986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.844132 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:01.845035 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.850331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3082ad63-a393-4470-af78-611b2e2bdc9d None None] Port dddea5b7-b637-4a3b-927b-e7a2456f8d3d cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:57:01.878828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7cc4e9c-9233-4dbf-88c5-6c64dd5c45bd None None] Network 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:01.892267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] Routers {'dfb7a792-bd06-44c5-b5e1-3f3024f735d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:01.894237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dfb7a792-bd06-44c5-b5e1-3f3024f735d2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.923489 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.925336 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6cfbd67-dcc0-40a8-8b1a-df4e03031635 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:01.945330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-89879a2c-0829-4609-8040-014a4e8f723a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/floatingips/904f551b-9163-45b9-aeac-28083625f960 HTTP/1.1" status: 200 len: 979 time: 5.0075037 Nov 24 13:57:01.949204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38030) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:01.951687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6496c788-be0e-47e7-b875-c875d2dfa110 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:01.953612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6496c788-be0e-47e7-b875-c875d2dfa110 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:01.958653 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6496c788-be0e-47e7-b875-c875d2dfa110 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1551964 Nov 24 13:57:01.961126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38034) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:01.976990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:01.977405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0f4d98c-51f4-4988-a334-5d868912a813 None None] The sync data for ids ['dfb7a792-bd06-44c5-b5e1-3f3024f735d2'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:02.061849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-48c5795a-9a19-4e7e-935b-3bd905f9e3e6 None None] Provisioning complete for port dddea5b7-b637-4a3b-927b-e7a2456f8d3d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:02.062402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-48c5795a-9a19-4e7e-935b-3bd905f9e3e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.101453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2769dfa3-216d-47c5-b2b3-02f298003915 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:02.105671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f656a66-d6ca-4b0a-a41c-cae253c3fb65 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.118997 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-99c4b112-4239-4bf5-9735-d9b2c45854d8 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/dfb7a792-bd06-44c5-b5e1-3f3024f735d2 HTTP/1.1" status: 200 len: 920 time: 0.4381967 Nov 24 13:57:02.120671 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-4f656a66-d6ca-4b0a-a41c-cae253c3fb65 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 24 13:57:02.121105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4f656a66-d6ca-4b0a-a41c-cae253c3fb65 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:02.126141 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4f656a66-d6ca-4b0a-a41c-cae253c3fb65 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/6f4eb763-c60f-43f9-9fe6-2a515f31ae4a HTTP/1.1" status: 409 len: 405 time: 0.1580133 Nov 24 13:57:02.126141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38038) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:02.126383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38042) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:02.160707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-588103021'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:02.169596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:02.178969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:network and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:02.182833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:02.191479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:02.210251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:02.231341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.231566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 90fa5787-2fe4-4d83-8231-c7e4dce36630 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:02.232056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.257860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-48c5795a-9a19-4e7e-935b-3bd905f9e3e6 None None] Port dddea5b7-b637-4a3b-927b-e7a2456f8d3d cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:57:02.269542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.270412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.297767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 2769dfa3-216d-47c5-b2b3-02f298003915 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:02.304253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 862} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:02.306892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2769dfa3-216d-47c5-b2b3-02f298003915 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:02.307281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.320057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-08a9fc08-a6ed-43af-8fb2-fe3a6c80d515 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=dfb7a792-bd06-44c5-b5e1-3f3024f735d2&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1957314 Nov 24 13:57:02.324515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38046) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:02.327743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.328231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Added segment f7657bb1-396a-435b-83fb-568e6fb54e8d of type vlan for network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 Nov 24 13:57:02.388883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] DHCP port deletion for 6f4eb763-c60f-43f9-9fe6-2a515f31ae4a request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:57:02.420347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Deleting port 2769dfa3-216d-47c5-b2b3-02f298003915 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:02.420797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.453927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.527021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.570856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.571205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.577310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 2769dfa3-216d-47c5-b2b3-02f298003915, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2769dfa3-216d-47c5-b2b3-02f298003915,segment=NetworkSegment(ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7),segment_id=ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:02.587847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.592657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f92e066-6206-4b34-916f-2540bdae786d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:02.690823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] It took 0.21 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:57:02.699045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a7a16c5-eb6f-42c9-b5e0-db9e110101f1 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:02.700082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 90fa5787-2fe4-4d83-8231-c7e4dce36630 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:02.700859 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0a7a16c5-eb6f-42c9-b5e0-db9e110101f1 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.3751707 Nov 24 13:57:02.704126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38056) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:02.756144 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a9e7e8af-6641-4378-a966-a7860d01c7a7 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=dfb7a792-bd06-44c5-b5e1-3f3024f735d2 HTTP/1.1" status: 200 len: 205 time: 0.0506516 Nov 24 13:57:02.758513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38060) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:02.779344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] For port 2769dfa3-216d-47c5-b2b3-02f298003915, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2769dfa3-216d-47c5-b2b3-02f298003915,segment=NetworkSegment(ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7),segment_id=ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:02.779738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.791740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=2769dfa3-216d-47c5-b2b3-02f298003915,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:02.825836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.837549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:02.838541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.849705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d69c49a6-d71e-4c1b-b40e-d13083031da0 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:02.850051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.850336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.850812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.851130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.851448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.851785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.852101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.852417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.852778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.853091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.853402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:02.902340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:02.905565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:02.907554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7bae1ed2-acfe-4ce2-8245-19ec9d8b214f tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:02.956797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=90fa5787-2fe4-4d83-8231-c7e4dce36630,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:02.964048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:02.967495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Calling delete_port for 2769dfa3-216d-47c5-b2b3-02f298003915 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:02.973014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Network': ['ID=cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:02.979486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:02.984904 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.8576686 Nov 24 13:57:02.988817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:02.994265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'subnet': {'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:02.997645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:03.015798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Router f7339c0d-a0c2-4777-a40a-51e11ecc846d is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:03.157388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e760293a-44d2-4102-ba83-38a492311d1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.164614 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:03.166331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:03.184611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:03.191004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:subnet and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:03.194340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:03.201683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:03.230600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:03.247003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.329407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.406117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.514742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.555530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:03.566012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] Sync routers for ids ['f7339c0d-a0c2-4777-a40a-51e11ecc846d'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:03.578664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] Routers {'f7339c0d-a0c2-4777-a40a-51e11ecc846d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:03.579286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f7339c0d-a0c2-4777-a40a-51e11ecc846d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:03.643803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:03.648191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.652140 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 5.2666218 Nov 24 13:57:03.653876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38068) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:03.657486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] Routers {'f7339c0d-a0c2-4777-a40a-51e11ecc846d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:03.658215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f7339c0d-a0c2-4777-a40a-51e11ecc846d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:03.705739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Deleting port 2769dfa3-216d-47c5-b2b3-02f298003915 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:03.706128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.753973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:03.754385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8cdd64b-9797-40fe-a2b5-2b88b2582708 None None] The sync data for ids ['f7339c0d-a0c2-4777-a40a-51e11ecc846d'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:03.846473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:03.848962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:03.951179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Deleting port aae70a5d-6f7a-4eaa-b478-cbb3fdf30e16 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:03.951517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.007914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] For port 2769dfa3-216d-47c5-b2b3-02f298003915, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2769dfa3-216d-47c5-b2b3-02f298003915,segment=NetworkSegment(ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7),segment_id=ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:04.008447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.079884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2769dfa3-216d-47c5-b2b3-02f298003915 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:04.084807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:57:04.103328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:04.106829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.108741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.115858 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:04.132747 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:04.133683 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:04.172738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Calling delete_port for 2769dfa3-216d-47c5-b2b3-02f298003915 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:04.177336 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/floatingips/904f551b-9163-45b9-aeac-28083625f960 HTTP/1.1" status: 204 len: 168 time: 2.2270513 Nov 24 13:57:04.177981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38078) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:04.228916 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:04.264597 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:04.268285 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:56:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:04.272970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:04.276892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port a3e3bf0e-62bf-4d6f-8988-b315f36c5998 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:04.277340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.325770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.332383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-905f5752-1416-4d0d-8a0d-4c7beee4d674 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:04.367747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.391111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Pushing event deleted for resources: {'Port': ['ID=2769dfa3-216d-47c5-b2b3-02f298003915,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:04.397986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:04.406625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] No DVR routers for this DVR port 2769dfa3-216d-47c5-b2b3-02f298003915 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:04.412836 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:04.413531 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f13edcc-13a0-48ac-988d-52b94780cdcf None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:04.414867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Subnet': ['ID=ff9638a3-fd57-464c-8184-b1f719583602,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:04.431391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.439246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:04.445893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-56e659cd-29e6-424a-9c63-a9dda3707ac4 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/f7339c0d-a0c2-4777-a40a-51e11ecc846d HTTP/1.1" status: 200 len: 924 time: 0.7891896 Nov 24 13:57:04.448258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38082) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:04.502720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Checking segment: {'id': 'f7657bb1-396a-435b-83fb-568e6fb54e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:04.502939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network hostable DHCP agents. Network: cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:04.516288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48a3df83-5842-4c5e-a0c9-099ba3d2933d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=f7339c0d-a0c2-4777-a40a-51e11ecc846d HTTP/1.1" status: 200 len: 205 time: 0.0674603 Nov 24 13:57:04.519732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38086) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:04.570909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Calling delete_port for aae70a5d-6f7a-4eaa-b478-cbb3fdf30e16 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:04.646768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:04.668218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:04.673339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:04.673914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.679554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66687a36-1403-4aaf-9a68-40ef46c4af37 None None] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:04.702095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.704308 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7145505 Nov 24 13:57:04.710203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38090) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:04.719650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'port': {'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4', 'name': 'tempest-NetworksIpV6TestAttrs-146998187'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:04.902437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.907949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b4fd052-13d7-4457-96ee-82a01982fc9f tempest-FloatingIPAdminTestJSON-1520419459 tempest-FloatingIPAdminTestJSON-1520419459-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:04.928876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4', 'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4', 'tenant_id': 'ed4d3f403947472c992ff0a82bb6a2d1', 'fixed_ips': [{'subnet_id': 'ff9638a3-fd57-464c-8184-b1f719583602'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:57:04.929714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:04.990661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for a3e3bf0e-62bf-4d6f-8988-b315f36c5998 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:04.992544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:04.998342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:port and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:05.018068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:05.021353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event deleted for resources: {'Port': ['ID=aae70a5d-6f7a-4eaa-b478-cbb3fdf30e16,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:05.026401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:05.028551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:05.132239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:05.136046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.188741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Allocated IP 2001:db8::f816:3eff:fee7:43b1 (cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4/ff9638a3-fd57-464c-8184-b1f719583602/1e5d4d8a-d61d-4f15-8f11-37914f3a0c16) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:05.224535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.319632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.325381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:05.350484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] device_id is not set on port 07dace0f-ac25-4a07-89ee-569bdc1dcf33 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:05.372481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=a3e3bf0e-62bf-4d6f-8988-b315f36c5998,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:05.377330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:05.419820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.429663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.439073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Transition to ACTIVE for port object 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:05.457552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Transition to ACTIVE for port object 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:05.463989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.472683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:05.531894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:05.539577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:05.543670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:05.549785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Pushing event updated for resources: {'Port': ['ID=1e5d4d8a-d61d-4f15-8f11-37914f3a0c16,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:05.554146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:05.609347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.623116 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/ports/a3e3bf0e-62bf-4d6f-8988-b315f36c5998 HTTP/1.1" status: 204 len: 168 time: 1.4405320 Nov 24 13:57:05.628741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38100) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:05.636044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:05.640678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.641820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Attempting to bind port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:05.642194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Attempting to bind port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'f7657bb1-396a-435b-83fb-568e6fb54e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:05.644630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Attempting to bind port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 on network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:05.646637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:05.651677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:05.652101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Checking segment: {'id': 'f7657bb1-396a-435b-83fb-568e6fb54e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:05.652216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:floatingip and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:05.652570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.653033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Bound using segment: {'id': 'f7657bb1-396a-435b-83fb-568e6fb54e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:05.653599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Bound port: 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7657bb1-396a-435b-83fb-568e6fb54e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:05.654020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.655482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:05.658169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Deleting port 0c64c0dc-319d-4783-8f46-69157b687e5f {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:05.658574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.688592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:05.719414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.726649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c04c03d5-05e5-4ab0-bbc7-e8dfb76f3e7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.766749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] For port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:05.769624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.770361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] For port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1e5d4d8a-d61d-4f15-8f11-37914f3a0c16,segment=NetworkSegment(f7657bb1-396a-435b-83fb-568e6fb54e8d),segment_id=f7657bb1-396a-435b-83fb-568e6fb54e8d)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:05.775175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.779528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:05.784327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.799388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Allocated IP 2001:db8::f816:3eff:fe59:489f (cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4/ff9638a3-fd57-464c-8184-b1f719583602/07dace0f-ac25-4a07-89ee-569bdc1dcf33) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:05.839193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.840035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Fanout notify agent at l3_agent the message router_deleted on router dfb7a792-bd06-44c5-b5e1-3f3024f735d2 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:05.860226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:05.861964 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/dfb7a792-bd06-44c5-b5e1-3f3024f735d2 HTTP/1.1" status: 204 len: 168 time: 3.1016724 Nov 24 13:57:05.865197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Pushing event updated for resources: {'Port': ['ID=1e5d4d8a-d61d-4f15-8f11-37914f3a0c16,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:05.868402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:05.872712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38104) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:05.885140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-2003667454', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:05.899133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:05.911675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Usage tracker for resource:router and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:05.916308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:05.932491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.074935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:06.099096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Calling delete_port for 0c64c0dc-319d-4783-8f46-69157b687e5f owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:06.154328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.155252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.223549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.266075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.297372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.308103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.350179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Transition to ACTIVE for port object 07dace0f-ac25-4a07-89ee-569bdc1dcf33 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:06.357182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.358408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e53c748b-db11-4d14-95d8-e37a6a072d18 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.4848568 Nov 24 13:57:06.362459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38114) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:06.368959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': True}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:06.513873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.547012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.553284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-02d06db3-93c8-4865-94e3-fccc2cbaf0b8 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:06.573291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4c1f944-ef6d-4db0-a6f0-c69614f7a88f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:06.597896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.170 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/b1d116e0-bef6-4ec4-be5f-c41c8d909bca) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:06.614422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event deleted for resources: {'Port': ['ID=0c64c0dc-319d-4783-8f46-69157b687e5f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:06.620580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:06.644592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.722365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:06.729241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:06.732519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Port': ['ID=07dace0f-ac25-4a07-89ee-569bdc1dcf33,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:06.735211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:06.736109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:06.740632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:06.741247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.820406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 2.1082027 Nov 24 13:57:06.827117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:06.958079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting subnet ff9638a3-fd57-464c-8184-b1f719583602 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:57:06.963157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.967227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.978698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:06.988780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b4c9d27-98f1-4462-b1bf-b7035b50e0b8 None None] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:07.048044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.104866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bea58a5c-1283-4f0f-ae3b-3e003491f0b0 None None] Provisioning for port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:07.112266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.246531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.298163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.306218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.326098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.349928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-906c47da-3695-41b5-924e-100670c92c1b tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:07.374703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.387009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.387551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Fanout notify agent at l3_agent the message router_deleted on router f7339c0d-a0c2-4777-a40a-51e11ecc846d {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:07.413904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.444994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:07.449391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:07.451577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=b1d116e0-bef6-4ec4-be5f-c41c8d909bca,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:07.454022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.457797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.459121 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/f7339c0d-a0c2-4777-a40a-51e11ecc846d HTTP/1.1" status: 204 len: 168 time: 2.9387977 Nov 24 13:57:07.460386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:07.468880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38128) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:07.469123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a459087c-7b6b-4105-b883-ff8ab9c180be tempest-DHCPAgentSchedulersTestJSON-1240419911 tempest-DHCPAgentSchedulersTestJSON-1240419911-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:07.488716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:07.515706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'name': 'tempest-snat-router-956211895', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': False}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:07.526948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:07.542556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Subnet': ['ID=ff9638a3-fd57-464c-8184-b1f719583602,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:07.545182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:07.546204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:router and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:07.556799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:07.567464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.571149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:07.610090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c09ee3b-4228-4ab4-9e16-f4e28d17d623 None None] Network cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:07.623734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.624908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.639362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/ff9638a3-fd57-464c-8184-b1f719583602 HTTP/1.1" status: 204 len: 168 time: 0.8112195 Nov 24 13:57:07.645466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38132) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:07.669823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.736161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.816573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8aea5c07-4b0a-42ce-90c6-480d30a636bd None None] Provisioning for port 07dace0f-ac25-4a07-89ee-569bdc1dcf33 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:07.823023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8aea5c07-4b0a-42ce-90c6-480d30a636bd None None] Provisioning complete for port 07dace0f-ac25-4a07-89ee-569bdc1dcf33 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:07.823023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8aea5c07-4b0a-42ce-90c6-480d30a636bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.851218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:07.859560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Allocated IP 172.26.4.100 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/ffb51fec-bc19-4d0c-af5b-610d65218b4b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:07.883067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6be53dd1-4aac-41e0-a0e2-8ca0dfc7b8b4 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:07.884528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6be53dd1-4aac-41e0-a0e2-8ca0dfc7b8b4 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:07.885277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6be53dd1-4aac-41e0-a0e2-8ca0dfc7b8b4 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Synchronizing usage tracker for tenant:ed4d3f403947472c992ff0a82bb6a2d1 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:07.887463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8aea5c07-4b0a-42ce-90c6-480d30a636bd None None] Port 07dace0f-ac25-4a07-89ee-569bdc1dcf33 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:57:07.951996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] DHCP port deletion for cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:57:07.956860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Deleting port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:07.957229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.043937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6be53dd1-4aac-41e0-a0e2-8ca0dfc7b8b4 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Unset dirty status for tenant:ed4d3f403947472c992ff0a82bb6a2d1 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:08.043937 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6be53dd1-4aac-41e0-a0e2-8ca0dfc7b8b4 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.3948834 Nov 24 13:57:08.067726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38136) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:08.149302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.163182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] For port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1e5d4d8a-d61d-4f15-8f11-37914f3a0c16,segment=NetworkSegment(f7657bb1-396a-435b-83fb-568e6fb54e8d),segment_id=f7657bb1-396a-435b-83fb-568e6fb54e8d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:08.163786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.188828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.208945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.214486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60d10bcd-8837-425d-9029-d4667d33e74d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.218209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.229033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-03d5d3b0-2902-43d2-b794-2ebca1a220aa tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:08.305662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.309907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48a3f6a2-9297-4f08-a272-59ab49575b78 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:08.322318 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-60d10bcd-8837-425d-9029-d4667d33e74d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): There was a conflict when trying to complete your request. Nov 24 13:57:08.322681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60d10bcd-8837-425d-9029-d4667d33e74d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:08.325111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=b1d116e0-bef6-4ec4-be5f-c41c8d909bca,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:08.327522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Calling delete_port for 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:08.339738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:08.349198 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-60d10bcd-8837-425d-9029-d4667d33e74d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 HTTP/1.1" status: 409 len: 405 time: 0.2766688 Nov 24 13:57:08.350607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38140) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:08.363740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-259205758'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:08.373272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:08.384061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:network and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:08.386925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.394497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:08.399862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:08.401624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Port': ['ID=ffb51fec-bc19-4d0c-af5b-610d65218b4b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:08.404515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:08.405554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:08.406580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:08.408739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:08.419606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.421383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.7902906 Nov 24 13:57:08.425907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38146) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:08.428895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.431937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'port': {'network_id': '6f791889-bb28-41c6-bdd5-71e28ee97eae', 'name': 'tempest-FloatingIPTestJSON-1145342357'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:08.450879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:08.454766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.459744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.463994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:08.508463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Pushing event deleted for resources: {'Port': ['ID=1e5d4d8a-d61d-4f15-8f11-37914f3a0c16,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:08.511915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:08.515197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] No DVR routers for this DVR port 1e5d4d8a-d61d-4f15-8f11-37914f3a0c16 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:08.565766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 864} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:08.593409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.593755 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Added segment 0c64ce30-b013-4835-b04f-5d8a0e09fd00 of type vlan for network d6be2542-59ff-4ef4-adbe-a4f39f298392 Nov 24 13:57:08.623549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:08.635585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:port and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:08.640885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for port was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:08.648759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.652672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:08.674254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.676516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:08.680930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.708738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.710477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] device_id is not set on port cf657499-bb8a-4218-8ad6-ffba00b23cb4 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:08.745175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.749421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:08.750303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.771487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:08.805470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.4536619 Nov 24 13:57:08.816781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38154) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:08.826822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'subnet': {'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:08.876565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Allocated IP 172.26.4.52 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/41f79423-82d3-4871-a3cb-fda06d1064f4) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:08.883637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:08.976743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Network': ['ID=d6be2542-59ff-4ef4-adbe-a4f39f298392,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:08.988317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network d6be2542-59ff-4ef4-adbe-a4f39f298392 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:08.997188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:09.071174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:09.089932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:09.092168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.2 (6f791889-bb28-41c6-bdd5-71e28ee97eae/d79c3e0a-e48a-43fd-b2f3-134c860e3935/cf657499-bb8a-4218-8ad6-ffba00b23cb4) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:09.116951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:09.167809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.181213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.189579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.275336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.301134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.306095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5b4139ca-c27b-42a8-95ce-94e472b968ac tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:09.510069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.531890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:09.541704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:09.547073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:09.588868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Port': ['ID=41f79423-82d3-4871-a3cb-fda06d1064f4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:09.604678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:09.626784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.633343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f830dddf-df65-44b8-9333-7f8ffc38be47 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:09.756158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=cf657499-bb8a-4218-8ad6-ffba00b23cb4,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:09.759798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 6f791889-bb28-41c6-bdd5-71e28ee97eae is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:09.762854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:09.763778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:09.768793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:09.783999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Router b40087fc-c614-4d5d-80a9-7fec7c01788e is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:09.889439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:09.890349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.037595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:57:10.044401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:10.044999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.048408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.059215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:10.124802 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.6958406 Nov 24 13:57:10.127782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38164) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:10.146559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'port_id': 'cf657499-bb8a-4218-8ad6-ffba00b23cb4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:10.191588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:10.201482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] Sync routers for ids ['b40087fc-c614-4d5d-80a9-7fec7c01788e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:10.208814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Subnet': ['ID=b9a382e7-cf6f-4573-ac18-52931067e6ea,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:10.219203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.220494 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "PUT /v2.0/routers/b40087fc-c614-4d5d-80a9-7fec7c01788e HTTP/1.1" status: 200 len: 915 time: 3.8570065 Nov 24 13:57:10.223791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38168) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:10.228511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:10.236741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] Routers {'b40087fc-c614-4d5d-80a9-7fec7c01788e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:10.237772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b40087fc-c614-4d5d-80a9-7fec7c01788e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:10.243726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.302821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Checking segment: {'id': '0c64ce30-b013-4835-b04f-5d8a0e09fd00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:10.303016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network hostable DHCP agents. Network: d6be2542-59ff-4ef4-adbe-a4f39f298392, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:10.315462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:10.330239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] Routers {'b40087fc-c614-4d5d-80a9-7fec7c01788e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:10.331093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b40087fc-c614-4d5d-80a9-7fec7c01788e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:10.390357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:10.390786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c570c541-782a-432a-b2c4-3a3370f46473 None None] The sync data for ids ['b40087fc-c614-4d5d-80a9-7fec7c01788e'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:10.423055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Router d423653b-8446-4056-b3e3-303440a46eed is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:10.425497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network d6be2542-59ff-4ef4-adbe-a4f39f298392 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:10.443227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, d6be2542-59ff-4ef4-adbe-a4f39f298392) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:10.454285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:10.455071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.456092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a55282b5-7c4d-4d09-aba0-0222cc33da35 None None] Network d6be2542-59ff-4ef4-adbe-a4f39f298392 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:10.535951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 1.7182736 Nov 24 13:57:10.539116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38172) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:10.638634 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d1829603-d5cc-45d2-9a17-280cc09966a1 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/b40087fc-c614-4d5d-80a9-7fec7c01788e HTTP/1.1" status: 200 len: 921 time: 0.4137006 Nov 24 13:57:10.645934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38176) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:10.683389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-d6be2542-59ff-4ef4-adbe-a4f39f298392', 'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392', 'tenant_id': 'ed4d3f403947472c992ff0a82bb6a2d1', 'fixed_ips': [{'subnet_id': 'b9a382e7-cf6f-4573-ac18-52931067e6ea'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:57:10.684252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.770270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.823311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-59f17c6f-543a-494b-aa1a-56adf75ebdfe tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Synchronizing usage tracker for tenant:3872d6d57b1a42eb979825c2f5fab10d on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:10.851708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-59f17c6f-543a-494b-aa1a-56adf75ebdfe tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Unset dirty status for tenant:3872d6d57b1a42eb979825c2f5fab10d on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:10.852650 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-59f17c6f-543a-494b-aa1a-56adf75ebdfe tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=b40087fc-c614-4d5d-80a9-7fec7c01788e&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2057710 Nov 24 13:57:10.855447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38180) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:10.858770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Allocated IP 2001:db8::f816:3eff:fe14:82cf (d6be2542-59ff-4ef4-adbe-a4f39f298392/b9a382e7-cf6f-4573-ac18-52931067e6ea/156d49e6-a98a-4e78-b1fa-d14844489c5b) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:10.867557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.905811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:10.919489 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Sync routers for ids ['d423653b-8446-4056-b3e3-303440a46eed'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:10.945851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:10.949769 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 3.4472477 Nov 24 13:57:10.949940 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Routers {'d423653b-8446-4056-b3e3-303440a46eed'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:10.949940 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d423653b-8446-4056-b3e3-303440a46eed'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:10.951171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38186) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:11.078041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb29c18d-6b49-4233-992c-bf9088c68c4f tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:11.086279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eb29c18d-6b49-4233-992c-bf9088c68c4f tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.2297723 Nov 24 13:57:11.089983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38194) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:11.129516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.145238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Transition to ACTIVE for port object 156d49e6-a98a-4e78-b1fa-d14844489c5b will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:11.188802 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Set router d423653b-8446-4056-b3e3-303440a46eed gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:11.208918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Transition to ACTIVE for port object 156d49e6-a98a-4e78-b1fa-d14844489c5b will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:11.223402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.232734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-da3ea9b2-4c84-4bd8-85f6-aa316101aa0b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:11.301095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.311930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:11.353998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.397807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Network d6be2542-59ff-4ef4-adbe-a4f39f298392 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:11.401977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:11.404837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Pushing event updated for resources: {'Port': ['ID=156d49e6-a98a-4e78-b1fa-d14844489c5b,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:11.407303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:11.411052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:11.411605 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0ac4c06d-faa5-4512-bfbb-23fa18b0206e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=b40087fc-c614-4d5d-80a9-7fec7c01788e HTTP/1.1" status: 200 len: 205 time: 0.0537214 Nov 24 13:57:11.412394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38198) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:11.414804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.515955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Attempting to bind port 156d49e6-a98a-4e78-b1fa-d14844489c5b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:11.516693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Attempting to bind port 156d49e6-a98a-4e78-b1fa-d14844489c5b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '0c64ce30-b013-4835-b04f-5d8a0e09fd00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:11.517256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Attempting to bind port 156d49e6-a98a-4e78-b1fa-d14844489c5b on network d6be2542-59ff-4ef4-adbe-a4f39f298392 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:11.525431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:11.526089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Checking segment: {'id': '0c64ce30-b013-4835-b04f-5d8a0e09fd00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:11.526790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.527349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Bound using segment: {'id': '0c64ce30-b013-4835-b04f-5d8a0e09fd00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:11.528015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Bound port: 156d49e6-a98a-4e78-b1fa-d14844489c5b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c64ce30-b013-4835-b04f-5d8a0e09fd00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:11.528575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.547010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ff9b6d73-d1c1-4a55-b46d-88b5f8800c8f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/d423653b-8446-4056-b3e3-303440a46eed HTTP/1.1" status: 200 len: 907 time: 0.5943487 Nov 24 13:57:11.547839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Subnet': ['ID=b9a382e7-cf6f-4573-ac18-52931067e6ea,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:11.556610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38202) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:11.557118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:11.565117 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd423653b-8446-4056-b3e3-303440a46eed', 'name': 'tempest-snat-router-956211895', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.52'}], 'enable_snat': False}, 'gw_port_id': '41f79423-82d3-4871-a3cb-fda06d1064f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:57:07Z', 'updated_at': '2021-11-24T13:57:09Z', 'revision_number': 3, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port': {'id': '41f79423-82d3-4871-a3cb-fda06d1064f4', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:b0:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd423653b-8446-4056-b3e3-303440a46eed', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:57:08Z', 'updated_at': '2021-11-24T13:57:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:11.569424 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Checking router: d423653b-8446-4056-b3e3-303440a46eed for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:57:11.569885 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Updating router d423653b-8446-4056-b3e3-303440a46eed port 41f79423-82d3-4871-a3cb-fda06d1064f4 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:57:11.570743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'name': 'tempest-snat-router-956211895', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': True}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:11.575617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:11.581181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Usage tracker for resource:router and tenant:bdc37f91168b4b15811cdc290c7d3b64 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:11.584084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Quota usage for router was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:11.596509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:11.623956 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.636630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.637553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.651942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] For port 156d49e6-a98a-4e78-b1fa-d14844489c5b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:11.656609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] For port 156d49e6-a98a-4e78-b1fa-d14844489c5b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=156d49e6-a98a-4e78-b1fa-d14844489c5b,segment=NetworkSegment(0c64ce30-b013-4835-b04f-5d8a0e09fd00),segment_id=0c64ce30-b013-4835-b04f-5d8a0e09fd00)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:11.663869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.671077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-25863036-bdac-4e01-86aa-6e281b9e81d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:11.679352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.708367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d6be2542-59ff-4ef4-adbe-a4f39f298392']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:11.724589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c64ce30-b013-4835-b04f-5d8a0e09fd00') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:11.725512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c64ce30-b013-4835-b04f-5d8a0e09fd00') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:11.742434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.767270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.779249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 864 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:11.779677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:11.780059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Pushing event updated for resources: {'Port': ['ID=156d49e6-a98a-4e78-b1fa-d14844489c5b,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:11.811971 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:11.816698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:11.857210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d00aeb2-5134-48c5-98ca-218bbd928ae3 None None] Network d6be2542-59ff-4ef4-adbe-a4f39f298392 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:11.893019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 13:57:11.893019 dv-neutron-818151-2-hyperv neutron-server[83526]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 13:57:11.893019 dv-neutron-818151-2-hyperv neutron-server[83526]: [parameters: {'id': 'd6be2542-59ff-4ef4-adbe-a4f39f298392'}] Nov 24 13:57:11.893019 dv-neutron-818151-2-hyperv neutron-server[83526]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:11.893866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:11.950078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.019824 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.032293 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Transition to ACTIVE for port object 41f79423-82d3-4871-a3cb-fda06d1064f4 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:12.039364 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.044886 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:12.078459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56cb4626-df19-45b6-b506-f6c3fed4752f None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 13:57:12.109606 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fc643b-8f42-476e-8057-d171ad53b391 None None] Pushing event updated for resources: {'Port': ['ID=41f79423-82d3-4871-a3cb-fda06d1064f4,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:12.139352 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Attempting to bind port 41f79423-82d3-4871-a3cb-fda06d1064f4 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:12.139717 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Attempting to bind port 41f79423-82d3-4871-a3cb-fda06d1064f4 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:12.140290 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Attempting to bind port 41f79423-82d3-4871-a3cb-fda06d1064f4 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:12.149278 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:12.149658 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:12.150075 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.150458 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:12.150931 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Bound port: 41f79423-82d3-4871-a3cb-fda06d1064f4, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:12.151325 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.164800 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP 4339b235-7e18-4fb2-8959-7bee53f68022 associated. External IP: 172.26.4.170, port: cf657499-bb8a-4218-8ad6-ffba00b23cb4. Nov 24 13:57:12.229458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.238921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.254610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56cb4626-df19-45b6-b506-f6c3fed4752f None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 13:57:12.291734 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fc643b-8f42-476e-8057-d171ad53b391 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:12.292776 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] For port 41f79423-82d3-4871-a3cb-fda06d1064f4, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:12.296029 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] For port 41f79423-82d3-4871-a3cb-fda06d1064f4, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=41f79423-82d3-4871-a3cb-fda06d1064f4,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:12.303572 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.308102 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-139cd7f2-6bb5-442b-8048-b63ef00113e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:12.383455 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6fc643b-8f42-476e-8057-d171ad53b391 None None] Pushing event updated for resources: {'Port': ['ID=41f79423-82d3-4871-a3cb-fda06d1064f4,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:12.387304 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fc643b-8f42-476e-8057-d171ad53b391 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:12.395340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.412906 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Routers {'d423653b-8446-4056-b3e3-303440a46eed'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:12.413674 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d423653b-8446-4056-b3e3-303440a46eed'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:12.415596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port 156d49e6-a98a-4e78-b1fa-d14844489c5b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:12.422181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.614362 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] Set router d423653b-8446-4056-b3e3-303440a46eed gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:12.775328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] For port 156d49e6-a98a-4e78-b1fa-d14844489c5b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=156d49e6-a98a-4e78-b1fa-d14844489c5b,segment=NetworkSegment(0c64ce30-b013-4835-b04f-5d8a0e09fd00),segment_id=0c64ce30-b013-4835-b04f-5d8a0e09fd00)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:12.775713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.838204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.909032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for 156d49e6-a98a-4e78-b1fa-d14844489c5b owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:12.920614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.922893 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd423653b-8446-4056-b3e3-303440a46eed', 'name': 'tempest-snat-router-956211895', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.52'}], 'enable_snat': False}, 'gw_port_id': '41f79423-82d3-4871-a3cb-fda06d1064f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:57:07Z', 'updated_at': '2021-11-24T13:57:09Z', 'revision_number': 3, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port': {'id': '41f79423-82d3-4871-a3cb-fda06d1064f4', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:b0:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd423653b-8446-4056-b3e3-303440a46eed', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:57:08Z', 'updated_at': '2021-11-24T13:57:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:12.928248 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c885042-06a5-42e4-a74b-119e7bd85384 None None] The sync data for ids ['d423653b-8446-4056-b3e3-303440a46eed'] in dv-neutron-818151-2-hyperv is: [{'id': 'd423653b-8446-4056-b3e3-303440a46eed', 'name': 'tempest-snat-router-956211895', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.52'}], 'enable_snat': False}, 'gw_port_id': '41f79423-82d3-4871-a3cb-fda06d1064f4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:57:07Z', 'updated_at': '2021-11-24T13:57:09Z', 'revision_number': 3, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port': {'id': '41f79423-82d3-4871-a3cb-fda06d1064f4', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b3:b0:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd423653b-8446-4056-b3e3-303440a46eed', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:57:08Z', 'updated_at': '2021-11-24T13:57:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:12.928454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.995998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Deleting port ffb51fec-bc19-4d0c-af5b-610d65218b4b {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:12.996653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:12.998060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.005334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1023f1dc-c2fa-493b-8a91-b628276acc71 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:13.052776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Port': ['ID=156d49e6-a98a-4e78-b1fa-d14844489c5b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:13.057185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:13.060078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No DVR routers for this DVR port 156d49e6-a98a-4e78-b1fa-d14844489c5b on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:13.222938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.259336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d6be2542-59ff-4ef4-adbe-a4f39f298392']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:13.280004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c64ce30-b013-4835-b04f-5d8a0e09fd00') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:13.280004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c64ce30-b013-4835-b04f-5d8a0e09fd00') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:13.293432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.311435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.319536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 864 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:13.320018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:13.335682 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:13.443696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.448136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8a852399-9146-4345-8e17-5def8344e27b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:13.472367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.482758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Network': ['ID=d6be2542-59ff-4ef4-adbe-a4f39f298392,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:13.491155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:13.507972 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/d6be2542-59ff-4ef4-adbe-a4f39f298392 HTTP/1.1" status: 204 len: 168 time: 2.9627783 Nov 24 13:57:13.507972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38216) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:13.515425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1055190666'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:13.516206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Allocated IP 172.26.4.238 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/81136194-b10c-4803-925f-6dffadffd708) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:13.525352 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:57:13.531460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:13.537119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:network and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:13.538925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.542762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:13.552507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:13.567318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:13.571846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.609063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:13.623235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.623628 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Added segment e28393d3-0f79-4628-975b-810083e9eda4 of type vlan for network fc2cc220-d876-4720-b29c-0d12d1d37962 Nov 24 13:57:13.652898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.675731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Calling delete_port for ffb51fec-bc19-4d0c-af5b-610d65218b4b owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:13.694916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.699659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:13.700503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:13.707696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35e09532-b962-439f-babe-4fcd6c7e91aa tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:13.832075 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.3241820 Nov 24 13:57:13.836399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38224) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:13.846949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'subnet': {'network_id': 'fc2cc220-d876-4720-b29c-0d12d1d37962', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:13.947583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Network': ['ID=fc2cc220-d876-4720-b29c-0d12d1d37962,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:13.952811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:13.964258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network fc2cc220-d876-4720-b29c-0d12d1d37962 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:13.980456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:13.985458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:subnet and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:13.994552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:13.994993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:14.006300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:14.006803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.022680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:14.143410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 41f79423-82d3-4871-a3cb-fda06d1064f4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:14.179539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.187294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cf9d83a9-8817-4f1b-98b8-070a2df232df tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:14.231289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.235096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 41f79423-82d3-4871-a3cb-fda06d1064f4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:14.253813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 41f79423-82d3-4871-a3cb-fda06d1064f4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:14.254171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event deleted for resources: {'Port': ['ID=ffb51fec-bc19-4d0c-af5b-610d65218b4b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:14.255814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.256795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:14.261586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:14.298069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.434660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.457907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 41f79423-82d3-4871-a3cb-fda06d1064f4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=41f79423-82d3-4871-a3cb-fda06d1064f4,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:14.464796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.472334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-177ce87a-5bbe-417c-bbc0-f79db79507e5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:14.519227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:14.590551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.601688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:14.601888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:14.602733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=41f79423-82d3-4871-a3cb-fda06d1064f4,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:14.613754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:14.658489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Port': ['ID=81136194-b10c-4803-925f-6dffadffd708,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:14.661784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.400s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:14.671471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:14.701259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Subnet': ['ID=0feda964-e991-4ed5-b2b0-52d2dbb784c8,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:14.706582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:14.719385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Checking segment: {'id': 'e28393d3-0f79-4628-975b-810083e9eda4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'fc2cc220-d876-4720-b29c-0d12d1d37962'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:14.719742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network hostable DHCP agents. Network: fc2cc220-d876-4720-b29c-0d12d1d37962, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:14.731484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.743970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network fc2cc220-d876-4720-b29c-0d12d1d37962 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:14.755923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, fc2cc220-d876-4720-b29c-0d12d1d37962) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:14.760259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:14.760943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:14.768263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-026a73f7-270b-4185-b2d4-ad290fc0af50 None None] Network fc2cc220-d876-4720-b29c-0d12d1d37962 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:14.799948 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9600980 Nov 24 13:57:14.804249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38232) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:14.988823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.037263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eab3283a-0df4-4b4a-a9ef-3e2ba06b9477 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-fc2cc220-d876-4720-b29c-0d12d1d37962', 'network_id': 'fc2cc220-d876-4720-b29c-0d12d1d37962', 'tenant_id': 'ed4d3f403947472c992ff0a82bb6a2d1', 'fixed_ips': [{'subnet_id': '0feda964-e991-4ed5-b2b0-52d2dbb784c8'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:57:15.038100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab3283a-0df4-4b4a-a9ef-3e2ba06b9477 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.063217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.150277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server [None req-eab3283a-0df4-4b4a-a9ef-3e2ba06b9477 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 0feda964-e991-4ed5-b2b0-52d2dbb784c8: This subnet is being modified by another concurrent operation. Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 274, in create_dhcp_port Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 99, in _port_action Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 335, in create_port Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 685, in inner Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 13:57:15.157299 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1423, in create_port Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1390, in _create_port_db Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1440, in create_port_db Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 669, in _ipam_get_subnets Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise exception Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 0feda964-e991-4ed5-b2b0-52d2dbb784c8: This subnet is being modified by another concurrent operation. Nov 24 13:57:15.161563 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Nov 24 13:57:15.168791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:15.183611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fea31d3-7725-4018-9775-a9dd934db03a None None] Network fc2cc220-d876-4720-b29c-0d12d1d37962 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:15.208851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Subnet': ['ID=0feda964-e991-4ed5-b2b0-52d2dbb784c8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:15.224619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:15.264472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.278450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.318092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.321288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:15.338882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.339210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Fanout notify agent at l3_agent the message router_deleted on router b40087fc-c614-4d5d-80a9-7fec7c01788e {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:15.344872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.351487 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/b40087fc-c614-4d5d-80a9-7fec7c01788e HTTP/1.1" status: 204 len: 168 time: 3.9337258 Nov 24 13:57:15.351487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.354253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38238) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:15.359925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1298540447', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:15.363850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:15.367142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc2cc220-d876-4720-b29c-0d12d1d37962']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.378241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:15.385603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e28393d3-0f79-4628-975b-810083e9eda4') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.385941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e28393d3-0f79-4628-975b-810083e9eda4') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.393586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Usage tracker for resource:router and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:15.398934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:15.406320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.413650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:15.418834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:15.419681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.428254 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2001744f-f5df-41a0-a6b8-ee0dbbc8474f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/floatingips/4339b235-7e18-4fb2-8959-7bee53f68022 HTTP/1.1" status: 200 len: 978 time: 5.2979350 Nov 24 13:57:15.431088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38242) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:15.443247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.444085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.464841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.474121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.475103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.480255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7133e1c-723d-4d47-a852-595e5e556c3d None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 13:57:15.492795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:15.493200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:15.509529 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:15.518397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.548759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:15.549406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.602612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port cf657499-bb8a-4218-8ad6-ffba00b23cb4 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:15.602823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.625039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:15.625710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62b6235f-7447-4103-88e8-95c8ee8d5158 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:15.646265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.654592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:15.676151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.677685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7133e1c-723d-4d47-a852-595e5e556c3d None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 13:57:15.694496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Network': ['ID=fc2cc220-d876-4720-b29c-0d12d1d37962,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:15.707033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:15.707270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Router bb192b8c-cb13-445f-bc3d-f80a48951f0e is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:15.747011 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/fc2cc220-d876-4720-b29c-0d12d1d37962 HTTP/1.1" status: 204 len: 168 time: 0.9413352 Nov 24 13:57:15.754888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38248) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:15.756189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.773273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-2007854050'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:15.778681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:15.783203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:network and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:15.786650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:15.793707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:15.825477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:15.828409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:15.996334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.007617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:16.018179 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79909753-9767-4163-81bf-eec9325d893d None None] Sync routers for ids ['bb192b8c-cb13-445f-bc3d-f80a48951f0e'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:16.045464 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] Routers {'bb192b8c-cb13-445f-bc3d-f80a48951f0e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:16.046328 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['bb192b8c-cb13-445f-bc3d-f80a48951f0e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:16.081877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.085936 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 4.5166295 Nov 24 13:57:16.088726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38256) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:16.111887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 41f79423-82d3-4871-a3cb-fda06d1064f4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:16.193305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.301098 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] Set router bb192b8c-cb13-445f-bc3d-f80a48951f0e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:16.326301 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2a90627c-719f-4b17-8d84-3df2796c7388 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/bb192b8c-cb13-445f-bc3d-f80a48951f0e HTTP/1.1" status: 200 len: 907 time: 0.2363641 Nov 24 13:57:16.328982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38260) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:16.394898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 41f79423-82d3-4871-a3cb-fda06d1064f4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:16.395669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.571908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.572281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.572631 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP 4339b235-7e18-4fb2-8959-7bee53f68022 disassociated. External IP: 172.26.4.170, port: cf657499-bb8a-4218-8ad6-ffba00b23cb4. Nov 24 13:57:16.572979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for cf657499-bb8a-4218-8ad6-ffba00b23cb4 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:16.599868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.611381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:16.622133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.626299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-885c4e38-c090-4cc5-863a-bae50bf3e854 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 1.2709076 Nov 24 13:57:16.627461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38264) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:16.638922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': False}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:16.702632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.702979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Added segment 05b4cfe5-cfa4-499c-a305-0431058fe7c6 of type vlan for network 9817bc9a-5f55-4176-a330-e2dc5b29af0c Nov 24 13:57:16.731597 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bb192b8c-cb13-445f-bc3d-f80a48951f0e', 'name': 'tempest-snat-router-956211895', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.238'}], 'enable_snat': True}, 'gw_port_id': '81136194-b10c-4803-925f-6dffadffd708', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:57:11Z', 'updated_at': '2021-11-24T13:57:15Z', 'revision_number': 3, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port': {'id': '81136194-b10c-4803-925f-6dffadffd708', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c2:a3:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bb192b8c-cb13-445f-bc3d-f80a48951f0e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.238', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:57:12Z', 'updated_at': '2021-11-24T13:57:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:16.735305 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79909753-9767-4163-81bf-eec9325d893d None None] Checking router: bb192b8c-cb13-445f-bc3d-f80a48951f0e for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:57:16.735794 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79909753-9767-4163-81bf-eec9325d893d None None] Updating router bb192b8c-cb13-445f-bc3d-f80a48951f0e port 81136194-b10c-4803-925f-6dffadffd708 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 13:57:16.802184 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-79909753-9767-4163-81bf-eec9325d893d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.820412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.823350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:16.833143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Deleting port 81136194-b10c-4803-925f-6dffadffd708 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:16.833143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.040366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.044154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:17.044763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.052731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3388854-92cf-4358-93be-c9d0d6fe138e tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:17.066644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.196122 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.4381030 Nov 24 13:57:17.217415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.235224 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-79909753-9767-4163-81bf-eec9325d893d None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.256989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38272) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:17.272224 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-79909753-9767-4163-81bf-eec9325d893d None None] Transition to ACTIVE for port object 81136194-b10c-4803-925f-6dffadffd708 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:17.285511 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-79909753-9767-4163-81bf-eec9325d893d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.293786 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:17.301448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Request body: {'subnet': {'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:17.365872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Network': ['ID=9817bc9a-5f55-4176-a330-e2dc5b29af0c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:17.380516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 9817bc9a-5f55-4176-a330-e2dc5b29af0c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:17.403751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Calling delete_port for 81136194-b10c-4803-925f-6dffadffd708 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:17.429742 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-79909753-9767-4163-81bf-eec9325d893d None None] Attempting to bind port 81136194-b10c-4803-925f-6dffadffd708 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:17.430474 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-79909753-9767-4163-81bf-eec9325d893d None None] Attempting to bind port 81136194-b10c-4803-925f-6dffadffd708 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:17.431046 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79909753-9767-4163-81bf-eec9325d893d None None] Attempting to bind port 81136194-b10c-4803-925f-6dffadffd708 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:17.434264 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba10501c-b399-46a8-8915-8f50ceb59627 None None] Pushing event updated for resources: {'Port': ['ID=81136194-b10c-4803-925f-6dffadffd708,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:17.438296 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-ba10501c-b399-46a8-8915-8f50ceb59627 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:17.442441 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79909753-9767-4163-81bf-eec9325d893d None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:17.443155 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79909753-9767-4163-81bf-eec9325d893d None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:17.444074 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-79909753-9767-4163-81bf-eec9325d893d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.444760 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79909753-9767-4163-81bf-eec9325d893d None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:17.445440 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-79909753-9767-4163-81bf-eec9325d893d None None] Bound port: 81136194-b10c-4803-925f-6dffadffd708, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:17.446402 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-79909753-9767-4163-81bf-eec9325d893d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.449584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.397s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:17.495986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.413s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:17.525308 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-79909753-9767-4163-81bf-eec9325d893d None None] For port 81136194-b10c-4803-925f-6dffadffd708, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:17.528891 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-79909753-9767-4163-81bf-eec9325d893d None None] For port 81136194-b10c-4803-925f-6dffadffd708, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=81136194-b10c-4803-925f-6dffadffd708,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:17.537240 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-79909753-9767-4163-81bf-eec9325d893d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.544407 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:17.559071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=cf657499-bb8a-4218-8ad6-ffba00b23cb4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:17.563511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.567200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:17.567541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:17.617486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:17.636089 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] Routers {'bb192b8c-cb13-445f-bc3d-f80a48951f0e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:17.636711 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['bb192b8c-cb13-445f-bc3d-f80a48951f0e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:17.646326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:17.656401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Usage tracker for resource:subnet and tenant:ed4d3f403947472c992ff0a82bb6a2d1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:17.662237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:17.671359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:17.675408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.686962 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba10501c-b399-46a8-8915-8f50ceb59627 None None] Pushing event updated for resources: {'Port': ['ID=81136194-b10c-4803-925f-6dffadffd708,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:17.691418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-ba10501c-b399-46a8-8915-8f50ceb59627 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:17.693500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Made reservation on behalf of ed4d3f403947472c992ff0a82bb6a2d1 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:17.794223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] Set router bb192b8c-cb13-445f-bc3d-f80a48951f0e gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:17.882421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:17.897203 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-79909753-9767-4163-81bf-eec9325d893d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bb192b8c-cb13-445f-bc3d-f80a48951f0e', 'name': 'tempest-snat-router-956211895', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:57:11Z', 'updated_at': '2021-11-24T13:57:16Z', 'revision_number': 4, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:17.901101 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79909753-9767-4163-81bf-eec9325d893d None None] The sync data for ids ['bb192b8c-cb13-445f-bc3d-f80a48951f0e'] in dv-neutron-818151-2-hyperv is: [{'id': 'bb192b8c-cb13-445f-bc3d-f80a48951f0e', 'name': 'tempest-snat-router-956211895', 'tenant_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:57:11Z', 'updated_at': '2021-11-24T13:57:16Z', 'revision_number': 4, 'project_id': 'bdc37f91168b4b15811cdc290c7d3b64', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:18.069058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Deleting port 81136194-b10c-4803-925f-6dffadffd708 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:18.069395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.242424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] For port 81136194-b10c-4803-925f-6dffadffd708, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=81136194-b10c-4803-925f-6dffadffd708,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:18.242781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.264556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:18.379959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Calling delete_port for 81136194-b10c-4803-925f-6dffadffd708 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:18.473245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.535541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.567708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.571403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d17d574-bdf7-4b3e-b2f8-17562c93dccc tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:18.620577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event deleted for resources: {'Port': ['ID=81136194-b10c-4803-925f-6dffadffd708,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:18.623435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:18.739006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 13:57:18.771099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.781868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:18.843547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:18.857489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Allocated IP 172.26.4.51 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/8d4757c1-c42c-4c05-a8ae-e280c285ed14) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:18.908255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event updated for resources: {'Subnet': ['ID=e9fccc86-a139-4924-9f8a-2a14ee032f07,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:18.929771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:19.001963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Checking segment: {'id': '05b4cfe5-cfa4-499c-a305-0431058fe7c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:19.002317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network hostable DHCP agents. Network: 9817bc9a-5f55-4176-a330-e2dc5b29af0c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:19.047870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:19.059273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:19.072423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:19.073174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:19.136468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:19.149297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:19.150366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:19.171913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.178605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Network 9817bc9a-5f55-4176-a330-e2dc5b29af0c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:19.198274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 9817bc9a-5f55-4176-a330-e2dc5b29af0c) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:19.200992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.209434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.216606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:19.217190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.223705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:19.224221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa0387b0-5864-4ac3-99d0-7c97b3441c7b None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:19.226342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13187fa4-cf5c-4a69-9b9a-e6934528535b None None] Network 9817bc9a-5f55-4176-a330-e2dc5b29af0c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:19.227256 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/ports/cf657499-bb8a-4218-8ad6-ffba00b23cb4 HTTP/1.1" status: 204 len: 168 time: 3.7949662 Nov 24 13:57:19.231679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.233510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38284) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:19.275577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.276477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Fanout notify agent at l3_agent the message router_deleted on router bb192b8c-cb13-445f-bc3d-f80a48951f0e {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:19.305473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.309279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/routers/bb192b8c-cb13-445f-bc3d-f80a48951f0e HTTP/1.1" status: 204 len: 168 time: 2.9758847 Nov 24 13:57:19.309527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38288) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:19.350105 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 2.0695343 Nov 24 13:57:19.354046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38292) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:19.382029 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-39034cb5-a513-4002-921d-4644af43e886 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/floatingips/4339b235-7e18-4fb2-8959-7bee53f68022 HTTP/1.1" status: 200 len: 688 time: 0.1451266 Nov 24 13:57:19.390230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38296) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:19.472916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.519633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-9817bc9a-5f55-4176-a330-e2dc5b29af0c', 'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c', 'tenant_id': 'ed4d3f403947472c992ff0a82bb6a2d1', 'fixed_ips': [{'subnet_id': 'e9fccc86-a139-4924-9f8a-2a14ee032f07'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:57:19.521979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.537421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e56259c7-4407-4dd5-9e82-cb112555b8a6 tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:19.690892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.816516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Allocated IP 2001:db8::f816:3eff:fe6f:6bad (9817bc9a-5f55-4176-a330-e2dc5b29af0c/e9fccc86-a139-4924-9f8a-2a14ee032f07/07f88d06-d20b-4bbf-9f1c-64230f4a1953) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:19.843049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:19.849924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:19.852463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port b1d116e0-bef6-4ec4-be5f-c41c8d909bca {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:19.852801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.877432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:19.928697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Pushing event updated for resources: {'Port': ['ID=8d4757c1-c42c-4c05-a8ae-e280c285ed14,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:19.944394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.407s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:19.959272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:19.972957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Deleting port 41f79423-82d3-4871-a3cb-fda06d1064f4 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:19.974328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.079109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.081366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.093152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Transition to ACTIVE for port object 07f88d06-d20b-4bbf-9f1c-64230f4a1953 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:20.114353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Transition to ACTIVE for port object 07f88d06-d20b-4bbf-9f1c-64230f4a1953 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:20.120957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.126131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:20.177065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] For port 41f79423-82d3-4871-a3cb-fda06d1064f4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=41f79423-82d3-4871-a3cb-fda06d1064f4,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:20.177849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.186111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:20.186462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.191805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Pushing event updated for resources: {'Port': ['ID=07f88d06-d20b-4bbf-9f1c-64230f4a1953,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:20.197488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:20.203135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Network 9817bc9a-5f55-4176-a330-e2dc5b29af0c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:20.204980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:20.208079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:20.303988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Attempting to bind port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:20.304461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Attempting to bind port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '05b4cfe5-cfa4-499c-a305-0431058fe7c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:20.304898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Attempting to bind port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 on network 9817bc9a-5f55-4176-a330-e2dc5b29af0c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:20.311850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:20.312301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Checking segment: {'id': '05b4cfe5-cfa4-499c-a305-0431058fe7c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:20.312772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.313233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Bound using segment: {'id': '05b4cfe5-cfa4-499c-a305-0431058fe7c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:20.313852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Bound port: 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05b4cfe5-cfa4-499c-a305-0431058fe7c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '9817bc9a-5f55-4176-a330-e2dc5b29af0c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:20.315521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.347097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.347859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.366206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-61e93bb1-a94f-4c01-9be3-8e67db6bdcf5 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3220613 Nov 24 13:57:20.369489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Calling delete_port for 41f79423-82d3-4871-a3cb-fda06d1064f4 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:20.416755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] For port 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:20.420337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] For port 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07f88d06-d20b-4bbf-9f1c-64230f4a1953,segment=NetworkSegment(05b4cfe5-cfa4-499c-a305-0431058fe7c6),segment_id=05b4cfe5-cfa4-499c-a305-0431058fe7c6)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:20.426237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.431327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:20.540037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Pushing event updated for resources: {'Port': ['ID=07f88d06-d20b-4bbf-9f1c-64230f4a1953,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:20.545608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:20.548414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for b1d116e0-bef6-4ec4-be5f-c41c8d909bca owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:20.580639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.587171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2de1073-8228-45c6-9211-9c9d8cc92155 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:20.654508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event deleted for resources: {'Port': ['ID=41f79423-82d3-4871-a3cb-fda06d1064f4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:20.656952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:20.854842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] For port 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host dv-neutron-818151-2-hyperv, got binding levels [] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:20.855189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:20.872948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.054349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.159382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for 07f88d06-d20b-4bbf-9f1c-64230f4a1953 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:21.190781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-89afc371-cb76-4087-a5a7-b6bce540409c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=cec6d7377f6a459a8b7de61e6d2b631f&device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 1099 time: 0.7563777 Nov 24 13:57:21.253598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.269455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5907ce89-2824-416a-a606-25984ac2900b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:21.450658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.456846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.484272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.485486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Fanout notify agent at l3_agent the message router_deleted on router d423653b-8446-4056-b3e3-303440a46eed {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:21.498805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.499916 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "DELETE /v2.0/routers/d423653b-8446-4056-b3e3-303440a46eed HTTP/1.1" status: 204 len: 168 time: 2.1894140 Nov 24 13:57:21.503960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38312) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:21.510266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-2047852679', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:21.519162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:21.519386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=b1d116e0-bef6-4ec4-be5f-c41c8d909bca,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:21.522027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:21.527245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Usage tracker for resource:router and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:21.531705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:21.536462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.541117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:21.559374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.560525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.589975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.625913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.702403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-646c5ccf-9dab-4d73-9806-4132c59822ce None None] Network 9817bc9a-5f55-4176-a330-e2dc5b29af0c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:21.716670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:21.717075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:21.764277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.767485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.769388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-f8f98a3c-c614-49f1-9f29-ec5a7b202494 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:21.770913 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-f8f98a3c-c614-49f1-9f29-ec5a7b202494 service neutron] 10.222.0.47 "GET /v2.0/networks?id=192cb388-42c9-4352-94b7-0d42c68d3b4b HTTP/1.1" status: 200 len: 913 time: 0.5583563 Nov 24 13:57:21.807231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-743c32e0-ec64-445e-9468-6a8b7de766c1 None None] Provisioning for port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:21.874034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:21.880015 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/floatingips/4339b235-7e18-4fb2-8959-7bee53f68022 HTTP/1.1" status: 204 len: 168 time: 2.4887748 Nov 24 13:57:21.881683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38318) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:21.904691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:21.918652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:21.927310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:floatingip and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:21.930494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:21.935412 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-2b76b3f5-5f0f-4db3-8d5d-a75b7315cb24 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=86d44079-75ac-4666-8917-6680359065f3 HTTP/1.1" status: 200 len: 1002 time: 0.1578000 Nov 24 13:57:22.100577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:22.109662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.113197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-670b9df8-3e8f-4472-be5e-308802841d94 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:22.114878 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-670b9df8-3e8f-4472-be5e-308802841d94 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fdef5004-cb01-46c8-ad07-7ca2196a0189 HTTP/1.1" status: 200 len: 851 time: 0.1286223 Nov 24 13:57:22.154835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07f88d06-d20b-4bbf-9f1c-64230f4a1953 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:22.179395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.180468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.238341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:22.239150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.271676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:22.277593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:22.278055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.358749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Allocated IP 172.26.4.114 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/c1db09f4-670c-45d1-ab44-beef80084fa6) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:22.402085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.449836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07f88d06-d20b-4bbf-9f1c-64230f4a1953,segment=NetworkSegment(05b4cfe5-cfa4-499c-a305-0431058fe7c6),segment_id=05b4cfe5-cfa4-499c-a305-0431058fe7c6)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:22.455176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.459220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-43934e4e-078f-43cb-a09a-1a3b706a122b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:22.506285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-3840f5e8-aef7-4a32-81c8-eaf6c974d2b1 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=192cb388-42c9-4352-94b7-0d42c68d3b4b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3781843 Nov 24 13:57:22.524733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 41f79423-82d3-4871-a3cb-fda06d1064f4 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:22.542495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.567008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 41f79423-82d3-4871-a3cb-fda06d1064f4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:57:22.567358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 41f79423-82d3-4871-a3cb-fda06d1064f4 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:57:22.574085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=07f88d06-d20b-4bbf-9f1c-64230f4a1953,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:22.575725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.577480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:22.586546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eb2be010-74fa-4c04-ae23-4f459a9110fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:22.636162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:22.639055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:22.642936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:22.693636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event updated for resources: {'Port': ['ID=c1db09f4-670c-45d1-ab44-beef80084fa6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:22.697714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:22.820465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.821185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.833590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.881254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-e668e505-6971-41ff-a3c2-d8073839b891 service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3550112 Nov 24 13:57:22.890587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] For port 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07f88d06-d20b-4bbf-9f1c-64230f4a1953,segment=NetworkSegment(05b4cfe5-cfa4-499c-a305-0431058fe7c6),segment_id=05b4cfe5-cfa4-499c-a305-0431058fe7c6)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:22.890948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:22.898268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Router b0b8945f-560b-40b1-b311-4c8e3652d8e2 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:23.053846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for 07f88d06-d20b-4bbf-9f1c-64230f4a1953 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:23.062468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Router 2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:23.299232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:23.312294 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] Sync routers for ids ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:23.336359 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] Routers {'2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:23.337609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:23.338064 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:23.341702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 1.8339734 Nov 24 13:57:23.341879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38332) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:23.348848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': False}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:23.410290 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:23.424468 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] Routers {'2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:23.425622 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:23.493579 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:23.494376 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73d9c420-bd03-421c-8f6a-fb50c49ad919 None None] The sync data for ids ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:23.500340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:23.500667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:23.521037 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d89a7184-aaf0-4fea-bcf4-57b019bec2c6 req-cef198d4-1a37-4a26-958c-bf309dbd2fed service neutron] 10.222.0.47 "GET /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6323597 Nov 24 13:57:23.547046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.242 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/ab88d479-f164-4174-a532-fa95533fee8e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:23.786679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:23.795521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:23.795876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:23.861505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:23.870800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] Sync routers for ids ['b0b8945f-560b-40b1-b311-4c8e3652d8e2'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:23.883571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] Routers {'b0b8945f-560b-40b1-b311-4c8e3652d8e2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:23.884219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b0b8945f-560b-40b1-b311-4c8e3652d8e2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:23.908356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:23.911926 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "PUT /v2.0/routers/b0b8945f-560b-40b1-b311-4c8e3652d8e2 HTTP/1.1" status: 200 len: 915 time: 7.2781937 Nov 24 13:57:23.918541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38336) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:23.945126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:23.958629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] Routers {'b0b8945f-560b-40b1-b311-4c8e3652d8e2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:23.959388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b0b8945f-560b-40b1-b311-4c8e3652d8e2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:24.023672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.024844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:24.025259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2879ddd-4ece-46e3-99d2-438937211c82 None None] The sync data for ids ['b0b8945f-560b-40b1-b311-4c8e3652d8e2'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:24.031626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-697f589e-f9dd-4dac-8e51-e8a460e2ed3b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:24.051053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07f88d06-d20b-4bbf-9f1c-64230f4a1953 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:24.076126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.145187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:24.145730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.180155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:24.183248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=ab88d479-f164-4174-a532-fa95533fee8e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:24.186350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:24.192975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:24.196068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:24.287547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] For port 07f88d06-d20b-4bbf-9f1c-64230f4a1953, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07f88d06-d20b-4bbf-9f1c-64230f4a1953,segment=NetworkSegment(05b4cfe5-cfa4-499c-a305-0431058fe7c6),segment_id=05b4cfe5-cfa4-499c-a305-0431058fe7c6)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:24.287937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.442179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.445589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.500711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for 07f88d06-d20b-4bbf-9f1c-64230f4a1953 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:24.652805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Router 2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:24.860515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:24.864648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:24.865459 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-75e7b4aa-9c59-405d-9232-b49d60295607 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "PUT /v2.0/routers/2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 HTTP/1.1" status: 200 len: 926 time: 1.5224125 Nov 24 13:57:24.868110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38346) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:24.870558 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] Sync routers for ids ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:24.882954 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] Routers {'2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:24.883647 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:24.946429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d2b1cc80-6924-48ae-8acb-7f9249a0e8ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/b0b8945f-560b-40b1-b311-4c8e3652d8e2 HTTP/1.1" status: 200 len: 921 time: 1.0266392 Nov 24 13:57:24.949443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38350) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:24.949708 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:24.962258 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] Routers {'2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:24.962882 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:25.010931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.017928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6543ea83-9fb3-4ffb-9c75-74fcf43286db tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:25.049500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:25.050319 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcd2f2bd-2acd-4b90-b82e-4bfe2fde3d8e None None] The sync data for ids ['2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:25.065615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Port': ['ID=07f88d06-d20b-4bbf-9f1c-64230f4a1953,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:25.068100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:25.141136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfacf173-78c1-49fd-bec6-cd517746728c None None] DHCP port deletion for 9817bc9a-5f55-4176-a330-e2dc5b29af0c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:57:25.160892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-970b3d1d-f154-42f4-af64-89a86066b4cc None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 13:57:25.179131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No DVR routers for this DVR port 07f88d06-d20b-4bbf-9f1c-64230f4a1953 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:25.224230 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3d384846-e747-421e-aeb2-6ea1f61521ee tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=b0b8945f-560b-40b1-b311-4c8e3652d8e2&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.2634389 Nov 24 13:57:25.227262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38354) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.253770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.338127 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e8dbeb4a-54fd-4853-8ad6-700dc7d32b5d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 HTTP/1.1" status: 200 len: 926 time: 0.4687989 Nov 24 13:57:25.341115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38360) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.365334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.372452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6e0cb1d7-dca2-4f1e-8299-4407b15a7775 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:25.373274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-970b3d1d-f154-42f4-af64-89a86066b4cc None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 13:57:25.415308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bd26bfd-1eeb-4c56-b3d9-49196de266ea tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:25.419356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9bd26bfd-1eeb-4c56-b3d9-49196de266ea tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.1872573 Nov 24 13:57:25.419555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Subnet': ['ID=e9fccc86-a139-4924-9f8a-2a14ee032f07,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:25.419667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38364) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.419955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:25.474766 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a069ed48-eb9e-4a2d-bfb1-53da6b5b0376 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=b0b8945f-560b-40b1-b311-4c8e3652d8e2 HTTP/1.1" status: 200 len: 205 time: 0.0539761 Nov 24 13:57:25.479687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38370) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.584906 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-650850e0-894e-42d3-81e9-8e4f1772b195 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.2429025 Nov 24 13:57:25.587679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38376) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.606446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.643824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.651709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9817bc9a-5f55-4176-a330-e2dc5b29af0c']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:25.698375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '05b4cfe5-cfa4-499c-a305-0431058fe7c6') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:25.698696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '05b4cfe5-cfa4-499c-a305-0431058fe7c6') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:25.722734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.748418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.776583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.791895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:25.792311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:25.808899 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:25.812310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0819fd22-408a-4e86-b919-efea11669604 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:25.812950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0819fd22-408a-4e86-b919-efea11669604 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Synchronizing usage tracker for tenant:bdc37f91168b4b15811cdc290c7d3b64 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:25.846597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0819fd22-408a-4e86-b919-efea11669604 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Unset dirty status for tenant:bdc37f91168b4b15811cdc290c7d3b64 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:25.847909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0819fd22-408a-4e86-b919-efea11669604 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.2592852 Nov 24 13:57:25.850912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38380) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.873439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb4f2d14-53b5-424b-896d-2f09b06409b2 None None] Network 9817bc9a-5f55-4176-a330-e2dc5b29af0c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:25.904954 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0d5eea51-23b4-45f0-8f85-b89fa63a411a tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 HTTP/1.1" status: 200 len: 205 time: 0.0503983 Nov 24 13:57:25.906500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38384) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:25.935462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:25.940198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-89be345b-0dbc-4a64-8316-25bbdbf0cd81 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:25.990529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.005094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.020553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Network': ['ID=9817bc9a-5f55-4176-a330-e2dc5b29af0c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:26.028566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:26.047243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/9817bc9a-5f55-4176-a330-e2dc5b29af0c HTTP/1.1" status: 204 len: 168 time: 6.6903250 Nov 24 13:57:26.058081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38388) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.099350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07f88d06-d20b-4bbf-9f1c-64230f4a1953 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:26.106863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.107296 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-123b70a9-e21b-42e6-ac8d-2df62c7f9892 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:26.107744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-123b70a9-e21b-42e6-ac8d-2df62c7f9892 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:26.109482 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-123b70a9-e21b-42e6-ac8d-2df62c7f9892 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/e9fccc86-a139-4924-9f8a-2a14ee032f07 HTTP/1.1" status: 404 len: 337 time: 0.0496120 Nov 24 13:57:26.112310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38392) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.113136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.117167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3b7ae9c-c691-47e9-a222-bbbb325e2107 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:26.137925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 07f88d06-d20b-4bbf-9f1c-64230f4a1953 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:57:26.138259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07f88d06-d20b-4bbf-9f1c-64230f4a1953 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:57:26.149616 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-b987bad8-085d-4194-8ef7-755016e6286d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:26.150213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b987bad8-085d-4194-8ef7-755016e6286d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:26.152104 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b987bad8-085d-4194-8ef7-755016e6286d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/9817bc9a-5f55-4176-a330-e2dc5b29af0c HTTP/1.1" status: 404 len: 339 time: 0.0362825 Nov 24 13:57:26.155989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38396) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.163091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2deabd57-f38a-46ed-89a9-0ffd0d9f11d5 None None] DHCP port deletion for 9817bc9a-5f55-4176-a330-e2dc5b29af0c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:57:26.214331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-73ec0495-9ddf-493c-9788-ea82f7cd95b1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:26.214768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-73ec0495-9ddf-493c-9788-ea82f7cd95b1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:26.216449 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-73ec0495-9ddf-493c-9788-ea82f7cd95b1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/0feda964-e991-4ed5-b2b0-52d2dbb784c8 HTTP/1.1" status: 404 len: 337 time: 0.0588768 Nov 24 13:57:26.227968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38400) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.258564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=ab88d479-f164-4174-a532-fa95533fee8e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:26.262703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:26.284800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.316310 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-52cc366f-4260-48b7-b955-ed96bec442df tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:26.316751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-52cc366f-4260-48b7-b955-ed96bec442df tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:26.318371 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-52cc366f-4260-48b7-b955-ed96bec442df tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/fc2cc220-d876-4720-b29c-0d12d1d37962 HTTP/1.1" status: 404 len: 339 time: 0.0839219 Nov 24 13:57:26.324128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38404) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.374424 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a17e4481-bd16-4f1a-ad11-d1208330d018 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:26.374863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a17e4481-bd16-4f1a-ad11-d1208330d018 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:26.376567 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a17e4481-bd16-4f1a-ad11-d1208330d018 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/b9a382e7-cf6f-4573-ac18-52931067e6ea HTTP/1.1" status: 404 len: 337 time: 0.0502069 Nov 24 13:57:26.382113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38408) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.425504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-9404fc2e-68e0-4fac-8bc9-695bf850e35d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:26.425859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9404fc2e-68e0-4fac-8bc9-695bf850e35d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:26.427484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9404fc2e-68e0-4fac-8bc9-695bf850e35d tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/d6be2542-59ff-4ef4-adbe-a4f39f298392 HTTP/1.1" status: 404 len: 339 time: 0.0448010 Nov 24 13:57:26.430481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38412) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:26.597212 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP dbbc78a5-3acf-4f33-831b-9ff323a433ef associated. External IP: 172.26.4.242, port: 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f. Nov 24 13:57:26.656190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.717870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port 07dace0f-ac25-4a07-89ee-569bdc1dcf33 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:26.718118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.832527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.853894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Deleting port 8d4757c1-c42c-4c05-a8ae-e280c285ed14 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:26.854228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:26.995655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:27.162288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.197196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:27.207444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:27.221441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:27.222209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:27.222821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.289554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:27.290857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 983 time: 5.4056494 Nov 24 13:57:27.293013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38422) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:27.299703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-1649707321'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:27.303804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:27.304409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:27.308287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for 07dace0f-ac25-4a07-89ee-569bdc1dcf33 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:27.309690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:27.314524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:network and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:27.317558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:27.323490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:27.333436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:27.336697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.366256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 864} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:27.368720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:27.369134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1a73a7d-1bf9-455b-a1a7-06539352d2d4 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:27.377389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.377736 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Added segment de884b0e-11a9-4a97-b549-eda337fde3a6 of type vlan for network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 Nov 24 13:57:27.405056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.427138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.437197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.442049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:27.442785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.448043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:27.530575 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.2365112 Nov 24 13:57:27.543681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38426) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:27.552638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'subnet': {'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:27.567600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Calling delete_port for 8d4757c1-c42c-4c05-a8ae-e280c285ed14 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:27.578769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Network': ['ID=531f7b50-2bae-4d72-a59f-d96c83fb1bb1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:27.583059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:27.589790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:27.618426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.622808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.638146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:27.690556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Port': ['ID=07dace0f-ac25-4a07-89ee-569bdc1dcf33,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:27.703895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:27.711316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:27.715968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Deleting port c1db09f4-670c-45d1-ab44-beef80084fa6 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:27.716308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.722718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:27.732998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:27.762587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.790034 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/ports/07dace0f-ac25-4a07-89ee-569bdc1dcf33 HTTP/1.1" status: 204 len: 168 time: 1.3538072 Nov 24 13:57:27.804464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38434) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:27.851622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:27.912022 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f280531b-9110-4e95-b856-7c5f9668aa10 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:27.912022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f280531b-9110-4e95-b856-7c5f9668aa10 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:27.962766 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f280531b-9110-4e95-b856-7c5f9668aa10 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/ff9638a3-fd57-464c-8184-b1f719583602 HTTP/1.1" status: 404 len: 337 time: 0.1542251 Nov 24 13:57:27.968211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38440) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:28.026157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.100365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.205830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.272253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-81230d1e-83ed-4ab9-a91c-8307018e60b4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:28.311488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Calling delete_port for c1db09f4-670c-45d1-ab44-beef80084fa6 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:28.353263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.355091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event deleted for resources: {'Port': ['ID=8d4757c1-c42c-4c05-a8ae-e280c285ed14,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:28.359532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:28.415872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:28.439834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f7657bb1-396a-435b-83fb-568e6fb54e8d') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:28.440091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f7657bb1-396a-435b-83fb-568e6fb54e8d') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:28.457976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.493294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.505249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 862 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:28.505692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:28.520400 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:28.525575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.533716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:28.629522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.655115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.666310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.680612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Subnet': ['ID=5507a308-2501-42bd-b79e-402405e9bbae,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:28.687560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:28.688013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:28.709886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4 HTTP/1.1" status: 204 len: 168 time: 0.7405748 Nov 24 13:57:28.715615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38444) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:28.716425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Network': ['ID=cc3f9f62-1f78-4c11-9a6e-8619e1bca0e4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:28.720469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:28.773952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Checking segment: {'id': 'de884b0e-11a9-4a97-b549-eda337fde3a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:28.774320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network hostable DHCP agents. Network: 531f7b50-2bae-4d72-a59f-d96c83fb1bb1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:28.801415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port dddea5b7-b637-4a3b-927b-e7a2456f8d3d {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:28.801814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.889653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:28.925218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 531f7b50-2bae-4d72-a59f-d96c83fb1bb1) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:28.935062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51a3fea5-c0a0-4da7-896e-cb00c5a19642 None None] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:28.953397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:28.953609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.954691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.964983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.972618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:28.977603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9c8bee9d-a870-400b-b718-13686014e07b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:29.036582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event deleted for resources: {'Port': ['ID=c1db09f4-670c-45d1-ab44-beef80084fa6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:29.039073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.4946964 Nov 24 13:57:29.043195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:29.043346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38452) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:29.048033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-593042883', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:29.069178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:29.076932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:router and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:29.081428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.089077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for router was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:29.099167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:29.139424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.139424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Fanout notify agent at l3_agent the message router_deleted on router b0b8945f-560b-40b1-b311-4c8e3652d8e2 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:29.181389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.182641 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/b0b8945f-560b-40b1-b311-4c8e3652d8e2 HTTP/1.1" status: 204 len: 168 time: 3.7016575 Nov 24 13:57:29.213366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38458) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:29.224508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for dddea5b7-b637-4a3b-927b-e7a2456f8d3d owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:29.264163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1979178761', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:29.280452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:29.289567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Usage tracker for resource:router and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:29.294310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.295166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.299310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-531f7b50-2bae-4d72-a59f-d96c83fb1bb1', 'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1', 'tenant_id': '7eb7035f979a46b388c48c890d0ee3b4', 'fixed_ips': [{'subnet_id': '5507a308-2501-42bd-b79e-402405e9bbae'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:57:29.300255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.307938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:29.323984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:29.355675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.357426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.358315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.369115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.378618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7cbc472d-7798-4fc9-a624-44072bd5d403 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:29.385488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.430268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Port': ['ID=dddea5b7-b637-4a3b-927b-e7a2456f8d3d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:29.437750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:29.448908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.462940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.486276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Allocated IP 172.20.0.2 (531f7b50-2bae-4d72-a59f-d96c83fb1bb1/5507a308-2501-42bd-b79e-402405e9bbae/577f3f16-7376-4c81-be46-1d02eeee5ca1) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:29.521486 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/ports/dddea5b7-b637-4a3b-927b-e7a2456f8d3d HTTP/1.1" status: 204 len: 168 time: 0.7993596 Nov 24 13:57:29.525358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38462) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:29.633762 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-6a330f64-c331-4835-b862-6efdc09a5499 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:29.633762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6a330f64-c331-4835-b862-6efdc09a5499 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:29.635359 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6a330f64-c331-4835-b862-6efdc09a5499 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/f8ca5703-a315-4f64-8d4b-8b6b304bc6a5 HTTP/1.1" status: 404 len: 337 time: 0.0990858 Nov 24 13:57:29.638072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38466) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:29.700543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.712248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Transition to ACTIVE for port object 577f3f16-7376-4c81-be46-1d02eeee5ca1 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:29.731145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Transition to ACTIVE for port object 577f3f16-7376-4c81-be46-1d02eeee5ca1 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:29.737228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.741483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:29.760218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.803473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:29.803909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.811486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:29.815801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:29.816401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.821167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.825728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Pushing event updated for resources: {'Port': ['ID=577f3f16-7376-4c81-be46-1d02eeee5ca1,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:29.852520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:29.919953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Attempting to bind port 577f3f16-7376-4c81-be46-1d02eeee5ca1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:29.920995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Attempting to bind port 577f3f16-7376-4c81-be46-1d02eeee5ca1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'de884b0e-11a9-4a97-b549-eda337fde3a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:29.921569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Attempting to bind port 577f3f16-7376-4c81-be46-1d02eeee5ca1 on network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:29.931202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.938208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:29.940086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Checking segment: {'id': 'de884b0e-11a9-4a97-b549-eda337fde3a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:29.940750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.941208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Bound using segment: {'id': 'de884b0e-11a9-4a97-b549-eda337fde3a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:29.941788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Bound port: 577f3f16-7376-4c81-be46-1d02eeee5ca1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'de884b0e-11a9-4a97-b549-eda337fde3a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:29.942248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.974558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.975123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Fanout notify agent at l3_agent the message router_deleted on router 2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:29.990599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:29.995972 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 HTTP/1.1" status: 204 len: 168 time: 4.0884612 Nov 24 13:57:29.997954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38472) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:30.006323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-2049862624', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:30.030830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:30.041674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Usage tracker for resource:router and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:30.050703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:30.070688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:30.087933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] For port 577f3f16-7376-4c81-be46-1d02eeee5ca1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:30.091648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] For port 577f3f16-7376-4c81-be46-1d02eeee5ca1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=577f3f16-7376-4c81-be46-1d02eeee5ca1,segment=NetworkSegment(de884b0e-11a9-4a97-b549-eda337fde3a6),segment_id=de884b0e-11a9-4a97-b549-eda337fde3a6)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:30.098321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.102636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:30.152983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.153901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.157378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.186201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.187717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Pushing event updated for resources: {'Port': ['ID=577f3f16-7376-4c81-be46-1d02eeee5ca1,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:30.191145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:30.205861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f4eb763-c60f-43f9-9fe6-2a515f31ae4a']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:30.220049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:30.220533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca0b2e1f-c7f3-4142-81f6-86ef3d52aea7') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:30.233369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.264598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.280760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 861 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:30.281883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.314223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:30.317188 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:30.349854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.390926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.452421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.458658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6dd45c7d-17b8-481f-95bb-7542feb46aa9 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:30.465066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.466211 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9a160afe-e0e2-41b7-8625-2df51400dcda tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4665217 Nov 24 13:57:30.479129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38480) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:30.482927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.494783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:30.510874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.553346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.558680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Network': ['ID=6f4eb763-c60f-43f9-9fe6-2a515f31ae4a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:30.568652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:30.616430 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/6f4eb763-c60f-43f9-9fe6-2a515f31ae4a HTTP/1.1" status: 204 len: 168 time: 0.9749954 Nov 24 13:57:30.619099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38484) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:30.706012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.26.4.123 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/bde37990-bbab-4cfa-b600-7a5886376721) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:30.866635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.898076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:30.930495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-410be528-d53b-4fd0-926e-04ba074c39bf tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:31.030705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=bde37990-bbab-4cfa-b600-7a5886376721,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:31.033760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:31.035866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:31.043342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:31.046205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:31.067468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting subnet 4a14fbf1-a9e7-403d-85aa-bb53582e04b5 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:57:31.074478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Allocated IP 172.26.4.163 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/bf868321-1f7e-41e4-a592-64b08a4a57f9) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:31.248219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.334759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.338011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.341443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc1a3e56-6ff0-4129-b2e2-f8374a073632 None None] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:31.351083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.390812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.406597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.408005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.411698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ee817cd7-c45e-491a-a0cf-cb863d1e3365 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:31.544441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:31.555441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.555768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:31.561366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:31.590290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event updated for resources: {'Port': ['ID=bf868321-1f7e-41e4-a592-64b08a4a57f9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:31.600025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:31.604394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d5e11b09-7105-4162-8adf-85d689305aa8 None None] Provisioning for port 577f3f16-7376-4c81-be46-1d02eeee5ca1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:31.693726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.727939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.777603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.790625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0373f63-dfad-4477-b8a4-b25222ab1eac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:31.842363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Subnet': ['ID=4a14fbf1-a9e7-403d-85aa-bb53582e04b5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:31.848556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:31.854011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.860843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b21fb74a-b8ce-417d-8a84-d1cd4f84d308 None None] Network 26f84c92-a854-4366-b20f-034e36babb08 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:31.870719 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/subnets/4a14fbf1-a9e7-403d-85aa-bb53582e04b5 HTTP/1.1" status: 204 len: 168 time: 1.2505889 Nov 24 13:57:31.874508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38494) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:31.987305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:31.988063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.044285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.067100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Allocated IP 172.26.4.62 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/64c7390f-dd21-4052-8673-e8b2a01779b6) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:32.079711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Deleting port d71f9aa0-0dcd-427a-af4e-d97b88441803 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:32.080399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.132886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 577f3f16-7376-4c81-be46-1d02eeee5ca1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:32.145952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router da5d85fa-d3d7-4ca9-ba88-50f459944054 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:32.227330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 577f3f16-7376-4c81-be46-1d02eeee5ca1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:32.249697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 577f3f16-7376-4c81-be46-1d02eeee5ca1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:32.250416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.285234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] DHCP port deletion for 26f84c92-a854-4366-b20f-034e36babb08 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:57:32.301130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Deleting port d71f9aa0-0dcd-427a-af4e-d97b88441803 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:32.302891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.419155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.439324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] For port d71f9aa0-0dcd-427a-af4e-d97b88441803, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d71f9aa0-0dcd-427a-af4e-d97b88441803,segment=NetworkSegment(5be17c8a-ee48-498e-8842-ab1952d21718),segment_id=5be17c8a-ee48-498e-8842-ab1952d21718)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:32.439709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.555530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.568884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Calling delete_port for d71f9aa0-0dcd-427a-af4e-d97b88441803 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:32.577767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Router 830365a1-8218-492d-abd0-656f0ceed582 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:32.589064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:32.606674 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] Sync routers for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:32.626635 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:32.627851 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:32.646458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] For port d71f9aa0-0dcd-427a-af4e-d97b88441803, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d71f9aa0-0dcd-427a-af4e-d97b88441803,segment=NetworkSegment(5be17c8a-ee48-498e-8842-ab1952d21718),segment_id=5be17c8a-ee48-498e-8842-ab1952d21718)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:32.647016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.651180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.663163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-48d0a9f7-0dee-4aa0-86b9-00c2fca8367a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1302008270-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:32.682821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 577f3f16-7376-4c81-be46-1d02eeee5ca1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=577f3f16-7376-4c81-be46-1d02eeee5ca1,segment=NetworkSegment(de884b0e-11a9-4a97-b549-eda337fde3a6),segment_id=de884b0e-11a9-4a97-b549-eda337fde3a6)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:32.718418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:32.722437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:32.723164 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:32.727788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:32.735452 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:32.736229 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:32.747007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.748215 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.7044573 Nov 24 13:57:32.752341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:32.754790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.792118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event updated for resources: {'Port': ['ID=64c7390f-dd21-4052-8673-e8b2a01779b6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:32.803325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:32.806395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8b425f0a-c234-4a0d-a22c-d599d8532f7a tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.042s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:32.847128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] No DVR routers for this DVR port d71f9aa0-0dcd-427a-af4e-d97b88441803 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:32.854958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Calling delete_port for d71f9aa0-0dcd-427a-af4e-d97b88441803 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:32.877057 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:32.880198 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4fe0bd5-139e-44c1-86ec-7904c23287ce None None] The sync data for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:32.893526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Port': ['ID=d71f9aa0-0dcd-427a-af4e-d97b88441803,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:32.901480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:32.906544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:32.912491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:33.009692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=577f3f16-7376-4c81-be46-1d02eeee5ca1,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:33.012962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:33.015063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:33.015416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:33.114479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-15b19d2c-71ba-449f-9f97-7972988a3567 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.170420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:33.181653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] Sync routers for ids ['830365a1-8218-492d-abd0-656f0ceed582'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:33.183625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.200056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] Routers {'830365a1-8218-492d-abd0-656f0ceed582'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:33.200850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['830365a1-8218-492d-abd0-656f0ceed582'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.202475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.203834 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 3.9895031 Nov 24 13:57:33.207794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38508) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:33.214128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:33.218798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['26f84c92-a854-4366-b20f-034e36babb08']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.233446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5be17c8a-ee48-498e-8842-ab1952d21718') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.233744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5be17c8a-ee48-498e-8842-ab1952d21718') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.252636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.280199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.284423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.291551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Releasing vlan 878 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:33.291999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.300225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] Routers {'830365a1-8218-492d-abd0-656f0ceed582'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:33.301177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['830365a1-8218-492d-abd0-656f0ceed582'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:33.311508 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:33.378124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:33.378548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a124e15d-cbbe-4e92-8c71-7cc69da901a2 None None] The sync data for ids ['830365a1-8218-492d-abd0-656f0ceed582'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:33.424537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.427976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f0cce906-f39c-4e1c-9f63-b5a512b1c1cf tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:33.446764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.453556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.512332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Pushing event deleted for resources: {'Network': ['ID=26f84c92-a854-4366-b20f-034e36babb08,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:33.513288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.517343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Deleting port d71f9aa0-0dcd-427a-af4e-d97b88441803 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:33.517343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.522859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:33.526929 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] 10.222.0.70 "DELETE /v2.0/networks/26f84c92-a854-4366-b20f-034e36babb08 HTTP/1.1" status: 204 len: 168 time: 1.6512072 Nov 24 13:57:33.596259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-24d52939-4032-4479-859a-89d3e2c683b8 None None] The port 'd71f9aa0-0dcd-427a-af4e-d97b88441803' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:57:33.661326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.665792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:33.895566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38520) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:33.930669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Router 5bae7694-ab65-494f-96f4-2908f8495bc3 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:34.098864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 577f3f16-7376-4c81-be46-1d02eeee5ca1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:34.179385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 577f3f16-7376-4c81-be46-1d02eeee5ca1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:34.179745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:34.203091 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0da29a54-dbed-4e9b-a56d-bdd809fe1d9c admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ed4d3f403947472c992ff0a82bb6a2d1&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3039296 Nov 24 13:57:34.203654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38528) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:34.246213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:34.252919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:34.255806 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "PUT /v2.0/routers/5bae7694-ab65-494f-96f4-2908f8495bc3 HTTP/1.1" status: 200 len: 883 time: 3.7677603 Nov 24 13:57:34.262011 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] Sync routers for ids ['5bae7694-ab65-494f-96f4-2908f8495bc3'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:34.264064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38532) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:34.273846 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] Routers {'5bae7694-ab65-494f-96f4-2908f8495bc3'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:34.274668 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['5bae7694-ab65-494f-96f4-2908f8495bc3'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:34.308512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:34.338688 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:34.346630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:34.350865 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] Routers {'5bae7694-ab65-494f-96f4-2908f8495bc3'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:34.351662 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['5bae7694-ab65-494f-96f4-2908f8495bc3'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:34.375978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d71f9aa0-0dcd-427a-af4e-d97b88441803 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:34.411411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d71f9aa0-0dcd-427a-af4e-d97b88441803 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:57:34.411609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d71f9aa0-0dcd-427a-af4e-d97b88441803 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:57:34.413546 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:34.414159 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec4d4601-b311-42d4-a7b3-c7c18a3318b1 None None] The sync data for ids ['5bae7694-ab65-494f-96f4-2908f8495bc3'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:34.414685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:34.425338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37309278-673f-4472-a51b-733d07a239f7 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:34.438709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=743a3b19-74bf-425a-9fef-c4bda45d1bda,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:34.441328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:34.443465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:34.447886 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/743a3b19-74bf-425a-9fef-c4bda45d1bda HTTP/1.1" status: 204 len: 168 time: 0.2436233 Nov 24 13:57:34.482261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.004120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.011233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9115891a-4867-4a32-84c1-d6feb71c929a tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/5bae7694-ab65-494f-96f4-2908f8495bc3 HTTP/1.1" status: 200 len: 924 time: 0.7425559 Nov 24 13:57:35.015345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38554) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:35.074928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.092850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.1 (531f7b50-2bae-4d72-a59f-d96c83fb1bb1/5507a308-2501-42bd-b79e-402405e9bbae/75a11923-c50e-4816-9824-634165f12b82) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:35.099285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Deleting port bf868321-1f7e-41e4-a592-64b08a4a57f9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:35.099285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.109536 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0083638b-e07a-4cb3-af14-450d124453e9 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=5bae7694-ab65-494f-96f4-2908f8495bc3&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0895634 Nov 24 13:57:35.112193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38560) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:35.273005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaa6de3b-f4b1-48e0-9084-0e0fcdb91b4a tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:35.276291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eaa6de3b-f4b1-48e0-9084-0e0fcdb91b4a tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.1630337 Nov 24 13:57:35.278682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38568) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:35.333677 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8b1bef84-3ece-48c6-af15-cd2baf9403f9 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=5bae7694-ab65-494f-96f4-2908f8495bc3 HTTP/1.1" status: 200 len: 205 time: 0.0531251 Nov 24 13:57:35.334814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38572) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:35.374519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38576) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:35.539247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.548771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.550909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.675403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-1403413080'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:35.685825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Calling delete_port for bf868321-1f7e-41e4-a592-64b08a4a57f9 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:35.698582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d6548e6b-8cef-4b9d-858e-073d7077bf41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.716049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Transition to ACTIVE for port object 75a11923-c50e-4816-9824-634165f12b82 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:35.725252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:35.733758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:35.738504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:35.753588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:35.788398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:35.791211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.815789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.841619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.847419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-93f101f6-744b-4645-8296-be3b7d38ccf1 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:35.890808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.900964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Deleting port 64c7390f-dd21-4052-8673-e8b2a01779b6 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:35.901649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:35.920807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:35.936314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group_rule and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:35.942307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:35.953318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:35.954924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=75a11923-c50e-4816-9824-634165f12b82,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:35.957445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:35.960205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:35.965469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:35.967533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:36.096211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.106958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.118778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.127492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ccae215f-aad6-4229-9034-ae0d48fae11f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:36.185948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Pushing event deleted for resources: {'Port': ['ID=bf868321-1f7e-41e4-a592-64b08a4a57f9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:36.192089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:36.245495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-74a6b673-c3f2-4db7-a066-022e25fb36f0 None None] Provisioning for port 75a11923-c50e-4816-9824-634165f12b82 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:36.251615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-74a6b673-c3f2-4db7-a066-022e25fb36f0 None None] Provisioning complete for port 75a11923-c50e-4816-9824-634165f12b82 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:36.252097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74a6b673-c3f2-4db7-a066-022e25fb36f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.255205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Calling delete_port for 64c7390f-dd21-4052-8673-e8b2a01779b6 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:36.320694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-74a6b673-c3f2-4db7-a066-022e25fb36f0 None None] Port 75a11923-c50e-4816-9824-634165f12b82 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:57:36.458384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.462734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51cbd96d-4e89-470f-9dac-2c24f3272ab6 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:36.503982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event deleted for resources: {'Port': ['ID=64c7390f-dd21-4052-8673-e8b2a01779b6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:36.508146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:36.518134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.535746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.541823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.544551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.601007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:36.632088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.718056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 882} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:36.732815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.738050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.757443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.815225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1762c4bc-b5fc-44f4-8363-a51e577c8a0a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:36.818052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:36.818389 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 88f19f83-091c-4d89-aa79-2ae8ba5b119e of type vlan for network d1d0487a-60e7-49df-8f6a-8133f5eb276b Nov 24 13:57:36.924619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:36.998554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.003989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.032728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.032728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Fanout notify agent at l3_agent the message router_deleted on router 5bae7694-ab65-494f-96f4-2908f8495bc3 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:37.047021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.048924 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/5bae7694-ab65-494f-96f4-2908f8495bc3 HTTP/1.1" status: 204 len: 168 time: 1.7128603 Nov 24 13:57:37.052549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38590) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:37.057668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1836243176', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:37.065316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:37.069640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Usage tracker for resource:router and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:37.072587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:37.078181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:37.089130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.090010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.108344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.126702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.149407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.150659 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-465f4122-c61b-4eab-a5a3-edfc0e9b8ecd tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.0971813 Nov 24 13:57:37.153334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:37.159343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': True}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:37.166402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.242791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Router 830365a1-8218-492d-abd0-656f0ceed582 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:37.270529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.274728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:37.275336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.285413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27578cc9-f48b-4672-ba41-851c4eabbbe5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:37.561022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=d1d0487a-60e7-49df-8f6a-8133f5eb276b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:37.574656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:37.644624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.360s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:37.652275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 2.2742891 Nov 24 13:57:37.656569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38602) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:37.664462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'name': 'tempest-PortsIpV6TestJSON-359260232'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:37.696349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.699836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:37.706818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.710576 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "PUT /v2.0/routers/830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 200 len: 706 time: 4.4990551 Nov 24 13:57:37.710576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.711522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] Sync routers for ids ['830365a1-8218-492d-abd0-656f0ceed582'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:37.725032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] Routers {'830365a1-8218-492d-abd0-656f0ceed582'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:37.725646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['830365a1-8218-492d-abd0-656f0ceed582'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:37.737041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38606) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:37.738921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9cb3ab27-29b7-47b5-80a8-4547b0fac87d tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:37.819828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:37.828235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.831533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] Routers {'830365a1-8218-492d-abd0-656f0ceed582'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:37.832370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['830365a1-8218-492d-abd0-656f0ceed582'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:37.833143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=75a11923-c50e-4816-9824-634165f12b82,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:37.836197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:37.890869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:37.895960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:37.896973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bfb0513-9d0a-4021-8bed-29970259be97 None None] The sync data for ids ['830365a1-8218-492d-abd0-656f0ceed582'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:37.913432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:37.920358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:37.937184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:37.953046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:37.960255 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fef42a88-6223-4c59-bf24-9e584349403d tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/routers/830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 200 len: 741 time: 0.2211125 Nov 24 13:57:37.963348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38610) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:38.013282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:38.013497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-25456744-763d-417e-8db7-29a8bfd7f585 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 200 len: 205 time: 0.0464368 Nov 24 13:57:38.013897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.015430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38614) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:38.021713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:38.045810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port ee13f173-2516-40d9-8098-80f4ac125ec3 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:38.054827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:38.122561 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7470f6c1-c716-4522-b403-3714d69b0358 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 200 len: 205 time: 0.1036465 Nov 24 13:57:38.125693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38620) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:38.327672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.359517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7fe3eeac-28bf-4be8-ad9a-82f5a601abc2 None None] Provisioning complete for port 75a11923-c50e-4816-9824-634165f12b82 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:38.359812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fe3eeac-28bf-4be8-ad9a-82f5a601abc2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.382269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.419080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7fe3eeac-28bf-4be8-ad9a-82f5a601abc2 None None] Port 75a11923-c50e-4816-9824-634165f12b82 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:57:38.426632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.433109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.504058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.573232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.581527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:38.775445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Allocated IP 172.26.4.129 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/34ee551a-6148-48db-90cf-fae333882eba) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:38.812271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=ee13f173-2516-40d9-8098-80f4ac125ec3,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:38.820027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:38.902239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '88f19f83-091c-4d89-aa79-2ae8ba5b119e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:38.902571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: d1d0487a-60e7-49df-8f6a-8133f5eb276b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:38.974453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:38.979276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.985385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:38.993940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, d1d0487a-60e7-49df-8f6a-8133f5eb276b) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:38.998682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:39.000983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.003473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:39.004092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.005189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e72d206a-4a1c-4ff2-aaaa-4e4ef88cf0db None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:39.035383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 849 time: 1.3770270 Nov 24 13:57:39.038966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.046033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1203165640'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:39.052402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:39.056813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:39.060075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:39.067100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.071033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:39.073571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4a5e1f84-560e-4cbe-a2a2-f3759924da01 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:39.097766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.098241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Fanout notify agent at l3_agent the message router_deleted on router 830365a1-8218-492d-abd0-656f0ceed582 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:39.114748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.115843 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4088d5ff-81a2-4d2e-9c81-7dd0f1b6e64b tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 204 len: 168 time: 0.9891753 Nov 24 13:57:39.119293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38632) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.145885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Port': ['ID=34ee551a-6148-48db-90cf-fae333882eba,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:39.148782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:39.160601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:39.161461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:39.164497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.171388 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b8dcef53-b02e-41ea-843a-a3ce7b08657a tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 200 len: 205 time: 0.0507061 Nov 24 13:57:39.174926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38636) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.176780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:39.179302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:39.245052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-dd9f7c1f-5405-4db7-b189-510a7efb41ca tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] delete failed (client error): The resource could not be found. Nov 24 13:57:39.247838 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dd9f7c1f-5405-4db7-b189-510a7efb41ca tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/830365a1-8218-492d-abd0-656f0ceed582 HTTP/1.1" status: 404 len: 336 time: 0.0699744 Nov 24 13:57:39.248837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38642) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.249039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 872} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:39.302513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.302964 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 970a8f6e-67b7-4022-ad9f-b82413c584d5 of type vlan for network 861dbac0-dcc1-4cab-83ff-d6c8b4088712 Nov 24 13:57:39.307088 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fd749030-c217-4944-be60-7d82e41964b7 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=b0b8945f-560b-40b1-b311-4c8e3652d8e2 HTTP/1.1" status: 200 len: 205 time: 0.0568097 Nov 24 13:57:39.309340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router da5d85fa-d3d7-4ca9-ba88-50f459944054 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:39.310051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38646) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.351325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.377726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-39e9aa37-033e-427a-9c85-72d72b9ce1f5 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] delete failed (client error): The resource could not be found. Nov 24 13:57:39.378742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-39e9aa37-033e-427a-9c85-72d72b9ce1f5 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/b0b8945f-560b-40b1-b311-4c8e3652d8e2 HTTP/1.1" status: 404 len: 336 time: 0.0676932 Nov 24 13:57:39.381865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38650) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.396991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.405646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:39.406359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.412281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09135114-fa9c-45c7-a359-665d7d53ce37 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:39.436417 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fe4e1ec7-4d40-4890-acfc-ea623fe328dc tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=b40087fc-c614-4d5d-80a9-7fec7c01788e HTTP/1.1" status: 200 len: 205 time: 0.0537369 Nov 24 13:57:39.438692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38654) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.530195 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.4897189 Nov 24 13:57:39.534850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38658) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.538421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=861dbac0-dcc1-4cab-83ff-d6c8b4088712,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:39.541054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:39.545003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'ports': [{'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'}, {'network_id': '861dbac0-dcc1-4cab-83ff-d6c8b4088712'}]} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:39.545225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:39.545676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': '861dbac0-dcc1-4cab-83ff-d6c8b4088712'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:39.549284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 861dbac0-dcc1-4cab-83ff-d6c8b4088712 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:39.561811 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-6646cdd6-598d-487d-a713-eb908f1f8b9e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] delete failed (client error): The resource could not be found. Nov 24 13:57:39.562842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6646cdd6-598d-487d-a713-eb908f1f8b9e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/b40087fc-c614-4d5d-80a9-7fec7c01788e HTTP/1.1" status: 404 len: 336 time: 0.1232717 Nov 24 13:57:39.566036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38662) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.619129 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9aa62938-926b-444b-be0a-2e6ed5246b53 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=dfb7a792-bd06-44c5-b5e1-3f3024f735d2 HTTP/1.1" status: 200 len: 205 time: 0.0496142 Nov 24 13:57:39.619948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38668) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.668204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.801386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-fff1705c-0818-4097-b555-68cc6a13a291 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] delete failed (client error): The resource could not be found. Nov 24 13:57:39.802317 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fff1705c-0818-4097-b555-68cc6a13a291 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/dfb7a792-bd06-44c5-b5e1-3f3024f735d2 HTTP/1.1" status: 404 len: 336 time: 0.1813316 Nov 24 13:57:39.804919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38672) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.859002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1472588-0d7a-426d-9258-442c93e80516 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=9fe8de26-591f-4828-8726-df1bcece267a HTTP/1.1" status: 200 len: 205 time: 0.0510006 Nov 24 13:57:39.860516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38678) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.926815 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-562ecad8-5c23-4e58-a258-94b282909183 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] delete failed (client error): The resource could not be found. Nov 24 13:57:39.927920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-562ecad8-5c23-4e58-a258-94b282909183 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/9fe8de26-591f-4828-8726-df1bcece267a HTTP/1.1" status: 404 len: 336 time: 0.0671856 Nov 24 13:57:39.930569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38682) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:39.950182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:39.958207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:39.962645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:39.966928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:39.976903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 2 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:39.987802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:40.034732 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5a55d355-b1bb-4c1b-93c5-d39db8f1fc35 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "GET /v2.0/ports?device_id=deacee55-7559-4620-abe5-d5721c599d46 HTTP/1.1" status: 200 len: 205 time: 0.1030123 Nov 24 13:57:40.037783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38686) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:40.049183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 2} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:40.052819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:40.083384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:40.107932 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-8084ff62-2d2a-4a0d-9ac1-e46d9ff1ca83 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] delete failed (client error): The resource could not be found. Nov 24 13:57:40.108951 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8084ff62-2d2a-4a0d-9ac1-e46d9ff1ca83 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/routers/deacee55-7559-4620-abe5-d5721c599d46 HTTP/1.1" status: 404 len: 336 time: 0.0702879 Nov 24 13:57:40.112714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38690) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:40.164366 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b448bbe8-69f5-45e7-a2ea-ecf204d64a1f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:40.164804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b448bbe8-69f5-45e7-a2ea-ecf204d64a1f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:40.166411 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b448bbe8-69f5-45e7-a2ea-ecf204d64a1f tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] 10.222.0.70 "DELETE /v2.0/subnets/29d8a545-ee5b-481a-85fe-598ef2379466 HTTP/1.1" status: 404 len: 337 time: 0.0528090 Nov 24 13:57:40.189816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:40.194905 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/routers/da5d85fa-d3d7-4ca9-ba88-50f459944054/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4415824 Nov 24 13:57:40.197566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38696) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:40.203076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'port': {'network_id': '531f7b50-2bae-4d72-a59f-d96c83fb1bb1', 'name': 'tempest-FloatingIPTestJSON-485665499'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:40.207637 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] Sync routers for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:40.220676 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:40.221659 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:40.272462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port eee266bf-afa3-419f-905d-31f7e60a52de yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:40.299954 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:40.311730 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:40.312612 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:40.384498 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:40.385168 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29716c52-1858-4bdd-80cf-f73ae0a38109 None None] The sync data for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:40.408319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:40.414376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Usage tracker for resource:port and tenant:7eb7035f979a46b388c48c890d0ee3b4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:40.417548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Quota usage for port was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:40.431401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attempting to reserve 1 items for resource port. Total usage: 6; quota limit: 500; headroom:494 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:40.446949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Made reservation on behalf of 7eb7035f979a46b388c48c890d0ee3b4 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:40.452543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:40.480654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] device_id is not set on port 0cda8a69-471e-438e-add9-8a38673645bb yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:40.554457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:40.666085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38706) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:40.669358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Allocated IP 172.20.0.8 (531f7b50-2bae-4d72-a59f-d96c83fb1bb1/5507a308-2501-42bd-b79e-402405e9bbae/0cda8a69-471e-438e-add9-8a38673645bb) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:40.854217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port f8e1a28a-d728-488b-9393-be59df958ead yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:40.885417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Router 2ba39187-b033-4f89-93e0-512ee750efc3 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:40.953964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb1306c-750b-4832-a3c3-790649441ff0 req-75831a5b-a2ea-459d-a9a4-85ff0f520897 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:40.955701 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cb1306c-750b-4832-a3c3-790649441ff0 req-75831a5b-a2ea-459d-a9a4-85ff0f520897 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.2645700 Nov 24 13:57:41.013075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.134938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:41.145972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.150487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Usage tracker for resource:security_group_rule and tenant:dd6026a26f1d498ca95d6f7540982ff5 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:41.158259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.164587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:41.170329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cb1306c-750b-4832-a3c3-790649441ff0 req-18568e4e-250f-4b35-b26b-9a5ded6654a6 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1895101 Nov 24 13:57:41.179465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:41.197376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Transition to ACTIVE for port object 0cda8a69-471e-438e-add9-8a38673645bb will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:41.279089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.286291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-40e5b51a-3abe-41b2-a9ce-df644db0ff5d tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:41.293877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.304885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b60edda4-c639-4aed-b821-6da6574aeb4c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:41.363855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.383031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.395216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:41.397187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:41.402676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event updated for resources: {'Port': ['ID=0cda8a69-471e-438e-add9-8a38673645bb,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:41.402676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:41.410812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:41.421353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=eee266bf-afa3-419f-905d-31f7e60a52de,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:41.426339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:41.428672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:41.430793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:41.431688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.436046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:41.440523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdf0ac85-67cf-44e7-a4cd-41ec1f8cdbdc tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:41.441715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:41.489574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:41.501673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] Sync routers for ids ['2ba39187-b033-4f89-93e0-512ee750efc3'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:41.516323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] Routers {'2ba39187-b033-4f89-93e0-512ee750efc3'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:41.516834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.517196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2ba39187-b033-4f89-93e0-512ee750efc3'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:41.520957 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "PUT /v2.0/routers/2ba39187-b033-4f89-93e0-512ee750efc3 HTTP/1.1" status: 200 len: 919 time: 4.3637748 Nov 24 13:57:41.521201 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=dd6026a26f1d498ca95d6f7540982ff5&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8523836 Nov 24 13:57:41.522261 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38720) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:41.522588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38722) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:41.523796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14ee8644-ae65-4bdb-b993-a0e02f60511f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:41.528724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:41.534489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:41.535219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.570345 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.3716750 Nov 24 13:57:41.573345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38728) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:41.578813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Request body: {'floatingip': {'port_id': '0cda8a69-471e-438e-add9-8a38673645bb'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:41.596907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:41.609598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] Routers {'2ba39187-b033-4f89-93e0-512ee750efc3'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:41.610748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2ba39187-b033-4f89-93e0-512ee750efc3'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:41.651646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=f8e1a28a-d728-488b-9393-be59df958ead,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:41.663792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:41.692236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '970a8f6e-67b7-4022-ad9f-b82413c584d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '861dbac0-dcc1-4cab-83ff-d6c8b4088712'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:41.692483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: 861dbac0-dcc1-4cab-83ff-d6c8b4088712, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:41.697146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.698408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:41.699214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8cccf7be-6ccc-4581-a5c2-90c84fef5b01 None None] The sync data for ids ['2ba39187-b033-4f89-93e0-512ee750efc3'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:41.739380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.772722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8dfc37e2-e674-4036-8948-f3db17378d76 None None] Provisioning for port 0cda8a69-471e-438e-add9-8a38673645bb completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:41.778491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8dfc37e2-e674-4036-8948-f3db17378d76 None None] Provisioning complete for port 0cda8a69-471e-438e-add9-8a38673645bb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:41.778863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8dfc37e2-e674-4036-8948-f3db17378d76 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.820032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 861dbac0-dcc1-4cab-83ff-d6c8b4088712 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:41.839598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8dfc37e2-e674-4036-8948-f3db17378d76 None None] Port 0cda8a69-471e-438e-add9-8a38673645bb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:57:41.841123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.856793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 861dbac0-dcc1-4cab-83ff-d6c8b4088712) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:41.865907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45f95714-1b73-403d-937d-a1389b02971c None None] Network 861dbac0-dcc1-4cab-83ff-d6c8b4088712 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:41.867867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:41.871940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:41.875224 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:41.876454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:41.918959 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 2.3803813 Nov 24 13:57:41.919145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38732) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.039013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:42.045440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bed674ee-481f-4792-9c91-137e35fff70f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:42.055094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port f8e1a28a-d728-488b-9393-be59df958ead {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:42.055425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:42.114966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14ee8644-ae65-4bdb-b993-a0e02f60511f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:42.123534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:42.124620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:42.126512 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/14ee8644-ae65-4bdb-b993-a0e02f60511f HTTP/1.1" status: 204 len: 168 time: 0.6002190 Nov 24 13:57:42.144742 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0883c2f3-c49e-4554-a9b9-cb04aa5fba1b tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/2ba39187-b033-4f89-93e0-512ee750efc3 HTTP/1.1" status: 200 len: 925 time: 0.6208787 Nov 24 13:57:42.148393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38742) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.491322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:42.513039 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fd90420d-4a60-4c4a-870d-9f6129efeafa tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=2ba39187-b033-4f89-93e0-512ee750efc3&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.3637631 Nov 24 13:57:42.516712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38754) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.638302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38758) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.651368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for f8e1a28a-d728-488b-9393-be59df958ead owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:42.740245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-febbf9f2-7138-438b-8d3a-8f118fd9ec72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:42.741669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-febbf9f2-7138-438b-8d3a-8f118fd9ec72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.2238367 Nov 24 13:57:42.749156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9b9727-ba9c-46de-af65-0eda27b0e9f5 req-b2263e4b-8e3c-4850-9967-c6123c4e2c82 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:42.751157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cd9b9727-ba9c-46de-af65-0eda27b0e9f5 req-b2263e4b-8e3c-4850-9967-c6123c4e2c82 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.2301672 Nov 24 13:57:42.751435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38762) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.882167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:42.886794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cd9b9727-ba9c-46de-af65-0eda27b0e9f5 req-b658eae7-7482-41bc-aab9-1545fadd50e6 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0875614 Nov 24 13:57:42.887787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:42.945107 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f610b897-9993-46e6-b883-6634c67e497e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=2ba39187-b033-4f89-93e0-512ee750efc3 HTTP/1.1" status: 200 len: 205 time: 0.1923466 Nov 24 13:57:42.948177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38768) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.981008 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1d3daf16-f5f8-4d4f-94b6-e46d2184ef0c admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=3872d6d57b1a42eb979825c2f5fab10d&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3416166 Nov 24 13:57:42.988333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38774) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:42.993398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.011021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-57c04495-6af4-422a-a0a8-96dbefac336d tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:43.063731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=f8e1a28a-d728-488b-9393-be59df958ead,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:43.078294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321a419d-c00f-44af-a4ba-d96fc851ff1b req-584a6a8d-c099-43c6-825f-ea33ef11c281 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:43.080856 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-321a419d-c00f-44af-a4ba-d96fc851ff1b req-584a6a8d-c099-43c6-825f-ea33ef11c281 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.4429889 Nov 24 13:57:43.081845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:43.099435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.130599 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/f8e1a28a-d728-488b-9393-be59df958ead HTTP/1.1" status: 204 len: 168 time: 1.2101285 Nov 24 13:57:43.133893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38780) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:43.208036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.226365 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-321a419d-c00f-44af-a4ba-d96fc851ff1b req-b4f310e6-e53a-479b-85fe-0a6d9c4f7012 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1369128 Nov 24 13:57:43.245490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.263470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP dbbc78a5-3acf-4f33-831b-9ff323a433ef associated. External IP: 172.26.4.242, port: 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f. Nov 24 13:57:43.307737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c18cab23-45c0-45e8-b13d-790b329eaa44 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:43.311801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c18cab23-45c0-45e8-b13d-790b329eaa44 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:43.312529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c18cab23-45c0-45e8-b13d-790b329eaa44 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:43.334396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c18cab23-45c0-45e8-b13d-790b329eaa44 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:43.336267 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c18cab23-45c0-45e8-b13d-790b329eaa44 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1455 time: 0.2013953 Nov 24 13:57:43.340592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38784) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:43.345089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.376770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.386160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0ea328f8-4682-4697-96f4-63bcb4f38468 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:43.407912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0c40d6d-7345-4cf9-b746-0e768711c7b1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:43.415001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:43.425852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.427090 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/a0c40d6d-7345-4cf9-b746-0e768711c7b1 HTTP/1.1" status: 204 len: 168 time: 0.4375358 Nov 24 13:57:43.432540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port eee266bf-afa3-419f-905d-31f7e60a52de {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:43.432877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.677413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.863222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.878958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Deleting port 34ee551a-6148-48db-90cf-fae333882eba {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:43.879359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:43.883223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for eee266bf-afa3-419f-905d-31f7e60a52de owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:44.045926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.057651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2c94cb7f-fe0d-4642-a98f-94cef94b76aa tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:44.152444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=eee266bf-afa3-419f-905d-31f7e60a52de,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:44.157617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:44.158736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.171573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.199912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/eee266bf-afa3-419f-905d-31f7e60a52de HTTP/1.1" status: 204 len: 168 time: 0.8558941 Nov 24 13:57:44.201449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38806) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:44.277096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2740aec5-0e67-4f90-b6a2-769818272014 req-c147d1d8-12f0-4a36-8531-9dd4f57216d5 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:44.287497 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2740aec5-0e67-4f90-b6a2-769818272014 req-c147d1d8-12f0-4a36-8531-9dd4f57216d5 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.2354376 Nov 24 13:57:44.300508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Calling delete_port for 34ee551a-6148-48db-90cf-fae333882eba owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:44.381117 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2740aec5-0e67-4f90-b6a2-769818272014 req-d66a336e-2627-4fc5-89e1-e048c71084a0 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0910952 Nov 24 13:57:44.390495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21b1a64f-ec44-4913-af8d-fc255b64ee63 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:44.391720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-21b1a64f-ec44-4913-af8d-fc255b64ee63 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:44.436068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-21b1a64f-ec44-4913-af8d-fc255b64ee63 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:44.441770 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-21b1a64f-ec44-4913-af8d-fc255b64ee63 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.2386079 Nov 24 13:57:44.442467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38820) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:44.443144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:44.494100 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b0976f9-82bc-4dc3-8516-6b40efd532d7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:57:44.498298 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3b0976f9-82bc-4dc3-8516-6b40efd532d7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/f8e1a28a-d728-488b-9393-be59df958ead HTTP/1.1" status: 404 len: 333 time: 0.0548520 Nov 24 13:57:44.498856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38824) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:44.555944 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-1f8357e5-c12f-4277-b41d-2199230b8718 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:57:44.559918 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1f8357e5-c12f-4277-b41d-2199230b8718 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/eee266bf-afa3-419f-905d-31f7e60a52de HTTP/1.1" status: 404 len: 333 time: 0.0601099 Nov 24 13:57:44.560473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38828) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:44.560789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38830) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:44.598706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-48bd7850-deb7-4078-8894-b00e605720f5 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:44.600417 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-48bd7850-deb7-4078-8894-b00e605720f5 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.47 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.2692804 Nov 24 13:57:44.742911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.772206 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2f9d9fa-9f6d-493f-84cc-eab2f8527c17 tempest-AgentManagementNegativeTest-482415557 tempest-AgentManagementNegativeTest-482415557-project] 10.222.0.70 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.2102544 Nov 24 13:57:44.788851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Deleting port b3bbfa33-7150-4f61-a354-9054fb0fbcda {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:44.789506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.835812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb34365-1ab9-4321-9104-7599b721c077 req-dda5571c-f1d6-4cd6-991d-641044c0482a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:44.837553 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ccb34365-1ab9-4321-9104-7599b721c077 req-dda5571c-f1d6-4cd6-991d-641044c0482a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.2525082 Nov 24 13:57:44.889213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.894156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-34b09353-7e93-44a2-93b6-8cae8e229bfb tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:44.932146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:44.971037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c9224f-18fa-43bc-ac6c-598284ecb3a3 req-374dc757-e084-405f-b088-392ed5d13efe tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:44.977259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['861dbac0-dcc1-4cab-83ff-d6c8b4088712']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:44.979205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-97c9224f-18fa-43bc-ac6c-598284ecb3a3 req-374dc757-e084-405f-b088-392ed5d13efe tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.3927443 Nov 24 13:57:44.993943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '970a8f6e-67b7-4022-ad9f-b82413c584d5') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:44.994239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '970a8f6e-67b7-4022-ad9f-b82413c584d5') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:45.006316 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ccb34365-1ab9-4321-9104-7599b721c077 req-bd1b1e47-686c-4dd7-b1e3-49f564c8beb2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1133754 Nov 24 13:57:45.009633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.010715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event deleted for resources: {'Port': ['ID=34ee551a-6148-48db-90cf-fae333882eba,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:45.028044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.036009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 872 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:45.036415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.192009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:45.224350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38844) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:45.340985 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:45.348965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.356178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.361021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:45.385817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=861dbac0-dcc1-4cab-83ff-d6c8b4088712,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:45.389342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:45.395631 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/861dbac0-dcc1-4cab-83ff-d6c8b4088712 HTTP/1.1" status: 204 len: 168 time: 0.8285153 Nov 24 13:57:45.395631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38852) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:45.405231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1234064749'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:45.412313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:45.417818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:45.421097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:45.429328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:45.431948 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-97c9224f-18fa-43bc-ac6c-598284ecb3a3 req-425e3819-fa46-4721-a34a-3b972e69b404 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4515829 Nov 24 13:57:45.491065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:45.494004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.535775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 899} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:45.557131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.557509 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 17f666c1-db5d-498f-9b19-0e6bfbc53082 of type vlan for network ab52d045-ab05-40f8-bd85-2935967bf948 Nov 24 13:57:45.564596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780290e2-c419-4e4a-8f59-1a87d8497a2b req-7a70e348-2e03-4aff-a360-f76ba15c9ff9 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:45.566071 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-780290e2-c419-4e4a-8f59-1a87d8497a2b req-7a70e348-2e03-4aff-a360-f76ba15c9ff9 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.1273649 Nov 24 13:57:45.611962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.649837 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-780290e2-c419-4e4a-8f59-1a87d8497a2b req-5bd4399d-50b2-4d80-837c-8ec0978013d2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734665 Nov 24 13:57:45.660815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.664880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:45.665454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.670712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:45.683749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.772624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3742085 Nov 24 13:57:45.776183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:45.784681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:45.808183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=ab52d045-ab05-40f8-bd85-2935967bf948,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:45.820951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ab52d045-ab05-40f8-bd85-2935967bf948 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:45.825923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] For port b3bbfa33-7150-4f61-a354-9054fb0fbcda, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=b3bbfa33-7150-4f61-a354-9054fb0fbcda,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:45.826297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.837196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:45.844542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:45.933680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:45.938543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:45.941950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:45.948582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:45.960228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:46.057645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:46.072554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.074327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Usage tracker for resource:security_group_rule and tenant:ba5418a2e6ec4adc8ce95268ca2fedc4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:46.085016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:46.089139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:46.102497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:46.117149 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:46.118041 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:46.168883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Performing IP validity checks on allocation pools {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 13:57:46.171676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 13:57:46.200002 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:46.216576 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:46.217634 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:46.283689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:46.304288 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:46.304934 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064ed0a9-cb91-459f-a9f4-da724f669060 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:46.346817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.358512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:46.443679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.483407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-63772406-3d25-46a9-9082-fc0918b84f37 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:46.485019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-63772406-3d25-46a9-9082-fc0918b84f37 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.47 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.7572258 Nov 24 13:57:46.490344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae861729-0abc-4f87-a02a-5237abdb5762 req-fff96e00-4dfd-4db6-8e9f-9dfddd48b08a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:46.491738 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae861729-0abc-4f87-a02a-5237abdb5762 req-fff96e00-4dfd-4db6-8e9f-9dfddd48b08a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 946 time: 0.8697376 Nov 24 13:57:46.494039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=3eb4706f-8477-441e-b441-04081be9264b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:46.499054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:46.500719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.509607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '17f666c1-db5d-498f-9b19-0e6bfbc53082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:46.509960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: ab52d045-ab05-40f8-bd85-2935967bf948, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:57:46.543001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce17cc2-5f23-45cb-9d53-9cb65f9e5dad req-78d65cca-1e93-4597-ad04-0f88afd827eb tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:46.544473 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ce17cc2-5f23-45cb-9d53-9cb65f9e5dad req-78d65cca-1e93-4597-ad04-0f88afd827eb tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.1503029 Nov 24 13:57:46.555343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network ab52d045-ab05-40f8-bd85-2935967bf948 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:57:46.582327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ab52d045-ab05-40f8-bd85-2935967bf948) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:46.594900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:46.595358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6824d03-ffb6-44df-a492-ef83a30bd278 None None] Network ab52d045-ab05-40f8-bd85-2935967bf948 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:46.595504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.622991 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ce17cc2-5f23-45cb-9d53-9cb65f9e5dad req-07fc7df1-0848-490b-a6e4-4ab470b781c6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699234 Nov 24 13:57:46.628061 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8483016 Nov 24 13:57:46.628576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38872) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:46.634521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948', 'name': 'tempest-PortsIpV6TestJSON-471130299'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:46.842680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:46.857278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:46.878007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:46.878812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ab52d045-ab05-40f8-bd85-2935967bf948', 'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': '3eb4706f-8477-441e-b441-04081be9264b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:57:46.880785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.881332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.882557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.882930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:46.883231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Floating IP 0ba2da75-3fb3-40ba-8176-d82ea40ba82d disassociated. External IP: 172.26.4.76, port: b3bbfa33-7150-4f61-a354-9054fb0fbcda. Nov 24 13:57:46.883569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Calling delete_port for b3bbfa33-7150-4f61-a354-9054fb0fbcda owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:46.906331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9bfccec-b239-40f2-a165-6137355941cd req-cf147e3e-a7bb-4c54-a063-f3ea3795057d tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:46.908762 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f9bfccec-b239-40f2-a165-6137355941cd req-cf147e3e-a7bb-4c54-a063-f3ea3795057d tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 945 time: 0.1312997 Nov 24 13:57:46.915994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:57:46.954218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Deleting port 86d44079-75ac-4666-8917-6680359065f3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:46.954549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.036761 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f9bfccec-b239-40f2-a165-6137355941cd req-2f3bed01-504f-457b-b3a9-b4c7643decfc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups?id=37727a31-8a03-487d-8622-0afcf6d8e970&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0768354 Nov 24 13:57:47.057520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.058052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Fanout notify agent at l3_agent the message router_deleted on router 2ba39187-b033-4f89-93e0-512ee750efc3 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:57:47.076618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Allocated IP 2001:db8::2 (ab52d045-ab05-40f8-bd85-2935967bf948/3eb4706f-8477-441e-b441-04081be9264b/ac19b8e6-0a46-4c62-9c5d-129b2199acfb) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:47.083104 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ae861729-0abc-4f87-a02a-5237abdb5762 req-73ff02d3-0834-414d-8a97-e81e6cdfd8ce tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3633232 Nov 24 13:57:47.101651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.138794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.148995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a10e4a2d-5752-48e4-9d73-57e0b6102286 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:47.285367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eff2f39a-6366-4192-a057-db4fa50c0bf3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:47.308716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:47.324627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.348903 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ba5418a2e6ec4adc8ce95268ca2fedc4&name=default HTTP/1.1" status: 200 len: 2647 time: 2.1198018 Nov 24 13:57:47.351746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38876) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:47.362908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.363965 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/2ba39187-b033-4f89-93e0-512ee750efc3 HTTP/1.1" status: 204 len: 168 time: 4.4148548 Nov 24 13:57:47.368089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38880) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:47.374494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1738270185', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:47.389975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:47.402060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Usage tracker for resource:router and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:47.405840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:47.415504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:47.427942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Transition to ACTIVE for port object ac19b8e6-0a46-4c62-9c5d-129b2199acfb will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:47.436510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.437442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.438987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.448769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.452913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b91bb0dc-346a-4bff-a469-fe7088f9364c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:47.455593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Transition to ACTIVE for port object ac19b8e6-0a46-4c62-9c5d-129b2199acfb will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:47.462986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.468361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-72dbc3de-45b4-4913-8a8c-9eb4f919176b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:47.504519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event deleted for resources: {'Port': ['ID=b3bbfa33-7150-4f61-a354-9054fb0fbcda,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:47.526765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:47.527387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.549067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.557890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Network ab52d045-ab05-40f8-bd85-2935967bf948 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:47.561563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:47.568342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:47.568342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.588333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Pushing event updated for resources: {'Port': ['ID=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:47.591120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:47.604305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::60 (ab52d045-ab05-40f8-bd85-2935967bf948/3eb4706f-8477-441e-b441-04081be9264b/1aa60f43-bff9-4a16-9ce4-14f343fe4bc8) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:47.613543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] For port 86d44079-75ac-4666-8917-6680359065f3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=86d44079-75ac-4666-8917-6680359065f3,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:47.613543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.749212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Attempting to bind port ac19b8e6-0a46-4c62-9c5d-129b2199acfb on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:57:47.749885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Attempting to bind port ac19b8e6-0a46-4c62-9c5d-129b2199acfb by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '17f666c1-db5d-498f-9b19-0e6bfbc53082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:57:47.750448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Attempting to bind port ac19b8e6-0a46-4c62-9c5d-129b2199acfb on network ab52d045-ab05-40f8-bd85-2935967bf948 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:57:47.767189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:57:47.767897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Checking segment: {'id': '17f666c1-db5d-498f-9b19-0e6bfbc53082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:57:47.768468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.769145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Bound using segment: {'id': '17f666c1-db5d-498f-9b19-0e6bfbc53082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:57:47.769798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Bound port: ac19b8e6-0a46-4c62-9c5d-129b2199acfb, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '17f666c1-db5d-498f-9b19-0e6bfbc53082', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'ab52d045-ab05-40f8-bd85-2935967bf948'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:57:47.770375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.892073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] For port ac19b8e6-0a46-4c62-9c5d-129b2199acfb, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:57:47.895626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] For port ac19b8e6-0a46-4c62-9c5d-129b2199acfb, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,segment=NetworkSegment(17f666c1-db5d-498f-9b19-0e6bfbc53082),segment_id=17f666c1-db5d-498f-9b19-0e6bfbc53082)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:57:47.902215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:47.909579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:47.965323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.008673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Pushing event updated for resources: {'Port': ['ID=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:48.012424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:48.053665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.056077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.057327 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/eff2f39a-6366-4192-a057-db4fa50c0bf3 HTTP/1.1" status: 204 len: 168 time: 0.7043998 Nov 24 13:57:48.058175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.062014 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c55a95c2-bb83-457e-9d79-e78e76bce388 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6932037 Nov 24 13:57:48.065569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38888) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:48.066821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8dd30505-6b61-4255-9853-d14f2d86f05e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:48.104923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eff2f39a-6366-4192-a057-db4fa50c0bf3,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:48.115276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'enable_snat': False}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:48.193419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:48.390486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.456316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:57:48.470391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd35304-7d9a-409a-a752-8e68577e2016 req-195563c7-100c-47cb-9815-73d080c351ae tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:48.483780 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bfd35304-7d9a-409a-a752-8e68577e2016 req-195563c7-100c-47cb-9815-73d080c351ae tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5793843 Nov 24 13:57:48.644148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device b3bbfa33-7150-4f61-a354-9054fb0fbcda no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:48.716468 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bfd35304-7d9a-409a-a752-8e68577e2016 req-3253a8ff-dfe3-49df-88f9-31a26187df0c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2300925 Nov 24 13:57:48.735174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76a264d3-8970-4853-803f-58223245e5f6 req-e5c5ef49-b48a-41c7-b48a-55234094ad28 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.0913475 Nov 24 13:57:48.795358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.795358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.795358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Floating IP 6ea898a1-1d36-44eb-8158-de32875963cc disassociated. External IP: 172.26.4.200, port: 86d44079-75ac-4666-8917-6680359065f3. Nov 24 13:57:48.795358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Calling delete_port for 86d44079-75ac-4666-8917-6680359065f3 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:48.797886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: b3bbfa33-7150-4f61-a354-9054fb0fbcda {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:57:48.798509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device b3bbfa33-7150-4f61-a354-9054fb0fbcda not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:57:48.799368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 86d44079-75ac-4666-8917-6680359065f3 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:48.952896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.957751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:48.984457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Router 29faa878-433b-448f-ae89-9e61ec9daefb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:48.993087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router da5d85fa-d3d7-4ca9-ba88-50f459944054 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:49.047134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-71e316a3-b84f-424e-8c8d-6df903d22d5b tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:49.101809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:49.174730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:49.224830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network ab52d045-ab05-40f8-bd85-2935967bf948 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:49.238135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:49.243360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:49.247283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:49.247935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:49.261397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=1aa60f43-bff9-4a16-9ce4-14f343fe4bc8,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:49.270439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:49.313400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:49.331942 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 2.6993015 Nov 24 13:57:49.347342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38906) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:49.408446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event deleted for resources: {'Port': ['ID=86d44079-75ac-4666-8917-6680359065f3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:49.422874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:49.457743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16eabc23-2d7c-4422-8a43-a533ffdf1d9c req-15246936-76fc-4604-9d54-c5a6971da89e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:49.466025 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-16eabc23-2d7c-4422-8a43-a533ffdf1d9c req-15246936-76fc-4604-9d54-c5a6971da89e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 867 time: 0.5336432 Nov 24 13:57:49.539231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:49.539566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:49.827666 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-16eabc23-2d7c-4422-8a43-a533ffdf1d9c req-a6a2c511-063e-4a4a-9690-21048b9352ef tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups?id=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3606818 Nov 24 13:57:49.853803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e60f9774-e83a-4082-8f88-0e3ade6e72d2 None None] Network ab52d045-ab05-40f8-bd85-2935967bf948 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:49.965160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:50.051969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38920) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.076899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4fea603-8535-4923-9c84-a483e154097e None None] Sync routers for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:50.150832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:50.151780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:50.180270 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8f052bf3-1fe4-40a6-a3c5-1c5c89747174 req-5c00f422-d8b5-4e56-8d16-e878b6ba0bad tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.0781569 Nov 24 13:57:50.237019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ac19b8e6-0a46-4c62-9c5d-129b2199acfb up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:50.261282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-318d37ab-f295-4483-a20c-7140769aba80 None None] Provisioning for port ac19b8e6-0a46-4c62-9c5d-129b2199acfb completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:50.277389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Router 6fb934fe-8876-4ad1-8081-30b7959413d2 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:50.396565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:50.408180 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] Sync routers for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:50.412029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] No DVR routers for this DVR port b3bbfa33-7150-4f61-a354-9054fb0fbcda on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:50.415148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:50.431146 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:50.432771 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:50.440131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'name': 'network-vif-deleted', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:57:50.450280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:50.460486 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7db2dfec-8c99-4a0b-8c7f-c4f5fa000bd0 req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.47 "DELETE /v2.0/ports/b3bbfa33-7150-4f61-a354-9054fb0fbcda HTTP/1.1" status: 204 len: 173 time: 5.8459351 Nov 24 13:57:50.478658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-a87b083e-e15d-4765-918f-94f07998008e tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.484999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a87b083e-e15d-4765-918f-94f07998008e tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12610 time: 0.4280522 Nov 24 13:57:50.495314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38928) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.515596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:50.583949 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:50.593304 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:57:50.596523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port ac19b8e6-0a46-4c62-9c5d-129b2199acfb completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:57:50.600543 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:50.601402 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:50.604366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:50.626278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:50.643062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af78c682-bb4f-46ed-a904-9540354133ba', 'name': 'network-vif-deleted', 'tag': 'b3bbfa33-7150-4f61-a354-9054fb0fbcda', 'status': 'completed', 'code': 200} Nov 24 13:57:50.646284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-42503662-e23c-40f2-907c-109134f56140 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.647263 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-42503662-e23c-40f2-907c-109134f56140 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.1508069 Nov 24 13:57:50.647409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port ac19b8e6-0a46-4c62-9c5d-129b2199acfb triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:50.647773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:50.669559 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:50.670545 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3300eb5-d391-4ba0-9821-e18b65523dfe None None] The sync data for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:50.678272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38932) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.685864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-d72c2924-c29f-4e80-9c05-54a64a2ccafb tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.686909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d72c2924-c29f-4e80-9c05-54a64a2ccafb tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0060449 Nov 24 13:57:50.703274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38936) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.711551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-0a8373ad-fc4a-415f-be7b-4a23f649032a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.715312 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a8373ad-fc4a-415f-be7b-4a23f649032a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0081439 Nov 24 13:57:50.721778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38940) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.736792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-c282bbd1-d186-406d-bdb8-a00f319bd257 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.740388 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c282bbd1-d186-406d-bdb8-a00f319bd257 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0152659 Nov 24 13:57:50.751509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38944) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.765646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-101d5024-2188-45d1-910c-853d6c001bd3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.769540 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-101d5024-2188-45d1-910c-853d6c001bd3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0113640 Nov 24 13:57:50.772951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38948) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.796331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-4623a951-ad9a-4353-b489-79371ae66d9a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.801207 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4623a951-ad9a-4353-b489-79371ae66d9a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0248382 Nov 24 13:57:50.801207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:50.812047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38952) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.829590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-1d52c876-48ae-49e2-b389-6a4c24f6fe71 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.833285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d52c876-48ae-49e2-b389-6a4c24f6fe71 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0130868 Nov 24 13:57:50.846537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38956) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.859605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-852321d2-0c42-47c5-b6a5-fbead5032537 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.864159 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-852321d2-0c42-47c5-b6a5-fbead5032537 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0101969 Nov 24 13:57:50.865107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38962) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.879058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:50.880682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-fb1575c7-d39c-4768-9924-7a75d3ec0428 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:50.883825 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fb1575c7-d39c-4768-9924-7a75d3ec0428 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0114362 Nov 24 13:57:50.888272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38966) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:50.903335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10b30ca-974f-4719-b928-cba3be15a5cb req-e923cbdd-985c-4f34-9bff-d1c6eef27dcf tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:50.911408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f10b30ca-974f-4719-b928-cba3be15a5cb req-e923cbdd-985c-4f34-9bff-d1c6eef27dcf tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6517286 Nov 24 13:57:50.997011 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0111b274-b74c-471b-8787-ee3103bf6dc4 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/floatingips/dbbc78a5-3acf-4f33-831b-9ff323a433ef HTTP/1.1" status: 200 len: 977 time: 9.4225223 Nov 24 13:57:51.011934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38970) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.045634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-231278ce-f25a-4af2-8d35-07590fe1c9a3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.047119 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-231278ce-f25a-4af2-8d35-07590fe1c9a3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.1561537 Nov 24 13:57:51.052573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38974) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.063163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-07daf744-00f2-4f1f-b0e8-4ecf96d19117 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.064534 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-07daf744-00f2-4f1f-b0e8-4ecf96d19117 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0106931 Nov 24 13:57:51.071705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38978) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.080897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-69efd705-3b78-429d-aebc-8b8a7bb1a216 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.086596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-69efd705-3b78-429d-aebc-8b8a7bb1a216 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0135658 Nov 24 13:57:51.091857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38982) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.150379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-23452d1a-2b8b-49bd-87ef-cd0aa9cd0768 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.154705 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-23452d1a-2b8b-49bd-87ef-cd0aa9cd0768 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0587585 Nov 24 13:57:51.159218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 0cda8a69-471e-438e-add9-8a38673645bb {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:51.159569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.162859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 38986) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.204615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-b7a2aa61-4aeb-4061-980b-670c6436ad1b tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.208706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b7a2aa61-4aeb-4061-980b-670c6436ad1b tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0443091 Nov 24 13:57:51.211711 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ce9f3abe-a7de-48c5-be94-53d476d4c45d req-2fddbca7-d0ae-41ec-9453-9974d4f89f15 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1211627 Nov 24 13:57:51.215400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38990) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.217338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.241636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-c5fdeae7-51ed-4dd9-92b0-af0c7ae2e05a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.247246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:51.251116 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c5fdeae7-51ed-4dd9-92b0-af0c7ae2e05a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0223355 Nov 24 13:57:51.256932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 38996) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.275463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-97b69ed7-fc22-41df-8947-84074d0db995 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.276449 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97b69ed7-fc22-41df-8947-84074d0db995 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0151420 Nov 24 13:57:51.283254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39000) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.300873 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f10b30ca-974f-4719-b928-cba3be15a5cb req-c914e8e2-6960-458a-88a1-6a918d70d3c8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3884459 Nov 24 13:57:51.306759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-60b67fee-185a-4b19-8b0e-0b791eb6968a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.307710 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-60b67fee-185a-4b19-8b0e-0b791eb6968a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0215123 Nov 24 13:57:51.338553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.435089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39004) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.441218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=1aa60f43-bff9-4a16-9ce4-14f343fe4bc8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:51.447398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:51.468294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-d38cd804-85f1-4f4e-81a3-31dda474bdf4 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.479746 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d38cd804-85f1-4f4e-81a3-31dda474bdf4 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0347729 Nov 24 13:57:51.480567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39008) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.498031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-fb99ffe8-2bd3-48c1-ab96-d956da3a67cf tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.498748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port ac19b8e6-0a46-4c62-9c5d-129b2199acfb, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,segment=NetworkSegment(17f666c1-db5d-498f-9b19-0e6bfbc53082),segment_id=17f666c1-db5d-498f-9b19-0e6bfbc53082)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:51.502835 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fb99ffe8-2bd3-48c1-ab96-d956da3a67cf tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0143340 Nov 24 13:57:51.507379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.510359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.512535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e3002b78-569f-48e3-9f9f-6c3c3fe1775c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:51.519044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-506dc2c6-ee38-4288-8687-cf3f157d2f61 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.523804 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-506dc2c6-ee38-4288-8687-cf3f157d2f61 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0153708 Nov 24 13:57:51.530370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39016) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.555016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d6091d17-5e42-428f-9f7f-ebdb867de70a None None] Provisioning complete for port ac19b8e6-0a46-4c62-9c5d-129b2199acfb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:51.555388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d6091d17-5e42-428f-9f7f-ebdb867de70a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.599614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-8dc2258f-aed2-4536-8022-f4c562ec9af3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.603549 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8dc2258f-aed2-4536-8022-f4c562ec9af3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0721269 Nov 24 13:57:51.610298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39020) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.649836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:51.661324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:51.683373 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dc550583-134b-4846-a924-1165e1fd1b23 req-c7d3597a-9ea6-44fa-bd9e-7e9e7dd7ff63 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/ports?device_id=af78c682-bb4f-46ed-a904-9540354133ba HTTP/1.1" status: 200 len: 210 time: 0.1725705 Nov 24 13:57:51.686795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-3d9c29ed-ce6e-4882-a68a-5dec096ae57a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.691269 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3d9c29ed-ce6e-4882-a68a-5dec096ae57a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0221047 Nov 24 13:57:51.697949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39024) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.703351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.709027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:34Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:51.726403 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 HTTP/1.1" status: 204 len: 168 time: 2.3687675 Nov 24 13:57:51.726573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4fea603-8535-4923-9c84-a483e154097e None None] Checking router: 29faa878-433b-448f-ae89-9e61ec9daefb for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:57:51.726949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-4871afe1-8fb8-475a-83c6-6dfcc0262195 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.728179 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4871afe1-8fb8-475a-83c6-6dfcc0262195 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0290606 Nov 24 13:57:51.731376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39028) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.731376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39030) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.754472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:51.755018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:51.777736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-12cc4616-aa37-4951-b705-0c4931c29ad3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.781276 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-12cc4616-aa37-4951-b705-0c4931c29ad3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0446739 Nov 24 13:57:51.788771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39036) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.798573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-6baeae2e-2fdb-4079-a014-68f83c273587 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.799801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6baeae2e-2fdb-4079-a014-68f83c273587 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0067377 Nov 24 13:57:51.804629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39040) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.808604 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-35dfc414-ff24-4a0b-8e3c-d0cb369f73c5 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:51.809172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-35dfc414-ff24-4a0b-8e3c-d0cb369f73c5 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:51.810928 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-35dfc414-ff24-4a0b-8e3c-d0cb369f73c5 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 HTTP/1.1" status: 404 len: 333 time: 0.0786910 Nov 24 13:57:51.812263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Allocated IP 172.26.4.208 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/a223b140-04da-4c24-b59d-ffdf730274b6) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:57:51.815131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39042) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.820563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d6091d17-5e42-428f-9f7f-ebdb867de70a None None] Could not find standard attr ID for object 1aa60f43-bff9-4a16-9ce4-14f343fe4bc8. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:57:51.842452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-629b2930-7ec6-4ed8-8e94-c868c395b8e3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.843665 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-629b2930-7ec6-4ed8-8e94-c868c395b8e3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0309422 Nov 24 13:57:51.848460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.870107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-49aec5a0-e212-478b-b067-76a12f96d36f tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.870337 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-994aa26c-c885-471f-909e-a08f135b96a2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:57:51.870952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-994aa26c-c885-471f-909e-a08f135b96a2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:51.871623 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-49aec5a0-e212-478b-b067-76a12f96d36f tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0208380 Nov 24 13:57:51.876677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39052) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.888042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:51.891015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-fb1aab14-023c-455a-af42-b8d2f69fb166 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.900739 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fb1aab14-023c-455a-af42-b8d2f69fb166 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0168312 Nov 24 13:57:51.901869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39056) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.933030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-b1e9187c-c1d3-4cf9-b3cc-4f23e8aed7e8 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.934279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b1e9187c-c1d3-4cf9-b3cc-4f23e8aed7e8 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0122919 Nov 24 13:57:51.938316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39060) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.941001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-994aa26c-c885-471f-909e-a08f135b96a2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:51.942113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-03d226e0-4786-4ffa-a556-c9ec67795052 None None] Could not find standard attr ID for object 1aa60f43-bff9-4a16-9ce4-14f343fe4bc8. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:57:51.942261 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-994aa26c-c885-471f-909e-a08f135b96a2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/1aa60f43-bff9-4a16-9ce4-14f343fe4bc8 HTTP/1.1" status: 404 len: 333 time: 0.1259732 Nov 24 13:57:51.945543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-6227bb5f-6c66-485a-92d7-5b12825cbb52 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:51.946645 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6227bb5f-6c66-485a-92d7-5b12825cbb52 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0071480 Nov 24 13:57:51.949227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39064) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.949722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39066) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:51.982329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:52.014458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:52.028793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] Sync routers for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:52.031146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-802bef5b-9595-4a46-989c-d1addc715c9d tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.033042 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-802bef5b-9595-4a46-989c-d1addc715c9d tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0807164 Nov 24 13:57:52.041424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39072) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.054842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-5b721782-04e0-4c5e-b429-89f40d4dd4e5 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.055801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5b721782-04e0-4c5e-b429-89f40d4dd4e5 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0132711 Nov 24 13:57:52.061810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39076) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.067524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-e03d514c-dcf1-461a-9686-e6981b44dbc0 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.068660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e03d514c-dcf1-461a-9686-e6981b44dbc0 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0052638 Nov 24 13:57:52.080823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39080) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.084510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:52.085272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:52.096731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-fcd2b8b9-74e9-4ed4-8754-272dca2d4808 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.097912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fcd2b8b9-74e9-4ed4-8754-272dca2d4808 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0159113 Nov 24 13:57:52.104103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39084) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.126429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-33bc5f43-d67c-4a71-b8a1-7a0927f4e419 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.130283 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-33bc5f43-d67c-4a71-b8a1-7a0927f4e419 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0100472 Nov 24 13:57:52.145982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ac19b8e6-0a46-4c62-9c5d-129b2199acfb up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:57:52.153636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39088) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.166833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-35b41bb3-9b37-4269-8c62-04543c6c8a2e tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.167786 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-35b41bb3-9b37-4269-8c62-04543c6c8a2e tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0132027 Nov 24 13:57:52.173534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39092) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.178288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] No DVR routers for this DVR port 86d44079-75ac-4666-8917-6680359065f3 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:52.181617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.184743 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b7f334b-c46c-4baa-b067-59a6f3a3f108 req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.47 "DELETE /v2.0/ports/86d44079-75ac-4666-8917-6680359065f3 HTTP/1.1" status: 204 len: 173 time: 5.6911168 Nov 24 13:57:52.194914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-8ca952e1-537c-43ad-9912-f22576438068 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.196608 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8ca952e1-537c-43ad-9912-f22576438068 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0123997 Nov 24 13:57:52.199098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.200477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39096) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.216027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-84774c23-1977-47d3-a4cc-89da42261e47 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.220132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-84774c23-1977-47d3-a4cc-89da42261e47 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0157554 Nov 24 13:57:52.221212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39100) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.228379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-177097ed-95c6-4c7a-9b53-f40fc72fc559 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.231996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-177097ed-95c6-4c7a-9b53-f40fc72fc559 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0074446 Nov 24 13:57:52.291237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39104) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.297427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-c4f1f9b3-6ce2-42f4-830f-69fcb7bf06f4 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.298750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c4f1f9b3-6ce2-42f4-830f-69fcb7bf06f4 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0064635 Nov 24 13:57:52.317024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39110) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.333831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-3638ad64-3986-4053-9768-6c399f1b1094 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.340357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3638ad64-3986-4053-9768-6c399f1b1094 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0223792 Nov 24 13:57:52.350526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39114) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.368130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-f285fce8-7672-4fac-8011-db8a76efe998 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.369058 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f285fce8-7672-4fac-8011-db8a76efe998 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0176246 Nov 24 13:57:52.377129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.412732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-99e19239-d113-4125-b3b0-6f67d5ae25e7 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.413748 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-99e19239-d113-4125-b3b0-6f67d5ae25e7 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 385 time: 0.0184667 Nov 24 13:57:52.426998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39124) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.435791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-82d83d36-a87d-4fff-85b1-c2a2f94b101c tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.448314 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-82d83d36-a87d-4fff-85b1-c2a2f94b101c tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0200131 Nov 24 13:57:52.456626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39128) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.467360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-e55559c7-fb3e-4bda-9d8c-8085cb6c8881 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.468444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e55559c7-fb3e-4bda-9d8c-8085cb6c8881 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0107558 Nov 24 13:57:52.470824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.471189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.471489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Floating IP dbbc78a5-3acf-4f33-831b-9ff323a433ef disassociated. External IP: 172.26.4.242, port: 0cda8a69-471e-438e-add9-8a38673645bb. Nov 24 13:57:52.471843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 0cda8a69-471e-438e-add9-8a38673645bb owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:52.478062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39132) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.486467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-0acfd4e2-69f1-42dd-a930-9cb53582e4d9 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.501882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-fb638b95-bdf7-4d8a-8634-c368b32657b4 req-06ad0b46-6b6c-4d3e-858d-35f6f5081446 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Synchronizing usage tracker for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:57:52.503342 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0acfd4e2-69f1-42dd-a930-9cb53582e4d9 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0227211 Nov 24 13:57:52.510226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39136) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.511096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port ac19b8e6-0a46-4c62-9c5d-129b2199acfb triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:57:52.511557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.518987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.519567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-463ed96c-8377-429d-98c4-07a270bd4910 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.523909 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-463ed96c-8377-429d-98c4-07a270bd4910 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0084901 Nov 24 13:57:52.526238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39140) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.541177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-1734344d-172f-42f4-9c9d-83e30f2d5aff tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.543230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1734344d-172f-42f4-9c9d-83e30f2d5aff tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0161052 Nov 24 13:57:52.546021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-515344a9-cb60-46a5-96b4-4e0db70e3bb2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:52.552718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.553363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-fb638b95-bdf7-4d8a-8634-c368b32657b4 req-06ad0b46-6b6c-4d3e-858d-35f6f5081446 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Unset dirty status for tenant:cec6d7377f6a459a8b7de61e6d2b631f on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:57:52.554578 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fb638b95-bdf7-4d8a-8634-c368b32657b4 req-06ad0b46-6b6c-4d3e-858d-35f6f5081446 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/ports?device_id=0643b8fd-317d-47c7-85f6-8bfe9873b949 HTTP/1.1" status: 200 len: 210 time: 0.1397452 Nov 24 13:57:52.561869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-9dd36a38-f959-49cf-8496-67590eb0fefe tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.566834 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9dd36a38-f959-49cf-8496-67590eb0fefe tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0108836 Nov 24 13:57:52.569990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39148) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.573104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:52.576559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-6ba5a9b3-d632-4cea-adb7-86516a543502 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.580634 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6ba5a9b3-d632-4cea-adb7-86516a543502 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0097249 Nov 24 13:57:52.581193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39152) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.603800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-2019cf00-daed-4694-8aff-0089464865b3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.604879 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2019cf00-daed-4694-8aff-0089464865b3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0214505 Nov 24 13:57:52.608087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39156) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.612207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 3eb4706f-8477-441e-b441-04081be9264b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:57:52.614632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-c1bbcf6f-34cb-4b4b-a57d-f994374d247b tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.617093 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1bbcf6f-34cb-4b4b-a57d-f994374d247b tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0066907 Nov 24 13:57:52.618353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39160) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.626108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-d54ed9f9-8aa4-4449-94ff-56cac9db4db0 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.629545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d54ed9f9-8aa4-4449-94ff-56cac9db4db0 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0074825 Nov 24 13:57:52.654993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'name': 'network-vif-deleted', 'tag': '86d44079-75ac-4666-8917-6680359065f3'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 13:57:52.658243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39164) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.660919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.702841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-78030b64-a761-4697-a9ef-00cc82c4fb1e tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.703936 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-78030b64-a761-4697-a9ef-00cc82c4fb1e tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0444229 Nov 24 13:57:52.708078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39170) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.709833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:52.719700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-37207038-881d-4f0a-b0c8-15d0584f9bff tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:52.741734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:57:52.750751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:57:52.753171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:57:52.771632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-7a0c9b3b-61ea-4695-b421-e125ce16ea42 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.772812 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7a0c9b3b-61ea-4695-b421-e125ce16ea42 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0602283 Nov 24 13:57:52.774639 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0643b8fd-317d-47c7-85f6-8bfe9873b949', 'name': 'network-vif-deleted', 'tag': '86d44079-75ac-4666-8917-6680359065f3', 'status': 'completed', 'code': 200} Nov 24 13:57:52.776954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=0cda8a69-471e-438e-add9-8a38673645bb,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:52.779030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39176) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.791446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:52.794687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-b437c088-8e02-475d-8e7d-0d38347d6e21 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.795618 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b437c088-8e02-475d-8e7d-0d38347d6e21 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0082366 Nov 24 13:57:52.800303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39180) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.806769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-799743c9-4e90-4124-a84b-a4af746f452a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.807696 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-799743c9-4e90-4124-a84b-a4af746f452a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0065160 Nov 24 13:57:52.811463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39184) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.817669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-d247da7b-31f1-4f3b-a4a2-5136ba98de23 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.818910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d247da7b-31f1-4f3b-a4a2-5136ba98de23 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0062172 Nov 24 13:57:52.881371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39188) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.941249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39192) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.977486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-fc443477-6a39-46d8-96b8-00949df5f11a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.979302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fc443477-6a39-46d8-96b8-00949df5f11a tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0112970 Nov 24 13:57:52.985533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Pushing event updated for resources: {'Port': ['ID=a223b140-04da-4c24-b59d-ffdf730274b6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:52.987651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39198) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:52.997760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-40d71d49-2dec-41a7-a043-3d526b7e4ec8 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:52.998746 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-40d71d49-2dec-41a7-a043-3d526b7e4ec8 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0099356 Nov 24 13:57:53.003076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.457s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:53.004717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39202) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.037508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-788d9b35-4dd9-47cd-88d6-a9bd1e06bae5 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:53.041533 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-788d9b35-4dd9-47cd-88d6-a9bd1e06bae5 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0260515 Nov 24 13:57:53.042370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.042854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39206) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.066866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [None req-1e06c1bf-4162-4749-9c08-c205d0c4eec7 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:53.070357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1e06c1bf-4162-4749-9c08-c205d0c4eec7 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0230801 Nov 24 13:57:53.082147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39210) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.095269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [None req-d7dd6453-56e0-40ee-8421-96c74eadcfc3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] http://10.222.0.70:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 13:57:53.107337 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d7dd6453-56e0-40ee-8421-96c74eadcfc3 tempest-ExtensionsTestJSON-579319159 tempest-ExtensionsTestJSON-579319159-project] 10.222.0.70 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0130296 Nov 24 13:57:53.163201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d4fea603-8535-4923-9c84-a483e154097e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:34Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:53.182254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4fea603-8535-4923-9c84-a483e154097e None None] The sync data for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv is: [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:07Z', 'revision_number': 4, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'b47a3021-ab27-448e-bbc9-296c441891bc', 'name': '', 'network_id': 'a9f12bbb-ee13-42dd-8eed-cf94fa9dada5', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'mac_address': 'fa:16:3e:d5:cd:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:06Z', 'updated_at': '2021-11-24T13:55:34Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'subnets': [{'id': '8c839c3b-21dc-400b-8b56-739bd37025c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:53.202571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.276262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.335576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:22Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:53.340372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a76783-6c0c-4669-8d9a-6484a907b597 req-23cea97c-5ca9-49c7-860f-16e7f340d369 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:53.342035 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42a76783-6c0c-4669-8d9a-6484a907b597 req-23cea97c-5ca9-49c7-860f-16e7f340d369 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.7473779 Nov 24 13:57:53.352966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] Checking router: 6fb934fe-8876-4ad1-8081-30b7959413d2 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:57:53.363870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router da5d85fa-d3d7-4ca9-ba88-50f459944054 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:57:53.383406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:53.387461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:53.426200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.459557 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42a76783-6c0c-4669-8d9a-6484a907b597 req-02e1e329-8d89-4edf-85a5-84a2e0bf2de9 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1075094 Nov 24 13:57:53.489224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.501102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-38a41afb-4bd3-444f-bddd-ce0ae5359374 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:53.523250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=37727a31-8a03-487d-8622-0afcf6d8e970,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:53.533543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:53.564109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.575522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.576862 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "DELETE /v2.0/security-groups/37727a31-8a03-487d-8622-0afcf6d8e970 HTTP/1.1" status: 204 len: 168 time: 0.6344688 Nov 24 13:57:53.594652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39218) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.633127 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0b85f3f-2152-4165-a206-afc30ed161b5 None None] New status for floating IP 0ba2da75-3fb3-40ba-8176-d82ea40ba82d: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 13:57:53.678289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:57:53.688921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.692394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39224) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.695351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:53.758414 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-d36bc437-7702-473f-8229-28239e0b6f47 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] show failed (client error): The resource could not be found. Nov 24 13:57:53.759431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d36bc437-7702-473f-8229-28239e0b6f47 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "GET /v2.0/security-groups/37727a31-8a03-487d-8622-0afcf6d8e970 HTTP/1.1" status: 404 len: 347 time: 0.1613824 Nov 24 13:57:53.765405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39228) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.921429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.925983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=3eb4706f-8477-441e-b441-04081be9264b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:53.929826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:53.931974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39236) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:53.942562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:53.944959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.034055 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/3eb4706f-8477-441e-b441-04081be9264b HTTP/1.1" status: 204 len: 168 time: 2.0831807 Nov 24 13:57:54.046272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39240) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:54.085355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0e4124e-2430-4c61-af96-7cbd8f211e40 None None] Network ab52d045-ab05-40f8-bd85-2935967bf948 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:57:54.106932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.159152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Deleting port eae84203-4712-4756-b9e1-83c91d8b25cf {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:54.159489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.167453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.233122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.259494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.326558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:22Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:54.335229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:54.337159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-578a6b47-ca4f-41c1-9766-20a1a314a7a2 None None] The sync data for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv is: [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:13Z', 'revision_number': 4, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'edb84025-b225-44f1-a2bb-577394c19988', 'name': '', 'network_id': '192cb388-42c9-4352-94b7-0d42c68d3b4b', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'mac_address': 'fa:16:3e:81:f9:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:07Z', 'updated_at': '2021-11-24T13:55:22Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'subnets': [{'id': 'fdef5004-cb01-46c8-ad07-7ca2196a0189', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:54.359903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Usage tracker for resource:security_group_rule and tenant:5dab7c3d59904a8a8af26a268653acd7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:54.363035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:54.371639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:54.376808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port ac19b8e6-0a46-4c62-9c5d-129b2199acfb {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:54.377434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.390354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.398110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a80f27ed-dc41-4ffb-8a87-ae8668b44fd5 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:54.424459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:54.431042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:54.431476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:54.460873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-427b10ec-d221-40d8-8e60-367740889785 None None] Sync routers for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:54.463826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.464917 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "DELETE /v2.0/security-groups/ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd HTTP/1.1" status: 204 len: 168 time: 0.5167348 Nov 24 13:57:54.467597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] DHCP port deletion for ab52d045-ab05-40f8-bd85-2935967bf948 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:57:54.473682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39244) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:54.480146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Deleting port ac19b8e6-0a46-4c62-9c5d-129b2199acfb {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:54.481198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.503570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.503920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.526551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-427b10ec-d221-40d8-8e60-367740889785 None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:54.527181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-427b10ec-d221-40d8-8e60-367740889785 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:54.549849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.556353 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-5b20eeaf-af42-4358-8a1b-bd4b8b23070b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] show failed (client error): The resource could not be found. Nov 24 13:57:54.557710 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5b20eeaf-af42-4358-8a1b-bd4b8b23070b tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "GET /v2.0/security-groups/ebeafe8c-5eb8-48ce-8306-6b3156b1cdcd HTTP/1.1" status: 404 len: 347 time: 0.0828362 Nov 24 13:57:54.563789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39250) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:54.565379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.607642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-427b10ec-d221-40d8-8e60-367740889785 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:54.651202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e4789a6-260c-4e8f-aefb-94af349180b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:54.734164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Calling delete_port for eae84203-4712-4756-b9e1-83c91d8b25cf owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:54.738365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54751852-98ff-4ed3-a836-dff527de378c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:54.769199 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3d98701-bd7d-4616-9333-70aa4f800314 None None] New status for floating IP 6ea898a1-1d36-44eb-8158-de32875963cc: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 13:57:54.805429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:54.808627 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=5dab7c3d59904a8a8af26a268653acd7&name=default HTTP/1.1" status: 200 len: 2647 time: 1.0328541 Nov 24 13:57:54.822704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39254) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:54.825140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] For port ac19b8e6-0a46-4c62-9c5d-129b2199acfb, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,segment=NetworkSegment(17f666c1-db5d-498f-9b19-0e6bfbc53082),segment_id=17f666c1-db5d-498f-9b19-0e6bfbc53082)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:54.825140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.840304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Deleting port 6da3b5a5-9d45-4123-9e45-8dc0a0748ea5 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:54.840754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.917359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:54.922821 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/ports/0cda8a69-471e-438e-add9-8a38673645bb HTTP/1.1" status: 204 len: 168 time: 3.9019876 Nov 24 13:57:54.924149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39258) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:54.986796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Router 031a9c63-71c7-45bb-934c-9c79e19032f9 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:57:55.047198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Calling delete_port for ac19b8e6-0a46-4c62-9c5d-129b2199acfb owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:55.054029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.054357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.127920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-427b10ec-d221-40d8-8e60-367740889785 None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:55.128723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-427b10ec-d221-40d8-8e60-367740889785 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:55.161218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port ac19b8e6-0a46-4c62-9c5d-129b2199acfb, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,segment=NetworkSegment(17f666c1-db5d-498f-9b19-0e6bfbc53082),segment_id=17f666c1-db5d-498f-9b19-0e6bfbc53082)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:55.161831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.194919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.199118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:55.238713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-427b10ec-d221-40d8-8e60-367740889785 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:55.239131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-427b10ec-d221-40d8-8e60-367740889785 None None] The sync data for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:55.241014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Calling delete_port for 6da3b5a5-9d45-4123-9e45-8dc0a0748ea5 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:55.242494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Pushing event deleted for resources: {'Port': ['ID=ac19b8e6-0a46-4c62-9c5d-129b2199acfb,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:55.248855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:55.256924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] No DVR routers for this DVR port ac19b8e6-0a46-4c62-9c5d-129b2199acfb on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:57:55.341615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.353505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for ac19b8e6-0a46-4c62-9c5d-129b2199acfb owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:55.388072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c66f26-a769-41b8-8efd-4c031bbb1f60 req-e78e138d-fe75-4708-8b39-ff9477188c78 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:55.389553 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79c66f26-a769-41b8-8efd-4c031bbb1f60 req-e78e138d-fe75-4708-8b39-ff9477188c78 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6624236 Nov 24 13:57:55.524683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 2 row(s); 1 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:55.524912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:55.570317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:57:55.582180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] Sync routers for ids ['031a9c63-71c7-45bb-934c-9c79e19032f9'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:57:55.592385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.594692 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "PUT /v2.0/routers/031a9c63-71c7-45bb-934c-9c79e19032f9 HTTP/1.1" status: 200 len: 920 time: 7.5142334 Nov 24 13:57:55.597577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39262) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:55.599479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] Routers {'031a9c63-71c7-45bb-934c-9c79e19032f9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:55.600478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['031a9c63-71c7-45bb-934c-9c79e19032f9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:55.622760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.685087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:55.697744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] Routers {'031a9c63-71c7-45bb-934c-9c79e19032f9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:57:55.697976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['031a9c63-71c7-45bb-934c-9c79e19032f9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:55.709572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.732556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db18d83a-e4cf-435a-9d61-9a93580e74cd tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:55.758208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:55.758633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7d1dee2-90c6-40fa-96bd-91b76c461316 None None] The sync data for ids ['031a9c63-71c7-45bb-934c-9c79e19032f9'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:57:55.805597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Pushing event deleted for resources: {'Port': ['ID=eae84203-4712-4756-b9e1-83c91d8b25cf,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:55.811073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:55.812087 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4bd09507-e458-47ef-8e08-902f17c4a85d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/031a9c63-71c7-45bb-934c-9c79e19032f9 HTTP/1.1" status: 200 len: 926 time: 0.2131002 Nov 24 13:57:55.814625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39266) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:55.817108 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79c66f26-a769-41b8-8efd-4c031bbb1f60 req-fa9bd345-27fc-450b-9c6d-cc7a45fbff5d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3940721 Nov 24 13:57:55.847220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:57:55.847540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:57:55.891667 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec09a24d-109b-45b1-ba06-6a74bf756f54 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=031a9c63-71c7-45bb-934c-9c79e19032f9&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0750835 Nov 24 13:57:55.893996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39270) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:55.929852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.935452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:55.956024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:55.961181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54751852-98ff-4ed3-a836-dff527de378c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:55.971465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:56.028778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Deleting port 6da3b5a5-9d45-4123-9e45-8dc0a0748ea5 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:56.029307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.053481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ac19b8e6-0a46-4c62-9c5d-129b2199acfb no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:57:56.082328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdbbc720-b209-464e-87bd-1214b317fc40 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:56.088228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cdbbc720-b209-464e-87bd-1214b317fc40 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/networks/402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 881 time: 0.1898174 Nov 24 13:57:56.088401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.089279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: ac19b8e6-0a46-4c62-9c5d-129b2199acfb {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:57:56.089518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39274) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:56.089625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ac19b8e6-0a46-4c62-9c5d-129b2199acfb not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:57:56.090408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/54751852-98ff-4ed3-a836-dff527de378c HTTP/1.1" status: 204 len: 168 time: 1.2605798 Nov 24 13:57:56.092381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.093451 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] 10.222.0.70 "DELETE /v2.0/floatingips/0ba2da75-3fb3-40ba-8176-d82ea40ba82d HTTP/1.1" status: 204 len: 168 time: 2.3254585 Nov 24 13:57:56.097902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39278) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:56.171587 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8be5a146-9973-46c9-9680-7d2a66e356ac tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=031a9c63-71c7-45bb-934c-9c79e19032f9 HTTP/1.1" status: 200 len: 205 time: 0.0743327 Nov 24 13:57:56.176233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39284) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:56.301203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.301579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.353629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port ac19b8e6-0a46-4c62-9c5d-129b2199acfb {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:56.353970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.434109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Calling delete_port for 6da3b5a5-9d45-4123-9e45-8dc0a0748ea5 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:56.489267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] The port 'ac19b8e6-0a46-4c62-9c5d-129b2199acfb' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:57:56.606400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.611222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f651a33-0263-402e-bc01-c3acae390ad9 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:56.654262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Pushing event deleted for resources: {'Port': ['ID=6da3b5a5-9d45-4123-9e45-8dc0a0748ea5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:56.658926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:56.736301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.752992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.768889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.770220 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] 10.222.0.70 "DELETE /v2.0/floatingips/6ea898a1-1d36-44eb-8158-de32875963cc HTTP/1.1" status: 204 len: 168 time: 2.1957538 Nov 24 13:57:56.773217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39298) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:56.785829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ab52d045-ab05-40f8-bd85-2935967bf948']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:56.805761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '17f666c1-db5d-498f-9b19-0e6bfbc53082') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:56.806062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '17f666c1-db5d-498f-9b19-0e6bfbc53082') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:57:56.822001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.875431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.932969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.950987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 899 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:57:56.951379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:57:56.968432 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:57:57.099020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27be35a1-4db2-4328-9aaf-142be7d723b9 req-a284e0b3-0fbd-4236-b0cc-d9aed7fdf1bc tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:57.100653 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-27be35a1-4db2-4328-9aaf-142be7d723b9 req-a284e0b3-0fbd-4236-b0cc-d9aed7fdf1bc tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.1320026 Nov 24 13:57:57.130100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39310) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.269464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.344746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c66ec9df-80b7-49d1-aca4-6977e554b6f7 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] Request body: {'port': {'network_id': 'bf26e40c-94a6-43e8-a209-741cadbf2e19', 'name': 'tempest-NetworksNegativeTestJSON-1462063779'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:57.375374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.380684 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-c66ec9df-80b7-49d1-aca4-6977e554b6f7 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] POST failed (client error): The resource could not be found. Nov 24 13:57:57.381122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c66ec9df-80b7-49d1-aca4-6977e554b6f7 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:57.382226 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c66ec9df-80b7-49d1-aca4-6977e554b6f7 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.2484279 Nov 24 13:57:57.387120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39316) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.390613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a9bcd93-32a4-4af3-8743-0fcd5b8792af tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:57.409002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.410593 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-27be35a1-4db2-4328-9aaf-142be7d723b9 req-51203900-7bc9-479d-85f5-5f4cd63b8249 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2982082 Nov 24 13:57:57.427384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=ab52d045-ab05-40f8-bd85-2935967bf948,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:57.428191 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-635280b9-f9c1-41a2-97ad-3aff9ee5a755 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:57.429304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-635280b9-f9c1-41a2-97ad-3aff9ee5a755 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:57.434757 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-635280b9-f9c1-41a2-97ad-3aff9ee5a755 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "DELETE /v2.0/networks/fc8076e4-8725-4a07-b8ed-e694edce80de HTTP/1.1" status: 404 len: 339 time: 0.0428462 Nov 24 13:57:57.434907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:57.435222 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/ab52d045-ab05-40f8-bd85-2935967bf948 HTTP/1.1" status: 204 len: 168 time: 3.3798559 Nov 24 13:57:57.439450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39320) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.439847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39322) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.449319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1186816264'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:57.495155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:57.545507 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-801cbb4d-7e94-4e7d-b6a3-dc8dbdcbc2ad tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:57.545984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-801cbb4d-7e94-4e7d-b6a3-dc8dbdcbc2ad tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:57.548383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-801cbb4d-7e94-4e7d-b6a3-dc8dbdcbc2ad tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "DELETE /v2.0/ports/ea034f43-6696-4e01-a0a5-46194f6751f9 HTTP/1.1" status: 404 len: 333 time: 0.1075053 Nov 24 13:57:57.549587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:57.557072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39328) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.558834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:57.569538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:57.589349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:57.592292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.643907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 866} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:57:57.659905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.660242 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 4faebad9-5f6a-4427-98ec-bb6944674c9d of type vlan for network 90437c3a-a79a-4e0b-be07-13528c18112f Nov 24 13:57:57.667786 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-a0c47213-94f9-4551-8b74-bbe51cd1f10b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] DELETE failed (client error): The resource could not be found. Nov 24 13:57:57.668220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a0c47213-94f9-4551-8b74-bbe51cd1f10b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:57.668620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.675208 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a0c47213-94f9-4551-8b74-bbe51cd1f10b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "DELETE /v2.0/subnets/48d8b7d4-542c-43d3-987b-e8ff9e046222 HTTP/1.1" status: 404 len: 337 time: 0.1109848 Nov 24 13:57:57.675479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39332) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.748014 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-595ebe21-533c-48c3-b18c-4484c0c4877c tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] GET failed (client error): The resource could not be found. Nov 24 13:57:57.752673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-595ebe21-533c-48c3-b18c-4484c0c4877c tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "GET /v2.0/networks/f26153c5-d7c0-44af-86ce-63a2dca76858 HTTP/1.1" status: 404 len: 339 time: 0.0729060 Nov 24 13:57:57.752820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.754711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39336) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.811408 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4d8a762-7965-4919-b9f4-9bb475a3296d tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] GET failed (client error): The resource could not be found. Nov 24 13:57:57.816764 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e4d8a762-7965-4919-b9f4-9bb475a3296d tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "GET /v2.0/ports/2095bb7e-2a95-49f9-97f7-193adf15ab91 HTTP/1.1" status: 404 len: 333 time: 0.0571017 Nov 24 13:57:57.817393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39340) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.870109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.878724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-615d8611-ad6c-4255-a486-1153c2a6688d tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] GET failed (client error): The resource could not be found. Nov 24 13:57:57.883575 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-615d8611-ad6c-4255-a486-1153c2a6688d tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "GET /v2.0/subnets/e494b290-b827-4be0-bf06-506fff21c12e HTTP/1.1" status: 404 len: 337 time: 0.0617321 Nov 24 13:57:57.884730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39344) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.894269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-541f53f5-77c9-4296-9c4b-d995b9c2ff2b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] Request body: {'network': {'name': 'new_name'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:57.917715 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-541f53f5-77c9-4296-9c4b-d995b9c2ff2b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] PUT failed (client error): The resource could not be found. Nov 24 13:57:57.918177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-541f53f5-77c9-4296-9c4b-d995b9c2ff2b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:57.923252 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-541f53f5-77c9-4296-9c4b-d995b9c2ff2b tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "PUT /v2.0/networks/0f426358-930a-40dd-bc34-74a85ee29753 HTTP/1.1" status: 404 len: 339 time: 0.0336895 Nov 24 13:57:57.950435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39348) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:57.974002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f7f02a1c-c913-4a8f-bd15-70c1e50743a3 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] Request body: {'port': {'name': 'new_name'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:57.974248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.976966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:57.977549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:57.988380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d4c041dc-da09-483b-b713-4747c222465c tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:58.018231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-f7f02a1c-c913-4a8f-bd15-70c1e50743a3 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] PUT failed (client error): The resource could not be found. Nov 24 13:57:58.018665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f7f02a1c-c913-4a8f-bd15-70c1e50743a3 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:58.023292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f7f02a1c-c913-4a8f-bd15-70c1e50743a3 tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "PUT /v2.0/ports/bc65d867-0ff3-4028-89ef-7a480977e297 HTTP/1.1" status: 404 len: 333 time: 0.0677073 Nov 24 13:57:58.023674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39352) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:58.039381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-db7ff14a-93eb-4f9a-ac2e-cd119f08018f tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:58.051576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:58.100060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Deleting port a223b140-04da-4c24-b59d-ffdf730274b6 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:58.100292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:58.143864 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6972401 Nov 24 13:57:58.145617 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-db7ff14a-93eb-4f9a-ac2e-cd119f08018f tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] PUT failed (client error): The resource could not be found. Nov 24 13:57:58.145760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39356) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:58.145988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-db7ff14a-93eb-4f9a-ac2e-cd119f08018f tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:57:58.147072 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-db7ff14a-93eb-4f9a-ac2e-cd119f08018f tempest-NetworksNegativeTestJSON-604478736 tempest-NetworksNegativeTestJSON-604478736-project] 10.222.0.70 "PUT /v2.0/subnets/27762503-fa06-4462-a936-3231008615c8 HTTP/1.1" status: 404 len: 337 time: 0.1224260 Nov 24 13:57:58.155822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=90437c3a-a79a-4e0b-be07-13528c18112f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:58.159315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:58.160652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:57:58.171132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 90437c3a-a79a-4e0b-be07-13528c18112f details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:57:58.584318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39366) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:58.665579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:58.682504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Deleting port edb84025-b225-44f1-a2bb-577394c19988 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:58.682831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:58.689115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:58.704482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:58.724452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:58.732072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:58.775505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:58.883519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Calling delete_port for a223b140-04da-4c24-b59d-ffdf730274b6 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:58.888047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:57:58.895184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Usage tracker for resource:security_group_rule and tenant:83574cc69af84d9aacb10461f2e4e2f1 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:57:58.905159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:57:58.908662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:57:58.915113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:57:58.922392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] For port edb84025-b225-44f1-a2bb-577394c19988, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=edb84025-b225-44f1-a2bb-577394c19988,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:57:58.922678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.070878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6925dc1c-6129-4b3a-a800-020fa4e3b8c4 req-7e6f236b-fccb-48a0-b8f8-2ce39ecbad6a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:57:59.072402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6925dc1c-6129-4b3a-a800-020fa4e3b8c4 req-7e6f236b-fccb-48a0-b8f8-2ce39ecbad6a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.4878752 Nov 24 13:57:59.162884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Calling delete_port for edb84025-b225-44f1-a2bb-577394c19988 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:57:59.181891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.309793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.317841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.325952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fdffffcd-91d5-41cf-b200-56676d09fec4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:59.359731 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6925dc1c-6129-4b3a-a800-020fa4e3b8c4 req-b8994544-9ae6-41ae-a9ed-80f4c5fb8fcb tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2747858 Nov 24 13:57:59.375737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c26353db-baeb-4f4b-8fc7-a36429a455d2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:59.380847 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=83574cc69af84d9aacb10461f2e4e2f1&name=default HTTP/1.1" status: 200 len: 2647 time: 0.7954953 Nov 24 13:57:59.386608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39376) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:57:59.388712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:59.515948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.537813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.544130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-50e6caba-45eb-433c-a825-94227992eb72 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:59.573996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 75a11923-c50e-4816-9824-634165f12b82 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:57:59.574329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.589907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.598831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Pushing event deleted for resources: {'Port': ['ID=edb84025-b225-44f1-a2bb-577394c19988,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:59.604957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:59.671215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.681946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:59.798656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.802037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:57:59.811769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event deleted for resources: {'Port': ['ID=a223b140-04da-4c24-b59d-ffdf730274b6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:59.819958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c26353db-baeb-4f4b-8fc7-a36429a455d2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:57:59.824774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:59.850828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:57:59.854927 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/c26353db-baeb-4f4b-8fc7-a36429a455d2 HTTP/1.1" status: 204 len: 168 time: 0.4650764 Nov 24 13:57:59.890119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.890983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.891353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.892019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.892297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.892653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.893006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.893354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.893701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.894047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.894394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:57:59.933950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:57:59.964671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:00.081534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:00.352871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 75a11923-c50e-4816-9824-634165f12b82 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:00.535513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:00.560184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:00.608448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:00.661020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb40baf-36d7-47ae-aafc-faee9ecce7b7 req-cbefb80c-cacc-4197-af56-797fb76245a5 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:00.662480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1bb40baf-36d7-47ae-aafc-faee9ecce7b7 req-cbefb80c-cacc-4197-af56-797fb76245a5 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.1594582 Nov 24 13:58:00.734832 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1bb40baf-36d7-47ae-aafc-faee9ecce7b7 req-f70caebe-a33c-4cb9-b407-6a5fd1c840ba tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555153 Nov 24 13:58:00.747477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Router 6fb934fe-8876-4ad1-8081-30b7959413d2 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:00.793828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=11288f35-f08d-439a-bc56-30b6110364f1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:00.866819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:00.873874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39400) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:00.994027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.013010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '4faebad9-5f6a-4427-98ec-bb6944674c9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:01.013365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: 90437c3a-a79a-4e0b-be07-13528c18112f, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:01.018157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.088680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:01.096160 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] 10.222.0.70 "PUT /v2.0/routers/6fb934fe-8876-4ad1-8081-30b7959413d2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3187025 Nov 24 13:58:01.096513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39406) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:01.104427 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] Sync routers for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:01.114998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-1080687168'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:01.119128 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:01.119818 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:01.132300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.133037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Fanout notify agent at l3_agent the message router_deleted on router 031a9c63-71c7-45bb-934c-9c79e19032f9 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:01.138114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:01.140175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 90437c3a-a79a-4e0b-be07-13528c18112f is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:01.152605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:01.166186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:01.217700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:01.219969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 90437c3a-a79a-4e0b-be07-13528c18112f) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:01.234726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6843efd-b929-4ddb-a95c-525107adbd67 None None] Network 90437c3a-a79a-4e0b-be07-13528c18112f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:01.241785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:01.242363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.272554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.281174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:01.315053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:01.317879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.319336 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:58:01.333049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.336307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Deleting port b47a3021-ab27-448e-bbc9-296c441891bc {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:01.336642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.389117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.395086 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-39e2a15e-d3d0-43bd-8640-89f022ae2b6e tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/031a9c63-71c7-45bb-934c-9c79e19032f9 HTTP/1.1" status: 204 len: 168 time: 5.2173042 Nov 24 13:58:01.396248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=75a11923-c50e-4816-9824-634165f12b82,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:01.396689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39410) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:01.401956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.402409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-568201300', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:01.414591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:01.417511 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.2681966 Nov 24 13:58:01.422431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39414) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:01.434963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:01.440078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-307661283'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:01.452435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Usage tracker for resource:router and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:01.464607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:01.478003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:01.607161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.608149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.658174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.705194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-90437c3a-a79a-4e0b-be07-13528c18112f', 'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': '11288f35-f08d-439a-bc56-30b6110364f1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:01.706039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.833900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.835620 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237'}], 'enable_snat': True}, 'gw_port_id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:57:59Z', 'revision_number': 5, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port': {'id': 'e8f8917d-9594-4d5f-93db-365790f34888', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:2a:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.237', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:01.847932 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] Checking router: 6fb934fe-8876-4ad1-8081-30b7959413d2 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:58:01.866350 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] Routers {'6fb934fe-8876-4ad1-8081-30b7959413d2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:01.867139 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6fb934fe-8876-4ad1-8081-30b7959413d2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:01.914160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Deleting port e8f8917d-9594-4d5f-93db-365790f34888 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:01.914504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:01.952368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:01.976193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:security_group_rule and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:01.983654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Allocated IP 2001:db8::2 (90437c3a-a79a-4e0b-be07-13528c18112f/11288f35-f08d-439a-bc56-30b6110364f1/055ab4b1-1499-4524-9020-069ab6e623c9) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:01.988414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:02.045927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:02.081974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.086708 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] Set router 6fb934fe-8876-4ad1-8081-30b7959413d2 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:58:02.136126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] For port e8f8917d-9594-4d5f-93db-365790f34888, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e8f8917d-9594-4d5f-93db-365790f34888,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:02.136489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.199325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:02.204174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] For port b47a3021-ab27-448e-bbc9-296c441891bc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b47a3021-ab27-448e-bbc9-296c441891bc,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:02.204741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.225568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:02.250960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.258979 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:58:01Z', 'revision_number': 6, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:02.264767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Transition to ACTIVE for port object 055ab4b1-1499-4524-9020-069ab6e623c9 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:02.270253 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7be87a8-4b32-4cf9-a065-ab9b03f1d8fb None None] The sync data for ids ['6fb934fe-8876-4ad1-8081-30b7959413d2'] in dv-neutron-818151-2-hyperv is: [{'id': '6fb934fe-8876-4ad1-8081-30b7959413d2', 'name': 'tempest-ServersTestManualDisk-2018880365-router', 'tenant_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:58Z', 'updated_at': '2021-11-24T13:58:01Z', 'revision_number': 6, 'project_id': 'cec6d7377f6a459a8b7de61e6d2b631f', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:02.283254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:02.291636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Transition to ACTIVE for port object 055ab4b1-1499-4524-9020-069ab6e623c9 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:02.311935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.334125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Calling delete_port for e8f8917d-9594-4d5f-93db-365790f34888 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:02.334424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-99ecab8e-9c30-445f-b5f1-07392afe57e7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:02.356315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:02.366525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Calling delete_port for b47a3021-ab27-448e-bbc9-296c441891bc owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:02.384037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Network 90437c3a-a79a-4e0b-be07-13528c18112f is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:02.385202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:02.389026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:02.441780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Pushing event updated for resources: {'Port': ['ID=055ab4b1-1499-4524-9020-069ab6e623c9,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:02.448163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:02.464388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:02.467696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.506176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Attempting to bind port 055ab4b1-1499-4524-9020-069ab6e623c9 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:02.506551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Attempting to bind port 055ab4b1-1499-4524-9020-069ab6e623c9 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '4faebad9-5f6a-4427-98ec-bb6944674c9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:02.506914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Attempting to bind port 055ab4b1-1499-4524-9020-069ab6e623c9 on network 90437c3a-a79a-4e0b-be07-13528c18112f {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:02.514979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 57, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:02.516171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Checking segment: {'id': '4faebad9-5f6a-4427-98ec-bb6944674c9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:02.516171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.516858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Bound using segment: {'id': '4faebad9-5f6a-4427-98ec-bb6944674c9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:02.517262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Bound port: 055ab4b1-1499-4524-9020-069ab6e623c9, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4faebad9-5f6a-4427-98ec-bb6944674c9d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': '90437c3a-a79a-4e0b-be07-13528c18112f'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:02.517637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.561333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e15704-8bff-417d-aa60-cbed1fa8841d req-c560a21b-5101-4b72-9c8d-dde4d91e4a35 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:02.564102 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68e15704-8bff-417d-aa60-cbed1fa8841d req-c560a21b-5101-4b72-9c8d-dde4d91e4a35 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5888145 Nov 24 13:58:02.565831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.568546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 8bd455e2-c24a-4cd9-994e-012f514f313e yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:02.585293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.608689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.612022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] For port 055ab4b1-1499-4524-9020-069ab6e623c9, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:02.615253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] For port 055ab4b1-1499-4524-9020-069ab6e623c9, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=055ab4b1-1499-4524-9020-069ab6e623c9,segment=NetworkSegment(4faebad9-5f6a-4427-98ec-bb6944674c9d),segment_id=4faebad9-5f6a-4427-98ec-bb6944674c9d)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:02.619588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.623162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:02.635417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-160599e9-a52e-4ea7-849d-46b725e99e3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:02.650004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.755501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Pushing event updated for resources: {'Port': ['ID=055ab4b1-1499-4524-9020-069ab6e623c9,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:02.758678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:02.769274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 858} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:02.825692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba40cbc5-78a1-4360-a259-ff96446c9c56,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:02.847103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:02.850909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.851253 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment d7616f88-fcf0-482c-9d78-68726f5f295b of type vlan for network 27d84f11-5c9d-4555-8c98-67f172766d45 Nov 24 13:58:02.879652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.886555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd579790-5167-48d0-85c5-469b0682c2ec tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:02.889132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68e15704-8bff-417d-aa60-cbed1fa8841d req-512c9171-223b-42d6-906c-a9f7b6777837 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2857873 Nov 24 13:58:02.975342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:02.982040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Pushing event deleted for resources: {'Port': ['ID=e8f8917d-9594-4d5f-93db-365790f34888,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:03.029415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.029895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.030584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.030732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.031136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.031603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.032669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.033097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.033518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.033939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.034363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:03.050454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:03.066285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::1ec (90437c3a-a79a-4e0b-be07-13528c18112f/11288f35-f08d-439a-bc56-30b6110364f1/8bd455e2-c24a-4cd9-994e-012f514f313e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:03.122461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Allocated IP 172.26.4.248 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/aa6aa9ac-1b48-4185-b55e-3fa2c96a42df) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:03.124151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-52a3b2f5-c3b3-4449-890a-658bb577e7dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.150920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.157643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:03.158357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.204556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b825676-ee07-4851-b1c4-3e5f36b123ac tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:03.315016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.340211 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 2.4105380 Nov 24 13:58:03.342092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39424) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:03.503040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.519325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.532267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.595126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-1507432842'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:03.701602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=27d84f11-5c9d-4555-8c98-67f172766d45,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:03.703994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:03.713206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 27d84f11-5c9d-4555-8c98-67f172766d45 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:03.723350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.519s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:03.821705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.840830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.846394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.887229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.887951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6fb934fe-8876-4ad1-8081-30b7959413d2 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:03.903144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.914119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ad599d33-cb11-4755-bc1a-4bc511efc38a tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:03.916561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fada95a3-29a1-4b0c-b7da-aafd33f4cc54 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.581s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:03.947478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:03.961523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:03.963253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:03.972877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:03.975841 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] 10.222.0.70 "DELETE /v2.0/routers/6fb934fe-8876-4ad1-8081-30b7959413d2 HTTP/1.1" status: 204 len: 168 time: 2.8764825 Nov 24 13:58:03.977580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:03.979888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:04.008906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39434) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:04.011561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:04.022030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Pushing event deleted for resources: {'Port': ['ID=b47a3021-ab27-448e-bbc9-296c441891bc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:04.088364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:04.093009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event updated for resources: {'Port': ['ID=aa6aa9ac-1b48-4185-b55e-3fa2c96a42df,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:04.106968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:04.138299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.149552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:04.149552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.159807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Deleting subnet fdef5004-cb01-46c8-ad07-7ca2196a0189 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:04.166512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.169241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 055ab4b1-1499-4524-9020-069ab6e623c9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:04.206491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 8bd455e2-c24a-4cd9-994e-012f514f313e will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:04.243527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.258857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 850} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:04.304417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad650940-7486-47a6-990f-abb360e25439 req-266e5de8-0a5c-42bc-accb-01a009f51568 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:04.310505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad650940-7486-47a6-990f-abb360e25439 req-266e5de8-0a5c-42bc-accb-01a009f51568 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 1.0024552 Nov 24 13:58:04.327052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 055ab4b1-1499-4524-9020-069ab6e623c9 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:04.358501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.363439 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-dfd9b081-5d74-4207-96ca-6cd268c89fab service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 1.0220006 Nov 24 13:58:04.380006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.381216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-817a5941-5a45-4ede-a955-1d8d5d2d8e5d None None] Network 90437c3a-a79a-4e0b-be07-13528c18112f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:04.392016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.392369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment ee4a4129-fbe1-4beb-8e23-257ebb7425b1 of type vlan for network c9fa6814-5f92-43d6-9db9-d60c19b25c66 Nov 24 13:58:04.406757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e8f8917d-9594-4d5f-93db-365790f34888 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:04.414763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-90466499-e91d-4f32-8e68-2b286958d23f tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:04.428860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.429770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.444772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: e8f8917d-9594-4d5f-93db-365790f34888 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:04.445111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e8f8917d-9594-4d5f-93db-365790f34888 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:04.445704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device edb84025-b225-44f1-a2bb-577394c19988 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:04.546851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: edb84025-b225-44f1-a2bb-577394c19988 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:04.548264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device edb84025-b225-44f1-a2bb-577394c19988 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:04.551096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 90437c3a-a79a-4e0b-be07-13528c18112f is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:04.564118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:04.596067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Provisioning for port 055ab4b1-1499-4524-9020-069ab6e623c9 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:04.609708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:04.613076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Provisioning complete for port 055ab4b1-1499-4524-9020-069ab6e623c9 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:04.613449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.614093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:04.614705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.651150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.657215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:04.678046 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad650940-7486-47a6-990f-abb360e25439 req-3a0b5ca0-5563-4598-b9b4-234dee299696 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3602524 Nov 24 13:58:04.695853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fdef5004-cb01-46c8-ad07-7ca2196a0189,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:04.699292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:04.703936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.717517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edcab1ec-e436-4239-80c8-28ebc4ed33e9 None None] Network 192cb388-42c9-4352-94b7-0d42c68d3b4b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:04.721936 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/fdef5004-cb01-46c8-ad07-7ca2196a0189 HTTP/1.1" status: 204 len: 168 time: 0.7119637 Nov 24 13:58:04.731083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39438) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:04.760879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=8bd455e2-c24a-4cd9-994e-012f514f313e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:04.787116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.372s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:04.792744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.819635 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 892 time: 3.3954394 Nov 24 13:58:04.823233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39442) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:04.904696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 8bd455e2-c24a-4cd9-994e-012f514f313e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:04.905381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:04.919805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954dce95-8922-403b-990b-af440217caab req-be086261-9a69-4a3b-ac22-f252fc2dc303 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:04.921199 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-be086261-9a69-4a3b-ac22-f252fc2dc303 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.5476820 Nov 24 13:58:05.027441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.034249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Router 9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:58:05.063856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.081140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.084879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:05.085453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.093224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5fd1609a-89df-4077-95da-bac79f607bc3 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:05.093434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] For port 055ab4b1-1499-4524-9020-069ab6e623c9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=055ab4b1-1499-4524-9020-069ab6e623c9,segment=NetworkSegment(4faebad9-5f6a-4427-98ec-bb6944674c9d),segment_id=4faebad9-5f6a-4427-98ec-bb6944674c9d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:05.101650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.105570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ba2e3e7-08eb-4a1c-baf6-99818ff5555f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:05.180010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Pushing event updated for resources: {'Port': ['ID=055ab4b1-1499-4524-9020-069ab6e623c9,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:05.192017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.192358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.192684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.193008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.193332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.193707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.194077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.195573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.195937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.196402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.196887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:58:05.204679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:05.246888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] DHCP port deletion for 192cb388-42c9-4352-94b7-0d42c68d3b4b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:05.252122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Deleting port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:05.252692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.288081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.316147 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.9189301 Nov 24 13:58:05.318393 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-e8a0fe25-2fbe-44ba-8042-f5f1ce14d539 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.3762667 Nov 24 13:58:05.319237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Deleting port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:05.319779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.349718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39446) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:05.401661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=c9fa6814-5f92-43d6-9db9-d60c19b25c66,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:05.416779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:05.420529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:05.422015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:05.428791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.503248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 8bd455e2-c24a-4cd9-994e-012f514f313e owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:05.637903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] For port 4f186f8f-1323-42d7-929a-6a3cde55f1b7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4f186f8f-1323-42d7-929a-6a3cde55f1b7,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:05.638420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.784621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Calling delete_port for 4f186f8f-1323-42d7-929a-6a3cde55f1b7 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:05.789253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-954dce95-8922-403b-990b-af440217caab req-bf1ecc33-bf84-48f0-b4e2-48b701b61bd6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:05.790715 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-bf1ecc33-bf84-48f0-b4e2-48b701b61bd6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.4454117 Nov 24 13:58:05.809736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.832962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-67a6f605-938b-4ae8-b425-6283df354fd1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:05.834642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9d19533-ea28-4f3f-b3f5-18d8cb0096f6 None None] Provisioning complete for port 055ab4b1-1499-4524-9020-069ab6e623c9 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:05.835029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9d19533-ea28-4f3f-b3f5-18d8cb0096f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.908987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=8bd455e2-c24a-4cd9-994e-012f514f313e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:05.921938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d024088-9a6f-47d8-b46c-d6a06d1ad6aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:05.928371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:05.944924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:05.971197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:05.995343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.003389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:06.026164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b888c3ad-caf3-40b9-b14a-94ae476f7eaa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:06.027643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:06.037273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.075217 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/8bd455e2-c24a-4cd9-994e-012f514f313e HTTP/1.1" status: 204 len: 168 time: 1.2504790 Nov 24 13:58:06.077838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:06.088548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39452) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:06.179647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Pushing event deleted for resources: {'Port': ['ID=4f186f8f-1323-42d7-929a-6a3cde55f1b7,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:06.182933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:06.193506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9d19533-ea28-4f3f-b3f5-18d8cb0096f6 None None] Could not find standard attr ID for object 8bd455e2-c24a-4cd9-994e-012f514f313e. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:58:06.199811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] No DVR routers for this DVR port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:06.200215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] For port 4f186f8f-1323-42d7-929a-6a3cde55f1b7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4f186f8f-1323-42d7-929a-6a3cde55f1b7,segment=NetworkSegment(423ee2bc-a1dd-4d07-afe8-56278dd019a5),segment_id=423ee2bc-a1dd-4d07-afe8-56278dd019a5)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:06.200581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.216252 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-e1a71ff7-ae03-4f16-b262-82b8920b7346 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:58:06.217592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e1a71ff7-ae03-4f16-b262-82b8920b7346 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:06.259172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 055ab4b1-1499-4524-9020-069ab6e623c9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:06.310800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:06.325454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c2c89208-4047-4163-8d79-6529c3c1dd7d None None] Could not find standard attr ID for object 8bd455e2-c24a-4cd9-994e-012f514f313e. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:58:06.328643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] Sync routers for ids ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:06.363988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] Routers {'9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:06.364632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:06.396081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Calling delete_port for 4f186f8f-1323-42d7-929a-6a3cde55f1b7 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:06.429232 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-5d759ae9-61e2-4d04-99e2-f61e4163c416 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.6181328 Nov 24 13:58:06.433637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:06.452643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 055ab4b1-1499-4524-9020-069ab6e623c9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:06.455271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.460211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.487192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e1a71ff7-ae03-4f16-b262-82b8920b7346 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:06.490904 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e1a71ff7-ae03-4f16-b262-82b8920b7346 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/8bd455e2-c24a-4cd9-994e-012f514f313e HTTP/1.1" status: 404 len: 333 time: 0.3988783 Nov 24 13:58:06.491071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.491911 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 888 time: 5.0935552 Nov 24 13:58:06.491911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39456) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:06.494306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] Routers {'9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:06.495021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:06.495278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39458) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:06.568122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:06.568537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5e04ba8-b607-4c28-8432-b7d204efcf9f None None] The sync data for ids ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:06.599825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:06.658739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:06.673032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:06.673032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:06.712427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-257d3f44-d296-47de-b04f-73a9ed3cc4ff req-6c28bd99-fecb-4dc1-8461-9ae24f2d1e83 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:06.713804 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-257d3f44-d296-47de-b04f-73a9ed3cc4ff req-6c28bd99-fecb-4dc1-8461-9ae24f2d1e83 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6003444 Nov 24 13:58:06.728678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4f186f8f-1323-42d7-929a-6a3cde55f1b7 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:06.734322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-6ebd6354-ef56-4e6f-b167-65db7b89b3c4 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2850842 Nov 24 13:58:06.769645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 4f186f8f-1323-42d7-929a-6a3cde55f1b7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:06.769645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4f186f8f-1323-42d7-929a-6a3cde55f1b7 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:06.996198 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-257d3f44-d296-47de-b04f-73a9ed3cc4ff req-0c3eb5ba-a5a9-4acc-9dee-e21efc8b49ff tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2637615 Nov 24 13:58:07.036008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 11288f35-f08d-439a-bc56-30b6110364f1 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:07.045453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.056182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-954dce95-8922-403b-990b-af440217caab req-2d3e698e-5794-429d-92ff-92d221b85bb1 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3135831 Nov 24 13:58:07.074488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router da5d85fa-d3d7-4ca9-ba88-50f459944054 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:07.144246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.177839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.184211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:07.290106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=92a67e43-85d9-4a70-a511-803d3c21308b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:07.298322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:07.334152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Deleting port 4f186f8f-1323-42d7-929a-6a3cde55f1b7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:07.334726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.401731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': 'd7616f88-fcf0-482c-9d78-68726f5f295b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:07.402087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: 27d84f11-5c9d-4555-8c98-67f172766d45, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:07.416064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] The port '4f186f8f-1323-42d7-929a-6a3cde55f1b7' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:07.417888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.505446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 27d84f11-5c9d-4555-8c98-67f172766d45 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:07.576766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.583432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 27d84f11-5c9d-4555-8c98-67f172766d45) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:07.589390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:07.589992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.603443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.608574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce897a32-2bd0-4c1a-a702-e82cffada014 None None] Network 27d84f11-5c9d-4555-8c98-67f172766d45 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:07.611236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-59ff74c0-5b87-4865-b9e4-c5d44b9f95ce tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:07.653916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=11288f35-f08d-439a-bc56-30b6110364f1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:07.661288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:07.665684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.667397 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/11288f35-f08d-439a-bc56-30b6110364f1 HTTP/1.1" status: 204 len: 168 time: 1.1731577 Nov 24 13:58:07.677514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39464) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:07.686352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.3254101 Nov 24 13:58:07.701604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39468) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:07.718748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['192cb388-42c9-4352-94b7-0d42c68d3b4b']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:07.722489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72ddb448-b3c3-4e97-8702-72b2fd4f917b None None] Network 90437c3a-a79a-4e0b-be07-13528c18112f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:07.734671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:07.768055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '423ee2bc-a1dd-4d07-afe8-56278dd019a5') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:07.768355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '423ee2bc-a1dd-4d07-afe8-56278dd019a5') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:07.813019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.847935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.890876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.894439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 055ab4b1-1499-4524-9020-069ab6e623c9 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:07.894777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.905055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Releasing vlan 896 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:07.905441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:07.920065 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:07.945083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:07.997866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:08.014170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:08.033011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:08.042012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-27d84f11-5c9d-4555-8c98-67f172766d45', 'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': '92a67e43-85d9-4a70-a511-803d3c21308b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:08.052483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.057246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.064560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:08.079505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:08.097467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.115137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Pushing event deleted for resources: {'Network': ['ID=192cb388-42c9-4352-94b7-0d42c68d3b4b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:08.118441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:08.126324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:08.140073 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] Sync routers for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:08.163216 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:08.164184 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:08.272512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Router 29faa878-433b-448f-ae89-9e61ec9daefb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:08.292093 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/routers/da5d85fa-d3d7-4ca9-ba88-50f459944054/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 13.3443279 Nov 24 13:58:08.293471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:08.303153 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:08.305996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] 10.222.0.70 "DELETE /v2.0/networks/192cb388-42c9-4352-94b7-0d42c68d3b4b HTTP/1.1" status: 204 len: 168 time: 3.5562611 Nov 24 13:58:08.332892 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] Routers {'da5d85fa-d3d7-4ca9-ba88-50f459944054'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:08.334245 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['da5d85fa-d3d7-4ca9-ba88-50f459944054'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:08.369018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.395055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Allocated IP 172.20.0.2 (27d84f11-5c9d-4555-8c98-67f172766d45/92a67e43-85d9-4a70-a511-803d3c21308b/ba795333-49cf-42f2-8352-31bf18d084d4) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:08.401791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port 055ab4b1-1499-4524-9020-069ab6e623c9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=055ab4b1-1499-4524-9020-069ab6e623c9,segment=NetworkSegment(4faebad9-5f6a-4427-98ec-bb6944674c9d),segment_id=4faebad9-5f6a-4427-98ec-bb6944674c9d)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:08.402316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.416285 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:08.417493 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56aad345-6eea-40d8-ac36-a65e89622915 None None] The sync data for ids ['da5d85fa-d3d7-4ca9-ba88-50f459944054'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:08.453526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] DHCP port deletion for 90437c3a-a79a-4e0b-be07-13528c18112f request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:08.469637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Deleting port 055ab4b1-1499-4524-9020-069ab6e623c9 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:08.470212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.548400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 055ab4b1-1499-4524-9020-069ab6e623c9 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:08.589338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.639121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ff6932-796b-49da-9e2b-0c6434777303 req-d8af59cd-0d42-4d22-990e-e645064cf38e tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:08.641230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68ff6932-796b-49da-9e2b-0c6434777303 req-d8af59cd-0d42-4d22-990e-e645064cf38e tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.4243236 Nov 24 13:58:08.646053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.660458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.665557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-84840440-b54d-4835-8329-aa2fbda6a568 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:08.689693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.702355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39480) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:08.704032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Deleting port aa6aa9ac-1b48-4185-b55e-3fa2c96a42df {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:08.704371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:08.763001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=055ab4b1-1499-4524-9020-069ab6e623c9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:08.770836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:08.781298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No DVR routers for this DVR port 055ab4b1-1499-4524-9020-069ab6e623c9 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:08.816811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] For port 055ab4b1-1499-4524-9020-069ab6e623c9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=055ab4b1-1499-4524-9020-069ab6e623c9,segment=NetworkSegment(4faebad9-5f6a-4427-98ec-bb6944674c9d),segment_id=4faebad9-5f6a-4427-98ec-bb6944674c9d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:08.817402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.006171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Calling delete_port for 055ab4b1-1499-4524-9020-069ab6e623c9 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:09.011878 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e959ff19-ca89-472e-b0d7-c10bb95ff313 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=cec6d7377f6a459a8b7de61e6d2b631f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2832062 Nov 24 13:58:09.016017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39484) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:09.021549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.030131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68ff6932-796b-49da-9e2b-0c6434777303 req-3720dbc7-a4ef-44da-a4b3-98e7ea309a30 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2030396 Nov 24 13:58:09.092913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.096595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['90437c3a-a79a-4e0b-be07-13528c18112f']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:09.102392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f73c988f-a201-46af-913d-ef02480cfe59 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:09.133839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4faebad9-5f6a-4427-98ec-bb6944674c9d') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:09.133839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4faebad9-5f6a-4427-98ec-bb6944674c9d') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:09.142862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.157978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.160708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.172476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.196366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Transition to ACTIVE for port object ba795333-49cf-42f2-8352-31bf18d084d4 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:09.239994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Transition to ACTIVE for port object ba795333-49cf-42f2-8352-31bf18d084d4 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:09.245983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:09.246465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:09.252300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.261944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=d84e48cc-8c0a-4880-b899-7d51994d9ca1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:09.265385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3192659b-23d4-47fb-bb2c-1e4581f48ece None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:09.268249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:09.272612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:09.295523 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] 10.222.0.70 "PUT /v2.0/routers/29faa878-433b-448f-ae89-9e61ec9daefb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 13.1964326 Nov 24 13:58:09.297920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39490) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:09.322287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Calling delete_port for aa6aa9ac-1b48-4185-b55e-3fa2c96a42df owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:09.351831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Pushing event updated for resources: {'Port': ['ID=ba795333-49cf-42f2-8352-31bf18d084d4,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:09.354514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:09.355524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] Sync routers for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:09.364445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.370303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:09.370862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: c9fa6814-5f92-43d6-9db9-d60c19b25c66, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:09.371908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Network 27d84f11-5c9d-4555-8c98-67f172766d45 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:09.374384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:09.377111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:09.385818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:09.386450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:09.392837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 866 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:09.393229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:09.409759 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:09.434271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.490353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:09.546592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.554532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, c9fa6814-5f92-43d6-9db9-d60c19b25c66) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:09.564734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Attempting to bind port ba795333-49cf-42f2-8352-31bf18d084d4 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:09.564734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Attempting to bind port ba795333-49cf-42f2-8352-31bf18d084d4 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd7616f88-fcf0-482c-9d78-68726f5f295b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:09.564992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Attempting to bind port ba795333-49cf-42f2-8352-31bf18d084d4 on network 27d84f11-5c9d-4555-8c98-67f172766d45 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:09.567541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:09.568181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.605939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.608200 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.9004624 Nov 24 13:58:09.612730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39494) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:09.620108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef5d937a-6e47-4ed0-b128-1b51e674287b None None] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:09.621219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1152a6af-e2ae-47fb-a15d-b1cb9e1cf6c5 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:09.623180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1796513932', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:09.634648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:09.638203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.653028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:09.658361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:09.663737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:09.664181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Checking segment: {'id': 'd7616f88-fcf0-482c-9d78-68726f5f295b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:09.664543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.664937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Bound using segment: {'id': 'd7616f88-fcf0-482c-9d78-68726f5f295b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:09.665419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Bound port: ba795333-49cf-42f2-8352-31bf18d084d4, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7616f88-fcf0-482c-9d78-68726f5f295b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '27d84f11-5c9d-4555-8c98-67f172766d45'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:09.665791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.665997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149edd7c-caaa-4c30-9d5b-9787c452df6b req-e0950ee9-4edd-454a-818e-b3b2e740e26d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:09.669543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:09.675070 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-149edd7c-caaa-4c30-9d5b-9787c452df6b req-e0950ee9-4edd-454a-818e-b3b2e740e26d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5005164 Nov 24 13:58:09.683007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=90437c3a-a79a-4e0b-be07-13528c18112f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:09.697863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.706630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.706630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.714516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:09.722337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.751631 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/90437c3a-a79a-4e0b-be07-13528c18112f HTTP/1.1" status: 204 len: 168 time: 2.0724897 Nov 24 13:58:09.752428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39498) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:09.753030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Deleting port 055ab4b1-1499-4524-9020-069ab6e623c9 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:09.753414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.759799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'name': 'tempest-PortsIpV6TestJSON-1296181256'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:09.775912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port bde37990-bbab-4cfa-b600-7a5886376721 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:09.776266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.852986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.873091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-42749a1e-9cec-407a-89fc-e839e37837a4 None None] The port '055ab4b1-1499-4524-9020-069ab6e623c9' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:09.938353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:58:09.960318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:09.996673 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-149edd7c-caaa-4c30-9d5b-9787c452df6b req-592e74b4-33b0-4ce1-bcef-84e822b128bb tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3207147 Nov 24 13:58:10.016169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.026524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64d5eb20-7cec-4992-ab19-a69ec34b2821 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:10.089495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.095683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c2226442-9af8-4bbf-a1f3-d9cd8831f6ad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.4739730 Nov 24 13:58:10.096283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e674e92-9d9b-4056-bace-5772f570a75e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:10.096402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:10.097887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:10.104368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] For port ba795333-49cf-42f2-8352-31bf18d084d4, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:10.117722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:10.120932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.122228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/3e674e92-9d9b-4056-bace-5772f570a75e HTTP/1.1" status: 204 len: 168 time: 1.1034913 Nov 24 13:58:10.127973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:10.131086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.143091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:10.146120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-84021d63-e7e8-4b5a-927a-ffdae58b75c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:10.188167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:10.189427 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] For port ba795333-49cf-42f2-8352-31bf18d084d4, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ba795333-49cf-42f2-8352-31bf18d084d4,segment=NetworkSegment(d7616f88-fcf0-482c-9d78-68726f5f295b),segment_id=d7616f88-fcf0-482c-9d78-68726f5f295b)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:10.204266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 055ab4b1-1499-4524-9020-069ab6e623c9 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:10.231645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Pushing event deleted for resources: {'Port': ['ID=aa6aa9ac-1b48-4185-b55e-3fa2c96a42df,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:10.240763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:10.270995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:10.274347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.308524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.313463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port f41d5170-3343-4fb6-b6c4-ea664b96a63c yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:10.348193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.560410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:10.564285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.702985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.710555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:10.715517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 055ab4b1-1499-4524-9020-069ab6e623c9 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:10.716085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 055ab4b1-1499-4524-9020-069ab6e623c9 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:10.800562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for bde37990-bbab-4cfa-b600-7a5886376721 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:10.818245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Pushing event updated for resources: {'Port': ['ID=ba795333-49cf-42f2-8352-31bf18d084d4,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:10.822064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:10.878148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-c9fa6814-5f92-43d6-9db9-d60c19b25c66', 'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': 'd84e48cc-8c0a-4880-b899-7d51994d9ca1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:10.879509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.105348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Router 9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:11.110569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.154556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796c80fb-066e-4b24-be71-777a00807ea4 req-6c7f871b-cf4a-48ed-acd6-8f513dbbca65 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:11.164519 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-796c80fb-066e-4b24-be71-777a00807ea4 req-6c7f871b-cf4a-48ed-acd6-8f513dbbca65 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.4495173 Nov 24 13:58:11.177380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.182921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.191001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-97a6e7c6-f91d-44a0-970a-8ca7472472ef tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:11.240138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Allocated IP 172.21.0.2 (c9fa6814-5f92-43d6-9db9-d60c19b25c66/d84e48cc-8c0a-4880-b899-7d51994d9ca1/3bb052da-aef1-4641-909d-dab80acc950b) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:11.242656 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-796c80fb-066e-4b24-be71-777a00807ea4 req-20db5f81-b6e2-4a71-8e3f-6337bbabf45c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745468 Nov 24 13:58:11.257043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220'}], 'enable_snat': True}, 'gw_port_id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:58:02Z', 'revision_number': 5, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port': {'id': '728c9c54-618b-4a75-a8c2-ed9801e1b27b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:c0:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:11.271604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] Checking router: 29faa878-433b-448f-ae89-9e61ec9daefb for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 13:58:11.372408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=bde37990-bbab-4cfa-b600-7a5886376721,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:11.378847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:11.411460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] Routers {'29faa878-433b-448f-ae89-9e61ec9daefb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:11.412076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['29faa878-433b-448f-ae89-9e61ec9daefb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:11.443179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:11.454929 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] Sync routers for ids ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:11.455459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.473104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4712cf56-2dd0-4e84-9d6f-3f3334b4c734 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:11.480705 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] Routers {'9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:11.481947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:11.613328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Deleting port 728c9c54-618b-4a75-a8c2-ed9801e1b27b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:11.615578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.746881 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:11.766128 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] Routers {'9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:11.767546 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:11.905015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] For port 728c9c54-618b-4a75-a8c2-ed9801e1b27b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=728c9c54-618b-4a75-a8c2-ed9801e1b27b,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:11.905717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.942723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:11.957087 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "PUT /v2.0/routers/9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 200 len: 709 time: 5.4553745 Nov 24 13:58:11.973141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39536) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:12.014510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.028267 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:12.028910 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dffe668a-ab6c-41c2-87fb-b6259130cca9 None None] The sync data for ids ['9cf4a4cd-a4a2-483e-8cbd-2bd47b918398'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:12.143151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] Set router 29faa878-433b-448f-ae89-9e61ec9daefb gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 13:58:12.370671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:58:11Z', 'revision_number': 6, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:12.381152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-666518ad-efb7-421a-9f8c-2dc9e29aa19e None None] The sync data for ids ['29faa878-433b-448f-ae89-9e61ec9daefb'] in dv-neutron-818151-2-hyperv is: [{'id': '29faa878-433b-448f-ae89-9e61ec9daefb', 'name': 'tempest-ServersTestJSON-1754938903-router', 'tenant_id': '8253655cf6fe49d7881f39cdb1344ce7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:58:11Z', 'revision_number': 6, 'project_id': '8253655cf6fe49d7881f39cdb1344ce7', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:12.383653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ba795333-49cf-42f2-8352-31bf18d084d4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:12.431696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Transition to ACTIVE for port object 3bb052da-aef1-4641-909d-dab80acc950b will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:12.492804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Transition to ACTIVE for port object 3bb052da-aef1-4641-909d-dab80acc950b will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:12.501835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:12.503855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port ba795333-49cf-42f2-8352-31bf18d084d4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:12.519059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.529856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:12.534295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:12.558576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=f41d5170-3343-4fb6-b6c4-ea664b96a63c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:12.578116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:12.592042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:12.593117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.603996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Pushing event updated for resources: {'Port': ['ID=3bb052da-aef1-4641-909d-dab80acc950b,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:12.606782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:12.613176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:12.614672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:12.617368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:12.623799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.152s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:12.659218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Calling delete_port for 728c9c54-618b-4a75-a8c2-ed9801e1b27b owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:12.676722 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 2.9188163 Nov 24 13:58:12.677218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39548) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:12.697641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3532a7a8-c6ef-4333-b410-6824c08d997d None None] Network 27d84f11-5c9d-4555-8c98-67f172766d45 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:12.747559 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f3458fe6-c09a-461e-acd0-d0348d6dced0 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/routers/9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 200 len: 744 time: 0.7729692 Nov 24 13:58:12.751548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Attempting to bind port 3bb052da-aef1-4641-909d-dab80acc950b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:12.751969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Attempting to bind port 3bb052da-aef1-4641-909d-dab80acc950b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:12.752469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Attempting to bind port 3bb052da-aef1-4641-909d-dab80acc950b on network c9fa6814-5f92-43d6-9db9-d60c19b25c66 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:12.756732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39554) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:12.816229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:12.816615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Checking segment: {'id': 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:12.817014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.817410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Bound using segment: {'id': 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:12.818086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Bound port: 3bb052da-aef1-4641-909d-dab80acc950b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': 'c9fa6814-5f92-43d6-9db9-d60c19b25c66'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:12.818461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.848261 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-916889fa-14c5-461d-beb5-a023b10447ba tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] 10.222.0.70 "GET /v2.0/ports?network_id=402f60a1-052a-4741-af19-c310771ae4cd&device_id=9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 200 len: 205 time: 0.0895543 Nov 24 13:58:12.851566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:12.879001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port f41d5170-3343-4fb6-b6c4-ea664b96a63c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:12.879344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.941275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Provisioning for port ba795333-49cf-42f2-8352-31bf18d084d4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:12.969029 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-642e4d2d-5250-4296-813b-077c73e1af68 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 200 len: 205 time: 0.0949934 Nov 24 13:58:12.969766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39564) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:12.970147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ec50992-0d1a-4f2e-b68e-7873ea3279d4 req-ae311fc5-0d72-43f4-9a50-7130e2e387bd tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:12.970253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Provisioning complete for port ba795333-49cf-42f2-8352-31bf18d084d4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:12.970253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:12.973287 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5ec50992-0d1a-4f2e-b68e-7873ea3279d4 req-ae311fc5-0d72-43f4-9a50-7130e2e387bd tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.7912247 Nov 24 13:58:13.104825 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5ec50992-0d1a-4f2e-b68e-7873ea3279d4 req-625fc89d-b0ef-4ebf-aef3-154b49bb3a3e tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1301425 Nov 24 13:58:13.108083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] For port 3bb052da-aef1-4641-909d-dab80acc950b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:13.134616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] For port 3bb052da-aef1-4641-909d-dab80acc950b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3bb052da-aef1-4641-909d-dab80acc950b,segment=NetworkSegment(ee4a4129-fbe1-4beb-8e23-257ebb7425b1),segment_id=ee4a4129-fbe1-4beb-8e23-257ebb7425b1)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:13.173963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.211271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0b2c0e87-3a53-4339-9ff9-80ec5b1125bb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:13.282904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.413950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.428182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Pushing event updated for resources: {'Port': ['ID=3bb052da-aef1-4641-909d-dab80acc950b,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:13.431524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-80f9b2e6-5e17-47bc-982d-4b14d3e68b75 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:13.445689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:13.447028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.464552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for f41d5170-3343-4fb6-b6c4-ea664b96a63c owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:13.516861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] For port ba795333-49cf-42f2-8352-31bf18d084d4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ba795333-49cf-42f2-8352-31bf18d084d4,segment=NetworkSegment(d7616f88-fcf0-482c-9d78-68726f5f295b),segment_id=d7616f88-fcf0-482c-9d78-68726f5f295b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:13.523342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.525556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:13.549989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39576) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:13.602512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.616362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Pushing event updated for resources: {'Port': ['ID=ba795333-49cf-42f2-8352-31bf18d084d4,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:13.629724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:13.647817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.655555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d28d655f-4315-4b6d-baef-d11260070ae8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:13.706177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=f41d5170-3343-4fb6-b6c4-ea664b96a63c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:13.708444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:13.719568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.734064 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/f41d5170-3343-4fb6-b6c4-ea664b96a63c HTTP/1.1" status: 204 len: 168 time: 1.0509143 Nov 24 13:58:13.734467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:13.740887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'mac_address': 'fa:16:3e:ae:c7:c4', 'name': 'tempest-PortsIpV6TestJSON-2054471612'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:13.863111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-67a880b6-2bf2-4f63-b4c5-26908181dc7e tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Request body: {'quota': {'network': 2}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:13.875379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Pushing event deleted for resources: {'Port': ['ID=728c9c54-618b-4a75-a8c2-ed9801e1b27b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:13.926681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-67a880b6-2bf2-4f63-b4c5-26908181dc7e tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "PUT /v2.0/quotas/2efc3c3016f64cc893e0733a1eb16546 HTTP/1.1" status: 200 len: 368 time: 0.3756034 Nov 24 13:58:13.930116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39586) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:13.939040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Request body: {'network': {'project_id': '2efc3c3016f64cc893e0733a1eb16546'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:13.943949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.512s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:13.945278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:13.950817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:13.954205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:13.958713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:13.965186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c730e9e9-a2d1-4651-a001-6e8c1452b661 None None] Provisioning complete for port ba795333-49cf-42f2-8352-31bf18d084d4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:13.965569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c730e9e9-a2d1-4651-a001-6e8c1452b661 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:13.968679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Usage tracker for resource:network and tenant:2efc3c3016f64cc893e0733a1eb16546 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:13.971965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:13.975417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:13.986720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 2; headroom:2 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:14.002843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:14.034357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Made reservation on behalf of 2efc3c3016f64cc893e0733a1eb16546 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:14.037519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.054075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.201543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.211223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.229442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.287369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 193c64db-1d87-4cdb-9926-3ecd5347ecbc yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:14.290437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ba795333-49cf-42f2-8352-31bf18d084d4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:14.319095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.363458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:14.386832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Usage tracker for resource:security_group_rule and tenant:2efc3c3016f64cc893e0733a1eb16546 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:14.392759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:14.400499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:14.471313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port ba795333-49cf-42f2-8352-31bf18d084d4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:14.471839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.500299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.687517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3bb052da-aef1-4641-909d-dab80acc950b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:14.802475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.809968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 3bb052da-aef1-4641-909d-dab80acc950b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:14.812454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.830828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.835303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f7983e46-0ed7-496e-8cfa-02ee688b4ba0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:14.887408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:14.892640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b47a3021-ab27-448e-bbc9-296c441891bc no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:14.914516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=306090a0-7876-4847-a455-7fda48ae16c7,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:14.918387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.918732 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Added segment db08b6be-953a-43ff-844c-f6a32ad0ace0 of type vlan for network acb7b564-72e3-46e0-ae6a-18feaab83ec9 Nov 24 13:58:14.920035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:14.932637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.935084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: b47a3021-ab27-448e-bbc9-296c441891bc {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:14.935672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b47a3021-ab27-448e-bbc9-296c441891bc not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:14.936378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 728c9c54-618b-4a75-a8c2-ed9801e1b27b no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:14.961300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:14.978042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 728c9c54-618b-4a75-a8c2-ed9801e1b27b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:14.978403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 728c9c54-618b-4a75-a8c2-ed9801e1b27b not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:14.990128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.003143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-871fc448-2d42-43ad-9003-faf262360a6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:15.080965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:15.088916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:15.091506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:15.096484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:15.097428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.117072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.118466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:15.119132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.130863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba801105-54ef-491f-8a47-8eac1427084e None None] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:15.155685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=193c64db-1d87-4cdb-9926-3ecd5347ecbc,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:15.163497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:15.166818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f5d263a4-9643-4b74-84f7-b1234db51002 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:15.212217 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 1.2783060 Nov 24 13:58:15.218734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Provisioning for port 3bb052da-aef1-4641-909d-dab80acc950b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:15.225756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Provisioning complete for port 3bb052da-aef1-4641-909d-dab80acc950b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:15.226163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.258795 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.5230958 Nov 24 13:58:15.271960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39592) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:15.272371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:15.323950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Request body: {'network': {'project_id': '2efc3c3016f64cc893e0733a1eb16546'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:15.334802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:15.339458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Pushing event updated for resources: {'Network': ['ID=acb7b564-72e3-46e0-ae6a-18feaab83ec9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:15.348152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:15.349230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Usage tracker for resource:network and tenant:2efc3c3016f64cc893e0733a1eb16546 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:15.358083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:15.366574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network acb7b564-72e3-46e0-ae6a-18feaab83ec9 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:15.369261 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 2; headroom:1 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:15.376953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef1f88e9-06bd-4ae2-8146-7e3175b40df1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:15.377635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ef1f88e9-06bd-4ae2-8146-7e3175b40df1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:15.392490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.393192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Fanout notify agent at l3_agent the message router_deleted on router da5d85fa-d3d7-4ca9-ba88-50f459944054 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:15.399402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Made reservation on behalf of 2efc3c3016f64cc893e0733a1eb16546 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:15.402869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.416771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ef1f88e9-06bd-4ae2-8146-7e3175b40df1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:15.420528 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ef1f88e9-06bd-4ae2-8146-7e3175b40df1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/193c64db-1d87-4cdb-9926-3ecd5347ecbc HTTP/1.1" status: 200 len: 845 time: 0.1429656 Nov 24 13:58:15.421926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39600) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:15.496396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 898} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:15.506572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 193c64db-1d87-4cdb-9926-3ecd5347ecbc {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:15.506907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.550676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.551011 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Added segment c61d7665-9188-437c-a180-1dcca370161f of type vlan for network 08fc8008-015c-4784-87f0-a48c86370eea Nov 24 13:58:15.576926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.628680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] For port 3bb052da-aef1-4641-909d-dab80acc950b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3bb052da-aef1-4641-909d-dab80acc950b,segment=NetworkSegment(ee4a4129-fbe1-4beb-8e23-257ebb7425b1),segment_id=ee4a4129-fbe1-4beb-8e23-257ebb7425b1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:15.633792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.637647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:15.640446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.669229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.682692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.697093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.698472 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/routers/da5d85fa-d3d7-4ca9-ba88-50f459944054 HTTP/1.1" status: 204 len: 168 time: 7.3972273 Nov 24 13:58:15.701363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39604) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:15.702837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.718315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468f70c7-085e-416d-865a-4d6ae7d0fbf3 req-bf1fdc0b-6ed4-480e-9df7-d664461cceb8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:15.719924 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-468f70c7-085e-416d-865a-4d6ae7d0fbf3 req-bf1fdc0b-6ed4-480e-9df7-d664461cceb8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 1.3900564 Nov 24 13:58:15.720706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.724474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Pushing event updated for resources: {'Port': ['ID=3bb052da-aef1-4641-909d-dab80acc950b,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:15.727580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:15.837099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.837950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:15.838444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.856817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.857320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Fanout notify agent at l3_agent the message router_deleted on router 9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:15.860604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:15.871889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.872478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 29faa878-433b-448f-ae89-9e61ec9daefb {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:15.874248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.884230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.20.0.1 (27d84f11-5c9d-4555-8c98-67f172766d45/92a67e43-85d9-4a70-a511-803d3c21308b/38ab8b22-40e8-4724-8eff-53563e13338c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:15.900519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.901917 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6057e73b-63f4-4ac9-8d00-dd7380c24185 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 204 len: 168 time: 2.9284832 Nov 24 13:58:15.907169 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.6323426 Nov 24 13:58:15.907862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39608) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:15.915886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39610) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:15.920467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-468f70c7-085e-416d-865a-4d6ae7d0fbf3 req-fc8b9819-0010-48d3-abc5-32162fc455ec tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1838772 Nov 24 13:58:15.923813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:15.924951 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] 10.222.0.70 "DELETE /v2.0/routers/29faa878-433b-448f-ae89-9e61ec9daefb HTTP/1.1" status: 204 len: 168 time: 6.6245134 Nov 24 13:58:15.934369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39614) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.075779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 193c64db-1d87-4cdb-9926-3ecd5347ecbc owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:16.093351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c60a73c0-a4d3-4fc0-9507-6b05f51768ea None None] Provisioning complete for port 3bb052da-aef1-4641-909d-dab80acc950b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:16.094079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60a73c0-a4d3-4fc0-9507-6b05f51768ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.116828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Deleting subnet 8c839c3b-21dc-400b-8b56-739bd37025c8 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:16.121930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.154435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3bb052da-aef1-4641-909d-dab80acc950b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:16.189109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.303487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Request body: {'network': {'project_id': '2efc3c3016f64cc893e0733a1eb16546'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:16.304569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.344397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:16.353681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-babf8bc3-5192-4855-9715-7f7e8948782c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 200 len: 205 time: 0.4356794 Nov 24 13:58:16.360160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Usage tracker for resource:network and tenant:2efc3c3016f64cc893e0733a1eb16546 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:16.362393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3bb052da-aef1-4641-909d-dab80acc950b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:16.362627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.364772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39624) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.365485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Pushing event updated for resources: {'Network': ['ID=08fc8008-015c-4784-87f0-a48c86370eea,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:16.410757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 08fc8008-015c-4784-87f0-a48c86370eea details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:16.426303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Quota usage for network was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:16.430520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.569s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:16.489704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 2; headroom:0 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:16.507170 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-52c244ee-1961-41c1-8f6e-0f544d324ecc tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] delete failed (client error): The resource could not be found. Nov 24 13:58:16.510557 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-52c244ee-1961-41c1-8f6e-0f544d324ecc tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/9cf4a4cd-a4a2-483e-8cbd-2bd47b918398 HTTP/1.1" status: 404 len: 336 time: 0.1402407 Nov 24 13:58:16.511829 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Nov 24 13:58:16.511829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:58:16.512591 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7b2765ca-aa01-43e3-84ef-eed185e5fc81 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.3035784 Nov 24 13:58:16.513090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.522042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39630) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.534987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.555468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.571280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8449b563-cd2b-42cd-9d63-154bf41e6508 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:16.575310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:16.609756 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea036ae1-bdcd-4677-9186-6b5089c5f382 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=031a9c63-71c7-45bb-934c-9c79e19032f9 HTTP/1.1" status: 200 len: 205 time: 0.0884068 Nov 24 13:58:16.630624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39636) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.631504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=193c64db-1d87-4cdb-9926-3ecd5347ecbc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:16.635806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:16.647661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.670216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8c839c3b-21dc-400b-8b56-739bd37025c8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:16.826490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:16.842714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.845867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-462d317e-b7f7-459a-8e00-d9234ec3979f None None] Network a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:16.847020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 38ab8b22-40e8-4724-8eff-53563e13338c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:16.849756 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-7c892fac-caad-4558-8ee3-d7d381ceacbc tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] delete failed (client error): The resource could not be found. Nov 24 13:58:16.850794 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7c892fac-caad-4558-8ee3-d7d381ceacbc tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/031a9c63-71c7-45bb-934c-9c79e19032f9 HTTP/1.1" status: 404 len: 336 time: 0.2171147 Nov 24 13:58:16.854798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting subnet 5507a308-2501-42bd-b79e-402405e9bbae {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:16.857043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39640) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.858079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.862072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.867730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a9bcc0-b0c7-4a95-9682-1b50de14ca66 req-4a78801b-2b59-435b-8eac-a2302c7245e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:16.870377 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-06a9bcc0-b0c7-4a95-9682-1b50de14ca66 req-4a78801b-2b59-435b-8eac-a2302c7245e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5312333 Nov 24 13:58:16.872647 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d41eef68-a758-4ddd-9e92-33ce7d472b13 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=2efc3c3016f64cc893e0733a1eb16546&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3410089 Nov 24 13:58:16.878321 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/8c839c3b-21dc-400b-8b56-739bd37025c8 HTTP/1.1" status: 204 len: 168 time: 0.9429338 Nov 24 13:58:16.879133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39644) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.879375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39646) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.916886 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/193c64db-1d87-4cdb-9926-3ecd5347ecbc HTTP/1.1" status: 204 len: 168 time: 1.4912357 Nov 24 13:58:16.917861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39652) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:16.966904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:16.972532 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fee1f321-6ee6-4338-ba08-00a1752b17c5 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=2ba39187-b033-4f89-93e0-512ee750efc3 HTTP/1.1" status: 200 len: 205 time: 0.1134536 Nov 24 13:58:16.987844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39656) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.006452 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-69eba702-3d08-4494-ae3e-d1ca746bbc8a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:58:17.006966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-69eba702-3d08-4494-ae3e-d1ca746bbc8a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:17.041010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-69eba702-3d08-4494-ae3e-d1ca746bbc8a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:17.047611 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-69eba702-3d08-4494-ae3e-d1ca746bbc8a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/193c64db-1d87-4cdb-9926-3ecd5347ecbc HTTP/1.1" status: 404 len: 333 time: 0.1239207 Nov 24 13:58:17.049395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39660) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.056390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'name': 'tempest-PortsIpV6TestJSON-1588109260'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:17.169057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-6a275bb5-54a7-4001-871b-ad8d64e82b72 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] delete failed (client error): The resource could not be found. Nov 24 13:58:17.173307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6a275bb5-54a7-4001-871b-ad8d64e82b72 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/2ba39187-b033-4f89-93e0-512ee750efc3 HTTP/1.1" status: 404 len: 336 time: 0.1812174 Nov 24 13:58:17.173566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39664) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.196312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.200285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.206624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:17.214083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] DHCP port deletion for a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:17.219747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Deleting port 399145cf-58a5-43fb-99bf-ae9950ebfae1 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:17.220337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.230263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.238238 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-06a9bcc0-b0c7-4a95-9682-1b50de14ca66 req-89865867-e8bf-4e5b-9b32-f4ed65bd02a4 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3244307 Nov 24 13:58:17.272869 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-49cb115c-7b51-4e4e-8490-f873f5a3104c tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=5bae7694-ab65-494f-96f4-2908f8495bc3 HTTP/1.1" status: 200 len: 205 time: 0.0981960 Nov 24 13:58:17.276791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:17.278873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39668) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.328491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.330440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=38ab8b22-40e8-4724-8eff-53563e13338c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:17.334446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:17.368057 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-3ba2e9dd-626b-4c93-98b0-78f229404655 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] delete failed (client error): The resource could not be found. Nov 24 13:58:17.369083 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3ba2e9dd-626b-4c93-98b0-78f229404655 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/5bae7694-ab65-494f-96f4-2908f8495bc3 HTTP/1.1" status: 404 len: 336 time: 0.0894494 Nov 24 13:58:17.372633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Deleting port 399145cf-58a5-43fb-99bf-ae9950ebfae1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:17.372971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.380729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39672) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.383002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:17.400823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 27d84f11-5c9d-4555-8c98-67f172766d45 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:17.413477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:17.416413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.431938 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0cda0949-ab37-44e2-9ed5-2505e90e13af tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 HTTP/1.1" status: 200 len: 205 time: 0.0465064 Nov 24 13:58:17.432098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:17.432182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39676) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.509573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] For port 399145cf-58a5-43fb-99bf-ae9950ebfae1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=399145cf-58a5-43fb-99bf-ae9950ebfae1,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:17.510145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.516880 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-cb1174dc-22f1-4651-a2d0-52dbfdfbbe08 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] delete failed (client error): The resource could not be found. Nov 24 13:58:17.522642 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cb1174dc-22f1-4651-a2d0-52dbfdfbbe08 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/2bd40513-c9a2-44fb-aaa1-74ad4ce9ea60 HTTP/1.1" status: 404 len: 336 time: 0.0818884 Nov 24 13:58:17.522642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39680) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.557908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:17.560929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.565052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.591077 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e55da968-1fb7-44eb-8ec6-96758ce53428 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "GET /v2.0/ports?device_id=f7339c0d-a0c2-4777-a40a-51e11ecc846d HTTP/1.1" status: 200 len: 205 time: 0.0655415 Nov 24 13:58:17.591284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39684) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.591369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.593719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.596421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:17.639030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Subnet': ['ID=5507a308-2501-42bd-b79e-402405e9bbae,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:17.655088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:17.658046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Calling delete_port for 399145cf-58a5-43fb-99bf-ae9950ebfae1 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:17.658437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port e030f73a-8fc0-4a08-975e-9c5108f8a46c yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:17.710149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.724013 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-ba509929-5d8c-4778-b757-bd855dec4c54 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] delete failed (client error): The resource could not be found. Nov 24 13:58:17.727733 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ba509929-5d8c-4778-b757-bd855dec4c54 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/routers/f7339c0d-a0c2-4777-a40a-51e11ecc846d HTTP/1.1" status: 404 len: 336 time: 0.1262999 Nov 24 13:58:17.734813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3410ba6-7736-42e2-a03c-23d556332beb None None] Network 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:17.738986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39688) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.804305 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/subnets/5507a308-2501-42bd-b79e-402405e9bbae HTTP/1.1" status: 204 len: 168 time: 2.1002197 Nov 24 13:58:17.808189 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-d8679d77-c040-453b-90e9-1e590c7fda67 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] DELETE failed (client error): The resource could not be found. Nov 24 13:58:17.808625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d8679d77-c040-453b-90e9-1e590c7fda67 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:58:17.810193 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d8679d77-c040-453b-90e9-1e590c7fda67 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] 10.222.0.70 "DELETE /v2.0/subnets/9a7f7f35-21b4-47ba-8801-49f36b8871de HTTP/1.1" status: 404 len: 337 time: 0.0691791 Nov 24 13:58:17.812605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39692) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.823455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.830368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b895b84f-d032-4c48-a127-801f914a42b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:17.897799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=306090a0-7876-4847-a455-7fda48ae16c7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:17.911740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:17.918482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:17.919598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "DELETE /v2.0/security-groups/306090a0-7876-4847-a455-7fda48ae16c7 HTTP/1.1" status: 204 len: 168 time: 1.0088878 Nov 24 13:58:17.923592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39698) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:17.926812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] For port 399145cf-58a5-43fb-99bf-ae9950ebfae1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=399145cf-58a5-43fb-99bf-ae9950ebfae1,segment=NetworkSegment(5c305207-8a12-478f-bc44-f5b3813baa70),segment_id=5c305207-8a12-478f-bc44-f5b3813baa70)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:17.927170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.016567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.027122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-18b1448c-8c0f-47e4-9087-b3eab6d354cd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:18.089538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] No DVR routers for this DVR port 399145cf-58a5-43fb-99bf-ae9950ebfae1 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:18.122453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-99c9faef-c215-4cc2-9958-c03032d6ce0d None None] Provisioning for port 38ab8b22-40e8-4724-8eff-53563e13338c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:18.128061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Pushing event deleted for resources: {'Port': ['ID=399145cf-58a5-43fb-99bf-ae9950ebfae1,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:18.133582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:18.134386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 399145cf-58a5-43fb-99bf-ae9950ebfae1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:18.141431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.157432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Calling delete_port for 399145cf-58a5-43fb-99bf-ae9950ebfae1 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:18.167158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-99c9faef-c215-4cc2-9958-c03032d6ce0d None None] Provisioning complete for port 38ab8b22-40e8-4724-8eff-53563e13338c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:18.167503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-99c9faef-c215-4cc2-9958-c03032d6ce0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.175362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.224334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 577f3f16-7376-4c81-be46-1d02eeee5ca1 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:18.224731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.226023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-99c9faef-c215-4cc2-9958-c03032d6ce0d None None] Port 38ab8b22-40e8-4724-8eff-53563e13338c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:18.227680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 399145cf-58a5-43fb-99bf-ae9950ebfae1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:18.228061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 399145cf-58a5-43fb-99bf-ae9950ebfae1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:18.274478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.345292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.383472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39706) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:18.396754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.428582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] DHCP port deletion for 531f7b50-2bae-4d72-a59f-d96c83fb1bb1 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:18.432747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Deleting port 577f3f16-7376-4c81-be46-1d02eeee5ca1 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:18.433130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.450450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-693e3ffe-6fdf-4366-bb4c-fd31ba79d613 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:18.538769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:18.539114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:18.697162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] For port 577f3f16-7376-4c81-be46-1d02eeee5ca1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=577f3f16-7376-4c81-be46-1d02eeee5ca1,segment=NetworkSegment(de884b0e-11a9-4a97-b549-eda337fde3a6),segment_id=de884b0e-11a9-4a97-b549-eda337fde3a6)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:18.697730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.712230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] For port 577f3f16-7376-4c81-be46-1d02eeee5ca1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=577f3f16-7376-4c81-be46-1d02eeee5ca1,segment=NetworkSegment(de884b0e-11a9-4a97-b549-eda337fde3a6),segment_id=de884b0e-11a9-4a97-b549-eda337fde3a6)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:18.712599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.728924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=e030f73a-8fc0-4a08-975e-9c5108f8a46c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:18.737172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:18.740440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:18.761241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.788921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:18.821861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Calling delete_port for 577f3f16-7376-4c81-be46-1d02eeee5ca1 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:18.850525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:18.854620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:18.855066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.865396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 577f3f16-7376-4c81-be46-1d02eeee5ca1 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:18.882394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.901509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:18.919842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:18.933883 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 1.8833952 Nov 24 13:58:18.941822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39712) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:18.961191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:18.967792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] No DVR routers for this DVR port 577f3f16-7376-4c81-be46-1d02eeee5ca1 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:18.977379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Pushing event deleted for resources: {'Port': ['ID=577f3f16-7376-4c81-be46-1d02eeee5ca1,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:18.980055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['08fc8008-015c-4784-87f0-a48c86370eea']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:18.983138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:18.997868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:19.006769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c61d7665-9188-437c-a180-1dcca370161f') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.006769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c61d7665-9188-437c-a180-1dcca370161f') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.020175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d9eff3-3f08-4d79-9c40-f37be338f596 req-29b4aca1-1cc8-4ac5-9198-784cf6298988 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:19.022365 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-63d9eff3-3f08-4d79-9c40-f37be338f596 req-29b4aca1-1cc8-4ac5-9198-784cf6298988 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5207212 Nov 24 13:58:19.022524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Usage tracker for resource:security_group_rule and tenant:ada69c0c144d4c8b93abf1e872ff5240 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:19.031347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:19.038712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:19.038904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.039055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:19.048982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Deleting port 399145cf-58a5-43fb-99bf-ae9950ebfae1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:19.049311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.082883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:19.138456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.149550 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-63d9eff3-3f08-4d79-9c40-f37be338f596 req-543b394e-ed66-4421-946f-14de750588fa tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1118016 Nov 24 13:58:19.149861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.158054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] The port '399145cf-58a5-43fb-99bf-ae9950ebfae1' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:19.199435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Releasing vlan 898 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:19.199863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:19.217953 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:19.366590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.371314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.376355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd141e2b-8618-4a27-a292-f18821f15efc tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:19.430016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] In _notify_port_updated(), no bound segment for port e030f73a-8fc0-4a08-975e-9c5108f8a46c on network d1d0487a-60e7-49df-8f6a-8133f5eb276b {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:58:19.430599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] It took 0.19 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:58:19.434102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:19.434732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.436073 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/ports/e030f73a-8fc0-4a08-975e-9c5108f8a46c HTTP/1.1" status: 200 len: 818 time: 0.4922965 Nov 24 13:58:19.440432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.440608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39718) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:19.458017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.465397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e678cd2-cbd6-414a-9090-f6c5fe6389e5 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:19.487212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.491318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=e030f73a-8fc0-4a08-975e-9c5108f8a46c,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:19.495640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:19.497444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.519383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Pushing event deleted for resources: {'Network': ['ID=08fc8008-015c-4784-87f0-a48c86370eea,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:19.519678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port e030f73a-8fc0-4a08-975e-9c5108f8a46c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:19.520177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.529103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.552524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 577f3f16-7376-4c81-be46-1d02eeee5ca1 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:19.552860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.557643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:19.567802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-75d90e9a-8683-43f2-a79a-bbea4b1a0a34 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:19.610734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a9f12bbb-ee13-42dd-8eed-cf94fa9dada5']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.628962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] The port '577f3f16-7376-4c81-be46-1d02eeee5ca1' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:19.664116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c305207-8a12-478f-bc44-f5b3813baa70') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.664406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c305207-8a12-478f-bc44-f5b3813baa70') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.674393 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "DELETE /v2.0/networks/08fc8008-015c-4784-87f0-a48c86370eea HTTP/1.1" status: 204 len: 168 time: 1.7472959 Nov 24 13:58:19.683223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39722) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:19.705754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.756751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.785644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.792007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=38ab8b22-40e8-4724-8eff-53563e13338c,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:19.814164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.846684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.851568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:19.875701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Releasing vlan 874 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:19.876365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.892318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:19.899173 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:19.913559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['531f7b50-2bae-4d72-a59f-d96c83fb1bb1']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.916093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c036872-7111-4de8-90c0-d1119f4be9b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:19.941498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee069db-5618-419f-96d9-7c35245cd623 req-52ff4508-ef51-4b19-aea9-c91eb474dd65 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:19.943265 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ee069db-5618-419f-96d9-7c35245cd623 req-52ff4508-ef51-4b19-aea9-c91eb474dd65 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6239800 Nov 24 13:58:19.943575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'de884b0e-11a9-4a97-b549-eda337fde3a6') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.943899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'de884b0e-11a9-4a97-b549-eda337fde3a6') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:19.968622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:19.975714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.099087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 577f3f16-7376-4c81-be46-1d02eeee5ca1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:20.101222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.102743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.111463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for e030f73a-8fc0-4a08-975e-9c5108f8a46c owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:20.136439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 577f3f16-7376-4c81-be46-1d02eeee5ca1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:20.136804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 577f3f16-7376-4c81-be46-1d02eeee5ca1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:20.157852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Releasing vlan 864 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:20.158268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.173130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66c287e3-f1c1-4b8b-81f9-2b4c1108b2c6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:20.173896 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:20.179687 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ada69c0c144d4c8b93abf1e872ff5240&name=default HTTP/1.1" status: 200 len: 2647 time: 1.7927618 Nov 24 13:58:20.180581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39726) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:20.185070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:20.207977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.222047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:20.237214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.292603 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ee069db-5618-419f-96d9-7c35245cd623 req-d58e572b-bf56-43db-bc1b-d426acc9ff21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3339651 Nov 24 13:58:20.293410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Pushing event deleted for resources: {'Network': ['ID=a9f12bbb-ee13-42dd-8eed-cf94fa9dada5,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:20.316724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:20.346652 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] 10.222.0.70 "DELETE /v2.0/networks/a9f12bbb-ee13-42dd-8eed-cf94fa9dada5 HTTP/1.1" status: 204 len: 168 time: 3.4342535 Nov 24 13:58:20.427847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.434366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7378cd23-ad38-4c50-b0ac-3babfd786206 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:20.454004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.468140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Network': ['ID=531f7b50-2bae-4d72-a59f-d96c83fb1bb1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:20.473200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:20.486143 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/networks/531f7b50-2bae-4d72-a59f-d96c83fb1bb1 HTTP/1.1" status: 204 len: 168 time: 2.6719527 Nov 24 13:58:20.489435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39734) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:20.534991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.552432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 27d84f11-5c9d-4555-8c98-67f172766d45 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:20.554941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:20.557839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.611916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39738) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:20.612930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5a3be017-e202-42c3-8fe0-51b23f784b57 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:20.640992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.702208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=e030f73a-8fc0-4a08-975e-9c5108f8a46c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:20.714426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['acb7b564-72e3-46e0-ae6a-18feaab83ec9']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:20.716712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:20.741410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db08b6be-953a-43ff-844c-f6a32ad0ace0') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:20.741697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db08b6be-953a-43ff-844c-f6a32ad0ace0') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:20.758793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.775257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63086370-7015-4eed-813c-5c1faddd88ae None None] Provisioning complete for port 38ab8b22-40e8-4724-8eff-53563e13338c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:20.775990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-63086370-7015-4eed-813c-5c1faddd88ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.787523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.814632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.829939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.832763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-63086370-7015-4eed-813c-5c1faddd88ae None None] Port 38ab8b22-40e8-4724-8eff-53563e13338c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:20.851393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:20.851812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.861267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port ab88d479-f164-4174-a532-fa95533fee8e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:20.861611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:20.865717 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:20.919971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/e030f73a-8fc0-4a08-975e-9c5108f8a46c HTTP/1.1" status: 204 len: 168 time: 1.4787924 Nov 24 13:58:20.927201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39742) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:20.942971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2278dff0-e9b4-4906-af4d-aaf2bf0c3da8 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=8253655cf6fe49d7881f39cdb1344ce7&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2995896 Nov 24 13:58:20.946645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39746) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:20.976496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c45f4a-1682-4962-b4fa-996a73e8a5a4 req-bb215940-a7d3-4499-931c-524c6e7b237d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:20.977945 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b0c45f4a-1682-4962-b4fa-996a73e8a5a4 req-bb215940-a7d3-4499-931c-524c6e7b237d tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.4901490 Nov 24 13:58:21.065441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.070526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b4a5f6d-15e8-4fdd-8ef2-745a0f196336 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:21.088889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.094943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.100046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Pushing event deleted for resources: {'Network': ['ID=acb7b564-72e3-46e0-ae6a-18feaab83ec9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:21.102365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:21.105414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f9aac905-7a79-44eb-a681-d9f68ad885a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:21.119614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] 10.222.0.70 "DELETE /v2.0/networks/acb7b564-72e3-46e0-ae6a-18feaab83ec9 HTTP/1.1" status: 204 len: 168 time: 1.4240537 Nov 24 13:58:21.133363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66c287e3-f1c1-4b8b-81f9-2b4c1108b2c6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:21.146288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b30778d-9190-45ed-a448-9c644e263604 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:21.150305 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4b30778d-9190-45ed-a448-9c644e263604 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.2199697 Nov 24 13:58:21.151072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:21.152577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39752) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:21.198519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8bae44ed-5a02-4b5c-8a01-82551153f917 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:58:21.211380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.215295 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/66c287e3-f1c1-4b8b-81f9-2b4c1108b2c6 HTTP/1.1" status: 204 len: 168 time: 1.0310462 Nov 24 13:58:21.231906 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b0c45f4a-1682-4962-b4fa-996a73e8a5a4 req-0bfd0e9b-7e20-4961-bf07-3c77b5f66993 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2367566 Nov 24 13:58:21.253850 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee71730d-bd68-4e2b-9008-fcd8f32b9e98 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:58:21.254354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ee71730d-bd68-4e2b-9008-fcd8f32b9e98 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:21.262320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.262636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.272566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.474393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for ab88d479-f164-4174-a532-fa95533fee8e owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:21.515843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ee71730d-bd68-4e2b-9008-fcd8f32b9e98 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:21.517406 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ee71730d-bd68-4e2b-9008-fcd8f32b9e98 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/e030f73a-8fc0-4a08-975e-9c5108f8a46c HTTP/1.1" status: 404 len: 333 time: 0.3584459 Nov 24 13:58:21.522129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39762) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:21.530288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1381044261'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:21.538393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.543719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:21.551580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:21.556149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:21.567004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:21.605818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:21.608828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.626517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771d18d2-1a57-4027-a6bd-f9b53bd79b94 req-157a1c1a-7588-4af1-946e-4dc607720015 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:21.633679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771d18d2-1a57-4027-a6bd-f9b53bd79b94 req-157a1c1a-7588-4af1-946e-4dc607720015 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.1801205 Nov 24 13:58:21.665230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.673697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b6e62e28-449c-416c-b2d4-077154082d97 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:21.691102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ccb9a54-bae1-4661-b828-f31edeae24e1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:21.691898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:21.704727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:21.708092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:21.716975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.717304 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 19acd6f2-169e-472a-8a95-24f619a7ece1 of type vlan for network 377ebc54-544a-4717-aa6f-490ff800affe Nov 24 13:58:21.728807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] Sync routers for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:21.734475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.739216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b1cf9f23-572f-466b-ade9-5a7b2bcebd5c tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:21.740039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771d18d2-1a57-4027-a6bd-f9b53bd79b94 req-c8d3a0f4-5b43-4d95-8d56-0bfa9f10ce57 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1012385 Nov 24 13:58:21.748180 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8bae44ed-5a02-4b5c-8a01-82551153f917/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.6525939 Nov 24 13:58:21.752449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39768) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:21.778681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.782753 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/7ccb9a54-bae1-4661-b828-f31edeae24e1 HTTP/1.1" status: 204 len: 168 time: 0.8248007 Nov 24 13:58:21.792229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:21.793038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:21.800613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=ab88d479-f164-4174-a532-fa95533fee8e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:21.805055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:21.830074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.900932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39776) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:21.902032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1d24f93-b482-4f43-b457-b0674674b5e2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:21.903315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b1d24f93-b482-4f43-b457-b0674674b5e2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:21.935373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.939181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.944310 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/floatingips/dbbc78a5-3acf-4f33-831b-9ff323a433ef HTTP/1.1" status: 204 len: 168 time: 1.4508162 Nov 24 13:58:21.946509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39782) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:21.953262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:21.954226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.959918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:21.960606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:21.970222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:21.977502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:21.980285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:22.024069 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-484369bc-4b40-4139-91a2-20dcec76362f admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=bdc37f91168b4b15811cdc290c7d3b64&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1217551 Nov 24 13:58:22.031103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39786) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.046611 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ec653747-94b7-418f-b09f-ac27c4a2f486 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] DELETE failed (client error): The resource could not be found. Nov 24 13:58:22.047175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ec653747-94b7-418f-b09f-ac27c4a2f486 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:58:22.052278 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec653747-94b7-418f-b09f-ac27c4a2f486 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/ports/0cda8a69-471e-438e-add9-8a38673645bb HTTP/1.1" status: 404 len: 333 time: 0.1047299 Nov 24 13:58:22.052931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39790) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.056952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:22.057618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-614770c4-db49-43e1-a399-2c9282f5a93c None None] The sync data for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:22.110831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ed37edb2-293c-4df9-8520-07405c5d1024 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Synchronizing usage tracker for tenant:7eb7035f979a46b388c48c890d0ee3b4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:22.122624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39794) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.123520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b1d24f93-b482-4f43-b457-b0674674b5e2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:22.125530 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b1d24f93-b482-4f43-b457-b0674674b5e2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports/38ab8b22-40e8-4724-8eff-53563e13338c HTTP/1.1" status: 200 len: 910 time: 0.3721602 Nov 24 13:58:22.137697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39798) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.181792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=377ebc54-544a-4717-aa6f-490ff800affe,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:22.190227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:22.195868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 377ebc54-544a-4717-aa6f-490ff800affe details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:22.206234 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.6787810 Nov 24 13:58:22.206742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39804) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.214495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': '377ebc54-544a-4717-aa6f-490ff800affe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:22.240387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:22.259387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-7cffb804-aaac-45ce-ab6f-6ffa3d5c1a27 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1327033 Nov 24 13:58:22.431952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ed37edb2-293c-4df9-8520-07405c5d1024 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Unset dirty status for tenant:7eb7035f979a46b388c48c890d0ee3b4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:22.436006 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ed37edb2-293c-4df9-8520-07405c5d1024 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/ports?device_id=da5d85fa-d3d7-4ca9-ba88-50f459944054 HTTP/1.1" status: 200 len: 205 time: 0.3793311 Nov 24 13:58:22.445065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39808) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.526464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:22.554074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:22.556003 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-35cc3653-2bb9-42cc-86cd-117b1bd0e70b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] delete failed (client error): The resource could not be found. Nov 24 13:58:22.559542 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-35cc3653-2bb9-42cc-86cd-117b1bd0e70b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/routers/da5d85fa-d3d7-4ca9-ba88-50f459944054 HTTP/1.1" status: 404 len: 336 time: 0.1018271 Nov 24 13:58:22.560410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:22.564474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39816) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.565924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:22.573715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:22.616370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:22.620277 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b0f1fee3-39fa-4d26-9e14-5b8aa198184a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] DELETE failed (client error): The resource could not be found. Nov 24 13:58:22.620564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b0f1fee3-39fa-4d26-9e14-5b8aa198184a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:58:22.625993 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b0f1fee3-39fa-4d26-9e14-5b8aa198184a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/subnets/5507a308-2501-42bd-b79e-402405e9bbae HTTP/1.1" status: 404 len: 337 time: 0.0575147 Nov 24 13:58:22.626387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39822) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:22.627783 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-b9922e70-fd6f-4c88-9d20-d679f437ad8f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.3010590 Nov 24 13:58:22.637870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:22.667115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:22.689860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Usage tracker for resource:security_group_rule and tenant:9752be6a48c84a83859941b46d150d7e is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:22.695227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:22.707549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:22.738025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:22.738380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:22.785427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:22.794468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db4a14e7-45a2-4f21-85a1-94cda7a83f64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:22.822935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da0f0e44-9b33-42cf-b31b-7b5fefdf1d40,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:22.835985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:22.862035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:22.863453 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/da0f0e44-9b33-42cf-b31b-7b5fefdf1d40 HTTP/1.1" status: 204 len: 168 time: 0.8313222 Nov 24 13:58:22.876803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-45278dcf-a2ee-481a-a14c-ff6c831511d5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:22.879001 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-45278dcf-a2ee-481a-a14c-ff6c831511d5 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.2221775 Nov 24 13:58:22.883213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.093032 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-b4d50f71-788c-4796-8eba-ea25c98bb88c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.1932304 Nov 24 13:58:23.112426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.172761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.183214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e49f16f1-104a-4797-a427-8ffdae797264 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:23.206339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-1d6d497f-9276-4b60-9717-e44849c4cc6c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:23.207940 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-1d6d497f-9276-4b60-9717-e44849c4cc6c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.1086636 Nov 24 13:58:23.259371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d34ca5e3-ef67-453e-ae75-7c4b6288a8c8,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:23.267649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:23.294344 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=9752be6a48c84a83859941b46d150d7e&name=default HTTP/1.1" status: 200 len: 2647 time: 1.1688955 Nov 24 13:58:23.298680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39842) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:23.313488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.368850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.375628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13ee104f-8ce8-4e61-9be8-33c910e0ceac tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:23.452363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:23.501721 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-d44c2b24-fb99-44a9-875d-ebf9f44e9665 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2771394 Nov 24 13:58:23.509375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.535826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.549690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=83e94be3-5294-4789-b6e2-18af20c8f444,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:23.578783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:23.614028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '19acd6f2-169e-472a-8a95-24f619a7ece1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '377ebc54-544a-4717-aa6f-490ff800affe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:23.614028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: 377ebc54-544a-4717-aa6f-490ff800affe, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:23.729129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 377ebc54-544a-4717-aa6f-490ff800affe is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:23.739590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.745301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9295a7e6-6329-40eb-81d1-c5e3ec7851b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:23.756354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-4ad42246-8c8d-4f45-93ae-d78dd69bdd16 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2106972 Nov 24 13:58:23.758619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 377ebc54-544a-4717-aa6f-490ff800affe) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:23.763519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d34ca5e3-ef67-453e-ae75-7c4b6288a8c8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:23.770442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:23.771021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.771184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a11624d6-01d3-44d5-9d3d-9cae7be7a887 None None] Network 377ebc54-544a-4717-aa6f-490ff800affe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:23.792625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:23.850984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.872199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dc72b6b2-1d0a-4095-9601-09bfbc15a65e tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:23.874983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:23.876124 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d34ca5e3-ef67-453e-ae75-7c4b6288a8c8 HTTP/1.1" status: 204 len: 168 time: 0.5539408 Nov 24 13:58:23.895937 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.6881285 Nov 24 13:58:23.898731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39864) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:23.908667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': '377ebc54-544a-4717-aa6f-490ff800affe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:24.021326 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4b7c66c-affa-41b5-97e9-abafeb2950c0 req-5a6f55cd-5a92-4d9f-a268-6089ffe92829 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2554398 Nov 24 13:58:24.069568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:24.074423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:24.097318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:24.101508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:24.105391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:24.111104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-377ebc54-544a-4717-aa6f-490ff800affe', 'network_id': '377ebc54-544a-4717-aa6f-490ff800affe', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': '83e94be3-5294-4789-b6e2-18af20c8f444'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:24.111983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.112474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:24.126379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:24.131678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.303437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Allocated IP 2001:db8::2 (377ebc54-544a-4717-aa6f-490ff800affe/83e94be3-5294-4789-b6e2-18af20c8f444/063f0c0a-4b83-4ba1-9e0a-fcc5c040425a) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:24.347234 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.ipam_backend_mixin [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 83e94be3-5294-4789-b6e2-18af20c8f444 (CIDR: 2001:db8::/64) Nov 24 13:58:24.361054 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:58:24.361575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:58:24.395268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3be0b12-4db9-4eec-80de-0a81d961c4c2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4951122 Nov 24 13:58:24.397730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39876) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:24.403946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': '377ebc54-544a-4717-aa6f-490ff800affe', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:24.517442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.627355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.650218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Transition to ACTIVE for port object 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:24.672853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39884) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:24.688764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.695160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Transition to ACTIVE for port object 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:24.709722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.718293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-351482bd-c6b7-4cfc-9536-19d05e996e26 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:24.727161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.732151 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/ports/547984d7-d2d9-46d8-a6f3-f3e1e5e00a9f HTTP/1.1" status: 204 len: 168 time: 2.1041243 Nov 24 13:58:24.736005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39890) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:24.764879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:24.769426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Usage tracker for resource:security_group_rule and tenant:e90d88cd940e48e8a64b1a77aaf08146 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:24.772303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:24.779648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:24.788444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Network 377ebc54-544a-4717-aa6f-490ff800affe is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:24.792328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:24.802565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:24.838045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:24.853369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:24.858898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:24.876630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:24.879599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 772a041b-4565-45ec-abf8-aafe0c72e29e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:24.880543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.900086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.908699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.919669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4d905a9a-d702-4315-905e-a7023de5f268 tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:24.935294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:24.940140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:24.977037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Pushing event updated for resources: {'Port': ['ID=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:24.983370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:24.988709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Attempting to bind port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:24.989355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Attempting to bind port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '19acd6f2-169e-472a-8a95-24f619a7ece1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '377ebc54-544a-4717-aa6f-490ff800affe'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:24.990124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Attempting to bind port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a on network 377ebc54-544a-4717-aa6f-490ff800affe {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:24.997301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:24.998147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Checking segment: {'id': '19acd6f2-169e-472a-8a95-24f619a7ece1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '377ebc54-544a-4717-aa6f-490ff800affe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:24.999488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.000415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Bound using segment: {'id': '19acd6f2-169e-472a-8a95-24f619a7ece1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '377ebc54-544a-4717-aa6f-490ff800affe'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:25.001397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Bound port: 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '19acd6f2-169e-472a-8a95-24f619a7ece1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '377ebc54-544a-4717-aa6f-490ff800affe'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:25.002097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.014105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=828bbb4c-7257-4cc7-9e06-f0c775d10167,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:25.094464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:25.102737 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=e90d88cd940e48e8a64b1a77aaf08146&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4288328 Nov 24 13:58:25.106093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39900) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:25.168691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:25.175255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:25.189005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.194412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-31ad12af-e0cb-4ac2-92c7-9806f5ca2cd8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:25.216533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.271010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.21.0.1 (c9fa6814-5f92-43d6-9db9-d60c19b25c66/d84e48cc-8c0a-4880-b899-7d51994d9ca1/5cf96c6d-d464-468b-b52d-9ed4448ba4b7) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:25.283428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.299587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.374798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Pushing event updated for resources: {'Port': ['ID=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:25.379316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:25.464307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 772a041b-4565-45ec-abf8-aafe0c72e29e owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:25.523425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.528863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-775873ce-752a-4081-bf38-3d83358c5db5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:25.550346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=828bbb4c-7257-4cc7-9e06-f0c775d10167,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:25.556699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:25.579881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.583489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/828bbb4c-7257-4cc7-9e06-f0c775d10167 HTTP/1.1" status: 204 len: 168 time: 0.4735191 Nov 24 13:58:25.666224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.677637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7608e260-f0ae-448d-9929-926f0b3a2e40 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:25.762383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.803870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:25.828823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.833246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 377ebc54-544a-4717-aa6f-490ff800affe is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:25.836016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dad8e862-248d-4610-8d18-9fa3d73eaaa6 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:25.838386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:25.842052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:25.843336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:25.863672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=11da58e8-5a02-4ba3-9f9b-df944ea7c144,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:25.866890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:25.881656 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.4765720 Nov 24 13:58:25.881656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39914) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:25.892007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': '377ebc54-544a-4717-aa6f-490ff800affe', 'fixed_ips': [{'subnet_id': '83e94be3-5294-4789-b6e2-18af20c8f444'}, {'subnet_id': '11da58e8-5a02-4ba3-9f9b-df944ea7c144'}], 'name': 'tempest-PortsIpV6TestJSON-223731831'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:25.901680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=772a041b-4565-45ec-abf8-aafe0c72e29e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:25.909236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:26.021180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.025433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.040373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-debb5fa1-03b8-4d00-b83d-92f70139ff29 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:26.081362 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/ports/772a041b-4565-45ec-abf8-aafe0c72e29e HTTP/1.1" status: 204 len: 168 time: 1.3439858 Nov 24 13:58:26.083941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39922) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:26.112875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:26.128636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:26.128636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:26.154197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39926) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:26.162260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=5cf96c6d-d464-468b-b52d-9ed4448ba4b7,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:26.173383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:26.193182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:26.201505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.294824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:26.311871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:26.315504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:26.324768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.352579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:26.404245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69f70fc9-b3a6-4002-ac75-b582e3f1c253 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:26.416471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69f70fc9-b3a6-4002-ac75-b582e3f1c253 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Synchronizing usage tracker for tenant:7eb7035f979a46b388c48c890d0ee3b4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:26.421154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:26.429221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:26.442818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.507482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 27a076c7-09d9-494d-9b81-0e19786c30b3 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:26.648525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69f70fc9-b3a6-4002-ac75-b582e3f1c253 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Unset dirty status for tenant:7eb7035f979a46b388c48c890d0ee3b4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:26.649687 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-69f70fc9-b3a6-4002-ac75-b582e3f1c253 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "GET /v2.0/ports?device_id=dae4f7ce-8421-4823-9021-9def9cbc7bdd HTTP/1.1" status: 200 len: 913 time: 0.5643086 Nov 24 13:58:26.661336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 39942) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:26.672762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-278521100'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:26.719021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bc975d9-227a-4966-8490-4e5fa37616fd None None] Provisioning for port 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:26.728475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bc975d9-227a-4966-8490-4e5fa37616fd None None] Provisioning complete for port 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:26.729083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bc975d9-227a-4966-8490-4e5fa37616fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.767696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39946) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:26.790834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:26.802469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Usage tracker for resource:network and tenant:de2c9dc2e19e46bf9064e80778f94c02 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:26.815796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:26.823708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6bc975d9-227a-4966-8490-4e5fa37616fd None None] Port 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:26.855265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:26.903104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Made reservation on behalf of de2c9dc2e19e46bf9064e80778f94c02 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:26.907478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:26.938496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65a8ee1b-0a80-4c55-8cc1-ee8b6a60364d None None] Network 377ebc54-544a-4717-aa6f-490ff800affe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:27.057900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.104156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::1ee (377ebc54-544a-4717-aa6f-490ff800affe/83e94be3-5294-4789-b6e2-18af20c8f444/27a076c7-09d9-494d-9b81-0e19786c30b3) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:27.111531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8:0:1::207 (377ebc54-544a-4717-aa6f-490ff800affe/11da58e8-5a02-4ba3-9f9b-df944ea7c144/27a076c7-09d9-494d-9b81-0e19786c30b3) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:27.146446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Provisioning for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:27.153431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Provisioning complete for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:27.154067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.190066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:27.196271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Usage tracker for resource:security_group_rule and tenant:de2c9dc2e19e46bf9064e80778f94c02 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:27.205677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:27.221778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:27.287952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-823321022', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:27.300487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:27.308242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Usage tracker for resource:port and tenant:3247d7c2a8c74789830b69f67bc7c863 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:27.318582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:27.328732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:27.365150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Made reservation on behalf of 3247d7c2a8c74789830b69f67bc7c863 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:27.367742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.399346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.418531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.439339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.454981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:27.457452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 27a076c7-09d9-494d-9b81-0e19786c30b3 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:27.460946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Usage tracker for resource:security_group_rule and tenant:3247d7c2a8c74789830b69f67bc7c863 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:27.464685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:27.472107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:27.480976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:27.492986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.502947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:27.518944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.528161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:27.529264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.542677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.588941 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:58:27.594747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Pushing event updated for resources: {'Port': ['ID=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:27.601271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a045c087-ff0e-4f18-8297-bf3bb393659f tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:27.627974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.634609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 377ebc54-544a-4717-aa6f-490ff800affe is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:27.638083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.640862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:27.641108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:27.644349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=27a076c7-09d9-494d-9b81-0e19786c30b3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:27.646682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:27.650682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:27.651278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.656226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] device_id is not set on port a486e6fc-e417-4ea0-9c8d-a48797f7baf7 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:27.696321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:27.697840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-19f3edd1-1bf3-4dbf-a07d-2e426cf32881 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:27.712254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Update dhcp port {'port': {'network_id': '377ebc54-544a-4717-aa6f-490ff800affe', 'fixed_ips': [{'subnet_id': '83e94be3-5294-4789-b6e2-18af20c8f444', 'ip_address': '2001:db8::2'}, {'subnet_id': '11da58e8-5a02-4ba3-9f9b-df944ea7c144'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '063f0c0a-4b83-4ba1-9e0a-fcc5c040425a'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 13:58:27.730433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=5cf96c6d-d464-468b-b52d-9ed4448ba4b7,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:27.742819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:27.776096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=caa4869e-aae1-4770-b515-1c6ce63c7272,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:27.782414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:27.786613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.810742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1016 time: 1.9275932 Nov 24 13:58:27.816558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39966) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:27.825140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '83e94be3-5294-4789-b6e2-18af20c8f444'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:27.825324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.915065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.973587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:27.980665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:28.007560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Allocated IP 172.26.4.243 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/a486e6fc-e417-4ea0-9c8d-a48797f7baf7) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:28.031114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 857} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:28.060598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Allocated IP 2001:db8:0:1::2 (377ebc54-544a-4717-aa6f-490ff800affe/11da58e8-5a02-4ba3-9f9b-df944ea7c144/063f0c0a-4b83-4ba1-9e0a-fcc5c040425a) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:28.115949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d0be39c0-0905-49dd-a6b1-fde85425b6f6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:28.130480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:28.133411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.133411 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Added segment fd51a9f4-208a-4391-a8b7-769eb8243233 of type vlan for network 9f28a011-66c8-49fb-8936-db5753ac9240 Nov 24 13:58:28.210525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:28.225287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:28.231880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:28.238864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.334009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:28.372094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.417227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.435703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:28.435703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.500917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Transition to ACTIVE for port object 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:28.514526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.529567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:28.596094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.690963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a had new provisioning blocks added so it will not transition to active. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:321}} Nov 24 13:58:28.730559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Pushing event updated for resources: {'Port': ['ID=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:28.734206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-10e3f959-3c1a-4fd8-8562-fc0957a41c7d None None] Provisioning complete for port 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:28.734586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-10e3f959-3c1a-4fd8-8562-fc0957a41c7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.772716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:28.790725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.799525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] It took 0.27 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:58:28.802848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:28.817401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-10e3f959-3c1a-4fd8-8562-fc0957a41c7d None None] Port 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:28.910468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.914887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:28.915670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:28.919251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:28.928113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:28.935632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:28.943789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-627fcdc8-65cd-4144-b011-938ce4faa7fc tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:28.970814 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 2.8157663 Nov 24 13:58:28.988032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.004037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Pushing event updated for resources: {'Port': ['ID=a486e6fc-e417-4ea0-9c8d-a48797f7baf7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:29.019586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:29.023594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Delete allocated IP 2001:db8:0:1::207 (377ebc54-544a-4717-aa6f-490ff800affe/11da58e8-5a02-4ba3-9f9b-df944ea7c144) {{(pid=83526) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 13:58:29.043707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:29.044338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.099348 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1036 time: 2.3324971 Nov 24 13:58:29.100070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 39992) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:29.115681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.243'}]}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:29.120063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:29.124633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Usage tracker for resource:router and tenant:3247d7c2a8c74789830b69f67bc7c863 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:29.127985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:29.133910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:29.155162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Pushing event updated for resources: {'Network': ['ID=9f28a011-66c8-49fb-8936-db5753ac9240,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:29.159021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:29.169068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 9f28a011-66c8-49fb-8936-db5753ac9240 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:29.199927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8bae44ed-5a02-4b5c-8a01-82551153f917 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:29.410467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.435521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.437614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.465884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Ignored duplicate provisioning block setup for port 27a076c7-09d9-494d-9b81-0e19786c30b3 by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} Nov 24 13:58:29.469703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40000) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:29.500293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.516246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4819c01a-a3f4-4497-97ff-2fb6e1b86314 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:29.540068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48a6acd3-9e05-4001-97a5-c34fa50c6e9c None None] Network 377ebc54-544a-4717-aa6f-490ff800affe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:29.696688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.700887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:29.709682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40006) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:29.717615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-21124467-d428-4515-970d-73cb936fa4b3 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:29.721014 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] Sync routers for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:29.724392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] In _notify_port_updated(), no bound segment for port 27a076c7-09d9-494d-9b81-0e19786c30b3 on network 377ebc54-544a-4717-aa6f-490ff800affe {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:58:29.728249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:29.728867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.730128 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/ports/27a076c7-09d9-494d-9b81-0e19786c30b3 HTTP/1.1" status: 200 len: 925 time: 1.9127963 Nov 24 13:58:29.738477 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:29.739231 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:29.742275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40008) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:29.753921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '83e94be3-5294-4789-b6e2-18af20c8f444'}, {'subnet_id': '11da58e8-5a02-4ba3-9f9b-df944ea7c144'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:29.757155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d4efcd5b-6018-4c2e-9a02-989105b4504e None None] Provisioning for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:29.770350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d4efcd5b-6018-4c2e-9a02-989105b4504e None None] Provisioning complete for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:29.770727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d4efcd5b-6018-4c2e-9a02-989105b4504e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.781800 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8bae44ed-5a02-4b5c-8a01-82551153f917/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6430266 Nov 24 13:58:29.785922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40014) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:29.787182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Request body: {'port': {'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240', 'binding:host_id': 'hv-neutron-8181', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1280310867'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:29.801432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=27a076c7-09d9-494d-9b81-0e19786c30b3,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:29.819997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:29.822138 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:29.825571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Usage tracker for resource:port and tenant:424bd3bb154e422a92550d080fd26ca9 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:29.829893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:29.839805 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:29.840816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:29.841282 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:29.872392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:29.911655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Made reservation on behalf of 424bd3bb154e422a92550d080fd26ca9 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:29.915025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:29.931497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:29.932077 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-845f65ca-ba60-4cfd-8e27-10164e9f2b8c None None] The sync data for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:29.943372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.058757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:30.067356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Usage tracker for resource:security_group_rule and tenant:424bd3bb154e422a92550d080fd26ca9 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:30.067831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19201242-785a-4fab-84fb-5511bb150af6 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:30.072072 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-19201242-785a-4fab-84fb-5511bb150af6 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports/5cf96c6d-d464-468b-b52d-9ed4448ba4b7 HTTP/1.1" status: 200 len: 910 time: 0.2776198 Nov 24 13:58:30.072203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:30.073484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40018) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:30.077951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:30.137366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:30.202600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.211329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.215361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port 3a65db68-1d85-40c3-9e94-b5812da40906 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:30.222947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:30.223577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.338529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e219bf27-a998-428e-8815-69cd159196bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:30.350605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.378921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.419431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79c7c23b-3264-4b33-99f3-b700fbf86930,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:30.446491 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-21124467-d428-4515-970d-73cb936fa4b3 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "PUT /v2.0/quotas/867ea7fcb1de453cac74da14da7c17da HTTP/1.1" status: 200 len: 366 time: 0.9755337 Nov 24 13:58:30.455062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:30.455568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40022) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:30.521424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fd9b35c7-a63c-4900-aa23-34a752116865 None None] Provisioning complete for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:30.522629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd9b35c7-a63c-4900-aa23-34a752116865 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.548178 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aaabf050-2008-40af-8179-94be2dce78d1 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 732 time: 0.0821097 Nov 24 13:58:30.555376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40026) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:30.598523 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5c2b6e29-6c76-4e40-b44d-154ace1f65c8 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "GET /v2.0/quotas/867ea7fcb1de453cac74da14da7c17da HTTP/1.1" status: 200 len: 366 time: 0.0361445 Nov 24 13:58:30.599693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40030) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:30.714554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port 3a65db68-1d85-40c3-9e94-b5812da40906 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:30.716603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fd9b35c7-a63c-4900-aa23-34a752116865 None None] Provisioning for port 27a076c7-09d9-494d-9b81-0e19786c30b3 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:30.723835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fd9b35c7-a63c-4900-aa23-34a752116865 None None] Provisioning complete for port 27a076c7-09d9-494d-9b81-0e19786c30b3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:30.724682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd9b35c7-a63c-4900-aa23-34a752116865 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.808783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd9b35c7-a63c-4900-aa23-34a752116865 None None] Port 27a076c7-09d9-494d-9b81-0e19786c30b3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:30.852946 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-55b6cb0a-f854-4d97-b3c5-908260d57ede tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "DELETE /v2.0/quotas/867ea7fcb1de453cac74da14da7c17da HTTP/1.1" status: 204 len: 168 time: 0.2522955 Nov 24 13:58:30.857377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40034) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:30.862058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.899973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Transition to ACTIVE for port object 3a65db68-1d85-40c3-9e94-b5812da40906 will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:30.905463 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e4aa72ae-5a0d-4408-bce1-733c65122dcd tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 470 time: 0.0420728 Nov 24 13:58:30.907801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40038) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:30.911008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 4af53af9-692f-41be-b166-26c1d45921f8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:30.911008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.941131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ca0d5004-9c0e-43d3-9e45-f23b676d351b None None] Provisioning complete for port 27a076c7-09d9-494d-9b81-0e19786c30b3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:30.941131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca0d5004-9c0e-43d3-9e45-f23b676d351b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.962222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:30.971236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0e5e7a2-94d5-4bb4-9c69-f1582236e44b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:31.006970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ca0d5004-9c0e-43d3-9e45-f23b676d351b None None] Port 27a076c7-09d9-494d-9b81-0e19786c30b3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:31.017087 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bb0183e0-0256-4942-9b4e-cc551116379c tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "GET /v2.0/quotas/867ea7fcb1de453cac74da14da7c17da HTTP/1.1" status: 200 len: 370 time: 0.1050251 Nov 24 13:58:31.025371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40042) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:31.040079 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bc4e7539-902d-4c74-b68f-7ca091ed7ff6 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "GET /v2.0/quotas/867ea7fcb1de453cac74da14da7c17da/default HTTP/1.1" status: 200 len: 370 time: 0.0123000 Nov 24 13:58:31.048413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40046) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:31.079054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8:0:1::342 (377ebc54-544a-4717-aa6f-490ff800affe/11da58e8-5a02-4ba3-9f9b-df944ea7c144/27a076c7-09d9-494d-9b81-0e19786c30b3) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:31.130437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1cdb456e-5242-473f-9038-1b72bccd4764 None None] Provisioning complete for port 27a076c7-09d9-494d-9b81-0e19786c30b3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:31.130943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1cdb456e-5242-473f-9038-1b72bccd4764 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.145297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=3a65db68-1d85-40c3-9e94-b5812da40906,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:31.158996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:31.173051 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-bfe58acf-f886-49ea-ae4a-f278f953992a tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] delete failed (client error): The resource could not be found. Nov 24 13:58:31.174067 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bfe58acf-f886-49ea-ae4a-f278f953992a tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "DELETE /v2.0/quotas/867ea7fcb1de453cac74da14da7c17da HTTP/1.1" status: 404 len: 348 time: 0.1247349 Nov 24 13:58:31.208095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1cdb456e-5242-473f-9038-1b72bccd4764 None None] Port 27a076c7-09d9-494d-9b81-0e19786c30b3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:31.214786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Checking segment: {'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:31.215144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Network hostable DHCP agents. Network: 9f28a011-66c8-49fb-8936-db5753ac9240, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:31.224411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.224779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.355779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40052) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:31.364828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 4af53af9-692f-41be-b166-26c1d45921f8 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:31.441043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Network 9f28a011-66c8-49fb-8936-db5753ac9240 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:31.443033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:network and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:31.453049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:31.465950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 9f28a011-66c8-49fb-8936-db5753ac9240) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:31.466388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.477328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-580ab440-2b68-4b18-b63b-75094bb4aa9b None None] Network 9f28a011-66c8-49fb-8936-db5753ac9240 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:31.480493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:31.491813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:subnet and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:31.502177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:31.508180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.512214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:31.512548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:31.512878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:31.526067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:subnetpool and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:31.531564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:31.531923 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:31.534043 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 2 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:31.543608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:31.559410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:31.559869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:31.560197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:31.570749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:port and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:31.575074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:31.575398 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:31.576253 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 3 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:31.585128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.588308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:31.631357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:31.631748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:31.632044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:31.646012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:router and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:31.660062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:31.660323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Ignored duplicate provisioning block setup for port 27a076c7-09d9-494d-9b81-0e19786c30b3 by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} Nov 24 13:58:31.663615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:31.663781 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:31.667317 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 4 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:31.673236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.689659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2fd00274-d753-48a8-8fcf-19cb055e3e01 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:31.691362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:31.691636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:31.691990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:31.696993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:floatingip and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:31.699359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:31.705542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cff3794-43b4-47a7-87c5-87339775867d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:31.742188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:31.752764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:31.753080 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:31.755820 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 5 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:31.762482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=4af53af9-692f-41be-b166-26c1d45921f8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:31.767722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:31.780833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:31.781164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:31.781497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:31.853771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:31.854104 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:31.858897 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 6 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:31.894840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:31.895197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:31.895500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:31.914233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:31.914560 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:31.916965 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 7 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:32.006488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:32.007137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:32.007137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:32.021592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=27a076c7-09d9-494d-9b81-0e19786c30b3,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:32.022277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:32.022604 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:32.024056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:security_group and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:32.028106 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 8 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:32.041949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:32.050442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:32.050811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:32.051099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:32.051674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.363s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:32.072856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Usage tracker for resource:security_group_rule and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:32.077899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:32.078220 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:32.079175 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 9 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:32.090468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:32.116454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] In _notify_port_updated(), no bound segment for port 27a076c7-09d9-494d-9b81-0e19786c30b3 on network 377ebc54-544a-4717-aa6f-490ff800affe {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:58:32.120308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:32.120930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.122221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/ports/27a076c7-09d9-494d-9b81-0e19786c30b3 HTTP/1.1" status: 200 len: 1011 time: 2.3790009 Nov 24 13:58:32.126144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40056) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:32.158317 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0cb0fda2-fe5c-4372-8138-438d9705d227 tempest-QuotasTest-1502889019 tempest-QuotasTest-1502889019-project-admin] 10.222.0.70 "GET /v2.0/quotas/bd63a44673144a52af880f26ebb83470/details.json HTTP/1.1" status: 200 len: 703 time: 0.8011782 Nov 24 13:58:32.159103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:32.159413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:32.159743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:32.173553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:32.173893 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:32.175863 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 10 to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 Nov 24 13:58:32.197223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:32.197517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:32.197791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:32.214507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.216365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 3a65db68-1d85-40c3-9e94-b5812da40906 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:32.216690 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 3a65db68-1d85-40c3-9e94-b5812da40906 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:32.217050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.266422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fc401d88-5c9e-41a8-a923-269cbe7833cb None None] Provisioning complete for port 27a076c7-09d9-494d-9b81-0e19786c30b3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:32.267385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fc401d88-5c9e-41a8-a923-269cbe7833cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.296139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.374176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fc401d88-5c9e-41a8-a923-269cbe7833cb None None] Port 27a076c7-09d9-494d-9b81-0e19786c30b3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:32.386532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] For port 3a65db68-1d85-40c3-9e94-b5812da40906, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:32.386723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempted to set empty binding levels {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 13:58:32.395821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.401733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0bce7cb3-c048-4cd0-90ef-3708d61a27f1 tempest-RoutersIpV6AdminTest-357177133 tempest-RoutersIpV6AdminTest-357177133-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:32.434562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 27a076c7-09d9-494d-9b81-0e19786c30b3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:32.435012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.472247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.492314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=3a65db68-1d85-40c3-9e94-b5812da40906,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:32.495827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:32.577602 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 982 time: 2.8036554 Nov 24 13:58:32.583444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40064) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:32.615812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40068) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:32.770047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Deleting port 3a65db68-1d85-40c3-9e94-b5812da40906 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:32.770047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:32.979097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.029064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.052486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.126121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74468087-5062-42e2-a76a-73a8eb57be27 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.149555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] For port 3a65db68-1d85-40c3-9e94-b5812da40906, host hv-neutron-8181, got binding levels [] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:33.150173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.160403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:33.177994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Usage tracker for resource:security_group_rule and tenant:ac40613f37014d5896aab0f8fd46710d is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:33.181138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:33.200981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:33.205044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.222948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.223344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Fanout notify agent at l3_agent the message router_deleted on router af6d69d2-e9b1-495a-ae8b-0fed41abf66c {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:33.282130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Calling delete_port for 3a65db68-1d85-40c3-9e94-b5812da40906 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:33.436993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.444293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9661b24a-08df-4cda-aade-868259894c05 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:33.472077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 27a076c7-09d9-494d-9b81-0e19786c30b3 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:33.493388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event deleted for resources: {'Port': ['ID=3a65db68-1d85-40c3-9e94-b5812da40906,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:33.526548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.534632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 24 13:58:33.535584 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-02cc42e4-b839-4415-bbfd-2ccecee29cc7 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 4.4272044 Nov 24 13:58:33.540799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:33.541191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40074) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:33.598529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.623158 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "DELETE /v2.0/ports/3a65db68-1d85-40c3-9e94-b5812da40906 HTTP/1.1" status: 204 len: 168 time: 1.0372891 Nov 24 13:58:33.625939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40078) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:33.629296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Deleting port a486e6fc-e417-4ea0-9c8d-a48797f7baf7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:33.629634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.709423 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-24caa89f-7961-481f-becb-be1a856f42fe tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:58:33.710674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-24caa89f-7961-481f-becb-be1a856f42fe tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "GET /v2.0/ports/3a65db68-1d85-40c3-9e94-b5812da40906 HTTP/1.1" status: 404 len: 333 time: 0.0783198 Nov 24 13:58:33.719298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40082) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:33.726108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.757157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:33.757490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.792546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Request body: {'port': {'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-77290192'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:33.804599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.812408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:33.818562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-30a058cc-dbbe-42ed-b1da-8047e0c14a9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:33.836198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Usage tracker for resource:port and tenant:424bd3bb154e422a92550d080fd26ca9 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:33.846668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Router dae4f7ce-8421-4823-9021-9def9cbc7bdd has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:33.849418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:33.870907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:33.935268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5bdccedc-cdfc-4ea3-96f7-6c7464301a10,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:33.970171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:33.971289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:34.034815 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ac40613f37014d5896aab0f8fd46710d&name=default HTTP/1.1" status: 200 len: 2647 time: 1.4155316 Nov 24 13:58:34.041859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Made reservation on behalf of 424bd3bb154e422a92550d080fd26ca9 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:34.044156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.052000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40088) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:34.115346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port 75357e54-1249-4455-b845-785b01a88bf3 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:34.157240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.169041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ae34850a-91ea-4f17-9c37-ebe1db6bf463 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:34.238248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Calling delete_port for a486e6fc-e417-4ea0-9c8d-a48797f7baf7 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:34.241834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.251126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=27a076c7-09d9-494d-9b81-0e19786c30b3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:34.258418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:34.469039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 5cf96c6d-d464-468b-b52d-9ed4448ba4b7 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:34.490111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.541589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.553177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.563868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.580671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:34.634281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Pushing event deleted for resources: {'Port': ['ID=a486e6fc-e417-4ea0-9c8d-a48797f7baf7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:34.636733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:34.704047 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/27a076c7-09d9-494d-9b81-0e19786c30b3 HTTP/1.1" status: 204 len: 168 time: 2.5720994 Nov 24 13:58:34.707524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40092) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:34.765834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:34.776324 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-326fb641-065b-4ff1-a6e3-890bf1e00949 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:58:34.776822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-326fb641-065b-4ff1-a6e3-890bf1e00949 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:34.777557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] Sync routers for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:34.784545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.790561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.792106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:34.792982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:34.793232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.799500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c638a4f6-bfd0-41a5-9719-c78786cb1a42 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:34.816511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-326fb641-065b-4ff1-a6e3-890bf1e00949 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:34.817258 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-326fb641-065b-4ff1-a6e3-890bf1e00949 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/27a076c7-09d9-494d-9b81-0e19786c30b3 HTTP/1.1" status: 404 len: 333 time: 0.1080413 Nov 24 13:58:34.820319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40096) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:34.820924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bdccedc-cdfc-4ea3-96f7-6c7464301a10,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:34.823524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:34.828339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.835291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/5bdccedc-cdfc-4ea3-96f7-6c7464301a10 HTTP/1.1" status: 204 len: 168 time: 0.7765150 Nov 24 13:58:34.835291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] 10.222.0.70 "DELETE /v2.0/ports/a486e6fc-e417-4ea0-9c8d-a48797f7baf7 HTTP/1.1" status: 204 len: 168 time: 1.2841442 Nov 24 13:58:34.845608 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "PUT /v2.0/routers/dae4f7ce-8421-4823-9021-9def9cbc7bdd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1790619 Nov 24 13:58:34.852228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40104) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:34.875991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:34.892784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] Routers {'dae4f7ce-8421-4823-9021-9def9cbc7bdd'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:34.894116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:34.940595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:34.952141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5cab462c-067a-497a-ac03-10c8bd4d912e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:34.966251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:34.966999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8fadd23-e87c-4607-bf09-950c94e6a011 None None] The sync data for ids ['dae4f7ce-8421-4823-9021-9def9cbc7bdd'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:35.124576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.235127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40112) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:35.255939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.285504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Network 9f28a011-66c8-49fb-8936-db5753ac9240 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:35.290433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=75357e54-1249-4455-b845-785b01a88bf3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:35.306764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:35.309512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.358s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:35.313030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d294ae3-140b-4e3f-b937-485a3ace5e23 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:35.359156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:35.360233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:35.361035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.392340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.407168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting port 3252a8a9-8979-468e-b728-319a92b95878 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:35.407849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.443610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=5cf96c6d-d464-468b-b52d-9ed4448ba4b7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:35.458377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:35.490193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:35.544811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.566014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 11da58e8-5a02-4ba3-9f9b-df944ea7c144 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:35.577889 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 958 time: 1.8531473 Nov 24 13:58:35.578729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.584549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40122) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:35.593691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:35.614484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.650602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.694585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9af1535a-c5d9-460d-9f5c-a6a7948bb8e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.746373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.784238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:35.816334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Calling delete_port for 3252a8a9-8979-468e-b728-319a92b95878 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:35.847399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Usage tracker for resource:security_group_rule and tenant:d018fdb9d26b4b14b964d3f97ce0342c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:35.855749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:35.870733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:35.872976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:35.887399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Usage tracker for resource:security_group_rule and tenant:bd63a44673144a52af880f26ebb83470 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:35.889895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:35.895592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:35.918880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:36.009206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.115555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.130389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.145733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:36.171694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.223979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5bf055c-c1de-4a65-a461-a6922009cfd9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:36.228460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.230313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:36.232456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.288706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.288971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8388e71a-ce58-4212-bf6a-cc6ea8fc7f8c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:36.293710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fad2a60a-835a-498f-a96a-728200b80a37 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:36.316729 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=d018fdb9d26b4b14b964d3f97ce0342c&name=default HTTP/1.1" status: 200 len: 2647 time: 1.0751023 Nov 24 13:58:36.326065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40126) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:36.330483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.346480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=11da58e8-5a02-4ba3-9f9b-df944ea7c144,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:36.383577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Port': ['ID=3252a8a9-8979-468e-b728-319a92b95878,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:36.395325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:36.408308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:36.409405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bc81cf05-53f9-4988-bc81-302560e20ec8 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.063s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:36.431690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.434358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5785ead-25cd-405d-8b3f-342b33f867e9 None None] Network 377ebc54-544a-4717-aa6f-490ff800affe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:36.475818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=bd63a44673144a52af880f26ebb83470&name=default HTTP/1.1" status: 200 len: 2647 time: 0.9780042 Nov 24 13:58:36.479099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40130) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:36.479795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2ec6017-9d59-4740-81db-48ab7dabefda,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:36.479914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port 75357e54-1249-4455-b845-785b01a88bf3 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:36.484384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:36.497963 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/11da58e8-5a02-4ba3-9f9b-df944ea7c144 HTTP/1.1" status: 204 len: 168 time: 1.6766765 Nov 24 13:58:36.504912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40134) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:36.506441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.545885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Transition to ACTIVE for port object 75357e54-1249-4455-b845-785b01a88bf3 will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:36.618754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.629093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09e052fa-286f-4592-8b01-5701109309f2 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:36.637786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 83e94be3-5294-4789-b6e2-18af20c8f444 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:36.644481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.673209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.676146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.734874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.786591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.789804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.800228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.907045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:36.914603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=75357e54-1249-4455-b845-785b01a88bf3,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:36.917597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:37.183051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.183640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.184145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.190438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.199171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.202711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.203171 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.204105 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 2 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.224508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.234922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:37.240538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.251806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e2b77be-6260-4cd0-b7f2-e0b1e211bd4a tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:37.253328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.253753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.254175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.267385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5bf055c-c1de-4a65-a461-a6922009cfd9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:37.267593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2ec6017-9d59-4740-81db-48ab7dabefda,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:37.270927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:37.274409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:37.281307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.282528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.282961 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.283633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 3 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.291550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.292783 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d5bf055c-c1de-4a65-a461-a6922009cfd9 HTTP/1.1" status: 204 len: 168 time: 0.9368703 Nov 24 13:58:37.314233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.315371 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d2ec6017-9d59-4740-81db-48ab7dabefda HTTP/1.1" status: 204 len: 168 time: 0.8329818 Nov 24 13:58:37.332160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.336695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Fanout notify agent at l3_agent the message router_deleted on router dae4f7ce-8421-4823-9021-9def9cbc7bdd {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:37.367372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.374878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:37.377481 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/routers/dae4f7ce-8421-4823-9021-9def9cbc7bdd HTTP/1.1" status: 204 len: 168 time: 2.5241253 Nov 24 13:58:37.386077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.386487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.387677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.400591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1b53b916-ad16-4fdb-8809-a8a13e2a97d2 None None] Provisioning complete for port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:37.400979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1b53b916-ad16-4fdb-8809-a8a13e2a97d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.406899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.407443 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.408944 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 4 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.419530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.430968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cddd2bbd-53d7-4874-9251-c4ba20564c1a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:37.441415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.441824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.442227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.450179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.453985 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.455211 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 5 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.475393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=83e94be3-5294-4789-b6e2-18af20c8f444,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:37.481094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:37.493232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.493790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.494236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.497025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.502468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.503162 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.503732 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 6 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.510179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71c31889-f8e6-42b3-a011-46e12f58865b None None] Network 377ebc54-544a-4717-aa6f-490ff800affe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:37.520264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8bae44ed-5a02-4b5c-8a01-82551153f917 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:37.536277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.536479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.536952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.542930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.543347 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.543811 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 7 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.577122 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/83e94be3-5294-4789-b6e2-18af20c8f444 HTTP/1.1" status: 204 len: 168 time: 1.0701895 Nov 24 13:58:37.578559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.578894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.581331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.584044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40148) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:37.639746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.640120 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.642807 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 8 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.730743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.731065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.731384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.746022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.747812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.748164 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.750082 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 9 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.771900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.772229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.772556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.776968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:37.777635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.812672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.812994 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.815244 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 10 to bind port 75357e54-1249-4455-b845-785b01a88bf3 Nov 24 13:58:37.841581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:37.842422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:37.842756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:37.886771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:37.887095 dv-neutron-818151-2-hyperv neutron-server[83525]: ERROR neutron.plugins.ml2.managers [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 75357e54-1249-4455-b845-785b01a88bf3 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:37.887443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:37.923738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Deleting subnet d79c3e0a-e48a-43fd-b2f3-134c860e3935 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:37.928815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.028908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.039349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] DHCP port deletion for 377ebc54-544a-4717-aa6f-490ff800affe request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:38.044110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Deleting port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:38.044487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.065479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40162) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.132439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:38.149616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.191949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:38.201726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8bae44ed-5a02-4b5c-8a01-82551153f917/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1266658 Nov 24 13:58:38.207871 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] Sync routers for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:38.209260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40168) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.221640 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:38.222253 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:38.288521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:38.289115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.296157 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:38.319490 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:38.322082 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:38.348903 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-85a451e1-41ab-4f8d-834d-9165c34b3173 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=3247d7c2a8c74789830b69f67bc7c863&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2814023 Nov 24 13:58:38.358167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40172) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.410165 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:38.411471 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb49ee25-5cf7-4d65-9449-9562dba92fde None None] The sync data for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:38.481321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:38.527486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.553075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:38.556432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.589553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.589872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] For port 75357e54-1249-4455-b845-785b01a88bf3, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:38.590391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempted to set empty binding levels {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 13:58:38.594067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Subnet': ['ID=d79c3e0a-e48a-43fd-b2f3-134c860e3935,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:38.594482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.596245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:38.600399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.607626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:38.610948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.613740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-190473df-f860-47f1-aee5-045f41d720b4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:38.628460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dace9e8a-24ef-4437-a228-bc078c1d1528 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:38.640997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.650836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.666140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:38.666512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:38.683236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:38.684807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.688824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/subnets/d79c3e0a-e48a-43fd-b2f3-134c860e3935 HTTP/1.1" status: 204 len: 168 time: 1.3096356 Nov 24 13:58:38.691113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40182) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.694246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=75357e54-1249-4455-b845-785b01a88bf3,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:38.701294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:38.702733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] In _notify_port_updated(), no bound segment for port 75357e54-1249-4455-b845-785b01a88bf3 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:58:38.703887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.708241 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "PUT /v2.0/ports/75357e54-1249-4455-b845-785b01a88bf3 HTTP/1.1" status: 200 len: 975 time: 3.1224055 Nov 24 13:58:38.708925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40186) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.814982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-86cd50a7-7a6e-408f-8443-74ef4b7037d6 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Synchronizing usage tracker for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:38.836060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-86cd50a7-7a6e-408f-8443-74ef4b7037d6 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Unset dirty status for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:38.840253 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-86cd50a7-7a6e-408f-8443-74ef4b7037d6 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 13558 time: 0.1303101 Nov 24 13:58:38.841394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40190) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.856252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Calling delete_port for 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:38.862229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40194) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:38.926256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:38.930090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:38.951899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Deleting port 75357e54-1249-4455-b845-785b01a88bf3 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:38.952989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:38.963812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:38.965061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:39.062214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1777250592'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:39.082984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:39.091258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:network and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:39.096557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:39.110052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.112056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:39.114028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.122622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:39.151324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=caa4869e-aae1-4770-b515-1c6ce63c7272,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:39.158171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:39.164523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.165633 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/caa4869e-aae1-4770-b515-1c6ce63c7272 HTTP/1.1" status: 204 len: 168 time: 0.8065517 Nov 24 13:58:39.166367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Made reservation on behalf of 8d1ebffadec64974b7bb8bd05493b745 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:39.169293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.176195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:39.176507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.234844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.250455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] For port 75357e54-1249-4455-b845-785b01a88bf3, host hv-neutron-8181, got binding levels [] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:39.250929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.344535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.357698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.386425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Calling delete_port for 75357e54-1249-4455-b845-785b01a88bf3 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:39.466485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Deleting port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:39.467481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.503108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:39.527363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:security_group_rule and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:39.534703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:39.539366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f791889-bb28-41c6-bdd5-71e28ee97eae']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:39.553198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.558612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:39.561618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a71af3eb-5c71-482f-abbe-b95985671d7d') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:39.561917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a71af3eb-5c71-482f-abbe-b95985671d7d') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:39.566000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbfea91d-1450-411b-aae7-9fa36d96793a tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:39.584480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.620096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event deleted for resources: {'Port': ['ID=75357e54-1249-4455-b845-785b01a88bf3,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:39.631256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:39.634216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.654229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Releasing vlan 883 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:39.655473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:39.671394 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:39.729102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:39.729610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.792935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] For port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,segment=NetworkSegment(19acd6f2-169e-472a-8a95-24f619a7ece1),segment_id=19acd6f2-169e-472a-8a95-24f619a7ece1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:39.794031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.800886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.812765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-55e64308-c3a0-46e5-aa0d-2e92113b7605 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388002345-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:39.845312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.858958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.869678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Pushing event deleted for resources: {'Network': ['ID=6f791889-bb28-41c6-bdd5-71e28ee97eae,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:39.874253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:39.906359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:39.906590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:39.913567 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] 10.222.0.70 "DELETE /v2.0/networks/6f791889-bb28-41c6-bdd5-71e28ee97eae HTTP/1.1" status: 204 len: 168 time: 1.2112892 Nov 24 13:58:39.917067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72c3e526-bd70-4f44-a8df-777bdcde073f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:39.966239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:39.971377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Calling delete_port for 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:40.045589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'SecurityGroup': ['ID=55bd2e3e-a1b7-4413-becd-3ff2ee0c5db4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:40.055646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:40.057414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.058002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Added segment da5ec78d-c0fb-4a9a-8119-f1f01908337b of type vlan for network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac Nov 24 13:58:40.089868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.140329 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "DELETE /v2.0/ports/75357e54-1249-4455-b845-785b01a88bf3 HTTP/1.1" status: 204 len: 168 time: 1.2949080 Nov 24 13:58:40.143481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40216) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:40.174224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.195456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ba050683-2bee-4e7f-a528-a120b12da24f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:58:40.196019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ba050683-2bee-4e7f-a528-a120b12da24f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Synchronizing usage tracker for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:40.203794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:40.204474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:40.218040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.233657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4424a3e0-f1de-48e8-9240-c4d5de461b8d tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:40.293280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=063f0c0a-4b83-4ba1-9e0a-fcc5c040425a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:40.298653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No DVR routers for this DVR port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:40.304112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ba050683-2bee-4e7f-a528-a120b12da24f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Unset dirty status for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:40.305186 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ba050683-2bee-4e7f-a528-a120b12da24f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "GET /v2.0/ports/75357e54-1249-4455-b845-785b01a88bf3 HTTP/1.1" status: 404 len: 333 time: 0.1613812 Nov 24 13:58:40.310066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.319618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:40.320362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.327388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40224) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:40.327865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40226) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:40.328557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:40.335408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:40.403427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1359420362', 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:40.426007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:40.439443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.469078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['377ebc54-544a-4717-aa6f-490ff800affe']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:40.483424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19acd6f2-169e-472a-8a95-24f619a7ece1') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:40.483813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19acd6f2-169e-472a-8a95-24f619a7ece1') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:40.489373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 1.6260834 Nov 24 13:58:40.494057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40236) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:40.501887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'subnet': {'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:40.509463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:40.513933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Network': ['ID=5fb5eabc-da3e-417c-a2c3-d7d4efa449ac,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:40.520957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:40.526707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:40.549580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Made reservation on behalf of 424bd3bb154e422a92550d080fd26ca9 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:40.562150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.636146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.644001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port ae2b9410-e715-4e31-9b17-69cf8cf58974 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:40.646681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:40.655278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:subnet and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:40.659962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:40.662641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.671821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:40.675485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 854 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:40.676009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:40.692071 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:40.758108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Made reservation on behalf of 8d1ebffadec64974b7bb8bd05493b745 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:40.828512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40242) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:40.832600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 38ab8b22-40e8-4724-8eff-53563e13338c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:40.832600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.870953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.875469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:40.899292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.919137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=377ebc54-544a-4717-aa6f-490ff800affe,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:40.929815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:40.954279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:40.969875 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/377ebc54-544a-4717-aa6f-490ff800affe HTTP/1.1" status: 204 len: 168 time: 3.3819618 Nov 24 13:58:40.973799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40248) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.120169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-908720163'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:41.124047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Deleting port 063f0c0a-4b83-4ba1-9e0a-fcc5c040425a {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:41.126410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.145239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:41.163348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e487ce55-75a3-4960-b44b-2ebf775fc2f0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:41.164073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e487ce55-75a3-4960-b44b-2ebf775fc2f0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:41.171918 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bffa4bf1-7b8a-4a44-aa2c-b52a0996d71f admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=7eb7035f979a46b388c48c890d0ee3b4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8260479 Nov 24 13:58:41.180890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:network and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:41.184135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40254) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.202922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:41.209735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2d71fd58-f130-48f1-b3ce-e99045276311 None None] The port '063f0c0a-4b83-4ba1-9e0a-fcc5c040425a' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:41.235892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e487ce55-75a3-4960-b44b-2ebf775fc2f0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:41.237043 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e487ce55-75a3-4960-b44b-2ebf775fc2f0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 847 time: 0.2623084 Nov 24 13:58:41.241805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40258) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.356312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.362733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7ed3c8c1-0d59-492f-aca1-a24f2eeeddff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:41.439129 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6819fa63-3eca-4d9b-95e7-63e5c6a458e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.1928532 Nov 24 13:58:41.440898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40262) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.441050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:41.450325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-313999491'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:41.459639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Subnet': ['ID=dc8904bf-b69b-4239-9ab9-681cccf0afac,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:41.462290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:41.474373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:41.475269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:41.481112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:41.490093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:41.503104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Checking segment: {'id': 'da5ec78d-c0fb-4a9a-8119-f1f01908337b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:41.503569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network hostable DHCP agents. Network: 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:41.512746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:41.512927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:41.516287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.516429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.548520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.551458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 872} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:41.556770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:41.564843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.566752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.567090 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 6cce861c-bd3c-45a4-ac1f-b455b0845cd5 of type vlan for network 05c770ce-6051-4d8b-8c2f-6b88c833f676 Nov 24 13:58:41.568536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:41.575833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:41.576865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.578590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba03427f-0964-4e1c-b71e-9a31d5ac089b None None] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:41.581165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.613670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.618852 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1241853 Nov 24 13:58:41.624158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40268) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.631023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-54159882', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:41.639308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:41.653649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:router and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:41.658144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:41.666595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:41.675834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.679631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:41.680345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.684391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:41.707608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.708581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.713134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 38ab8b22-40e8-4724-8eff-53563e13338c owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:41.798047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.801018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.3590748 Nov 24 13:58:41.804768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40272) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.808181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:41.810371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=05c770ce-6051-4d8b-8c2f-6b88c833f676,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:41.816816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:41.834358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:41.834606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:security_group_rule and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:41.844497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.853627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:41.861056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:41.874237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.881153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:41.925044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.937534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d6dc00a4-0208-4a24-9d25-7705dd7cd1a4 tempest-FloatingIPAdminTestJSON-1742335912 tempest-FloatingIPAdminTestJSON-1742335912-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:41.947850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:41.950285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.955892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-5fb5eabc-da3e-417c-a2c3-d7d4efa449ac', 'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac', 'tenant_id': '8d1ebffadec64974b7bb8bd05493b745', 'fixed_ips': [{'subnet_id': 'dc8904bf-b69b-4239-9ab9-681cccf0afac'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:41.956717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.958985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:41.966539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:41.975328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:41.985347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:41.986540 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c9455ecd-2936-4b17-a30c-0d1db06d2e81 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 713 time: 0.3608251 Nov 24 13:58:41.989882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40276) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:41.993034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:42.126496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.141483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Network 9f28a011-66c8-49fb-8936-db5753ac9240 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:42.142495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=ae2b9410-e715-4e31-9b17-69cf8cf58974,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:42.148132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:42.152057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:42.153562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b59af4f-5d19-4c4e-9430-b94a4e5cd9ff tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:42.173864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Allocated IP 172.20.0.2 (5fb5eabc-da3e-417c-a2c3-d7d4efa449ac/dc8904bf-b69b-4239-9ab9-681cccf0afac/bf72844d-11fe-45b7-9a59-cd37c071e67c) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:42.193053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:42.194502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:42.195094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.242754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.245383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.246684 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/b81981ad-4d83-41c2-8617-9abdfc592eb3 HTTP/1.1" status: 204 len: 168 time: 1.0461388 Nov 24 13:58:42.251732 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.9079437 Nov 24 13:58:42.252962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=38ab8b22-40e8-4724-8eff-53563e13338c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:42.255473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40282) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:42.300669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:42.301454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-50e8d29f-ae35-43e4-9670-43888e4f8b38 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:42.336956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.468412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b81981ad-4d83-41c2-8617-9abdfc592eb3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:42.539412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.551970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Transition to ACTIVE for port object bf72844d-11fe-45b7-9a59-cd37c071e67c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:42.562720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.568544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:42.577479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Transition to ACTIVE for port object bf72844d-11fe-45b7-9a59-cd37c071e67c will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:42.595684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.608566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-812c737f-a57c-4eb8-83a4-ac157dc3d224 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:42.645418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.662869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b053f4ac-c2cb-4556-b065-426945c16c80 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:42.690661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-99eacd67-cd76-4d44-b0a1-9e4f8cad8859 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Synchronizing usage tracker for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:42.696794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:42.700503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:42.705657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:42.708400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Pushing event updated for resources: {'Port': ['ID=bf72844d-11fe-45b7-9a59-cd37c071e67c,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:42.712904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:42.719811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:42.738863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bb408cf9-bda5-4dad-ab8e-e9b7783f8993,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:42.742015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:42.750177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.750518 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Added segment d835348b-9d02-474a-b714-2386d2846663 of type vlan for network 336d79b0-b678-4519-960c-1d6db0696693 Nov 24 13:58:42.782481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.785842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-99eacd67-cd76-4d44-b0a1-9e4f8cad8859 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Unset dirty status for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:42.786996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-99eacd67-cd76-4d44-b0a1-9e4f8cad8859 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "GET /v2.0/ports/ae2b9410-e715-4e31-9b17-69cf8cf58974 HTTP/1.1" status: 200 len: 955 time: 0.5288911 Nov 24 13:58:42.791453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40292) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:42.810439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Attempting to bind port bf72844d-11fe-45b7-9a59-cd37c071e67c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:42.811319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Attempting to bind port bf72844d-11fe-45b7-9a59-cd37c071e67c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'da5ec78d-c0fb-4a9a-8119-f1f01908337b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:42.811803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Attempting to bind port bf72844d-11fe-45b7-9a59-cd37c071e67c on network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:42.818625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:42.819557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Checking segment: {'id': 'da5ec78d-c0fb-4a9a-8119-f1f01908337b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:42.819557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.820198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Bound using segment: {'id': 'da5ec78d-c0fb-4a9a-8119-f1f01908337b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:42.820732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Bound port: bf72844d-11fe-45b7-9a59-cd37c071e67c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'da5ec78d-c0fb-4a9a-8119-f1f01908337b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:42.821239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.831291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.916091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] For port bf72844d-11fe-45b7-9a59-cd37c071e67c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:42.921100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] For port bf72844d-11fe-45b7-9a59-cd37c071e67c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf72844d-11fe-45b7-9a59-cd37c071e67c,segment=NetworkSegment(da5ec78d-c0fb-4a9a-8119-f1f01908337b),segment_id=da5ec78d-c0fb-4a9a-8119-f1f01908337b)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:42.929033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.933117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-59db3b89-08c7-4e59-9a73-ff06a83f50a4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:42.975676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Deleting port ae2b9410-e715-4e31-9b17-69cf8cf58974 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:42.976404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:42.995847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:43.010734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8828d3de-507b-4465-99c8-2e1a8f9cd8c1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:43.018284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Pushing event updated for resources: {'Port': ['ID=bf72844d-11fe-45b7-9a59-cd37c071e67c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:43.022058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:43.092221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:43.096251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:43.096983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:43.104161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-285b9d94-f0ec-407d-8b92-be52b6f523e0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:43.122114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '6cce861c-bd3c-45a4-ac1f-b455b0845cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:43.122454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: 05c770ce-6051-4d8b-8c2f-6b88c833f676, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:43.137068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=8f1d66b5-e969-4d53-8dcb-c22e468d4dbd,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:43.146127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:43.313212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:43.328248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:43.468279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 793 time: 2.6384423 Nov 24 13:58:43.481039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40306) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:43.481265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 05c770ce-6051-4d8b-8c2f-6b88c833f676) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:43.492616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52dc6de6-d072-400f-a4b9-a97b63e86a32 None None] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:43.493975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:43.494566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:43.552595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40310) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:43.574855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'subnet': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:43.585206 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7772281 Nov 24 13:58:43.589912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40316) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:43.594568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Network': ['ID=336d79b0-b678-4519-960c-1d6db0696693,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:43.598005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.494s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:43.600672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676', 'name': 'tempest-PortsIpV6TestJSON-667656855'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:43.615436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 336d79b0-b678-4519-960c-1d6db0696693 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:43.782276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'networks': [{'name': 'tempest-network--1989736997'}, {'name': 'tempest-network--1651595115'}]} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:43.782649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'network': {'name': 'tempest-network--1989736997'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:43.783039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'network': {'name': 'tempest-network--1651595115'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:43.791558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:43.804410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:network and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:43.814179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:43.817233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:43.831593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 2 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:43.834782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:43.842356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:43.853063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:43.911543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-05c770ce-6051-4d8b-8c2f-6b88c833f676', 'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': '8f1d66b5-e969-4d53-8dcb-c22e468d4dbd'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:43.912584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.007943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:44.019810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'network': 2} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:44.023387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.063597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Calling delete_port for ae2b9410-e715-4e31-9b17-69cf8cf58974 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:44.083827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.113546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:44.125165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:44.125454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.160344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:44.163080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf72844d-11fe-45b7-9a59-cd37c071e67c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:44.197843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Allocated IP 172.20.0.1 (5fb5eabc-da3e-417c-a2c3-d7d4efa449ac/dc8904bf-b69b-4239-9ab9-681cccf0afac/a3271513-0ae5-4d4f-bdc3-5ef021be7626) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:44.203317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:subnet and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:44.235096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:44.245759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:44.260986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Allocated IP 2001:db8::2 (05c770ce-6051-4d8b-8c2f-6b88c833f676/8f1d66b5-e969-4d53-8dcb-c22e468d4dbd/b0c04d1e-d3f0-404b-9953-4e9ea244f29c) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:44.269130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:44.286325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:security_group_rule and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:44.300596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:44.303725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d63fceb2-ecef-4a38-9d38-35037dc62498 None None] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:44.316444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:44.317606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:44.327511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port bf72844d-11fe-45b7-9a59-cd37c071e67c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:44.352003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.362735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f8d2deee-c9a5-41cd-b45c-8e17e63887ab tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:44.446988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8bae44ed-5a02-4b5c-8a01-82551153f917 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:58:44.475718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event deleted for resources: {'Port': ['ID=ae2b9410-e715-4e31-9b17-69cf8cf58974,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:44.492146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:44.503519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.511766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.527695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.537679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.538903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Transition to ACTIVE for port object a3271513-0ae5-4d4f-bdc3-5ef021be7626 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:44.545211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.545826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.550987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Provisioning for port bf72844d-11fe-45b7-9a59-cd37c071e67c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:44.558153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0494c3f0-24b5-4f8d-9b39-582d1ec1dbaa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:44.572096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Provisioning complete for port bf72844d-11fe-45b7-9a59-cd37c071e67c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:44.572458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.609258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c6bc1edc-b441-46bc-9344-2cd1f17c521f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:44.612556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:44.620725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 884} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:44.630664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.637964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:44.669545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.670568 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Added segment 0e9038be-046d-4327-a2c5-80e2313fa3ac of type vlan for network ef3c3cdb-97ae-45c0-822a-c396bc109f45 Nov 24 13:58:44.732549 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "DELETE /v2.0/ports/ae2b9410-e715-4e31-9b17-69cf8cf58974 HTTP/1.1" status: 204 len: 168 time: 1.9375346 Nov 24 13:58:44.734177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:44.743362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40320) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:44.746084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:44.748664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:44.778457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.780835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.784430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:44.790793 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8bae44ed-5a02-4b5c-8a01-82551153f917/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5804644 Nov 24 13:58:44.794683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40324) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:44.818726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] Sync routers for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:44.844823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9582acc8-6dd2-4578-8ebc-3f42335b232c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:44.851465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Port': ['ID=a3271513-0ae5-4d4f-bdc3-5ef021be7626,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:44.853053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:44.858452 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-16181579-d9fd-4d39-ae58-347da5dba8c0 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:58:44.865000 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-16181579-d9fd-4d39-ae58-347da5dba8c0 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "GET /v2.0/ports/ae2b9410-e715-4e31-9b17-69cf8cf58974 HTTP/1.1" status: 404 len: 333 time: 0.1153567 Nov 24 13:58:44.865185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40328) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:44.866227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Transition to ACTIVE for port object b0c04d1e-d3f0-404b-9953-4e9ea244f29c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:44.870411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Request body: {'port': {'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1471057795'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:44.898332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.907741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:44.913828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9582acc8-6dd2-4578-8ebc-3f42335b232c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:44.915274 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9582acc8-6dd2-4578-8ebc-3f42335b232c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=8bae44ed-5a02-4b5c-8a01-82551153f917 HTTP/1.1" status: 200 len: 205 time: 0.1192212 Nov 24 13:58:44.916394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Usage tracker for resource:port and tenant:424bd3bb154e422a92550d080fd26ca9 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:44.916954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Transition to ACTIVE for port object b0c04d1e-d3f0-404b-9953-4e9ea244f29c will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:44.919476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.921387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40332) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:44.921892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:44.922450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 896} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:44.928972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:44.929614 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:44.936778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:44.937255 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Added segment 21118b71-6a13-49ba-acad-4c8acac7fcf6 of type vlan for network b450ff86-7892-4057-8eff-71bad2104ab7 Nov 24 13:58:45.003373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.010105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83c8e230-4f14-4a52-aa1a-27bde6bd6a9b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:45.039580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:45.039928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.106998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.108562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:45.119004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] For port bf72844d-11fe-45b7-9a59-cd37c071e67c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf72844d-11fe-45b7-9a59-cd37c071e67c,segment=NetworkSegment(da5ec78d-c0fb-4a9a-8119-f1f01908337b),segment_id=da5ec78d-c0fb-4a9a-8119-f1f01908337b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:45.127184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:45.133180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:45.135073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Pushing event updated for resources: {'Port': ['ID=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:45.137047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.147836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::10f (05c770ce-6051-4d8b-8c2f-6b88c833f676/8f1d66b5-e969-4d53-8dcb-c22e468d4dbd/6f4f7052-8b24-49e9-be9c-6cfeb1ae7099) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:45.149228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:45.152242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:45.152739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:45.190868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] Routers {'8bae44ed-5a02-4b5c-8a01-82551153f917'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:45.191479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8bae44ed-5a02-4b5c-8a01-82551153f917'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:45.207363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Made reservation on behalf of 424bd3bb154e422a92550d080fd26ca9 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:45.209438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.231633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.233031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.236985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:45.240163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:45.241420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.257230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-52eb7636-83ab-4c11-95f6-d68a7d71773f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:45.272204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:45.272606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af174e17-7a1f-4c44-9497-84a8c6203baf None None] The sync data for ids ['8bae44ed-5a02-4b5c-8a01-82551153f917'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:45.294587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port 09a08228-8351-4a97-9d7e-fb1249c630a7 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:45.385770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.400412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Pushing event updated for resources: {'Port': ['ID=bf72844d-11fe-45b7-9a59-cd37c071e67c,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:45.411539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:45.412797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Attempting to bind port b0c04d1e-d3f0-404b-9953-4e9ea244f29c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:45.414795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Attempting to bind port b0c04d1e-d3f0-404b-9953-4e9ea244f29c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '6cce861c-bd3c-45a4-ac1f-b455b0845cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:45.415171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Attempting to bind port b0c04d1e-d3f0-404b-9953-4e9ea244f29c on network 05c770ce-6051-4d8b-8c2f-6b88c833f676 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:45.424906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:45.425278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Checking segment: {'id': '6cce861c-bd3c-45a4-ac1f-b455b0845cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:45.425680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.426070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Bound using segment: {'id': '6cce861c-bd3c-45a4-ac1f-b455b0845cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:45.426532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Bound port: b0c04d1e-d3f0-404b-9953-4e9ea244f29c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6cce861c-bd3c-45a4-ac1f-b455b0845cd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:45.426905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.459945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.472220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-662fb7f3-d8e7-4664-aa67-00e97d565f65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:45.528002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] For port b0c04d1e-d3f0-404b-9953-4e9ea244f29c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:45.532242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] For port b0c04d1e-d3f0-404b-9953-4e9ea244f29c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,segment=NetworkSegment(6cce861c-bd3c-45a4-ac1f-b455b0845cd5),segment_id=6cce861c-bd3c-45a4-ac1f-b455b0845cd5)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:45.541602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.550289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:45.586278 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 2.0325544 Nov 24 13:58:45.593233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40338) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:45.596178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Network': ['ID=ef3c3cdb-97ae-45c0-822a-c396bc109f45,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:45.620383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ef3c3cdb-97ae-45c0-822a-c396bc109f45 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:45.676871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Pushing event updated for resources: {'Port': ['ID=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:45.683298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Subnet': ['ID=a9d59020-6118-4b61-85b7-abab2d903c4f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:45.699552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:45.700185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-96c6bd28-46c6-4fda-b9a3-0ce1b1cb3193 None None] Provisioning for port a3271513-0ae5-4d4f-bdc3-5ef021be7626 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:45.709471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-96c6bd28-46c6-4fda-b9a3-0ce1b1cb3193 None None] Provisioning complete for port a3271513-0ae5-4d4f-bdc3-5ef021be7626 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:45.709865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-96c6bd28-46c6-4fda-b9a3-0ce1b1cb3193 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:45.731870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:45.872527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-96c6bd28-46c6-4fda-b9a3-0ce1b1cb3193 None None] Port a3271513-0ae5-4d4f-bdc3-5ef021be7626 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:45.886505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-96c6bd28-46c6-4fda-b9a3-0ce1b1cb3193 None None] Provisioning complete for port bf72844d-11fe-45b7-9a59-cd37c071e67c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:45.887028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-96c6bd28-46c6-4fda-b9a3-0ce1b1cb3193 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.072482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.164221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Checking segment: {'id': 'd835348b-9d02-474a-b714-2386d2846663', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '336d79b0-b678-4519-960c-1d6db0696693'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:46.164502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network hostable DHCP agents. Network: 336d79b0-b678-4519-960c-1d6db0696693, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:46.178786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Network': ['ID=b450ff86-7892-4057-8eff-71bad2104ab7,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:46.194758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b450ff86-7892-4057-8eff-71bad2104ab7 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:46.203470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.946s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:46.203997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.930s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:46.204372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:46.243193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.249595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b777ddbf-3fb3-47dc-ab57-9013699edce1 None None] Provisioning complete for port a3271513-0ae5-4d4f-bdc3-5ef021be7626 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:46.250059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b777ddbf-3fb3-47dc-ab57-9013699edce1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.256876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-269fb1de-5153-42a1-976c-b2c6bf8af32e tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:46.262302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:46.267053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:46.271649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:46.275006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf72844d-11fe-45b7-9a59-cd37c071e67c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:46.276787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:46.277713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Synchronizing usage tracker for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:46.338787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.343094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:46.364526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.376506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 336d79b0-b678-4519-960c-1d6db0696693) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:46.376805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.382665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Network 9f28a011-66c8-49fb-8936-db5753ac9240 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:46.389150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:46.392290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:46.393117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.399358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Unset dirty status for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:46.400660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-faca20c6-76cc-45e3-b174-07c93413272a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2407 time: 0.8062391 Nov 24 13:58:46.404155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:46.405496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40342) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:46.409186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=09a08228-8351-4a97-9d7e-fb1249c630a7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:46.415157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:46.416001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:46.416597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.424075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:46.442131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.9606082 Nov 24 13:58:46.450805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40346) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:46.465142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'name': 'tempest-AllowedAddressPairTestJSON-93726827'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:46.471948 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 1.6058085 Nov 24 13:58:46.472878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a36e5b0-174d-47db-a9cc-fd405e14045c None None] Network 336d79b0-b678-4519-960c-1d6db0696693 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:46.473384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40350) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:46.480261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Request body: {'port': {'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:46.521658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.522438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router 8bae44ed-5a02-4b5c-8a01-82551153f917 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:58:46.551483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.594234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b777ddbf-3fb3-47dc-ab57-9013699edce1 None None] Port a3271513-0ae5-4d4f-bdc3-5ef021be7626 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:46.598452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.602347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fca8611a-3608-4ad3-a7b4-f580b0bbd34f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/8bae44ed-5a02-4b5c-8a01-82551153f917 HTTP/1.1" status: 204 len: 168 time: 1.6745183 Nov 24 13:58:46.608092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40354) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:46.635832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.660878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bf72844d-11fe-45b7-9a59-cd37c071e67c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:46.660878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.676477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-85b5b5ed-139c-406c-b2ac-5cc1d2486434 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:46.699303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.736709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.799319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.814599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-336d79b0-b678-4519-960c-1d6db0696693', 'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'tenant_id': 'a4a56793d07e455186fd2fc1eb5e9e6c', 'fixed_ips': [{'subnet_id': 'a9d59020-6118-4b61-85b7-abab2d903c4f'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:46.815646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.825572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Port': ['ID=a3271513-0ae5-4d4f-bdc3-5ef021be7626,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:46.839323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:46.840405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:46.844685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bde827b4-43ea-4265-830f-b43eb828f156 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:46.981856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:47.019355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:port and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:47.025315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:47.026637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b0c04d1e-d3f0-404b-9953-4e9ea244f29c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:47.032068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:47.042696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:47.070339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Allocated IP 172.20.0.2 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/2a736275-7784-4a1a-8be5-0f1a93368c5f) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:47.097133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:47.099555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:47.103586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:47.104264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.111199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=6f4f7052-8b24-49e9-be9c-6cfeb1ae7099,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:47.174865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-020e246a-78d0-47b2-8b0c-3e3f409cf4db None None] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:47.187738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.343s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:47.202784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.208873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet d84e48cc-8c0a-4880-b899-7d51994d9ca1 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:47.215195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.247473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] device_id is not set on port 09a08228-8351-4a97-9d7e-fb1249c630a7 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:47.259463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ef3c3cdb-97ae-45c0-822a-c396bc109f45']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:47.261940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.292350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0e9038be-046d-4327-a2c5-80e2313fa3ac') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:47.292691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0e9038be-046d-4327-a2c5-80e2313fa3ac') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:47.293371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Transition to ACTIVE for port object 09a08228-8351-4a97-9d7e-fb1249c630a7 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:47.296461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.303719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port b0c04d1e-d3f0-404b-9953-4e9ea244f29c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:47.305794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:47.308854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.329682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.335618 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.7457228 Nov 24 13:58:47.336970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fb18f197-e372-4c1b-ace5-dc0397da0699 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:47.340915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40358) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:47.354124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': '05c770ce-6051-4d8b-8c2f-6b88c833f676', 'name': 'tempest-PortsIpV6TestJSON-1216882634'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:47.371282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.412571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Provisioning for port b0c04d1e-d3f0-404b-9953-4e9ea244f29c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:47.413517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] device_id is not set on port 0ca99164-2ff5-42fb-9a57-593e92cd372c yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:47.457672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Provisioning complete for port b0c04d1e-d3f0-404b-9953-4e9ea244f29c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:47.458067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.492337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=09a08228-8351-4a97-9d7e-fb1249c630a7,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:47.496962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:47.519576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.537345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.537345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.537345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.541586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.551041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.566320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Releasing vlan 884 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:47.566974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.567189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.568305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Transition to ACTIVE for port object 2a736275-7784-4a1a-8be5-0f1a93368c5f will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:47.581484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.581811 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:47.582823 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:47.584796 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 2 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:47.611367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.611692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.611963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.624950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.625483 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.627150 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 3 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:47.631493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Transition to ACTIVE for port object 2a736275-7784-4a1a-8be5-0f1a93368c5f will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:47.650805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.651167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.651648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.658826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.659228 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.659547 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 4 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:47.669391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.673748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.679895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-799e8e46-f404-4237-84d5-eae246d234cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:47.680071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-82cfdd0e-bb00-480d-9675-35a8a869e887 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:47.690633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:47.713577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:47.726721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=d84e48cc-8c0a-4880-b899-7d51994d9ca1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:47.734463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.734806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.735144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.740666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:47.750268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.750668 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.751772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.754812 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 5 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:47.775363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.775700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.776061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.782155 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/d84e48cc-8c0a-4880-b899-7d51994d9ca1 HTTP/1.1" status: 204 len: 168 time: 1.1699245 Nov 24 13:58:47.784047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:47.784448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40362) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:47.800797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:47.803046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9942c4a5-6e5e-4075-9c75-94b1f5fd2451 None None] Network c9fa6814-5f92-43d6-9db9-d60c19b25c66 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:47.818016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:47.819489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.819848 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.823114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 6 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:47.832267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:47.835713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Pushing event updated for resources: {'Port': ['ID=2a736275-7784-4a1a-8be5-0f1a93368c5f,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:47.845222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:47.851163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.851498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.851857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.873551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.873894 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.876983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 7 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:47.925385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:47.925855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:47.926336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:47.992019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:47.992352 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:47.994481 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 8 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:48.027429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:48.027788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:48.028147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:48.048270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] For port b0c04d1e-d3f0-404b-9953-4e9ea244f29c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,segment=NetworkSegment(6cce861c-bd3c-45a4-ac1f-b455b0845cd5),segment_id=6cce861c-bd3c-45a4-ac1f-b455b0845cd5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:48.064018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:48.064381 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:48.066360 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 9 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:48.084429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet 92a67e43-85d9-4a70-a511-803d3c21308b {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:48.088116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.093149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.104444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c489acdd-058c-4c72-bcbd-c8dc80158c4f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:48.130518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:48.131211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:48.131720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:48.137632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Attempting to bind port 2a736275-7784-4a1a-8be5-0f1a93368c5f on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:48.138083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Attempting to bind port 2a736275-7784-4a1a-8be5-0f1a93368c5f by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd835348b-9d02-474a-b714-2386d2846663', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '336d79b0-b678-4519-960c-1d6db0696693'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:48.139125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Attempting to bind port 2a736275-7784-4a1a-8be5-0f1a93368c5f on network 336d79b0-b678-4519-960c-1d6db0696693 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:48.151625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:48.152240 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:48.159079 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempt 10 to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 Nov 24 13:58:48.163364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.169787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:48.175622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a66aff2b-3b78-4c4c-a05a-b40b6321dc61 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:48.182681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.193786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.209202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:48.219951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:48.220416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:48.220908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:48.221399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempting to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:48.236550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 13:58:48.236875 dv-neutron-818151-2-hyperv neutron-server[83526]: ERROR neutron.plugins.ml2.managers [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Failed to bind port 09a08228-8351-4a97-9d7e-fb1249c630a7 on host hv-neutron-8181 for vnic_type normal using segments [{'id': 'fd51a9f4-208a-4391-a8b7-769eb8243233', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '9f28a011-66c8-49fb-8936-db5753ac9240'}] Nov 24 13:58:48.237410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.280843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:48.281295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Checking segment: {'id': 'd835348b-9d02-474a-b714-2386d2846663', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '336d79b0-b678-4519-960c-1d6db0696693'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:48.281810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.282264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Bound using segment: {'id': 'd835348b-9d02-474a-b714-2386d2846663', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '336d79b0-b678-4519-960c-1d6db0696693'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:48.282805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Bound port: 2a736275-7784-4a1a-8be5-0f1a93368c5f, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd835348b-9d02-474a-b714-2386d2846663', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '336d79b0-b678-4519-960c-1d6db0696693'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:48.283346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.306621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:48.323807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Network': ['ID=ef3c3cdb-97ae-45c0-822a-c396bc109f45,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:48.350552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:48.415739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] For port 09a08228-8351-4a97-9d7e-fb1249c630a7, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:48.416613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Attempted to set empty binding levels {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Nov 24 13:58:48.418483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.424802 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/networks/ef3c3cdb-97ae-45c0-822a-c396bc109f45 HTTP/1.1" status: 204 len: 168 time: 2.0171163 Nov 24 13:58:48.426345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Allocated IP 172.20.0.8 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/0ca99164-2ff5-42fb-9a57-593e92cd372c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:48.431425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:48.454570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.455892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Provisioning complete for port a3271513-0ae5-4d4f-bdc3-5ef021be7626 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:48.456268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.462498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:48.464714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e504895-5002-439b-8091-6f4ae7d2f5a2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:48.466184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.485894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Pushing event updated for resources: {'Port': ['ID=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:48.530137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:48.542548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] In _notify_port_updated(), no bound segment for port 09a08228-8351-4a97-9d7e-fb1249c630a7 on network 9f28a011-66c8-49fb-8936-db5753ac9240 {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:58:48.543837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.548610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "PUT /v2.0/ports/09a08228-8351-4a97-9d7e-fb1249c630a7 HTTP/1.1" status: 200 len: 977 time: 2.0738626 Nov 24 13:58:48.553235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40372) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:48.581039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1c632922-40fc-42b9-9315-206409185f86 None None] For port 2a736275-7784-4a1a-8be5-0f1a93368c5f, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:48.597009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Port a3271513-0ae5-4d4f-bdc3-5ef021be7626 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:48.610041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event updated for resources: {'Port': ['ID=09a08228-8351-4a97-9d7e-fb1249c630a7,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:48.614265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1c632922-40fc-42b9-9315-206409185f86 None None] For port 2a736275-7784-4a1a-8be5-0f1a93368c5f, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2a736275-7784-4a1a-8be5-0f1a93368c5f,segment=NetworkSegment(d835348b-9d02-474a-b714-2386d2846663),segment_id=d835348b-9d02-474a-b714-2386d2846663)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:48.615559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:48.618807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 1bbfc996-6133-4441-8445-7f964e31d204 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:48.625293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Provisioning complete for port b0c04d1e-d3f0-404b-9953-4e9ea244f29c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:48.625783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.640878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Deleting port 09a08228-8351-4a97-9d7e-fb1249c630a7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:48.641220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.665960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.674232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.680356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:48.681002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:48.695331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.729968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=92a67e43-85d9-4a70-a511-803d3c21308b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:48.741756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:48.748933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.763005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] DHCP port deletion for c9fa6814-5f92-43d6-9db9-d60c19b25c66 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:48.766337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf2b3dc-57e8-4faa-be80-03f94ad4b333 None None] Network 27d84f11-5c9d-4555-8c98-67f172766d45 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:48.791524 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/92a67e43-85d9-4a70-a511-803d3c21308b HTTP/1.1" status: 204 len: 168 time: 1.0036416 Nov 24 13:58:48.791739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40378) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:48.808127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Deleting port 3bb052da-aef1-4641-909d-dab80acc950b {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:48.808701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:48.944383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Pushing event updated for resources: {'Port': ['ID=2a736275-7784-4a1a-8be5-0f1a93368c5f,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:48.947468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:49.051074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.072720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.119520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.136602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::2e (05c770ce-6051-4d8b-8c2f-6b88c833f676/8f1d66b5-e969-4d53-8dcb-c22e468d4dbd/1bbfc996-6133-4441-8445-7f964e31d204) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:49.151972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] For port 09a08228-8351-4a97-9d7e-fb1249c630a7, host hv-neutron-8181, got binding levels [] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:49.152596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.228248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b450ff86-7892-4057-8eff-71bad2104ab7']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:49.245179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '21118b71-6a13-49ba-acad-4c8acac7fcf6') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:49.245726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '21118b71-6a13-49ba-acad-4c8acac7fcf6') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:49.260304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.285301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.292775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Releasing vlan 896 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:49.293480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.347349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Provisioning for port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:49.348886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Calling delete_port for 09a08228-8351-4a97-9d7e-fb1249c630a7 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:49.357728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] For port 3bb052da-aef1-4641-909d-dab80acc950b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3bb052da-aef1-4641-909d-dab80acc950b,segment=NetworkSegment(ee4a4129-fbe1-4beb-8e23-257ebb7425b1),segment_id=ee4a4129-fbe1-4beb-8e23-257ebb7425b1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:49.358143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.370851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Provisioning complete for port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:49.371235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:49.397590 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:49.420142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Transition to ACTIVE for port object 0ca99164-2ff5-42fb-9a57-593e92cd372c will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:49.420990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 3bb052da-aef1-4641-909d-dab80acc950b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:49.421429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.493728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.496269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.501424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60f59a35-1e89-4d8a-b003-d24c8e83a6c1 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:49.507628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc151809-3621-4233-bcbe-4a2a05ba496b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:49.522491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.533819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Calling delete_port for 3bb052da-aef1-4641-909d-dab80acc950b owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:49.575407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Pushing event deleted for resources: {'Port': ['ID=09a08228-8351-4a97-9d7e-fb1249c630a7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:49.591189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-63f49736-f769-41e4-a684-5bb848bdad21 None None] Port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:49.598473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Network': ['ID=b450ff86-7892-4057-8eff-71bad2104ab7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:49.602699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:49.608908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:49.613186 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/networks/b450ff86-7892-4057-8eff-71bad2104ab7 HTTP/1.1" status: 204 len: 168 time: 1.1806874 Nov 24 13:58:49.623088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Router eff8244f-7b8f-486d-b7d4-46f1d8c7938c is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:58:49.626082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40384) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:49.629917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.637721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] DHCP port deletion for 27d84f11-5c9d-4555-8c98-67f172766d45 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:49.643862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Deleting port ba795333-49cf-42f2-8352-31bf18d084d4 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:49.644333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.644483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.659868 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "DELETE /v2.0/ports/09a08228-8351-4a97-9d7e-fb1249c630a7 HTTP/1.1" status: 204 len: 168 time: 1.1055787 Nov 24 13:58:49.660644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40388) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:49.689375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.695579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7f8eb46b-1aa9-454b-af35-3e7ae3bc2d8f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:49.703057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-25130224-c676-425a-89d9-c5cab21b19eb tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:49.739226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-045395de-72c8-4955-8efa-b6f1905a7175 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] GET failed (client error): The resource could not be found. Nov 24 13:58:49.739876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-045395de-72c8-4955-8efa-b6f1905a7175 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Synchronizing usage tracker for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:49.755600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Pushing event deleted for resources: {'Port': ['ID=3bb052da-aef1-4641-909d-dab80acc950b,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:49.786431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:49.830349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 3bb052da-aef1-4641-909d-dab80acc950b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3bb052da-aef1-4641-909d-dab80acc950b,segment=NetworkSegment(ee4a4129-fbe1-4beb-8e23-257ebb7425b1),segment_id=ee4a4129-fbe1-4beb-8e23-257ebb7425b1)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:49.830701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:49.839381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-045395de-72c8-4955-8efa-b6f1905a7175 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Unset dirty status for tenant:424bd3bb154e422a92550d080fd26ca9 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:49.840619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-045395de-72c8-4955-8efa-b6f1905a7175 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] 10.222.0.70 "GET /v2.0/ports/09a08228-8351-4a97-9d7e-fb1249c630a7 HTTP/1.1" status: 404 len: 333 time: 0.1767442 Nov 24 13:58:49.846595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40394) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:49.908718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:49.923729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] For port ba795333-49cf-42f2-8352-31bf18d084d4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ba795333-49cf-42f2-8352-31bf18d084d4,segment=NetworkSegment(d7616f88-fcf0-482c-9d78-68726f5f295b),segment_id=d7616f88-fcf0-482c-9d78-68726f5f295b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:49.924317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.023173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.100721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 3bb052da-aef1-4641-909d-dab80acc950b owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:50.146217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Calling delete_port for ba795333-49cf-42f2-8352-31bf18d084d4 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:50.169530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:50.203098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.507s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:50.217510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] No DVR routers for this DVR port 3bb052da-aef1-4641-909d-dab80acc950b on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:50.266743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.285604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:50.286189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:50.290279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22d50883-1aa0-4f61-94e1-49fc18f55304 None None] Network 336d79b0-b678-4519-960c-1d6db0696693 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:50.312009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2a736275-7784-4a1a-8be5-0f1a93368c5f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:50.317866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=0ca99164-2ff5-42fb-9a57-593e92cd372c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:50.333183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.632s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:50.345250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 1bbfc996-6133-4441-8445-7f964e31d204 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:50.349128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e6a832be-3a9b-4012-bc34-6a2ada360346 None None] Provisioning complete for port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:50.349512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e6a832be-3a9b-4012-bc34-6a2ada360346 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.364525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:50.365134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.415324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71401b9a-06d9-494b-a0a8-3f25b57fcb3a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:50.420345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71401b9a-06d9-494b-a0a8-3f25b57fcb3a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:50.421114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-71401b9a-06d9-494b-a0a8-3f25b57fcb3a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Synchronizing usage tracker for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:50.424837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.436767 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 3.9791977 Nov 24 13:58:50.440713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40400) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:50.457405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'name': 'tempest-AllowedAddressPairTestJSON-374308584', 'allowed_address_pairs': [{'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:96:a0:72'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:50.468645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-71401b9a-06d9-494b-a0a8-3f25b57fcb3a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Unset dirty status for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:50.470154 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-71401b9a-06d9-494b-a0a8-3f25b57fcb3a tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.8360963 Nov 24 13:58:50.475496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.477412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40404) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:50.486477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a65c74bc-7d79-47ac-a26a-37de19518367 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:50.519364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.523068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-970618918'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:50.534043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:50.537771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:50.548469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f28a011-66c8-49fb-8936-db5753ac9240']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.551354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:58:50.563810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "PUT /v2.0/routers/eff8244f-7b8f-486d-b7d4-46f1d8c7938c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5715935 Nov 24 13:58:50.566194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40408) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:50.569044 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] Sync routers for ids ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:58:50.574457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e6a832be-3a9b-4012-bc34-6a2ada360346 None None] Port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:50.578080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:50.578560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fd51a9f4-208a-4391-a8b7-769eb8243233') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.578852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fd51a9f4-208a-4391-a8b7-769eb8243233') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.588303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'port': {'network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac', 'name': 'tempest-FloatingIPNegativeTestJSON-971214831'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:50.595667 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] Routers {'eff8244f-7b8f-486d-b7d4-46f1d8c7938c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:50.596437 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.608343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.611888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Pushing event deleted for resources: {'Port': ['ID=ba795333-49cf-42f2-8352-31bf18d084d4,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:50.614620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:50.624703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:50.624990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:50.634600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:50.637828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.639578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:50.640476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.652466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Releasing vlan 857 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:50.652954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.656775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=1bbfc996-6133-4441-8445-7f964e31d204,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:50.662848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:50.668538 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:50.671959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:50.680387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] No DVR routers for this DVR port ba795333-49cf-42f2-8352-31bf18d084d4 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:50.686809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:port and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:50.691898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:50.724835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:50.725229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 2a736275-7784-4a1a-8be5-0f1a93368c5f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:50.728079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.743411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b0c04d1e-d3f0-404b-9953-4e9ea244f29c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:50.749857 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.4018831 Nov 24 13:58:50.757722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40412) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:50.769341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:50.784169 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.784884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.787030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 3bb052da-aef1-4641-909d-dab80acc950b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:50.787342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.801477 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] Routers {'eff8244f-7b8f-486d-b7d4-46f1d8c7938c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:58:50.802149 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:58:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.814431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Provisioning for port 2a736275-7784-4a1a-8be5-0f1a93368c5f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:50.850182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9dcad83e-f22c-4fd3-a829-8404f547a278 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:50.886852 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:50.887659 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef043bb4-d380-48b1-bafe-15cf3002d99b None None] The sync data for ids ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:58:50.890968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:50.903728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 865} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:50.906553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.915272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Pushing event deleted for resources: {'Network': ['ID=9f28a011-66c8-49fb-8936-db5753ac9240,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:50.916634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Provisioning complete for port 2a736275-7784-4a1a-8be5-0f1a93368c5f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:50.917814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.930693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] The port '3bb052da-aef1-4641-909d-dab80acc950b' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:50.931824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:50.946433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:50.950467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:port and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:50.954437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:50.960648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:50.963293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:50.963639 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Added segment d61814b2-ff40-4418-a90c-b32f25c064e7 of type vlan for network f094f437-c839-458e-8d8b-9524c2d831ad Nov 24 13:58:51.012685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Made reservation on behalf of 8d1ebffadec64974b7bb8bd05493b745 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:51.016346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.035428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.053302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd2dd006-00e0-46e3-a925-f8843a43c6a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:51.054054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd2dd006-00e0-46e3-a925-f8843a43c6a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:51.064425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] device_id is not set on port dfdf302d-3f2a-4693-b5fd-a5bdd768147a yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:51.091871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] 10.222.0.70 "DELETE /v2.0/networks/9f28a011-66c8-49fb-8936-db5753ac9240 HTTP/1.1" status: 204 len: 168 time: 1.2437878 Nov 24 13:58:51.134527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.149601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd2dd006-00e0-46e3-a925-f8843a43c6a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:51.150752 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dd2dd006-00e0-46e3-a925-f8843a43c6a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A10f HTTP/1.1" status: 200 len: 928 time: 0.3920305 Nov 24 13:58:51.155675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40418) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:51.160686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b0c04d1e-d3f0-404b-9953-4e9ea244f29c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:51.161344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.200797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.204866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:51.205479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.219751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:51.262963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.271140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] For port 2a736275-7784-4a1a-8be5-0f1a93368c5f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2a736275-7784-4a1a-8be5-0f1a93368c5f,segment=NetworkSegment(d835348b-9d02-474a-b714-2386d2846663),segment_id=d835348b-9d02-474a-b714-2386d2846663)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:51.296120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c9fa6814-5f92-43d6-9db9-d60c19b25c66']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:51.313011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:51.313579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ee4a4129-fbe1-4beb-8e23-257ebb7425b1') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:51.320397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.327479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.350004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3fdf6b20-d447-447d-a588-ab0dbe957087 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:51.364094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.374451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 850 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:51.374846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:51.449374 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:51.483056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 1bbfc996-6133-4441-8445-7f964e31d204 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:51.483641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.532141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.539625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-291dab6f-ddac-492b-b1d6-8722ba318ba0 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:51.556964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Network': ['ID=f094f437-c839-458e-8d8b-9524c2d831ad,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:51.569233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:51.574685 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.0954452 Nov 24 13:58:51.580506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40424) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:51.581434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.586999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Pushing event updated for resources: {'Port': ['ID=2a736275-7784-4a1a-8be5-0f1a93368c5f,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:51.590349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:51.594806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c5b3d735-2c84-4b03-a3df-4adb971059cb None None] Provisioning for port 1bbfc996-6133-4441-8445-7f964e31d204 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:51.600188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network f094f437-c839-458e-8d8b-9524c2d831ad details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:51.600333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Allocated IP 172.20.0.13 (5fb5eabc-da3e-417c-a2c3-d7d4efa449ac/dc8904bf-b69b-4239-9ab9-681cccf0afac/dfdf302d-3f2a-4693-b5fd-a5bdd768147a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:51.610230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-616505140'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:51.623288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/c9fa6814-5f92-43d6-9db9-d60c19b25c66 HTTP/1.1" status: 204 len: 168 time: 2.8274798 Nov 24 13:58:51.623638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:51.638811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:network and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:51.640268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40428) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:51.643039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=c9fa6814-5f92-43d6-9db9-d60c19b25c66,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:51.644023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:51.651888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:51.705770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40432) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:51.707380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:51.712331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.739945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ba795333-49cf-42f2-8352-31bf18d084d4 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:51.757626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:51.760442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.787436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: ba795333-49cf-42f2-8352-31bf18d084d4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:51.787869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ba795333-49cf-42f2-8352-31bf18d084d4 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:51.788241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3bb052da-aef1-4641-909d-dab80acc950b no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:51.835160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c5b3d735-2c84-4b03-a3df-4adb971059cb None None] Provisioning complete for port 1bbfc996-6133-4441-8445-7f964e31d204 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:51.835543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c5b3d735-2c84-4b03-a3df-4adb971059cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:51.844787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] device_id is not set on port 1d12e37d-d49a-4e50-87c0-e430bbacfa05 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:51.869210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 3bb052da-aef1-4641-909d-dab80acc950b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:58:51.869590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3bb052da-aef1-4641-909d-dab80acc950b not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:58:51.900094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c5b3d735-2c84-4b03-a3df-4adb971059cb None None] Port 1bbfc996-6133-4441-8445-7f964e31d204 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:52.023586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.024342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-73e553d7-8435-4682-88db-9d67c2b9a6f8 None None] Provisioning complete for port 2a736275-7784-4a1a-8be5-0f1a93368c5f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:52.024755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-73e553d7-8435-4682-88db-9d67c2b9a6f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.029675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 875} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:52.074902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.075355 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Added segment 17aa258e-479f-4461-8fb0-38618861ace2 of type vlan for network 18f03f43-6de6-44d7-beab-ef9f5cdb4875 Nov 24 13:58:52.090741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.130744 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f2259626-ea38-4daf-8125-89d90769d6fc admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=de2c9dc2e19e46bf9064e80778f94c02&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4036210 Nov 24 13:58:52.131422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2a736275-7784-4a1a-8be5-0f1a93368c5f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:58:52.134343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Allocated IP 172.20.0.12 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/1d12e37d-d49a-4e50-87c0-e430bbacfa05) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:52.136190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40438) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:52.244809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2a736275-7784-4a1a-8be5-0f1a93368c5f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:52.245643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.256283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 1bbfc996-6133-4441-8445-7f964e31d204 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:52.286126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.306728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-73e553d7-8435-4682-88db-9d67c2b9a6f8 None None] Provisioning for port 0ca99164-2ff5-42fb-9a57-593e92cd372c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:52.326334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-73e553d7-8435-4682-88db-9d67c2b9a6f8 None None] Provisioning complete for port 0ca99164-2ff5-42fb-9a57-593e92cd372c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:52.326922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-73e553d7-8435-4682-88db-9d67c2b9a6f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.341566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['27d84f11-5c9d-4555-8c98-67f172766d45']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:52.366204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7616f88-fcf0-482c-9d78-68726f5f295b') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:52.366497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7616f88-fcf0-482c-9d78-68726f5f295b') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:58:52.404860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.429213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.437726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-73e553d7-8435-4682-88db-9d67c2b9a6f8 None None] Port 0ca99164-2ff5-42fb-9a57-593e92cd372c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:52.465181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.492944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.495056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.504787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 858 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:58:52.505172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.509793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Transition to ACTIVE for port object dfdf302d-3f2a-4693-b5fd-a5bdd768147a will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:52.525123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.529782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:52.530737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:58:52.531677 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:58:52.537451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:52.641195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.676280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.685797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:52.696026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Network': ['ID=18f03f43-6de6-44d7-beab-ef9f5cdb4875,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:52.698836 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 1.1143134 Nov 24 13:58:52.699703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:52.700514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.708595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40442) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:52.710983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 18f03f43-6de6-44d7-beab-ef9f5cdb4875 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:52.717721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'ports': [{'network_id': 'f094f437-c839-458e-8d8b-9524c2d831ad', 'name': 'tempest-port--144995708', 'admin_state_up': True}, {'network_id': '18f03f43-6de6-44d7-beab-ef9f5cdb4875', 'admin_state_up': False}]} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:52.718053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'port': {'network_id': 'f094f437-c839-458e-8d8b-9524c2d831ad', 'name': 'tempest-port--144995708', 'admin_state_up': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:52.718486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'port': {'network_id': '18f03f43-6de6-44d7-beab-ef9f5cdb4875', 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:52.721463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=27d84f11-5c9d-4555-8c98-67f172766d45,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:52.727641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:52.731578 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/27d84f11-5c9d-4555-8c98-67f172766d45 HTTP/1.1" status: 204 len: 168 time: 1.0900505 Nov 24 13:58:52.738096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.739683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40446) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:52.756861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.758410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:52.765110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5062d840-d4e7-4444-914f-7a5f282d2974 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:52.785750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0be39c0-0905-49dd-a6b1-fde85425b6f6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:52.789159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:52.790583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.791735 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d0be39c0-0905-49dd-a6b1-fde85425b6f6 HTTP/1.1" status: 204 len: 168 time: 0.6501997 Nov 24 13:58:52.799527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-1428384270'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:52.861338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:52.889989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:52.898646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.898865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.900384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:52.929412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:52.934311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Transition to ACTIVE for port object 1d12e37d-d49a-4e50-87c0-e430bbacfa05 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:52.956537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:52.964686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:52.964884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:52.968706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Port': ['ID=dfdf302d-3f2a-4693-b5fd-a5bdd768147a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:52.981449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c496b2f-f456-41f5-893e-a133cd9ba118 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:52.983989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:52.984681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:53.010725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dba5cc05-dcbd-45a2-a439-7f1c8a061dd3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.091s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:53.037794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:53.041682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:53.050307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:53.051827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:53.055475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.118156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=1d12e37d-d49a-4e50-87c0-e430bbacfa05,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:53.131647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:53.138411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=1bbfc996-6133-4441-8445-7f964e31d204,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:53.147821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:53.148466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.151624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:53.192619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 998 time: 2.7507410 Nov 24 13:58:53.195320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40454) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.306221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.308155 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/1bbfc996-6133-4441-8445-7f964e31d204 HTTP/1.1" status: 204 len: 168 time: 2.1514411 Nov 24 13:58:53.312105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40458) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.312636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40460) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.346973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79f89576-d00a-45a9-b399-a0bf719a5c9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:53.351220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79f89576-d00a-45a9-b399-a0bf719a5c9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:53.355540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79f89576-d00a-45a9-b399-a0bf719a5c9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:53.361336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-79f89576-d00a-45a9-b399-a0bf719a5c9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Synchronizing usage tracker for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:53.365653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 883} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:53.372599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:53.373487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.376318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f04c91f9-24b1-4fec-a263-a00de32fe6b9 None None] Provisioning for port dfdf302d-3f2a-4693-b5fd-a5bdd768147a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:53.382732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f04c91f9-24b1-4fec-a263-a00de32fe6b9 None None] Provisioning complete for port dfdf302d-3f2a-4693-b5fd-a5bdd768147a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:53.383201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f04c91f9-24b1-4fec-a263-a00de32fe6b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.387485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:53.398157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:port and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:53.403604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:53.428055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 2 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:53.431034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.431598 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment 8b5c5607-b717-44a7-aa93-a0adf92cd04d of type vlan for network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 Nov 24 13:58:53.446204 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.8737042 Nov 24 13:58:53.454629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40466) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.472309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:53.484705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:53.487246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'port': 2} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:53.491134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.494524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f04c91f9-24b1-4fec-a263-a00de32fe6b9 None None] Port dfdf302d-3f2a-4693-b5fd-a5bdd768147a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:53.507673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.511481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:floatingip and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:53.518044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:53.531139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:53.534026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.550444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-47c9c400-49cd-49fa-94f7-c344ed5b29b2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:58:53.554207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-47c9c400-49cd-49fa-94f7-c344ed5b29b2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/1bbfc996-6133-4441-8445-7f964e31d204 HTTP/1.1" status: 404 len: 333 time: 0.2352130 Nov 24 13:58:53.555167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40470) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.585411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.596696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-79f89576-d00a-45a9-b399-a0bf719a5c9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Unset dirty status for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:53.599089 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-79f89576-d00a-45a9-b399-a0bf719a5c9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2464 time: 0.4014671 Nov 24 13:58:53.602574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.605645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.606392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:53.607614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.617998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:53.619868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a2962034-87d3-4b90-9bca-c86eff675452 None None] Provisioning for port 1d12e37d-d49a-4e50-87c0-e430bbacfa05 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:53.626186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a2962034-87d3-4b90-9bca-c86eff675452 None None] Provisioning complete for port 1d12e37d-d49a-4e50-87c0-e430bbacfa05 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:53.626979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a2962034-87d3-4b90-9bca-c86eff675452 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.689992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a2962034-87d3-4b90-9bca-c86eff675452 None None] Port 1d12e37d-d49a-4e50-87c0-e430bbacfa05 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:53.693905 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a9d9d32a-7614-4142-9c87-7bf53d3b9ee4 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=424bd3bb154e422a92550d080fd26ca9&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3761530 Nov 24 13:58:53.696486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:53.696818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.706218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40478) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.745998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port 1d12e37d-d49a-4e50-87c0-e430bbacfa05 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:53.746330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:53.816550 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.0696082 Nov 24 13:58:53.825151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40482) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:53.827664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] device_id is not set on port eaa58211-9a55-4cf8-9539-9c1fda5e8acc yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:53.848972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=ff74eaa9-bb45-4cf5-93f7-684d6e9d8563,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:53.858035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:53.860768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:53.910704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:54.064768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.119671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:54.136164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:54.141834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:54.155356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:54.156074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.166637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.191803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.217783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:54.306415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.391645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:54.424414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for 1d12e37d-d49a-4e50-87c0-e430bbacfa05 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:54.518445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.631941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.656251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.661741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d1f064c-435b-48d8-9c43-cb94191b02cc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:54.676860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.687266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd223953-ee92-47ee-b691-612c7cd99308 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:54.690111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.707301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] device_id is not set on port 480d4045-e7d2-4ce3-9ac8-0f76919e9857 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:54.712424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Port': ['ID=1d12e37d-d49a-4e50-87c0-e430bbacfa05,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:54.717314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:54.718800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cb05f5ab-2c1c-44b9-814f-66a31824b8dc tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:54.775715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79c7c23b-3264-4b33-99f3-b700fbf86930,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:54.793325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:54.802107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=6f4f7052-8b24-49e9-be9c-6cfeb1ae7099,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:54.831112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:54.856500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.869251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:54.870372 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/79c7c23b-3264-4b33-99f3-b700fbf86930 HTTP/1.1" status: 204 len: 168 time: 1.1468856 Nov 24 13:58:54.972104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Allocated IP 172.26.4.13 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/4204d088-4133-46ed-8bb2-f49387e7d05c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:55.142965 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 HTTP/1.1" status: 204 len: 168 time: 1.5867929 Nov 24 13:58:55.146686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40488) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:55.199634 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d95c484-bc76-4694-a701-e7a9b6de933e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:58:55.200316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5d95c484-bc76-4694-a701-e7a9b6de933e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:55.250008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.256804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.258277 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/ports/1d12e37d-d49a-4e50-87c0-e430bbacfa05 HTTP/1.1" status: 204 len: 168 time: 1.6492569 Nov 24 13:58:55.259254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40494) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:55.264792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5d95c484-bc76-4694-a701-e7a9b6de933e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:55.266318 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5d95c484-bc76-4694-a701-e7a9b6de933e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/6f4f7052-8b24-49e9-be9c-6cfeb1ae7099 HTTP/1.1" status: 404 len: 333 time: 0.1187308 Nov 24 13:58:55.274949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40498) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:55.318720 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-7663a786-c3bd-43a7-a517-5c7eaa03f21b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] GET failed (client error): The resource could not be found. Nov 24 13:58:55.319428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7663a786-c3bd-43a7-a517-5c7eaa03f21b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Synchronizing usage tracker for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:55.336207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.340212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7663a786-c3bd-43a7-a517-5c7eaa03f21b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Unset dirty status for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:58:55.342268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7663a786-c3bd-43a7-a517-5c7eaa03f21b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "GET /v2.0/ports/1d12e37d-d49a-4e50-87c0-e430bbacfa05 HTTP/1.1" status: 404 len: 333 time: 0.0803554 Nov 24 13:58:55.346557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:55.346728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:55.353102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'name': 'tempest-AllowedAddressPairTestJSON-928384992'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:55.388677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.501144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:55.511586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:55.522696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:55.525692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.548987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=983c0237-d8a7-4fa1-9353-bb3decd0db62,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:55.550319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] device_id is not set on port 088a7aaf-fa46-4384-8a60-30de5f58f504 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:55.566406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:55.567573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.579426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2b19623e-c877-4ed5-bcd5-2237b31fef53 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:55.652976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': '8b5c5607-b717-44a7-aa93-a0adf92cd04d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:55.653334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: ff74eaa9-bb45-4cf5-93f7-684d6e9d8563, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:55.691056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.700128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Port': ['ID=eaa58211-9a55-4cf8-9539-9c1fda5e8acc,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:55.705221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:55.707282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Allocated IP 172.20.0.12 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/088a7aaf-fa46-4384-8a60-30de5f58f504) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:55.716887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0dfef806-7e3b-4393-b806-2debd58ca917 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.016s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:55.790748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 8f1d66b5-e969-4d53-8dcb-c22e468d4dbd {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:58:55.804183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.852060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:55.858630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:55.866795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:55.905253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Port': ['ID=4204d088-4133-46ed-8bb2-f49387e7d05c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:55.918602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:55.921948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:55.924142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Checking segment: {'id': 'd61814b2-ff40-4418-a90c-b32f25c064e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 865, 'network_id': 'f094f437-c839-458e-8d8b-9524c2d831ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:55.924497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network hostable DHCP agents. Network: f094f437-c839-458e-8d8b-9524c2d831ad, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:55.924742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.942779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.945349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Transition to ACTIVE for port object 088a7aaf-fa46-4384-8a60-30de5f58f504 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:55.970799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:55.976962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-abd021e4-5d50-4c92-a2e2-55b9d3295274 tempest-RoutersAdminTest-195760609 tempest-RoutersAdminTest-195760609-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:55.996615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ff74eaa9-bb45-4cf5-93f7-684d6e9d8563) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:56.007795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffbb283c-e674-46c8-9b7c-8a52b8ea890e None None] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:56.017453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:56.018043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.024869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40520) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:56.053309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:56.065229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:56.070299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:56.077973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network f094f437-c839-458e-8d8b-9524c2d831ad is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:56.090427 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.2519107 Nov 24 13:58:56.091168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, f094f437-c839-458e-8d8b-9524c2d831ad) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:56.095997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40526) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:56.104778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1441295826', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:56.110469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=088a7aaf-fa46-4384-8a60-30de5f58f504,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:56.111080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:56.111912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.115124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:56.119730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7cce030c-22b1-4056-b67d-74ea32d38ac0 tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:56.160579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:56.161790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.167179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:56.187261 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:56.204542 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.8561962 Nov 24 13:58:56.207106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40530) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:56.215702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:96:a0:72'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:56.224862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:56.230076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.244281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5875f10a-ac5b-47dc-ae4c-45af3c146af2 None None] Network f094f437-c839-458e-8d8b-9524c2d831ad requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:56.333585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:56.345157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-253000998'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:56.356904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:56.370503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:network and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:56.377106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:56.387741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:56.406968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.468196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:56.471230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.493137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.517477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ff74eaa9-bb45-4cf5-93f7-684d6e9d8563', 'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': '983c0237-d8a7-4fa1-9353-bb3decd0db62'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:58:56.518503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.536873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6436354a-f9c0-4fd5-8a34-24efdb8b1979 None None] Provisioning for port 088a7aaf-fa46-4384-8a60-30de5f58f504 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:56.548846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6436354a-f9c0-4fd5-8a34-24efdb8b1979 None None] Provisioning complete for port 088a7aaf-fa46-4384-8a60-30de5f58f504 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:56.549228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6436354a-f9c0-4fd5-8a34-24efdb8b1979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.579508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:56.586330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Port': ['ID=480d4045-e7d2-4ce3-9ac8-0f76919e9857,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:56.589121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.590169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.611601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.492s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:56.627748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:security_group_rule and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:56.635460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:56.645547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:56.659015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.672792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.707495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6436354a-f9c0-4fd5-8a34-24efdb8b1979 None None] Port 088a7aaf-fa46-4384-8a60-30de5f58f504 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:56.735608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Checking segment: {'id': '17aa258e-479f-4461-8fb0-38618861ace2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '18f03f43-6de6-44d7-beab-ef9f5cdb4875'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:56.736099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network hostable DHCP agents. Network: 18f03f43-6de6-44d7-beab-ef9f5cdb4875, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:56.768053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.776349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.787173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.793667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.800841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Allocated IP 172.20.0.2 (ff74eaa9-bb45-4cf5-93f7-684d6e9d8563/983c0237-d8a7-4fa1-9353-bb3decd0db62/348e08fb-e096-4972-827e-5e9a4dbbbe83) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:56.801287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.802756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:56.810029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.818762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.822917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:56.827410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 895} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:58:56.854749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d9d88955-7413-452e-af7c-12451011b19e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:56.858276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.858616 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Added segment 7f01240a-2983-4237-852e-c085968bc54f of type vlan for network 1c8e456a-762d-4344-9670-e5d3a55cd60d Nov 24 13:58:56.871427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=8f1d66b5-e969-4d53-8dcb-c22e468d4dbd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:56.878151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:56.889130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:56.892816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.893853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b8de5926-d077-4dac-864e-bf0b983b8e49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.067s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:56.895309 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/8f1d66b5-e969-4d53-8dcb-c22e468d4dbd HTTP/1.1" status: 204 len: 168 time: 1.6170495 Nov 24 13:58:56.906781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40536) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:56.907742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:56.912516 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3f0327bc-2c98-4d77-8173-52814a0e8dd3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.8155074 Nov 24 13:58:56.920720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-436046f7-4c92-4f9a-917b-3449e56454e9 None None] Network 05c770ce-6051-4d8b-8c2f-6b88c833f676 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:56.938502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40538) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:56.953817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network 18f03f43-6de6-44d7-beab-ef9f5cdb4875 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:56.968618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'port': {'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563', 'name': 'tempest-RoutersTest-1959309115'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:57.047804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 18f03f43-6de6-44d7-beab-ef9f5cdb4875) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:57.098151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] In _notify_port_updated(), no bound segment for port 088a7aaf-fa46-4384-8a60-30de5f58f504 on network 336d79b0-b678-4519-960c-1d6db0696693 {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:58:57.102910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:57.102910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.106344 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "PUT /v2.0/ports/088a7aaf-fa46-4384-8a60-30de5f58f504 HTTP/1.1" status: 200 len: 993 time: 0.8952849 Nov 24 13:58:57.111458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.117226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40544) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:57.126338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:57.131243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=088a7aaf-fa46-4384-8a60-30de5f58f504,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:57.134160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17a40aa0-6d4e-4b3c-9bd0-8e439a7bb14e None None] Network 18f03f43-6de6-44d7-beab-ef9f5cdb4875 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:57.140156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:57.145948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:57.146317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:57.147302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.168587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.180686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Transition to ACTIVE for port object 348e08fb-e096-4972-827e-5e9a4dbbbe83 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:57.204546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.215104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Transition to ACTIVE for port object 348e08fb-e096-4972-827e-5e9a4dbbbe83 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:57.217686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.222044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:57.222663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.230932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-626c1bff-750b-401e-b8c1-dd33c617200a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:57.276439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.278037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:57.290551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:57.298664 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1449 time: 4.5889096 Nov 24 13:58:57.306621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40548) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:57.317229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port 088a7aaf-fa46-4384-8a60-30de5f58f504 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:57.317655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.333104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-785928ae-ee89-4fff-bab8-a42016e05301 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:57.351772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 797 time: 1.3225234 Nov 24 13:58:57.352452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40552) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:57.357986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:57.361600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.361851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port b0c04d1e-d3f0-404b-9953-4e9ea244f29c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:57.362185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.405097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'subnet': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:57.499896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:58:57.564825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Pushing event updated for resources: {'Port': ['ID=348e08fb-e096-4972-827e-5e9a4dbbbe83,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:57.568991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] device_id is not set on port 06a84519-98cc-4ef0-a9ac-10737da649aa yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:58:57.590893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:57.597190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:57.604173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:57.608756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Network': ['ID=1c8e456a-762d-4344-9670-e5d3a55cd60d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:57.609008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.609970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:57.611498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.381s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:57.627325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b10a09f2-09fd-4cbe-a44f-9d41ab44354b None None] Provisioning complete for port 088a7aaf-fa46-4384-8a60-30de5f58f504 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:58:57.628388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b10a09f2-09fd-4cbe-a44f-9d41ab44354b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.643668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.652821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:57.664315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:58:57.734742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b227fcef-54fc-4ad9-aea1-3133166bd69b tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:57.737330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:58:57.739168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b227fcef-54fc-4ad9-aea1-3133166bd69b tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:57.743206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b227fcef-54fc-4ad9-aea1-3133166bd69b tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1444 time: 0.4331355 Nov 24 13:58:57.749130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40556) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:57.781056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:subnet and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:58:57.797656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:58:57.826932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Deleting port eaa58211-9a55-4cf8-9539-9c1fda5e8acc {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:57.826932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.865857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.20.0.7 (ff74eaa9-bb45-4cf5-93f7-684d6e9d8563/983c0237-d8a7-4fa1-9353-bb3decd0db62/06a84519-98cc-4ef0-a9ac-10737da649aa) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:58:57.872772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b10a09f2-09fd-4cbe-a44f-9d41ab44354b None None] Port 088a7aaf-fa46-4384-8a60-30de5f58f504 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:58:57.888932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Attempting to bind port 348e08fb-e096-4972-827e-5e9a4dbbbe83 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:58:57.889300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Attempting to bind port 348e08fb-e096-4972-827e-5e9a4dbbbe83 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '8b5c5607-b717-44a7-aa93-a0adf92cd04d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:58:57.889659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Attempting to bind port 348e08fb-e096-4972-827e-5e9a4dbbbe83 on network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:58:57.911295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:58:57.911676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Checking segment: {'id': '8b5c5607-b717-44a7-aa93-a0adf92cd04d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:57.912101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.912497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Bound using segment: {'id': '8b5c5607-b717-44a7-aa93-a0adf92cd04d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:58:57.912964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Bound port: 348e08fb-e096-4972-827e-5e9a4dbbbe83, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b5c5607-b717-44a7-aa93-a0adf92cd04d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': 'ff74eaa9-bb45-4cf5-93f7-684d6e9d8563'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:58:57.913423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:57.928697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Port': ['ID=4204d088-4133-46ed-8bb2-f49387e7d05c,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:57.945194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:58:57.956127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:57.988059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] DHCP port deletion for 05c770ce-6051-4d8b-8c2f-6b88c833f676 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:58:57.997158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Deleting port b0c04d1e-d3f0-404b-9953-4e9ea244f29c {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:57.997952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.009817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:58:58.055121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port b0c04d1e-d3f0-404b-9953-4e9ea244f29c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,segment=NetworkSegment(6cce861c-bd3c-45a4-ac1f-b455b0845cd5),segment_id=6cce861c-bd3c-45a4-ac1f-b455b0845cd5)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:58.055477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.069192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.086031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] For port 348e08fb-e096-4972-827e-5e9a4dbbbe83, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:58:58.245182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] For port b0c04d1e-d3f0-404b-9953-4e9ea244f29c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,segment=NetworkSegment(6cce861c-bd3c-45a4-ac1f-b455b0845cd5),segment_id=6cce861c-bd3c-45a4-ac1f-b455b0845cd5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:58:58.245801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.309450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b0c04d1e-d3f0-404b-9953-4e9ea244f29c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:58:58.317726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.328215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.403262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.408306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Calling delete_port for b0c04d1e-d3f0-404b-9953-4e9ea244f29c owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:58.419340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for b0c04d1e-d3f0-404b-9953-4e9ea244f29c owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:58.445275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] For port 348e08fb-e096-4972-827e-5e9a4dbbbe83, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=348e08fb-e096-4972-827e-5e9a4dbbbe83,segment=NetworkSegment(8b5c5607-b717-44a7-aa93-a0adf92cd04d),segment_id=8b5c5607-b717-44a7-aa93-a0adf92cd04d)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:58:58.458441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.462577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 06a84519-98cc-4ef0-a9ac-10737da649aa will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:58:58.470595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Calling delete_port for eaa58211-9a55-4cf8-9539-9c1fda5e8acc owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:58.475353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:58.511280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.567114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.573333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b6a2a33a-5f89-4283-81b6-8221ff565e68 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:58.588433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.589958 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.1341624 Nov 24 13:58:58.599679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Pushing event updated for resources: {'Port': ['ID=348e08fb-e096-4972-827e-5e9a4dbbbe83,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:58.603618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for 088a7aaf-fa46-4384-8a60-30de5f58f504 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:58:58.614814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40562) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:58.628889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b0885b37-fac5-4e7c-aefe-997df1acfbdc tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'floatingip': {'port_id': 'dfdf302d-3f2a-4693-b5fd-a5bdd768147a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:58:58.643801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:58.658005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.664029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port b0c04d1e-d3f0-404b-9953-4e9ea244f29c update to DOWN by agent not found {{(pid=83527) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2088}} Nov 24 13:58:58.666531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:58.723273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Pushing event deleted for resources: {'Port': ['ID=b0c04d1e-d3f0-404b-9953-4e9ea244f29c,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:58.726747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:58.729879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] No DVR routers for this DVR port b0c04d1e-d3f0-404b-9953-4e9ea244f29c on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:58:58.736389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.762527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:58:58.768208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:58:58.770699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:58:58.802701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b0885b37-fac5-4e7c-aefe-997df1acfbdc tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.809747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:58:58.810502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:58:58.879590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=06a84519-98cc-4ef0-a9ac-10737da649aa,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:58.892746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:58.910861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-32ebcf54-6deb-433c-9d09-01d236f26db2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:58.969524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:58.978434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54cfcf6-2cee-4992-9ef6-78fac9a194d2 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:58.996236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.007516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Port': ['ID=eaa58211-9a55-4cf8-9539-9c1fda5e8acc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:59.009901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:59.031106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/ports/eaa58211-9a55-4cf8-9539-9c1fda5e8acc HTTP/1.1" status: 204 len: 168 time: 1.2823200 Nov 24 13:58:59.034370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Port': ['ID=088a7aaf-fa46-4384-8a60-30de5f58f504,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:59.039030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:58:59.039663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.043942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40568) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:59.048052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:59.086636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.096522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-201e2626-8f83-4d72-83af-f11a0330c392 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:58:59.103779 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 2.1642146 Nov 24 13:58:59.109510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40572) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:59.282208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Deleting port 480d4045-e7d2-4ce3-9ac8-0f76919e9857 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:59.282719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.318101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Subnet': ['ID=51009db1-2b8a-4b29-afa1-2b1aba84cd14,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:58:59.319817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port b0c04d1e-d3f0-404b-9953-4e9ea244f29c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:59.320733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.359332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:58:59.383372 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-b0885b37-fac5-4e7c-aefe-997df1acfbdc tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] update failed (client error): The resource could not be found. Nov 24 13:58:59.387418 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b0885b37-fac5-4e7c-aefe-997df1acfbdc tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "PUT /v2.0/floatingips/edb55340-c34b-4820-832d-09f60bffd3a7 HTTP/1.1" status: 404 len: 507 time: 0.7710786 Nov 24 13:58:59.388799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40578) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:59.508185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] The port 'b0c04d1e-d3f0-404b-9953-4e9ea244f29c' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:58:59.541519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Checking segment: {'id': '7f01240a-2983-4237-852e-c085968bc54f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:58:59.541886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network hostable DHCP agents. Network: 1c8e456a-762d-4344-9670-e5d3a55cd60d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:58:59.647444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.697248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Deleting port 4204d088-4133-46ed-8bb2-f49387e7d05c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:58:59.697577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.804607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bfea0f6-2f85-49d9-b5f5-654030d6116a None None] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:58:59.818182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.842822 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/ports/088a7aaf-fa46-4384-8a60-30de5f58f504 HTTP/1.1" status: 204 len: 168 time: 2.7222855 Nov 24 13:58:59.850331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:58:59.850788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:58:59.907683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ff1f3fba-6dd1-4985-aa16-610e7c876bb5 None None] Provisioning for port 348e08fb-e096-4972-827e-5e9a4dbbbe83 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:58:59.928596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:58:59.947147 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a80c2c84-6c2b-481e-84be-5397901e213a tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] GET failed (client error): The resource could not be found. Nov 24 13:58:59.947694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a80c2c84-6c2b-481e-84be-5397901e213a tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Synchronizing usage tracker for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:58:59.952897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['05c770ce-6051-4d8b-8c2f-6b88c833f676']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:00.018282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.018606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.150251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 1c8e456a-762d-4344-9670-e5d3a55cd60d) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:00.159132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75a0782f-7a5a-4567-936d-60daeb16971c None None] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:00.190333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Calling delete_port for 4204d088-4133-46ed-8bb2-f49387e7d05c owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:00.234554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6cce861c-bd3c-45a4-ac1f-b455b0845cd5') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:00.234820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6cce861c-bd3c-45a4-ac1f-b455b0845cd5') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:00.256679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Calling delete_port for 480d4045-e7d2-4ce3-9ac8-0f76919e9857 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:00.346707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:00.347972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.361802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a80c2c84-6c2b-481e-84be-5397901e213a tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Unset dirty status for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:00.363743 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a80c2c84-6c2b-481e-84be-5397901e213a tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "GET /v2.0/ports/088a7aaf-fa46-4384-8a60-30de5f58f504 HTTP/1.1" status: 404 len: 333 time: 0.5105820 Nov 24 13:59:00.368420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40588) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:00.374936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.383258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'name': 'tempest-AllowedAddressPairTestJSON-1105947413'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:00.424741 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.0641294 Nov 24 13:59:00.426070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40592) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:00.428978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.432554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 348e08fb-e096-4972-827e-5e9a4dbbbe83 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:00.466000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1785026945'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:00.486887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 872 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:00.487652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.493347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:00.519331 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:00.576953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Provisioning for port 06a84519-98cc-4ef0-a9ac-10737da649aa completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:00.588432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Provisioning complete for port 06a84519-98cc-4ef0-a9ac-10737da649aa triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:00.589132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.605135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.612439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec59a2d5-5f71-4301-b3c8-030fd9650ee1 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:00.622263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-1c8e456a-762d-4344-9670-e5d3a55cd60d', 'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'tenant_id': 'bf4eb15856244358b02c2c7e03cc6aad', 'fixed_ips': [{'subnet_id': '51009db1-2b8a-4b29-afa1-2b1aba84cd14'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:00.623890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.661105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.670365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Port 06a84519-98cc-4ef0-a9ac-10737da649aa cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:00.675896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e72bee8-f912-4c07-9d8c-2b7808e23162 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:00.676301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 348e08fb-e096-4972-827e-5e9a4dbbbe83 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:00.732220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 348e08fb-e096-4972-827e-5e9a4dbbbe83 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:00.732652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.741899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Port': ['ID=480d4045-e7d2-4ce3-9ac8-0f76919e9857,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:00.744379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:00.749287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.753344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.766301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.782989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:00.808326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Provisioning complete for port 348e08fb-e096-4972-827e-5e9a4dbbbe83 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:00.808925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.823289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Port': ['ID=4204d088-4133-46ed-8bb2-f49387e7d05c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:00.837394 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/05c770ce-6051-4d8b-8c2f-6b88c833f676 HTTP/1.1" status: 204 len: 168 time: 3.9176729 Nov 24 13:59:00.837394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=05c770ce-6051-4d8b-8c2f-6b88c833f676,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:00.845735 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/ports/480d4045-e7d2-4ce3-9ac8-0f76919e9857 HTTP/1.1" status: 204 len: 168 time: 1.8003836 Nov 24 13:59:00.846560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40596) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:00.850326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:00.853522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.854194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.854479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:00.854947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.855406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.855932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.856388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.857432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.857886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.858336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.858955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.859436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:00.860789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-633459426'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:00.879532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:00.905240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:00.914695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:00.917841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1e7fca8c-727f-4e58-9671-4373308078cf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Synchronizing usage tracker for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:00.921037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:00.925792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:00.929297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:port and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:00.936078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Allocated IP 2001:db8::2 (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/f72a7729-96f9-4002-8f07-de2621d1e126) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:00.936705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:00.940543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:00.954167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:00.964775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1e7fca8c-727f-4e58-9671-4373308078cf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Unset dirty status for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:00.967647 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1e7fca8c-727f-4e58-9671-4373308078cf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.1106703 Nov 24 13:59:00.968482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:00.972102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.983705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40604) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:00.991204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:00.995066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:00.999373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:01.009094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-796512218'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:01.025306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:01.033307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:network and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:01.037078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:01.047520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:01.049858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] device_id is not set on port 810f5737-7579-4f6d-8560-ed366b895529 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:01.101281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 874} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:01.102985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:01.118894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:01.121861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.132477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.146887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.152945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.153294 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 396a008a-bb6e-46b7-a1bf-cb54122e8c61 of type vlan for network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b Nov 24 13:59:01.160164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:01.163202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.202448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.204935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:01.219686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.220044 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Added segment 885eeab2-0313-4030-8a5c-6e8afa5fd81a of type vlan for network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d Nov 24 13:59:01.241566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.243776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 348e08fb-e096-4972-827e-5e9a4dbbbe83, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=348e08fb-e096-4972-827e-5e9a4dbbbe83,segment=NetworkSegment(8b5c5607-b717-44a7-aa93-a0adf92cd04d),segment_id=8b5c5607-b717-44a7-aa93-a0adf92cd04d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:01.256744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.259267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] device_id is not set on port c1c6148e-979d-44d5-9880-f440dd760abb yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:01.261680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-20854573-3d51-4e48-9f43-15a6d266a037 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:01.275156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.280175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:01.280713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.287738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8261a31b-30d1-4a96-b119-943beb621382 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:01.320593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.321325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.322637 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "DELETE /v2.0/floatingips/edb55340-c34b-4820-832d-09f60bffd3a7 HTTP/1.1" status: 204 len: 168 time: 1.9329414 Nov 24 13:59:01.334144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40608) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:01.379506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'floatingip': {'floating_network_id': '5fb5eabc-da3e-417c-a2c3-d7d4efa449ac', 'port_id': 'dfdf302d-3f2a-4693-b5fd-a5bdd768147a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:01.397094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:01.410462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:floatingip and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:01.417396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:01.423096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=bc8378de-2042-4bb7-8c0b-2cd387a2aa6b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:01.426096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:01.438292 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.5869129 Nov 24 13:59:01.442345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40612) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:01.448600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:01.448959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-ce744e8d-d936-47cc-a916-30c9330fc599 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:01.449782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:01.451953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:01.462906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:01.473348 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.482778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=348e08fb-e096-4972-827e-5e9a4dbbbe83,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:01.492380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:01.504998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.526466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.536391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Transition to ACTIVE for port object f72a7729-96f9-4002-8f07-de2621d1e126 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:01.536630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.545682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3b50389-b0ed-46f1-b57b-f3bfca2776ab tempest-RoutersAdminNegativeIpV6Test-524099243 tempest-RoutersAdminNegativeIpV6Test-524099243-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:01.553067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.556990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:01.557785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.566494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-666a1913-fbba-4680-8d5c-407dc053730f tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:01.579431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Allocated IP 172.20.0.7 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/c1c6148e-979d-44d5-9880-f440dd760abb) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:01.585871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Transition to ACTIVE for port object f72a7729-96f9-4002-8f07-de2621d1e126 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:01.596376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.601725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:01.665646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:01.669034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:01.679590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:01.725974 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.7388101 Nov 24 13:59:01.735708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:01.738080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40616) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:01.743225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Pushing event updated for resources: {'Port': ['ID=f72a7729-96f9-4002-8f07-de2621d1e126,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:01.745917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=06a84519-98cc-4ef0-a9ac-10737da649aa,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:01.753553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:01.759150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1962640997'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:01.763401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Network': ['ID=ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:01.766095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:01.770368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:01.775225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:01.778282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:01.782396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:01.790693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:network and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:01.798320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:01.799685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:01.811835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:01.814840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Allocated IP 2001:db8::15f (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/810f5737-7579-4f6d-8560-ed366b895529) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:01.824248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:01.851927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Attempting to bind port f72a7729-96f9-4002-8f07-de2621d1e126 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:01.852564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Attempting to bind port f72a7729-96f9-4002-8f07-de2621d1e126 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '7f01240a-2983-4237-852e-c085968bc54f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:01.852762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Attempting to bind port f72a7729-96f9-4002-8f07-de2621d1e126 on network 1c8e456a-762d-4344-9670-e5d3a55cd60d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:01.866263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:01.880325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:01.883285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.939680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 58, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:01.940150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Checking segment: {'id': '7f01240a-2983-4237-852e-c085968bc54f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:01.940482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:01.940882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Bound using segment: {'id': '7f01240a-2983-4237-852e-c085968bc54f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:01.941365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Bound port: f72a7729-96f9-4002-8f07-de2621d1e126, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7f01240a-2983-4237-852e-c085968bc54f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:01.941746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.036181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:02.063473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.103557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] For port f72a7729-96f9-4002-8f07-de2621d1e126, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:02.106938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] For port f72a7729-96f9-4002-8f07-de2621d1e126, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f72a7729-96f9-4002-8f07-de2621d1e126,segment=NetworkSegment(7f01240a-2983-4237-852e-c085968bc54f),segment_id=7f01240a-2983-4237-852e-c085968bc54f)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:02.124485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.128484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.128834 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Added segment 04a41245-90a5-417c-9b5e-da355a3a494e of type vlan for network 8e992287-9a67-4a60-a7e0-52e5565b5c63 Nov 24 13:59:02.158717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.191441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:02.257296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Transition to ACTIVE for port object c1c6148e-979d-44d5-9880-f440dd760abb will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:02.259879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 348e08fb-e096-4972-827e-5e9a4dbbbe83 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:02.292262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.301269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Pushing event updated for resources: {'Port': ['ID=f72a7729-96f9-4002-8f07-de2621d1e126,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:02.306121 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:59:02.307824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6e616c3-d971-4225-ac1e-b7e15f9f1119 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 0.9718466 Nov 24 13:59:02.309569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.312359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:02.313404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40620) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:02.323298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2e1b6bf1-185f-4b97-a35b-617b293c91b4 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:02.366242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 348e08fb-e096-4972-827e-5e9a4dbbbe83 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:02.367041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.380790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.431167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'dfdf302d-3f2a-4693-b5fd-a5bdd768147a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:02.442052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:02.447707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Usage tracker for resource:floatingip and tenant:8d1ebffadec64974b7bb8bd05493b745 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:02.451703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:02.455875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-141cc364-f2d6-42c2-a4c3-9f4d9882336c None None] Provisioning complete for port 06a84519-98cc-4ef0-a9ac-10737da649aa triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:02.456301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-141cc364-f2d6-42c2-a4c3-9f4d9882336c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.458839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:02.477597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=c1c6148e-979d-44d5-9880-f440dd760abb,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:02.489319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.496986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.501941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:02.502644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.510548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:02.540607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:02.555047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.567149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Transition to ACTIVE for port object 810f5737-7579-4f6d-8560-ed366b895529 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:02.604450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-141cc364-f2d6-42c2-a4c3-9f4d9882336c None None] Port 06a84519-98cc-4ef0-a9ac-10737da649aa cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:02.641759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.657811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:02.663083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:02.667533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:02.706596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Network': ['ID=8e992287-9a67-4a60-a7e0-52e5565b5c63,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:02.709816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:02.716717 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.9745853 Nov 24 13:59:02.722755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 8e992287-9a67-4a60-a7e0-52e5565b5c63 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:02.813374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.822148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-35248eb1-9fb7-4d60-b022-d6c6abd763ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:02.866231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.922526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:02.926794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:02.929408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:02.933861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:02.934584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:02.991968 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 2.5524430 Nov 24 13:59:02.992839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40624) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:03.001411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=810f5737-7579-4f6d-8560-ed366b895529,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:03.004462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:03.008378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1330724584', 'allowed_address_pairs': [{'ip_address': '2001:db8::15f', 'mac_address': 'fa:16:3e:df:b7:c3'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:03.025604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-679fe574-93b7-4d67-8e47-0325809fc604 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.150s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:03.037349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-67f0b010-69cf-4798-a7ef-ec0b870cf174 None None] Provisioning for port c1c6148e-979d-44d5-9880-f440dd760abb completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:03.052843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-67f0b010-69cf-4798-a7ef-ec0b870cf174 None None] Provisioning complete for port c1c6148e-979d-44d5-9880-f440dd760abb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:03.053558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-67f0b010-69cf-4798-a7ef-ec0b870cf174 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.083976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '396a008a-bb6e-46b7-a1bf-cb54122e8c61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:03.084347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: bc8378de-2042-4bb7-8c0b-2cd387a2aa6b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:03.119821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:03.120526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.150166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-184400a6-d029-4bb5-b091-f76456ec5afa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.161211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-67f0b010-69cf-4798-a7ef-ec0b870cf174 None None] Port c1c6148e-979d-44d5-9880-f440dd760abb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:03.195336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=af993afa-a669-418f-9f70-aaa8fa208134,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:03.204478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:03.211093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.211411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.212064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.212429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.212791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.213204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.213564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.214117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.214297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.214613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.214966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:03.219072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:03.240374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, bc8378de-2042-4bb7-8c0b-2cd387a2aa6b) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:03.244812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:03.245603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.250870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd11171b-19ce-4728-8fb9-e4bc060e16a8 None None] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:03.293201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:03.299421 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8555226 Nov 24 13:59:03.303156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:port and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:03.306152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:03.308956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:03.315188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b', 'name': 'tempest-PortsIpV6TestJSON-1792407957', 'fixed_ips': [{'subnet_id': 'af993afa-a669-418f-9f70-aaa8fa208134', 'ip_address': '2001:db8::10'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:03.440239 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 3.0680261 Nov 24 13:59:03.454526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40632) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:03.471922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:96:a0:72'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:03.474468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:03.476754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:03.485178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:03.489925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:03.499093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:03.504953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.524189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:03.531613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] device_id is not set on port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:03.640191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.703940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Allocated IP 2001:db8::2a8 (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/37ba6e35-5b5e-41c8-86fb-f8b1207895a6) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:03.742833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-bc8378de-2042-4bb7-8c0b-2cd387a2aa6b', 'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': 'af993afa-a669-418f-9f70-aaa8fa208134'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:03.744327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.821559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9836d7b8-953b-4ba8-bcfa-45aeaee8274f None None] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:03.839779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.960150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:03.983329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Transition to ACTIVE for port object 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:03.988364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Allocated IP 172.26.4.80 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/9c203860-3bb6-4d6f-b219-4e69de55ab4c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:03.999872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-278995c5-af9a-4eb1-ae81-ec4678fccf37 None None] Provisioning for port f72a7729-96f9-4002-8f07-de2621d1e126 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:04.017361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:04.028212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.081155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 9fca2117-615b-4712-ad6f-e8835fc14f3c yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:04.081315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Allocated IP 2001:db8::2 (bc8378de-2042-4bb7-8c0b-2cd387a2aa6b/af993afa-a669-418f-9f70-aaa8fa208134/31380672-651e-4b33-b8c2-1af2c15cda36) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:04.192740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.230012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:04.336929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:04.347360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=37ba6e35-5b5e-41c8-86fb-f8b1207895a6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:04.361880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:04.362943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:04.365531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:04.370147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f72a7729-96f9-4002-8f07-de2621d1e126 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:04.371397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:04.372935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.422857 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1008 time: 1.4236834 Nov 24 13:59:04.424006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40638) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:04.425376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.462175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:59:04.479966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.492889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.500625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ab8b40ca-bc1f-4ae9-90c8-3d7990a352ae tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:04.524063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.533088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.549951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Transition to ACTIVE for port object 31380672-651e-4b33-b8c2-1af2c15cda36 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:04.558281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f72a7729-96f9-4002-8f07-de2621d1e126 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:04.568280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f72a7729-96f9-4002-8f07-de2621d1e126 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:04.568799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.589642 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:59:04.620448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c7c479e-41a9-4c53-aa52-95aeffcfdbc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:04.628435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.629446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c7c479e-41a9-4c53-aa52-95aeffcfdbc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:04.635173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c7c479e-41a9-4c53-aa52-95aeffcfdbc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:04.636471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1c7c479e-41a9-4c53-aa52-95aeffcfdbc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Synchronizing usage tracker for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:04.661436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1c7c479e-41a9-4c53-aa52-95aeffcfdbc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Unset dirty status for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:04.666384 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1c7c479e-41a9-4c53-aa52-95aeffcfdbc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2482 time: 0.2369680 Nov 24 13:59:04.667639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40642) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:04.672516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Transition to ACTIVE for port object 31380672-651e-4b33-b8c2-1af2c15cda36 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:04.680346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.696421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.702505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8a3a623f-584e-4b02-b0c0-28d312859bee None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:04.753189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:04.753880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.766767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Pushing event updated for resources: {'Port': ['ID=31380672-651e-4b33-b8c2-1af2c15cda36,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:04.775009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:04.848352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.912247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:04.916068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:04.921880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:04.945255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f72a7729-96f9-4002-8f07-de2621d1e126, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f72a7729-96f9-4002-8f07-de2621d1e126,segment=NetworkSegment(7f01240a-2983-4237-852e-c085968bc54f),segment_id=7f01240a-2983-4237-852e-c085968bc54f)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:04.981281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:04.992933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:05.012219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.018314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:05.019143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:05.028096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.050747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:05.072930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::10 (bc8378de-2042-4bb7-8c0b-2cd387a2aa6b/af993afa-a669-418f-9f70-aaa8fa208134/9fca2117-615b-4712-ad6f-e8835fc14f3c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:05.096647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event updated for resources: {'Port': ['ID=9c203860-3bb6-4d6f-b219-4e69de55ab4c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:05.207856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f72a7729-96f9-4002-8f07-de2621d1e126,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:05.266773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.267598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.268229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.268762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.269453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.269998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.270580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.271129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.271647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.272326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.272844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 13:59:05.294091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:05.299879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Attempting to bind port 31380672-651e-4b33-b8c2-1af2c15cda36 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:05.300544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Attempting to bind port 31380672-651e-4b33-b8c2-1af2c15cda36 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '396a008a-bb6e-46b7-a1bf-cb54122e8c61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:05.301123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Attempting to bind port 31380672-651e-4b33-b8c2-1af2c15cda36 on network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:05.310058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:05.310876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Checking segment: {'id': '396a008a-bb6e-46b7-a1bf-cb54122e8c61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:05.311616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.312536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Bound using segment: {'id': '396a008a-bb6e-46b7-a1bf-cb54122e8c61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:05.313255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Bound port: 31380672-651e-4b33-b8c2-1af2c15cda36, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '396a008a-bb6e-46b7-a1bf-cb54122e8c61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:05.313854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.428952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Provisioning for port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:05.461379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Provisioning complete for port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:05.462431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.510617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.010s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:05.553417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.925s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:05.574188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] For port 31380672-651e-4b33-b8c2-1af2c15cda36, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:05.583794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:05.588855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] For port 31380672-651e-4b33-b8c2-1af2c15cda36, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=31380672-651e-4b33-b8c2-1af2c15cda36,segment=NetworkSegment(396a008a-bb6e-46b7-a1bf-cb54122e8c61),segment_id=396a008a-bb6e-46b7-a1bf-cb54122e8c61)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:05.598586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.603751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dc488b08-22b6-4f32-a017-72116489eb7d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:05.607310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.718455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Provisioning for port 810f5737-7579-4f6d-8560-ed366b895529 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:05.776404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cc00c5b-b613-4ee9-bc90-33910f8b2943 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.780980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Provisioning complete for port 810f5737-7579-4f6d-8560-ed366b895529 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:05.795114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.835417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] In _notify_port_updated(), no bound segment for port c1c6148e-979d-44d5-9880-f440dd760abb on network 336d79b0-b678-4519-960c-1d6db0696693 {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:59:05.837413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:05.840378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:05.841519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:05.846905 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "PUT /v2.0/ports/c1c6148e-979d-44d5-9880-f440dd760abb HTTP/1.1" status: 200 len: 996 time: 2.3884656 Nov 24 13:59:05.850951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40646) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:05.907020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Pushing event updated for resources: {'Port': ['ID=31380672-651e-4b33-b8c2-1af2c15cda36,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:05.910172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Port 810f5737-7579-4f6d-8560-ed366b895529 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:05.914087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.310s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:05.941859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=06a84519-98cc-4ef0-a9ac-10737da649aa,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:05.961016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Provisioning complete for port f72a7729-96f9-4002-8f07-de2621d1e126 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:05.962383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c31e882c-65ff-450b-a1cb-cad4c141f6b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.233264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f72a7729-96f9-4002-8f07-de2621d1e126 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:06.243562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40650) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:06.278062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.295343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'subnets': [{'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1106988903', 'ip_version': 6}, {'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:06.296128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'subnet': {'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1106988903', 'ip_version': 6}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:06.297458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Request body: {'subnet': {'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:06.302322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 9fca2117-615b-4712-ad6f-e8835fc14f3c will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:06.339500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.349406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d8308d-54d9-4896-9527-ea4be1d394e0 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:06.368187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f72a7729-96f9-4002-8f07-de2621d1e126 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:06.368686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.372174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Deleting port 9c203860-3bb6-4d6f-b219-4e69de55ab4c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:06.372772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.405970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:06.475124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:06.479120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:06.486483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:06.492209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:06.496212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:06.496823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.505208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=c1c6148e-979d-44d5-9880-f440dd760abb,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:06.506361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=9fca2117-615b-4712-ad6f-e8835fc14f3c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:06.514135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:06.517760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.525685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c168b865-4508-42e6-beb9-c498cbad4139 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:06.532287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Provisioning complete for port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:06.533706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.569497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Port 37ba6e35-5b5e-41c8-86fb-f8b1207895a6 was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 13:59:06.569763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:06.575805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.493s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:06.576098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=37ba6e35-5b5e-41c8-86fb-f8b1207895a6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:06.576321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:06.578502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port c1c6148e-979d-44d5-9880-f440dd760abb {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:06.578843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.580151 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 3.2727497 Nov 24 13:59:06.581621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:06.583638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40654) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:06.586511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Provisioning complete for port 810f5737-7579-4f6d-8560-ed366b895529 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:06.587275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.625599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': 'bc8378de-2042-4bb7-8c0b-2cd387a2aa6b', 'name': 'tempest-PortsIpV6TestJSON-1097990595', 'fixed_ips': [{'subnet_id': 'af993afa-a669-418f-9f70-aaa8fa208134', 'ip_address': '2001:db8::f'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:06.655313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Port 810f5737-7579-4f6d-8560-ed366b895529 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:06.669983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.679923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Provisioning complete for port c1c6148e-979d-44d5-9880-f440dd760abb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:06.680583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.750929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-038cfbc2-f872-4766-9494-cc25c09f7ec7 None None] Port c1c6148e-979d-44d5-9880-f440dd760abb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:06.874269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.879242 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/ports/37ba6e35-5b5e-41c8-86fb-f8b1207895a6 HTTP/1.1" status: 204 len: 168 time: 2.2072918 Nov 24 13:59:06.880252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40658) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:06.940066 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f95a1f8f-6bff-4281-9b04-ed7f6c0433c3 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] GET failed (client error): The resource could not be found. Nov 24 13:59:06.940720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f95a1f8f-6bff-4281-9b04-ed7f6c0433c3 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Synchronizing usage tracker for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:06.943546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.943930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:06.951347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:06.959222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:06.963434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:06.970115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:06.979427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f95a1f8f-6bff-4281-9b04-ed7f6c0433c3 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Unset dirty status for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:06.980480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f95a1f8f-6bff-4281-9b04-ed7f6c0433c3 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "GET /v2.0/ports/37ba6e35-5b5e-41c8-86fb-f8b1207895a6 HTTP/1.1" status: 404 len: 333 time: 0.0999441 Nov 24 13:59:06.984795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40662) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:06.990950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1902182829'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:07.013686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:07.019164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:07.080151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-499b5cf5-896a-4b4c-b8ad-98e01440d51b None None] Provisioning complete for port 06a84519-98cc-4ef0-a9ac-10737da649aa triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:07.080482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-499b5cf5-896a-4b4c-b8ad-98e01440d51b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:07.112289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port a03b88b1-5bc8-467b-b93c-f85a68eb0642 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:07.145095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-499b5cf5-896a-4b4c-b8ad-98e01440d51b None None] Port 06a84519-98cc-4ef0-a9ac-10737da649aa cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:07.203867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Calling delete_port for 9c203860-3bb6-4d6f-b219-4e69de55ab4c owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:07.282879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:07.287619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:07.307076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:07.342243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6f63425-9bd7-4af8-9827-4c276f78da02 None None] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:07.361278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Usage tracker for resource:subnet and tenant:1fa2af35c0b84da8bf2e29338b782924 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:07.372901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:07.392841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:07.396843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:07.440530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] device_id is not set on port c0680fee-97e7-4019-8e29-b9ad24a638d7 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:07.456384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-70ea73a3-6954-4608-8264-ad32c13ed88c None None] Provisioning for port 31380672-651e-4b33-b8c2-1af2c15cda36 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:07.590531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::f (bc8378de-2042-4bb7-8c0b-2cd387a2aa6b/af993afa-a669-418f-9f70-aaa8fa208134/a03b88b1-5bc8-467b-b93c-f85a68eb0642) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:07.632458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attempting to reserve 2 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:07.702714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Made reservation on behalf of 1fa2af35c0b84da8bf2e29338b782924 for: {'subnet': 2} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:07.832533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Allocated IP 2001:db8::251 (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/c0680fee-97e7-4019-8e29-b9ad24a638d7) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:07.845461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:07.926306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8343c970-2cba-4d6b-b8e5-546c800e5c77 None None] Provisioning for port 9fca2117-615b-4712-ad6f-e8835fc14f3c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:07.934974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8343c970-2cba-4d6b-b8e5-546c800e5c77 None None] Provisioning complete for port 9fca2117-615b-4712-ad6f-e8835fc14f3c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:07.935851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8343c970-2cba-4d6b-b8e5-546c800e5c77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:07.949666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.001005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8343c970-2cba-4d6b-b8e5-546c800e5c77 None None] Port 9fca2117-615b-4712-ad6f-e8835fc14f3c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:08.017850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for c1c6148e-979d-44d5-9880-f440dd760abb owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:08.044821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.062972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cb456fc3-0942-4e3b-971f-3f697fdd45e7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:08.064549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object a03b88b1-5bc8-467b-b93c-f85a68eb0642 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:08.117563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Port': ['ID=9c203860-3bb6-4d6f-b219-4e69de55ab4c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:08.134955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-67c3d6d3-af2e-4afc-a5b8-a21907a3b9fc None None] Provisioning complete for port 9fca2117-615b-4712-ad6f-e8835fc14f3c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:08.135337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-67c3d6d3-af2e-4afc-a5b8-a21907a3b9fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.157092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.164006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.172128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6b89bcf2-18d2-4ac7-ac12-9c97298123ac tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:08.184106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:08.211001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 31380672-651e-4b33-b8c2-1af2c15cda36 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:08.229207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Transition to ACTIVE for port object c0680fee-97e7-4019-8e29-b9ad24a638d7 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:08.262063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-67c3d6d3-af2e-4afc-a5b8-a21907a3b9fc None None] Port 9fca2117-615b-4712-ad6f-e8835fc14f3c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:08.264996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=a03b88b1-5bc8-467b-b93c-f85a68eb0642,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:08.272447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:08.274555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.274748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:08.274857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.276880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:08.280334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:08.284386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:08.285093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.325736 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.7403548 Nov 24 13:59:08.327916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.329502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40666) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:08.366758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.370952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 31380672-651e-4b33-b8c2-1af2c15cda36 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:08.379469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 31380672-651e-4b33-b8c2-1af2c15cda36 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:08.380147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.381820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3b861346-3c40-4db1-8511-e81b8300a90a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:08.487835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:08.498189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:08.503480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=c0680fee-97e7-4019-8e29-b9ad24a638d7,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:08.506136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:08.511348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:08.512011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.521670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:08.537818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.558098 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 1.5715907 Nov 24 13:59:08.564785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40670) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:08.581761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ab542ad-e81b-416d-b2d5-fd444130edad tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:08.582261 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8ab542ad-e81b-416d-b2d5-fd444130edad tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:08.585168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 31380672-651e-4b33-b8c2-1af2c15cda36, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=31380672-651e-4b33-b8c2-1af2c15cda36,segment=NetworkSegment(396a008a-bb6e-46b7-a1bf-cb54122e8c61),segment_id=396a008a-bb6e-46b7-a1bf-cb54122e8c61)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:08.592549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.600296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:08.603801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::15f', 'mac_address': 'fa:16:3e:df:b7:c3'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:08.635234 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] create failed (client error): The resource could not be found. Nov 24 13:59:08.641881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40674) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:08.642068 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 6.3276637 Nov 24 13:59:08.656482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.676023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:08.706091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=31380672-651e-4b33-b8c2-1af2c15cda36,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:08.722691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d49d9ea-a594-43f2-9f67-60de48b93929 None None] Provisioning for port a03b88b1-5bc8-467b-b93c-f85a68eb0642 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:08.724645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8ab542ad-e81b-416d-b2d5-fd444130edad tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:08.728323 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8ab542ad-e81b-416d-b2d5-fd444130edad tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 928 time: 0.3952160 Nov 24 13:59:08.728490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:08.731084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d49d9ea-a594-43f2-9f67-60de48b93929 None None] Provisioning complete for port a03b88b1-5bc8-467b-b93c-f85a68eb0642 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:08.732157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d49d9ea-a594-43f2-9f67-60de48b93929 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.741034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40678) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:08.764203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:59:08.808946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6d49d9ea-a594-43f2-9f67-60de48b93929 None None] Port a03b88b1-5bc8-467b-b93c-f85a68eb0642 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:08.831803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Deleting port dfdf302d-3f2a-4693-b5fd-a5bdd768147a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:08.832154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.854877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Port': ['ID=c1c6148e-979d-44d5-9880-f440dd760abb,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:08.857789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:08.936998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-02bcefa5-ce0d-42b3-9ba6-6a49bd6c318f None None] Provisioning for port c0680fee-97e7-4019-8e29-b9ad24a638d7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:08.943665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-02bcefa5-ce0d-42b3-9ba6-6a49bd6c318f None None] Provisioning complete for port c0680fee-97e7-4019-8e29-b9ad24a638d7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:08.944096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-02bcefa5-ce0d-42b3-9ba6-6a49bd6c318f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:08.979720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:09.041211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-02bcefa5-ce0d-42b3-9ba6-6a49bd6c318f None None] Port c0680fee-97e7-4019-8e29-b9ad24a638d7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:09.047539 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/ports/c1c6148e-979d-44d5-9880-f440dd760abb HTTP/1.1" status: 204 len: 168 time: 3.1146462 Nov 24 13:59:09.057111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40682) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:09.147797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-903d82fa-a9e1-43f5-9764-e2289e2e8c9e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:09.151629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-903d82fa-a9e1-43f5-9764-e2289e2e8c9e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:09.156317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-903d82fa-a9e1-43f5-9764-e2289e2e8c9e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:09.157979 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-903d82fa-a9e1-43f5-9764-e2289e2e8c9e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2391 time: 0.4139755 Nov 24 13:59:09.188277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40686) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:09.203580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-3d70b2b5-99f9-482a-ac0b-b7bc378a3755 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] GET failed (client error): The resource could not be found. Nov 24 13:59:09.208295 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3d70b2b5-99f9-482a-ac0b-b7bc378a3755 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "GET /v2.0/ports/c1c6148e-979d-44d5-9880-f440dd760abb HTTP/1.1" status: 404 len: 333 time: 0.1468132 Nov 24 13:59:09.239344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40690) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:09.254369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'name': 'tempest-AllowedAddressPairTestJSON-688067723'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:09.287713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:09.375044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:09.447334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port a03b88b1-5bc8-467b-b93c-f85a68eb0642 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:09.448108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:09.631139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Calling delete_port for dfdf302d-3f2a-4693-b5fd-a5bdd768147a owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:09.652998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:09.664677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:port and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:09.703880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:09.726206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:09.736889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] Sync routers for ids ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:09.745497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:09.753287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] Routers {'e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:09.754002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:09.819063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:09.831620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] Routers {'e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:09.832916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:09.837924 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.7246699 Nov 24 13:59:09.841155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:09.844522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:09.845547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40694) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:09.891470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:09.892056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3c7ce0c-b545-4182-9cc8-565948cfd260 None None] The sync data for ids ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:09.914031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] device_id is not set on port 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:09.968465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13111561-69ae-4863-8e9d-01bc1317c80a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:09.968972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-13111561-69ae-4863-8e9d-01bc1317c80a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:09.991889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:09.992400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.000019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.000851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8586263c-493a-43c7-8926-ccb079941e24 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:10.007142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c61dde1c-7fcf-46b4-9877-181456875ff4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:10.047418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-13111561-69ae-4863-8e9d-01bc1317c80a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:10.048599 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-13111561-69ae-4863-8e9d-01bc1317c80a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports/06a84519-98cc-4ef0-a9ac-10737da649aa HTTP/1.1" status: 200 len: 977 time: 0.2022400 Nov 24 13:59:10.058079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40698) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:10.064549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Port': ['ID=dfdf302d-3f2a-4693-b5fd-a5bdd768147a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:10.068029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.123821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:10.137410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 31380672-651e-4b33-b8c2-1af2c15cda36 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:10.143519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.172956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:10.207311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for a03b88b1-5bc8-467b-b93c-f85a68eb0642 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:10.226756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 31380672-651e-4b33-b8c2-1af2c15cda36 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:10.227196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.358287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] In _notify_port_updated(), no bound segment for port c0680fee-97e7-4019-8e29-b9ad24a638d7 on network 1c8e456a-762d-4344-9670-e5d3a55cd60d {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:59:10.362179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:10.362798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.366810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "PUT /v2.0/ports/c0680fee-97e7-4019-8e29-b9ad24a638d7 HTTP/1.1" status: 200 len: 1003 time: 1.7943408 Nov 24 13:59:10.369485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40702) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:10.380737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=c0680fee-97e7-4019-8e29-b9ad24a638d7,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:10.425953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:10.435611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Subnet': ['ID=462a7cd7-4314-45b5-b518-2a7a0a57168b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:10.449028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.442s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:10.462841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.479550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port c0680fee-97e7-4019-8e29-b9ad24a638d7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:10.479830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.486320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.496551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3f5be8f7-e2c3-40b9-84cb-41aa8b94a34f tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:10.520385 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "DELETE /v2.0/ports/dfdf302d-3f2a-4693-b5fd-a5bdd768147a HTTP/1.1" status: 204 len: 168 time: 1.8774607 Nov 24 13:59:10.530731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Allocated IP 172.20.0.12 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/3aa9980f-d1f4-45d0-8d6f-4a02fe748de8) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:10.534896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40706) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:10.540528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Checking segment: {'id': '885eeab2-0313-4030-8a5c-6e8afa5fd81a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:10.540895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network hostable DHCP agents. Network: ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:10.558064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=a03b88b1-5bc8-467b-b93c-f85a68eb0642,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:10.566602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:10.663108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.671746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:10.717881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2a5f20c8-07be-46ef-a36d-0961432649de None None] Provisioning complete for port c0680fee-97e7-4019-8e29-b9ad24a638d7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:10.718178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2a5f20c8-07be-46ef-a36d-0961432649de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.721980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:10.733839 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/a03b88b1-5bc8-467b-b93c-f85a68eb0642 HTTP/1.1" status: 204 len: 168 time: 1.5432923 Nov 24 13:59:10.735348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:10.745444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40710) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:10.745960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:10.754080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ac33ad4-f5e5-4541-9b2d-fc56ed995807 None None] Network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:10.863521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2a5f20c8-07be-46ef-a36d-0961432649de None None] Port c0680fee-97e7-4019-8e29-b9ad24a638d7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:10.967231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b59a8ca6-c54d-4eaa-ab76-553d8e8d0127 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:10.968006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b59a8ca6-c54d-4eaa-ab76-553d8e8d0127 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Synchronizing usage tracker for tenant:8d1ebffadec64974b7bb8bd05493b745 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:10.990200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.022328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d', 'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d', 'tenant_id': '1fa2af35c0b84da8bf2e29338b782924', 'fixed_ips': [{'subnet_id': '462a7cd7-4314-45b5-b518-2a7a0a57168b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:11.023523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.056123 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ae18e00-fba4-4b99-ac2c-7d2d54621f9a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:59:11.056638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8ae18e00-fba4-4b99-ac2c-7d2d54621f9a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:11.086168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event updated for resources: {'Subnet': ['ID=b6981736-5fc4-4970-8e01-f509695c87f4,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:11.096753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:11.130020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8ae18e00-fba4-4b99-ac2c-7d2d54621f9a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:11.131370 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8ae18e00-fba4-4b99-ac2c-7d2d54621f9a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/a03b88b1-5bc8-467b-b93c-f85a68eb0642 HTTP/1.1" status: 404 len: 333 time: 0.3317964 Nov 24 13:59:11.137207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40714) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:11.198095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Checking segment: {'id': '04a41245-90a5-417c-9b5e-da355a3a494e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:11.198720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network hostable DHCP agents. Network: 8e992287-9a67-4a60-a7e0-52e5565b5c63, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:11.205779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Allocated IP 2001:db8::1 (ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d/462a7cd7-4314-45b5-b518-2a7a0a57168b/cb99150f-0a4b-4190-9746-a6a619b51b25) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:11.233745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.257976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for c0680fee-97e7-4019-8e29-b9ad24a638d7 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:11.268751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 9fca2117-615b-4712-ad6f-e8835fc14f3c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:11.269091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.286970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b59a8ca6-c54d-4eaa-ab76-553d8e8d0127 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Unset dirty status for tenant:8d1ebffadec64974b7bb8bd05493b745 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:11.291325 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b59a8ca6-c54d-4eaa-ab76-553d8e8d0127 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "GET /v2.0/ports?device_id=eff8244f-7b8f-486d-b7d4-46f1d8c7938c HTTP/1.1" status: 200 len: 913 time: 0.7482181 Nov 24 13:59:11.300097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40718) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:11.309445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Transition to ACTIVE for port object 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:11.375663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Network 8e992287-9a67-4a60-a7e0-52e5565b5c63 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:11.400826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 8e992287-9a67-4a60-a7e0-52e5565b5c63) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:11.415621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:11.416047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:11.416719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.444289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.452784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24645648-1eec-4cd4-a4a3-8d949989c2dc None None] Network 8e992287-9a67-4a60-a7e0-52e5565b5c63 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:11.460338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ed265e2b-6508-45dd-a3a8-4eeee49b0263 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:11.544890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.566683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Transition to ACTIVE for port object cb99150f-0a4b-4190-9746-a6a619b51b25 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:11.572021 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1476 time: 5.3223228 Nov 24 13:59:11.574522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40722) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:11.602795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:11.610186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Transition to ACTIVE for port object cb99150f-0a4b-4190-9746-a6a619b51b25 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:11.613214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:11.622694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:11.655881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=3aa9980f-d1f4-45d0-8d6f-4a02fe748de8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:11.659363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.673442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:11.676315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:11.679644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.693926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9863b0cc-8eba-45b2-800f-3858ebd8c8e6 tempest-RoutersAdminTest-727092644 tempest-RoutersAdminTest-727092644-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:11.720432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:11.721946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.753908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=c0680fee-97e7-4019-8e29-b9ad24a638d7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:11.758501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f81e481-e19a-4d59-8d51-e60f2e0b46b4 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:11.760280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f81e481-e19a-4d59-8d51-e60f2e0b46b4 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:11.761926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f81e481-e19a-4d59-8d51-e60f2e0b46b4 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:11.764630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.765019 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5f81e481-e19a-4d59-8d51-e60f2e0b46b4 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2102 time: 0.1858654 Nov 24 13:59:11.767914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:11.774827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40726) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:11.798848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:11.800471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Pushing event updated for resources: {'Port': ['ID=cb99150f-0a4b-4190-9746-a6a619b51b25,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:11.807834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:11.810615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:11.813250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:11.828290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-8e992287-9a67-4a60-a7e0-52e5565b5c63', 'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63', 'tenant_id': '1fa2af35c0b84da8bf2e29338b782924', 'fixed_ips': [{'subnet_id': 'b6981736-5fc4-4970-8e01-f509695c87f4'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:11.829121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:11.909674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 9fca2117-615b-4712-ad6f-e8835fc14f3c owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:11.963534 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.7205358 Nov 24 13:59:11.970925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40730) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:12.008827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Attempting to bind port cb99150f-0a4b-4190-9746-a6a619b51b25 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:12.009192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Attempting to bind port cb99150f-0a4b-4190-9746-a6a619b51b25 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '885eeab2-0313-4030-8a5c-6e8afa5fd81a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:12.009552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Attempting to bind port cb99150f-0a4b-4190-9746-a6a619b51b25 on network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:12.033120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'network_id': '336d79b0-b678-4519-960c-1d6db0696693', 'name': 'tempest-AllowedAddressPairTestJSON-1676526273'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:12.082998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:12.083378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Checking segment: {'id': '885eeab2-0313-4030-8a5c-6e8afa5fd81a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:12.083797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.084194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Bound using segment: {'id': '885eeab2-0313-4030-8a5c-6e8afa5fd81a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:12.084680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Bound port: cb99150f-0a4b-4190-9746-a6a619b51b25, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '885eeab2-0313-4030-8a5c-6e8afa5fd81a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:12.085061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.092620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.102222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b01f65e1-152a-4e5e-aaaf-850565911b41 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:12.141406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ea4ea5f2-0ed6-4512-bebf-0889b245ffc5 None None] Provisioning for port 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:12.167701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=9fca2117-615b-4712-ad6f-e8835fc14f3c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:12.173290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:12.192360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ea4ea5f2-0ed6-4512-bebf-0889b245ffc5 None None] Provisioning complete for port 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:12.192737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ea4ea5f2-0ed6-4512-bebf-0889b245ffc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.229186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.269698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/9fca2117-615b-4712-ad6f-e8835fc14f3c HTTP/1.1" status: 204 len: 168 time: 1.1313977 Nov 24 13:59:12.272401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40734) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:12.313553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Allocated IP 2001:db8:0:1::1 (8e992287-9a67-4a60-a7e0-52e5565b5c63/b6981736-5fc4-4970-8e01-f509695c87f4/48031ae7-654e-4668-be3e-fcdc15012374) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:12.319062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:12.325840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c13fc519-3c2f-47ec-9efa-0a4d954bf13e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:59:12.326903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c13fc519-3c2f-47ec-9efa-0a4d954bf13e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:12.328150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ea4ea5f2-0ed6-4512-bebf-0889b245ffc5 None None] Port 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:12.346474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb99150f-0a4b-4190-9746-a6a619b51b25,segment=NetworkSegment(885eeab2-0313-4030-8a5c-6e8afa5fd81a),segment_id=885eeab2-0313-4030-8a5c-6e8afa5fd81a)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:12.350432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c13fc519-3c2f-47ec-9efa-0a4d954bf13e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:12.352036 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c13fc519-3c2f-47ec-9efa-0a4d954bf13e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/9fca2117-615b-4712-ad6f-e8835fc14f3c HTTP/1.1" status: 404 len: 333 time: 0.0783474 Nov 24 13:59:12.355212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40738) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:12.363287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.370389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef27-22d9-4bc2-ad30-da49efaab8c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:12.542207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Pushing event updated for resources: {'Port': ['ID=cb99150f-0a4b-4190-9746-a6a619b51b25,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:12.554170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:12.577470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Deleting subnet 462a7cd7-4314-45b5-b518-2a7a0a57168b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:12.597933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.605222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet af993afa-a669-418f-9f70-aaa8fa208134 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:12.609545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.643269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.668390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.685590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Transition to ACTIVE for port object 48031ae7-654e-4668-be3e-fcdc15012374 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:12.690047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.715087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:12.715458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Transition to ACTIVE for port object 48031ae7-654e-4668-be3e-fcdc15012374 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:12.722526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.729391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:12.735679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:12.799546 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/ports/c0680fee-97e7-4019-8e29-b9ad24a638d7 HTTP/1.1" status: 204 len: 168 time: 2.4234467 Nov 24 13:59:12.806060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40742) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:12.808028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Usage tracker for resource:port and tenant:a4a56793d07e455186fd2fc1eb5e9e6c is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:12.815370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Network 8e992287-9a67-4a60-a7e0-52e5565b5c63 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:12.818584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:12.830847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:12.832748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:12.847598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:12.866328 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-e48f9f4d-8ab5-4a7c-957e-927d29091037 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] GET failed (client error): The resource could not be found. Nov 24 13:59:12.867624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e48f9f4d-8ab5-4a7c-957e-927d29091037 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "GET /v2.0/ports/c0680fee-97e7-4019-8e29-b9ad24a638d7 HTTP/1.1" status: 404 len: 333 time: 0.0599251 Nov 24 13:59:12.870667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Pushing event updated for resources: {'Port': ['ID=48031ae7-654e-4668-be3e-fcdc15012374,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:12.874800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40746) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:12.875496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:12.881341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1299780337'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:12.901651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.008605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Attempting to bind port 48031ae7-654e-4668-be3e-fcdc15012374 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:13.008957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Attempting to bind port 48031ae7-654e-4668-be3e-fcdc15012374 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '04a41245-90a5-417c-9b5e-da355a3a494e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:13.009280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Attempting to bind port 48031ae7-654e-4668-be3e-fcdc15012374 on network 8e992287-9a67-4a60-a7e0-52e5565b5c63 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:13.017602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:13.017602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Checking segment: {'id': '04a41245-90a5-417c-9b5e-da355a3a494e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:13.017953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.018186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Bound using segment: {'id': '04a41245-90a5-417c-9b5e-da355a3a494e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:13.018656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Bound port: 48031ae7-654e-4668-be3e-fcdc15012374, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '04a41245-90a5-417c-9b5e-da355a3a494e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '8e992287-9a67-4a60-a7e0-52e5565b5c63'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:13.019040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.058344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Made reservation on behalf of a4a56793d07e455186fd2fc1eb5e9e6c for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:13.062540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.072404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.096324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.100915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:13.103176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6eaa4842-b6b0-4c25-9960-9ee18a701f78 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:13.130366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] For port 48031ae7-654e-4668-be3e-fcdc15012374, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:13.136135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] For port 48031ae7-654e-4668-be3e-fcdc15012374, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=48031ae7-654e-4668-be3e-fcdc15012374,segment=NetworkSegment(04a41245-90a5-417c-9b5e-da355a3a494e),segment_id=04a41245-90a5-417c-9b5e-da355a3a494e)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:13.144919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.155218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-906c8f7b-bcaa-4e25-81e5-62538207bf83 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:13.246801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] device_id is not set on port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:13.252715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:port and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:13.257125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=af993afa-a669-418f-9f70-aaa8fa208134,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:13.257600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Pushing event updated for resources: {'Port': ['ID=48031ae7-654e-4668-be3e-fcdc15012374,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:13.259110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:13.265887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:13.266652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:13.273085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.285390 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/af993afa-a669-418f-9f70-aaa8fa208134 HTTP/1.1" status: 204 len: 168 time: 0.9250712 Nov 24 13:59:13.285390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40752) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:13.288194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:13.291326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.293900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:13.298157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.304791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29fe2294-0465-4829-acee-51f7fbbba82f None None] Network bc8378de-2042-4bb7-8c0b-2cd387a2aa6b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:13.364798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.443338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.466247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 31380672-651e-4b33-b8c2-1af2c15cda36 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:13.466878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.520865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] device_id is not set on port 0339d6ce-eed7-4382-b1e7-ddeba11df779 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:13.710962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.724324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-72f4cb91-84fd-44e8-b6eb-bc8e3383cc16 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:13.781463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f11f541c-1326-4734-b005-7b897259a29b None None] DHCP port deletion for bc8378de-2042-4bb7-8c0b-2cd387a2aa6b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:13.786996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Deleting port 31380672-651e-4b33-b8c2-1af2c15cda36 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:13.787593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.797625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Subnet': ['ID=462a7cd7-4314-45b5-b518-2a7a0a57168b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:13.818440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:13.831053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:13.866529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Allocated IP 172.20.0.5 (336d79b0-b678-4519-960c-1d6db0696693/a9d59020-6118-4b61-85b7-abab2d903c4f/b0b661a4-8fc8-4f78-b0c6-2a5018a7285e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:13.905221 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/subnets/462a7cd7-4314-45b5-b518-2a7a0a57168b HTTP/1.1" status: 204 len: 168 time: 2.1272988 Nov 24 13:59:13.913741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40758) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:13.937865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Allocated IP 2001:db8::31b (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/0339d6ce-eed7-4382-b1e7-ddeba11df779) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:14.084387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f11f541c-1326-4734-b005-7b897259a29b None None] For port 31380672-651e-4b33-b8c2-1af2c15cda36, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=31380672-651e-4b33-b8c2-1af2c15cda36,segment=NetworkSegment(396a008a-bb6e-46b7-a1bf-cb54122e8c61),segment_id=396a008a-bb6e-46b7-a1bf-cb54122e8c61)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:14.084913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:14.219828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Calling delete_port for 31380672-651e-4b33-b8c2-1af2c15cda36 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:14.236256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:14.257767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Transition to ACTIVE for port object 0339d6ce-eed7-4382-b1e7-ddeba11df779 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:14.310223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0a5c798-22ad-4aaa-a805-5ecd50eb60c3 None None] Network ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:14.311872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port 31380672-651e-4b33-b8c2-1af2c15cda36, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=31380672-651e-4b33-b8c2-1af2c15cda36,segment=NetworkSegment(396a008a-bb6e-46b7-a1bf-cb54122e8c61),segment_id=396a008a-bb6e-46b7-a1bf-cb54122e8c61)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:14.312586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:14.331622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:14.341967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-57d89524-ff8f-468b-b918-9f70b3cd3868 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:14.534905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 31380672-651e-4b33-b8c2-1af2c15cda36 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:14.582734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 48031ae7-654e-4668-be3e-fcdc15012374 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:14.602950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:14.610383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Pushing event deleted for resources: {'Port': ['ID=31380672-651e-4b33-b8c2-1af2c15cda36,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:14.625321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d9685ec6-e4d4-469f-bca1-5b261e961a4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:14.657375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:14.728125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4d4e761e-1c82-4f5c-b016-6856aefcfd30 None None] Provisioning for port cb99150f-0a4b-4190-9746-a6a619b51b25 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:14.738364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=0339d6ce-eed7-4382-b1e7-ddeba11df779,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:14.742128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:14.757511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f11f541c-1326-4734-b005-7b897259a29b None None] No DVR routers for this DVR port 31380672-651e-4b33-b8c2-1af2c15cda36 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:14.803643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:14.817909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:14.820525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:14.825241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:14.825999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:14.965156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:14.965974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:14.975727 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 2.0965047 Nov 24 13:59:14.977047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40768) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:15.010424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:df:b7:c3'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:15.022686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 48031ae7-654e-4668-be3e-fcdc15012374 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:15.050993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cb99150f-0a4b-4190-9746-a6a619b51b25 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:15.126448 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-366794d4-5a10-476b-9fe2-090473888197 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.3926656 Nov 24 13:59:15.181199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-253f027d-a990-423d-b148-80f87324ce50 None None] Network 8e992287-9a67-4a60-a7e0-52e5565b5c63 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:15.196777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.213519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Transition to ACTIVE for port object b0b661a4-8fc8-4f78-b0c6-2a5018a7285e will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:15.295095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Provisioning for port 48031ae7-654e-4668-be3e-fcdc15012374 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:15.300278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] DHCP port deletion for ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:15.307538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Deleting subnet b6981736-5fc4-4970-8e01-f509695c87f4 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:15.311314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.313661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Provisioning complete for port 48031ae7-654e-4668-be3e-fcdc15012374 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:15.314259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.359411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Deleting port cb99150f-0a4b-4190-9746-a6a619b51b25 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:15.359913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.378596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.398966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port cb99150f-0a4b-4190-9746-a6a619b51b25 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:15.412224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-58584753-c258-4413-abd9-d0a2f4965017 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:15.413955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 06a84519-98cc-4ef0-a9ac-10737da649aa {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:15.414326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.414449 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-58584753-c258-4413-abd9-d0a2f4965017 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.2719533 Nov 24 13:59:15.427945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port cb99150f-0a4b-4190-9746-a6a619b51b25 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:15.428395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.477613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 31380672-651e-4b33-b8c2-1af2c15cda36 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:15.477928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.502318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb720ee-60da-4ad4-b8af-c088fbd00206 req-ef348398-985d-4c3c-ac4b-0f495a847818 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:15.503706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8cb720ee-60da-4ad4-b8af-c088fbd00206 req-ef348398-985d-4c3c-ac4b-0f495a847818 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6212459 Nov 24 13:59:15.520882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.566519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e629b4a-9438-4f10-9cee-7d388a2a7bd7 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:15.760827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] The port '31380672-651e-4b33-b8c2-1af2c15cda36' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:15.772639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=b0b661a4-8fc8-4f78-b0c6-2a5018a7285e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:15.808918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:15.812278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Network 336d79b0-b678-4519-960c-1d6db0696693 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:15.832128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.853072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.861939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:15.865204 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8cb720ee-60da-4ad4-b8af-c088fbd00206 req-8908ef11-ca57-4b4c-a064-f76ffdc1becb tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3476958 Nov 24 13:59:15.868152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:15.874377 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-9d7cf5da-1f92-4d1e-a713-adf287693605 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.4514732 Nov 24 13:59:15.894529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.907329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb99150f-0a4b-4190-9746-a6a619b51b25,segment=NetworkSegment(885eeab2-0313-4030-8a5c-6e8afa5fd81a),segment_id=885eeab2-0313-4030-8a5c-6e8afa5fd81a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:15.907734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.957898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:15.966935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.004801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bc8378de-2042-4bb7-8c0b-2cd387a2aa6b']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:16.021327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '396a008a-bb6e-46b7-a1bf-cb54122e8c61') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:16.021677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '396a008a-bb6e-46b7-a1bf-cb54122e8c61') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:16.036730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.044058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Calling delete_port for cb99150f-0a4b-4190-9746-a6a619b51b25 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:16.065504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.115329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 874 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:16.116144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.129470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 06a84519-98cc-4ef0-a9ac-10737da649aa owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:16.130185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb99150f-0a4b-4190-9746-a6a619b51b25,segment=NetworkSegment(885eeab2-0313-4030-8a5c-6e8afa5fd81a),segment_id=885eeab2-0313-4030-8a5c-6e8afa5fd81a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:16.135400 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:16.142952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.145453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-85554b7f-eda0-4857-a06a-74f8fac2f166 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:16.174654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:16.175258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.227216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:16.227740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:16.237471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 31380672-651e-4b33-b8c2-1af2c15cda36 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:16.277880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.315240 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 4.2935688 Nov 24 13:59:16.318288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 31380672-651e-4b33-b8c2-1af2c15cda36 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:59:16.318644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 31380672-651e-4b33-b8c2-1af2c15cda36 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:59:16.334390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40772) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:16.335599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.345448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:96:a0:72'}, {'ip_address': '172.20.0.12', 'mac_address': 'fa:16:3e:21:ce:df'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:16.347969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=cb99150f-0a4b-4190-9746-a6a619b51b25,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:16.355408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:16.391289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:16.392472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:16.393571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9937ec94-1eac-41d3-898e-432b6cd23af6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:16.445239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cb99150f-0a4b-4190-9746-a6a619b51b25 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:16.467675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.473758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Subnet': ['ID=b6981736-5fc4-4970-8e01-f509695c87f4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:16.476445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:16.476854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82a2be1f-d3b9-44de-a2ae-470510cbaf40 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:16.490511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.495242 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/subnets/b6981736-5fc4-4970-8e01-f509695c87f4 HTTP/1.1" status: 204 len: 168 time: 2.5802717 Nov 24 13:59:16.496196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40776) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:16.505090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.507299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Deleting port a3271513-0ae5-4d4f-bdc3-5ef021be7626 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:16.507656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.509687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a370cdfe-e21f-4291-8719-f905a01e19f6 None None] Network 8e992287-9a67-4a60-a7e0-52e5565b5c63 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:16.511194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-cb83eedd-0647-4b82-beca-dd2dc1949cab service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:16.513677 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-cb83eedd-0647-4b82-beca-dd2dc1949cab service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.4453599 Nov 24 13:59:16.564776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=bc8378de-2042-4bb7-8c0b-2cd387a2aa6b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:16.580657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:16.595047 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/bc8378de-2042-4bb7-8c0b-2cd387a2aa6b HTTP/1.1" status: 204 len: 168 time: 3.3086131 Nov 24 13:59:16.618138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40780) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:16.628478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1878796114'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:16.637138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:16.645035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:network and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:16.691749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:16.708392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:16.748735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Deleting port cb99150f-0a4b-4190-9746-a6a619b51b25 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:16.749460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.760787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:16.764270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.808518 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-84bc9304-b27e-4edd-9c55-0e2a9a5e9374 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2811770 Nov 24 13:59:16.820468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.844388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 879} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:16.849538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a490ca2-b4b6-4f1a-b93b-3f71dd6a16a1 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:16.849971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6a490ca2-b4b6-4f1a-b93b-3f71dd6a16a1 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Synchronizing usage tracker for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:16.970105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb99150f-0a4b-4190-9746-a6a619b51b25,segment=NetworkSegment(885eeab2-0313-4030-8a5c-6e8afa5fd81a),segment_id=885eeab2-0313-4030-8a5c-6e8afa5fd81a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:16.984215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.986820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:16.987309 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Added segment 61dc770c-e764-4d87-acf1-c9432dc3d4b7 of type vlan for network 25c148b8-41b8-4c0d-a895-3a676614a606 Nov 24 13:59:16.996007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.006384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.025827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:17.053662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.064267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.074364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88a044a1-a4ea-4dba-9d3e-98eb039c7596 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:17.104997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6a490ca2-b4b6-4f1a-b93b-3f71dd6a16a1 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Unset dirty status for tenant:1fa2af35c0b84da8bf2e29338b782924 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:17.110475 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6a490ca2-b4b6-4f1a-b93b-3f71dd6a16a1 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.6009467 Nov 24 13:59:17.116885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40786) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:17.196020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.202608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=cb99150f-0a4b-4190-9746-a6a619b51b25,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:17.206232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb99150f-0a4b-4190-9746-a6a619b51b25,segment=NetworkSegment(885eeab2-0313-4030-8a5c-6e8afa5fd81a),segment_id=885eeab2-0313-4030-8a5c-6e8afa5fd81a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:17.206626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.214245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9af64f9-2021-480c-b28f-3afae79e2f41 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:17.214601 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-d6ad28cc-de3c-4051-a1b7-4a980e847967 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3965955 Nov 24 13:59:17.230719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] In _notify_port_updated(), no bound segment for port 0339d6ce-eed7-4382-b1e7-ddeba11df779 on network 1c8e456a-762d-4344-9670-e5d3a55cd60d {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:59:17.231549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:17.234970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:17.235626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.239857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "PUT /v2.0/ports/0339d6ce-eed7-4382-b1e7-ddeba11df779 HTTP/1.1" status: 200 len: 1003 time: 2.2521906 Nov 24 13:59:17.255104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40790) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:17.256775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.268750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=0339d6ce-eed7-4382-b1e7-ddeba11df779,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:17.282219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:17.367956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] For port 48031ae7-654e-4668-be3e-fcdc15012374, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=48031ae7-654e-4668-be3e-fcdc15012374,segment=NetworkSegment(04a41245-90a5-417c-9b5e-da355a3a494e),segment_id=04a41245-90a5-417c-9b5e-da355a3a494e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:17.368294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.368294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:17.368294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.374037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2566c72a-de8a-42f9-9ef0-651e48098518 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:17.426470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] DHCP port deletion for 8e992287-9a67-4a60-a7e0-52e5565b5c63 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:17.434459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Calling delete_port for cb99150f-0a4b-4190-9746-a6a619b51b25 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:17.460425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.472099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1c632922-40fc-42b9-9315-206409185f86 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:17.542824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=06a84519-98cc-4ef0-a9ac-10737da649aa,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:17.545545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Pushing event updated for resources: {'Port': ['ID=48031ae7-654e-4668-be3e-fcdc15012374,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:17.545805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.332s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:17.554050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:17.563327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Deleting port 48031ae7-654e-4668-be3e-fcdc15012374 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:17.563543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.568350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Calling delete_port for a3271513-0ae5-4d4f-bdc3-5ef021be7626 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:17.578191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Network': ['ID=25c148b8-41b8-4c0d-a895-3a676614a606,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:17.596025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:17.601380 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9792552 Nov 24 13:59:17.601889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 25c148b8-41b8-4c0d-a895-3a676614a606 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:17.605286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40794) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:17.615681 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bff0e106-2714-48a4-b236-a8c8c0bdb92f req-1d71d893-c5f7-4c1e-93dd-65f57d1fccc7 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3745811 Nov 24 13:59:17.630173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a9729c-f05d-4014-ad04-78ef37accad5 req-0e1e04e8-cfde-4a36-85c1-3a74fb2ab36a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:17.638504 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79a9729c-f05d-4014-ad04-78ef37accad5 req-0e1e04e8-cfde-4a36-85c1-3a74fb2ab36a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5976825 Nov 24 13:59:17.642616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.645944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:17.664127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.697594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.734853 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79a9729c-f05d-4014-ad04-78ef37accad5 req-d403b479-af6d-43e1-a55b-94a46cc98f74 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0937927 Nov 24 13:59:17.760432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port 0339d6ce-eed7-4382-b1e7-ddeba11df779 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:17.761311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.889884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Deleting port 48031ae7-654e-4668-be3e-fcdc15012374 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:17.903976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:17.953184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Provisioning for port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:17.967617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Provisioning complete for port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:17.968316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.002727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:18.003321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:18.014844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] For port 48031ae7-654e-4668-be3e-fcdc15012374, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=48031ae7-654e-4668-be3e-fcdc15012374,segment=NetworkSegment(04a41245-90a5-417c-9b5e-da355a3a494e),segment_id=04a41245-90a5-417c-9b5e-da355a3a494e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:18.015540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.020355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:18.024424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:18.027345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:18.035082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:18.046566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:18.152023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.205054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Calling delete_port for 48031ae7-654e-4668-be3e-fcdc15012374 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:18.239419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:18.283551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Provisioning for port 0339d6ce-eed7-4382-b1e7-ddeba11df779 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:18.291044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Provisioning complete for port 0339d6ce-eed7-4382-b1e7-ddeba11df779 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:18.291044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.347564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.354552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9325131e-2c28-44e4-86ea-b54a7f371699 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:18.440598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Pushing event deleted for resources: {'Port': ['ID=48031ae7-654e-4668-be3e-fcdc15012374,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:18.446356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:18.457750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 48031ae7-654e-4668-be3e-fcdc15012374 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:18.501600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] No DVR routers for this DVR port 48031ae7-654e-4668-be3e-fcdc15012374 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:18.505164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Port 0339d6ce-eed7-4382-b1e7-ddeba11df779 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:18.512822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 48031ae7-654e-4668-be3e-fcdc15012374 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:59:18.513178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 48031ae7-654e-4668-be3e-fcdc15012374 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:59:18.516268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4740cb6-459c-4a59-88fa-c399576aca41 None None] Could not find standard attr ID for object 48031ae7-654e-4668-be3e-fcdc15012374. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:59:18.540094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.546215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8e7713d8-9a25-43c7-8d2d-02ec31cccbd7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:18.634871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=a84152c6-7f00-40d3-a765-70d962ef8e04,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:18.638751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:18.642581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Checking segment: {'id': '61dc770c-e764-4d87-acf1-c9432dc3d4b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:18.642747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Deleting port cb99150f-0a4b-4190-9746-a6a619b51b25 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:18.642935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network hostable DHCP agents. Network: 25c148b8-41b8-4c0d-a895-3a676614a606, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:18.643052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.666768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 25c148b8-41b8-4c0d-a895-3a676614a606 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:18.686211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 25c148b8-41b8-4c0d-a895-3a676614a606) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:18.689906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ba9d693b-d67f-41bc-abfd-241cc202ec9f None None] Provisioning complete for port 0339d6ce-eed7-4382-b1e7-ddeba11df779 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:18.690273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ba9d693b-d67f-41bc-abfd-241cc202ec9f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.691113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:18.691652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.722610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.1110349 Nov 24 13:59:18.723942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e1f1932-6e63-4e68-bef2-88050552d0c4 None None] Network 25c148b8-41b8-4c0d-a895-3a676614a606 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:18.725324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40798) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:18.731823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-1603833659', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:18.738639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:18.742632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:router and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:18.745645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:18.753921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:18.765541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.766567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.788140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.811794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.837484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.841819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.845884 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4b644315-d690-47b4-90b0-ac0828b5a36a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.1162703 Nov 24 13:59:18.846452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40804) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:18.853420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606', 'name': 'tempest-PortsIpV6TestJSON-835388374'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:18.858477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] For port 48031ae7-654e-4668-be3e-fcdc15012374, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=48031ae7-654e-4668-be3e-fcdc15012374,segment=NetworkSegment(04a41245-90a5-417c-9b5e-da355a3a494e),segment_id=04a41245-90a5-417c-9b5e-da355a3a494e)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:18.859073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:18.973452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ba9d693b-d67f-41bc-abfd-241cc202ec9f None None] Port 0339d6ce-eed7-4382-b1e7-ddeba11df779 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:19.001126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:19.007106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:port and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:19.009558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:19.016290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:19.027875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:19.032345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.056099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port 75bea202-20c4-4b49-ae93-6ac33488937b yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:19.088092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Calling delete_port for 48031ae7-654e-4668-be3e-fcdc15012374 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:19.107184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-25c148b8-41b8-4c0d-a895-3a676614a606', 'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': 'a84152c6-7f00-40d3-a765-70d962ef8e04'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:19.108038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.198404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] For port cb99150f-0a4b-4190-9746-a6a619b51b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb99150f-0a4b-4190-9746-a6a619b51b25,segment=NetworkSegment(885eeab2-0313-4030-8a5c-6e8afa5fd81a),segment_id=885eeab2-0313-4030-8a5c-6e8afa5fd81a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:19.200089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.240493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::18a (25c148b8-41b8-4c0d-a895-3a676614a606/a84152c6-7f00-40d3-a765-70d962ef8e04/75bea202-20c4-4b49-ae93-6ac33488937b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:19.309696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:19.310448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:19.385480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Calling delete_port for cb99150f-0a4b-4190-9746-a6a619b51b25 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:19.400255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.412891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:19.487909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.493107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.497157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c1f64c23-9d77-4655-9dc4-e9d97a8b330d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:19.500257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.523774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object 75bea202-20c4-4b49-ae93-6ac33488937b will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:19.542902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Pushing event deleted for resources: {'Port': ['ID=cb99150f-0a4b-4190-9746-a6a619b51b25,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:19.547137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:19.550273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] No DVR routers for this DVR port cb99150f-0a4b-4190-9746-a6a619b51b25 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:19.566008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.581647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e3418b98-76c0-44c5-8d87-bad903986229 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:19.593440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Port': ['ID=a3271513-0ae5-4d4f-bdc3-5ef021be7626,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:19.645573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Allocated IP 2001:db8::2 (25c148b8-41b8-4c0d-a895-3a676614a606/a84152c6-7f00-40d3-a765-70d962ef8e04/11072b39-7584-4ebf-abcf-bef9eade3ac1) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:19.646357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 25c148b8-41b8-4c0d-a895-3a676614a606 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:19.657926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:19.661383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:19.665665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:19.667720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.667875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:19.678731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:59:19.701448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.719178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for 0339d6ce-eed7-4382-b1e7-ddeba11df779 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:19.720117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=75bea202-20c4-4b49-ae93-6ac33488937b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:19.732121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:19.734778 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 0.8871183 Nov 24 13:59:19.737501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40810) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:19.878624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Deleting port 48031ae7-654e-4668-be3e-fcdc15012374 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:19.879246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.900448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.915870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Transition to ACTIVE for port object 11072b39-7584-4ebf-abcf-bef9eade3ac1 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:19.935319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.943032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Transition to ACTIVE for port object 11072b39-7584-4ebf-abcf-bef9eade3ac1 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:19.944234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:19.950974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:19.958010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f11f541c-1326-4734-b005-7b897259a29b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:20.034073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Network 25c148b8-41b8-4c0d-a895-3a676614a606 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:20.037276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:20.039693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:20.045381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Pushing event updated for resources: {'Port': ['ID=11072b39-7584-4ebf-abcf-bef9eade3ac1,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:20.049993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:20.072413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] The port '48031ae7-654e-4668-be3e-fcdc15012374' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:20.137592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Attempting to bind port 11072b39-7584-4ebf-abcf-bef9eade3ac1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:20.139184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Attempting to bind port 11072b39-7584-4ebf-abcf-bef9eade3ac1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '61dc770c-e764-4d87-acf1-c9432dc3d4b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:20.139184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Attempting to bind port 11072b39-7584-4ebf-abcf-bef9eade3ac1 on network 25c148b8-41b8-4c0d-a895-3a676614a606 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:20.146733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:20.147130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Checking segment: {'id': '61dc770c-e764-4d87-acf1-c9432dc3d4b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:20.147531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:20.147991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Bound using segment: {'id': '61dc770c-e764-4d87-acf1-c9432dc3d4b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:20.148471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Bound port: 11072b39-7584-4ebf-abcf-bef9eade3ac1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61dc770c-e764-4d87-acf1-c9432dc3d4b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '25c148b8-41b8-4c0d-a895-3a676614a606'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:20.148857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:20.252057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] For port 11072b39-7584-4ebf-abcf-bef9eade3ac1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:20.307604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027bb630-55d0-42d1-9b71-d9c4c85c7563 req-c7e0dbb2-0f03-4342-9b66-26c591791dd1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:20.310335 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-027bb630-55d0-42d1-9b71-d9c4c85c7563 req-c7e0dbb2-0f03-4342-9b66-26c591791dd1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 1.4046969 Nov 24 13:59:20.350513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] For port 11072b39-7584-4ebf-abcf-bef9eade3ac1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=11072b39-7584-4ebf-abcf-bef9eade3ac1,segment=NetworkSegment(61dc770c-e764-4d87-acf1-c9432dc3d4b7),segment_id=61dc770c-e764-4d87-acf1-c9432dc3d4b7)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:20.360468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:20.364310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event updated for resources: {'Port': ['ID=b0b661a4-8fc8-4f78-b0c6-2a5018a7285e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:20.365199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6d0f209c-8a74-42c1-8a45-252511b75a86 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:20.505914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Pushing event updated for resources: {'Port': ['ID=11072b39-7584-4ebf-abcf-bef9eade3ac1,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:20.509028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:20.578322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:20.633167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:20.639882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.696s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:20.678335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:20.712092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-22af508e-6f43-44aa-8e83-176d82d1cace None None] Provisioning complete for port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:20.712625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-22af508e-6f43-44aa-8e83-176d82d1cace None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:20.810863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-22af508e-6f43-44aa-8e83-176d82d1cace None None] Port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:20.859452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=0339d6ce-eed7-4382-b1e7-ddeba11df779,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:20.936896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:20.949649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.050340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.055405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.064762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-26badc41-ee45-43a6-8ed4-93ce7b9e636d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:21.122285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] In _notify_port_updated(), no bound segment for port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e on network 336d79b0-b678-4519-960c-1d6db0696693 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:59:21.126149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:21.126797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.128131 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "PUT /v2.0/ports/b0b661a4-8fc8-4f78-b0c6-2a5018a7285e HTTP/1.1" status: 200 len: 1056 time: 4.7879050 Nov 24 13:59:21.147591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40814) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:21.157693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e992287-9a67-4a60-a7e0-52e5565b5c63']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:21.188449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=75bea202-20c4-4b49-ae93-6ac33488937b,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:21.191573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:21.204969 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-027bb630-55d0-42d1-9b71-d9c4c85c7563 req-8f678c66-92b3-43b6-ac92-0a35584b1480 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.8374989 Nov 24 13:59:21.214055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.218759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '04a41245-90a5-417c-9b5e-da355a3a494e') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:21.219577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '04a41245-90a5-417c-9b5e-da355a3a494e') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:21.248822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.303893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port b0b661a4-8fc8-4f78-b0c6-2a5018a7285e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:21.304220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.330046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.334602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.343117 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/ports/0339d6ce-eed7-4382-b1e7-ddeba11df779 HTTP/1.1" status: 204 len: 168 time: 4.0778053 Nov 24 13:59:21.354815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40820) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:21.377220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Releasing vlan 880 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:21.377624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:21.393312 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:21.412297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:59:21.422424 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-8ed4f90e-c5d4-45e4-b92d-dccfeae51944 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] GET failed (client error): The resource could not be found. Nov 24 13:59:21.422942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8ed4f90e-c5d4-45e4-b92d-dccfeae51944 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Synchronizing usage tracker for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:21.484732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.492278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8ed4f90e-c5d4-45e4-b92d-dccfeae51944 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Unset dirty status for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:21.495811 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8ed4f90e-c5d4-45e4-b92d-dccfeae51944 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "GET /v2.0/ports/0339d6ce-eed7-4382-b1e7-ddeba11df779 HTTP/1.1" status: 404 len: 333 time: 0.1392770 Nov 24 13:59:21.499949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40824) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:21.506499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-279891952'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:21.678597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.700220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:21.723573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.726131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.726818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1bf5e02-3144-4f84-9ee9-c33898b56d7e None None] Network 25c148b8-41b8-4c0d-a895-3a676614a606 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:21.746297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:21.784643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:21.817717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:21.819692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-763073f3-79be-4499-8c3b-d745e898eb17 None None] Provisioning for port 11072b39-7584-4ebf-abcf-bef9eade3ac1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:21.820914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:21.860014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Network': ['ID=8e992287-9a67-4a60-a7e0-52e5565b5c63,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:21.966402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] device_id is not set on port 3e754d2d-58b3-4039-9a0e-0e72202e90e6 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:22.088198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.388s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:22.183506 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/networks/8e992287-9a67-4a60-a7e0-52e5565b5c63 HTTP/1.1" status: 204 len: 168 time: 5.0619652 Nov 24 13:59:22.186080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40828) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:22.295930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7877f469-e6b2-4b20-a99c-8ae346a66ae6 None None] Provisioning for port 75bea202-20c4-4b49-ae93-6ac33488937b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:22.314431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7877f469-e6b2-4b20-a99c-8ae346a66ae6 None None] Provisioning complete for port 75bea202-20c4-4b49-ae93-6ac33488937b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:22.315071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7877f469-e6b2-4b20-a99c-8ae346a66ae6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.428336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7877f469-e6b2-4b20-a99c-8ae346a66ae6 None None] Port 75bea202-20c4-4b49-ae93-6ac33488937b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:22.440199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:22.442957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.458749 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] Sync routers for ids ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:22.461388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.469639 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bd46bad1-b4ef-46d1-b963-566c3ea66efa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 12.4043107 Nov 24 13:59:22.475624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40832) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:22.476898 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] Routers {'e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:22.479842 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:22.532630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 11072b39-7584-4ebf-abcf-bef9eade3ac1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:22.536187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Allocated IP 2001:db8::221 (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/3e754d2d-58b3-4039-9a0e-0e72202e90e6) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:22.539394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.560489 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:22.573333 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] Routers {'e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:22.574088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:22.626788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.627629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.635152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e71259e-f864-456a-9308-83ba07c99097 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:22.649004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for b0b661a4-8fc8-4f78-b0c6-2a5018a7285e owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:22.668210 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:22.668833 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4dffeb64-bd96-46b9-83ac-0035deb40905 None None] The sync data for ids ['e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:22.669070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9d6c81f-a100-491c-8d7d-ba8781d2ab74 None None] Provisioning complete for port 75bea202-20c4-4b49-ae93-6ac33488937b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:22.669612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9d6c81f-a100-491c-8d7d-ba8781d2ab74 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.761488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a9d6c81f-a100-491c-8d7d-ba8781d2ab74 None None] Port 75bea202-20c4-4b49-ae93-6ac33488937b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:22.768760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 11072b39-7584-4ebf-abcf-bef9eade3ac1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:22.776304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 11072b39-7584-4ebf-abcf-bef9eade3ac1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:22.777232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.794493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Router eff8244f-7b8f-486d-b7d4-46f1d8c7938c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:59:22.916555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.927880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-224a9ef8-58ac-4bab-a5f3-c352ce187b22 None None] Provisioning complete for port 75bea202-20c4-4b49-ae93-6ac33488937b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:22.928252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-224a9ef8-58ac-4bab-a5f3-c352ce187b22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:22.960241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=75bea202-20c4-4b49-ae93-6ac33488937b,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:23.003491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-224a9ef8-58ac-4bab-a5f3-c352ce187b22 None None] Port 75bea202-20c4-4b49-ae93-6ac33488937b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:23.005738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 11072b39-7584-4ebf-abcf-bef9eade3ac1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=11072b39-7584-4ebf-abcf-bef9eade3ac1,segment=NetworkSegment(61dc770c-e764-4d87-acf1-c9432dc3d4b7),segment_id=61dc770c-e764-4d87-acf1-c9432dc3d4b7)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:23.010936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.013657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e6261707-9cbc-433b-966e-6fd4efb6ceb6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:23.035239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.063483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.428s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:23.085315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.087560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=11072b39-7584-4ebf-abcf-bef9eade3ac1,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:23.091705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:23.131677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '885eeab2-0313-4030-8a5c-6e8afa5fd81a') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.132319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '885eeab2-0313-4030-8a5c-6e8afa5fd81a') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.149000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.176255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:23.191819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.192181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] Sync routers for ids ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:23.198736 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9b624d08-6b92-4d3a-86b6-cf9194b1feee tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "PUT /v2.0/routers/eff8244f-7b8f-486d-b7d4-46f1d8c7938c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.8955994 Nov 24 13:59:23.201999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40836) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:23.204698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:23.205107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.210796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] Routers {'eff8244f-7b8f-486d-b7d4-46f1d8c7938c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:23.212373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:23.221903 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:23.224002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.243672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network 25c148b8-41b8-4c0d-a895-3a676614a606 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:23.249460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:23.295932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b54900d3-acf9-411f-9165-d1615041f879 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:23.308110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.327452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] Routers {'eff8244f-7b8f-486d-b7d4-46f1d8c7938c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:23.329451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.363835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.410253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:23.410823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad250d4c-20b0-4a84-b64e-54bfc6c40c5b None None] The sync data for ids ['eff8244f-7b8f-486d-b7d4-46f1d8c7938c'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:23.442716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Port': ['ID=b0b661a4-8fc8-4f78-b0c6-2a5018a7285e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:23.486379 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-ec27befb-cc65-4a7b-af8b-480ba22a9a65 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] remove_router_interface failed (client error): The resource could not be found. Nov 24 13:59:23.488261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ec27befb-cc65-4a7b-af8b-480ba22a9a65 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 1.0115223 Nov 24 13:59:23.498925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40840) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:23.504813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Transition to ACTIVE for port object 3e754d2d-58b3-4039-9a0e-0e72202e90e6 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:23.508915 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-bac963fe-f67b-43cf-b010-6af9fb3ed271 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.5539145 Nov 24 13:59:23.573574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-461aa396-fedd-493e-9da9-63d1cc46c1d1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:23.619064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.323s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:23.636407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2339d3da-c0c2-4c99-8c0d-37a3b6ed0ee8 None None] Provisioning complete for port 75bea202-20c4-4b49-ae93-6ac33488937b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:23.636915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2339d3da-c0c2-4c99-8c0d-37a3b6ed0ee8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.660889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.661361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-461aa396-fedd-493e-9da9-63d1cc46c1d1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:23.665604 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-461aa396-fedd-493e-9da9-63d1cc46c1d1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf HTTP/1.1" status: 200 len: 205 time: 0.1627858 Nov 24 13:59:23.670009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40844) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:23.673762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b1be2b8c-417d-454e-b13c-a3847cb973f3 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:23.689707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.709420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2339d3da-c0c2-4c99-8c0d-37a3b6ed0ee8 None None] Port 75bea202-20c4-4b49-ae93-6ac33488937b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:23.805308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Network': ['ID=ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:23.857502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:23.895803 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/networks/ea7479ba-1bb9-49b7-bcf4-a7299ef4e71d HTTP/1.1" status: 204 len: 168 time: 1.7071710 Nov 24 13:59:23.899031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.905087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40848) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:23.908696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:23.919359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f4526a72-7757-4957-94eb-08a57d4694ad tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:24.094159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.100166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:24.109972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=3e754d2d-58b3-4039-9a0e-0e72202e90e6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:24.112894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:24.114969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:24.117550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:24.121128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:24.122252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.160565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.168169 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-2e4fe0bd-6410-4831-8d67-246a03ebba0e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.5670133 Nov 24 13:59:24.218585 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.7175744 Nov 24 13:59:24.224424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40852) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:24.239630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'network_id': '1c8e456a-762d-4344-9670-e5d3a55cd60d', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-264609085'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:24.421883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 11072b39-7584-4ebf-abcf-bef9eade3ac1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:24.507286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e88437d7-5ed1-4265-9360-d39d3ede5911 None None] Provisioning for port 3e754d2d-58b3-4039-9a0e-0e72202e90e6 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:24.515795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e88437d7-5ed1-4265-9360-d39d3ede5911 None None] Provisioning complete for port 3e754d2d-58b3-4039-9a0e-0e72202e90e6 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:24.516976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e88437d7-5ed1-4265-9360-d39d3ede5911 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.551697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.563661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 11072b39-7584-4ebf-abcf-bef9eade3ac1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:24.564065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.619385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.628598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e88437d7-5ed1-4265-9360-d39d3ede5911 None None] Port 3e754d2d-58b3-4039-9a0e-0e72202e90e6 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:24.641093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-83639d5a-b578-46da-8532-db9bd128436c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:24.642180 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-83639d5a-b578-46da-8532-db9bd128436c service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.4451687 Nov 24 13:59:24.643640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['18f03f43-6de6-44d7-beab-ef9f5cdb4875']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:24.684780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.689339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/ports/b0b661a4-8fc8-4f78-b0c6-2a5018a7285e HTTP/1.1" status: 204 len: 168 time: 3.5316365 Nov 24 13:59:24.712823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40856) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:24.719270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '17aa258e-479f-4461-8fb0-38618861ace2') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:24.719568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '17aa258e-479f-4461-8fb0-38618861ace2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:24.736783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:24.752830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.799964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.812490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Usage tracker for resource:port and tenant:bf4eb15856244358b02c2c7e03cc6aad is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:24.819995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:24.830694 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c15d3db-bd62-4229-bc68-86a319c41044 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] GET failed (client error): The resource could not be found. Nov 24 13:59:24.831205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8c15d3db-bd62-4229-bc68-86a319c41044 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Synchronizing usage tracker for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:24.833812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:24.856504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.881475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Releasing vlan 875 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:24.881797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:24.900788 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:24.911240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Made reservation on behalf of bf4eb15856244358b02c2c7e03cc6aad for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:24.914563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:24.936746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Router 9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:59:24.943183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8c15d3db-bd62-4229-bc68-86a319c41044 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Unset dirty status for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:24.946764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8c15d3db-bd62-4229-bc68-86a319c41044 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "GET /v2.0/ports/b0b661a4-8fc8-4f78-b0c6-2a5018a7285e HTTP/1.1" status: 404 len: 333 time: 0.2299488 Nov 24 13:59:24.957293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:24.995937 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-6a463905-bd73-4c20-b74f-23dbcaf33052 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.3414505 Nov 24 13:59:25.054261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] device_id is not set on port 423688c9-9cac-4588-8c0a-b30bbad6a842 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:25.083579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.088642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.089109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Fanout notify agent at l3_agent the message router_deleted on router eff8244f-7b8f-486d-b7d4-46f1d8c7938c {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:59:25.107528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.113354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:25.113686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.126681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.137894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4804b8ae-5d99-471c-ac26-2b182372daca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:25.145577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.146655 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-94844f8f-db0d-48c0-88e9-30a4f29d66e4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "DELETE /v2.0/routers/eff8244f-7b8f-486d-b7d4-46f1d8c7938c HTTP/1.1" status: 204 len: 168 time: 1.9435651 Nov 24 13:59:25.153926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40864) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:25.198428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.280197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.280667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:59:25.291678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-2e5f6f1e-7e4d-427a-99cb-18f06cdd5289 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:25.292647 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-2e5f6f1e-7e4d-427a-99cb-18f06cdd5289 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.2823505 Nov 24 13:59:25.302103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Network': ['ID=18f03f43-6de6-44d7-beab-ef9f5cdb4875,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:25.326576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.327638 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b2ec501d-33f3-4dbc-8664-c92389e71e6b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf HTTP/1.1" status: 204 len: 168 time: 1.6552706 Nov 24 13:59:25.349314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40868) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:25.463976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:25.494119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/networks/18f03f43-6de6-44d7-beab-ef9f5cdb4875 HTTP/1.1" status: 204 len: 168 time: 1.5868826 Nov 24 13:59:25.501841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40872) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:25.607843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Allocated IP 2001:db8::135 (1c8e456a-762d-4344-9670-e5d3a55cd60d/51009db1-2b8a-4b29-afa1-2b1aba84cd14/423688c9-9cac-4588-8c0a-b30bbad6a842) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:25.661531 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-06be410e-b08f-4496-afb7-bc70669da961 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3496156 Nov 24 13:59:25.699409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:25.707788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/routers/9d1a8e5f-39ea-43e3-910c-c2576ed0cd98/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9690080 Nov 24 13:59:25.712127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40876) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:25.716028 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] Sync routers for ids ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:25.731743 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] Routers {'9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:25.733332 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:25.739158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.794213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Deleting subnet dc8904bf-b69b-4239-9ab9-681cccf0afac {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:25.799390 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:25.809777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.811373 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] Routers {'9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:25.812021 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:25.877155 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:25.877539 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f856f8b-c67c-4c34-81ae-d79a68cbeddb None None] The sync data for ids ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:25.887902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:25.958407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for 3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:25.997545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-bd77329c-a4a7-4337-8b0c-180b9dbb76fc service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3223906 Nov 24 13:59:26.059198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8ba1138-25d0-422a-8dde-fc4837161dbf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:26.060134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a8ba1138-25d0-422a-8dde-fc4837161dbf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:26.060331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.163091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.167583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a8ba1138-25d0-422a-8dde-fc4837161dbf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:26.171669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a8ba1138-25d0-422a-8dde-fc4837161dbf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports?device_id=9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 HTTP/1.1" status: 200 len: 988 time: 0.4491541 Nov 24 13:59:26.174250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40880) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:26.311914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet 983c0237-d8a7-4fa1-9353-bb3decd0db62 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:26.322105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.323885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Transition to ACTIVE for port object 423688c9-9cac-4588-8c0a-b30bbad6a842 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:26.344799 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f13fd58-312c-4245-923b-cb273e532ae9 req-257176d9-a1b6-4018-bf12-68f9d4bf161e service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3411567 Nov 24 13:59:26.384646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.392021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-81f14638-f727-4ba7-8844-331b027af5c2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:26.484883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:26.486749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=423688c9-9cac-4588-8c0a-b30bbad6a842,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:26.490633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:26.493190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:26.494365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:26.496011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.499340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:26.500100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.515230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.585884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f094f437-c839-458e-8d8b-9524c2d831ad']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:26.597445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.645203 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 2.4131842 Nov 24 13:59:26.645414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40884) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:26.651877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::15f', 'mac_address': 'fa:16:3e:df:b7:c3'}, {'ip_address': '2001:db8::221', 'mac_address': 'fa:16:3e:64:e4:1b'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:26.654567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd61814b2-ff40-4418-a90c-b32f25c064e7') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:26.654868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd61814b2-ff40-4418-a90c-b32f25c064e7') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:26.672178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.691474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.698035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3a2333b-fcea-4917-8cea-0dd6848433ad tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:26.767060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Port': ['ID=3aa9980f-d1f4-45d0-8d6f-4a02fe748de8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:26.769028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69effa9d-10d7-41fb-850d-38641b66fc91 None None] Provisioning for port 423688c9-9cac-4588-8c0a-b30bbad6a842 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:26.769687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.775808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69effa9d-10d7-41fb-850d-38641b66fc91 None None] Provisioning complete for port 423688c9-9cac-4588-8c0a-b30bbad6a842 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:26.776346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69effa9d-10d7-41fb-850d-38641b66fc91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.780932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:26.786154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Releasing vlan 865 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:26.786477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:26.801935 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:26.853601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-69effa9d-10d7-41fb-850d-38641b66fc91 None None] Port 423688c9-9cac-4588-8c0a-b30bbad6a842 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:26.963888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:26.973668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09a92f56-d88a-4e0e-801a-a1269372c8be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:26.988618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.004575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.059433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Subnet': ['ID=dc8904bf-b69b-4239-9ab9-681cccf0afac,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:27.069416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:27.072495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.087253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11bfa5df-ab4e-453a-9ec5-b95871150303 tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:27.097675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d53aa72d-4fea-4e58-acec-e064b78bf2db None None] Network 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:27.107015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.110044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.127496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Pushing event deleted for resources: {'Network': ['ID=f094f437-c839-458e-8d8b-9524c2d831ad,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:27.130637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:27.141047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.159995 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] 10.222.0.70 "DELETE /v2.0/networks/f094f437-c839-458e-8d8b-9524c2d831ad HTTP/1.1" status: 204 len: 168 time: 1.6510758 Nov 24 13:59:27.161685 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "DELETE /v2.0/subnets/dc8904bf-b69b-4239-9ab9-681cccf0afac HTTP/1.1" status: 204 len: 168 time: 2.0049500 Nov 24 13:59:27.166653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40890) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:27.191703 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/ports/3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 HTTP/1.1" status: 204 len: 168 time: 2.2322235 Nov 24 13:59:27.193262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.197109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40894) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:27.204124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-68962d79-6dc2-48c9-ba2b-ba6c897c226c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:27.331622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=983c0237-d8a7-4fa1-9353-bb3decd0db62,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:27.357838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:27.361907 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-e6cc3e68-9f1a-4f44-9ffb-3ee62ffe1ab9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] GET failed (client error): The resource could not be found. Nov 24 13:59:27.362420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e6cc3e68-9f1a-4f44-9ffb-3ee62ffe1ab9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Synchronizing usage tracker for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:27.378885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.392285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f97a7e91-7e04-490b-9db8-d39da5022879 None None] Network ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:27.393013 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/983c0237-d8a7-4fa1-9353-bb3decd0db62 HTTP/1.1" status: 204 len: 168 time: 2.0426762 Nov 24 13:59:27.399870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40898) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:27.403149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.420426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e6cc3e68-9f1a-4f44-9ffb-3ee62ffe1ab9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Unset dirty status for tenant:a4a56793d07e455186fd2fc1eb5e9e6c on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:27.421598 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e6cc3e68-9f1a-4f44-9ffb-3ee62ffe1ab9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "GET /v2.0/ports/3aa9980f-d1f4-45d0-8d6f-4a02fe748de8 HTTP/1.1" status: 404 len: 333 time: 0.1900413 Nov 24 13:59:27.427230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Deleting port bf72844d-11fe-45b7-9a59-cd37c071e67c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:27.427558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.437954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40902) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:27.487973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] DHCP port deletion for 5fb5eabc-da3e-417c-a2c3-d7d4efa449ac request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:27.507399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Deleting port bf72844d-11fe-45b7-9a59-cd37c071e67c {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:27.507793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.600612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.649963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] For port bf72844d-11fe-45b7-9a59-cd37c071e67c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf72844d-11fe-45b7-9a59-cd37c071e67c,segment=NetworkSegment(da5ec78d-c0fb-4a9a-8119-f1f01908337b),segment_id=da5ec78d-c0fb-4a9a-8119-f1f01908337b)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:27.650386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.661279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40908) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:27.682514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.703630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-074d5e07-4cef-4ddc-9e9e-b20f6b9281a3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:27.767787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] In _notify_port_updated(), no bound segment for port 423688c9-9cac-4588-8c0a-b30bbad6a842 on network 1c8e456a-762d-4344-9670-e5d3a55cd60d {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:59:27.771653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:27.772317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.776099 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "PUT /v2.0/ports/423688c9-9cac-4588-8c0a-b30bbad6a842 HTTP/1.1" status: 200 len: 1067 time: 1.1272929 Nov 24 13:59:27.806810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.809969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40914) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:27.841481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Calling delete_port for bf72844d-11fe-45b7-9a59-cd37c071e67c owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:27.907088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] For port bf72844d-11fe-45b7-9a59-cd37c071e67c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf72844d-11fe-45b7-9a59-cd37c071e67c,segment=NetworkSegment(da5ec78d-c0fb-4a9a-8119-f1f01908337b),segment_id=da5ec78d-c0fb-4a9a-8119-f1f01908337b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:27.907593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.967479 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c9cd9fec-7199-4506-8cc9-75298dbcf7e8 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=1fa2af35c0b84da8bf2e29338b782924&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3028252 Nov 24 13:59:27.967696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 348e08fb-e096-4972-827e-5e9a4dbbbe83 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:27.967843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:27.967936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40918) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:28.014411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port 0ca99164-2ff5-42fb-9a57-593e92cd372c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:28.014757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.031134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] DHCP port deletion for ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:28.040678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event updated for resources: {'Port': ['ID=423688c9-9cac-4588-8c0a-b30bbad6a842,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:28.058267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.067905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.076107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.085987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1550b0b8-071a-4685-9fa4-f050ee7936fa tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:28.101432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Calling delete_port for bf72844d-11fe-45b7-9a59-cd37c071e67c owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:28.116334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.413s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:28.135838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Port': ['ID=bf72844d-11fe-45b7-9a59-cd37c071e67c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:28.140127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:28.142152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Deleting port 348e08fb-e096-4972-827e-5e9a4dbbbe83 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:28.142608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.143674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.150372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port 423688c9-9cac-4588-8c0a-b30bbad6a842 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:28.150712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.156645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] No DVR routers for this DVR port bf72844d-11fe-45b7-9a59-cd37c071e67c on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:28.255874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a247ff29-0287-4d2c-a0bc-78728424d890 None None] Provisioning complete for port 423688c9-9cac-4588-8c0a-b30bbad6a842 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:28.256362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a247ff29-0287-4d2c-a0bc-78728424d890 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.335041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:28.335435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:28.368475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a247ff29-0287-4d2c-a0bc-78728424d890 None None] Port 423688c9-9cac-4588-8c0a-b30bbad6a842 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:28.453400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf72844d-11fe-45b7-9a59-cd37c071e67c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:28.479049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.503053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: bf72844d-11fe-45b7-9a59-cd37c071e67c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:59:28.503597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf72844d-11fe-45b7-9a59-cd37c071e67c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:59:28.504151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 348e08fb-e096-4972-827e-5e9a4dbbbe83 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:28.507907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5fb5eabc-da3e-417c-a2c3-d7d4efa449ac']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:28.523240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'da5ec78d-c0fb-4a9a-8119-f1f01908337b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:28.523512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'da5ec78d-c0fb-4a9a-8119-f1f01908337b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:28.534395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.539596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:28.548363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.563453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] For port 348e08fb-e096-4972-827e-5e9a4dbbbe83, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=348e08fb-e096-4972-827e-5e9a4dbbbe83,segment=NetworkSegment(8b5c5607-b717-44a7-aa93-a0adf92cd04d),segment_id=8b5c5607-b717-44a7-aa93-a0adf92cd04d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:28.563881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.564651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6bc1edc-b441-46bc-9344-2cd1f17c521f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:28.567084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:28.575160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.587606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:28.588212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:28.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:28.618007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.619124 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/c6bc1edc-b441-46bc-9344-2cd1f17c521f HTTP/1.1" status: 204 len: 168 time: 0.6503453 Nov 24 13:59:28.696655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.701871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-88b85a44-edab-444a-beed-af90da974900 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:28.718482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.729211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Pushing event deleted for resources: {'Network': ['ID=5fb5eabc-da3e-417c-a2c3-d7d4efa449ac,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:28.734584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Calling delete_port for 348e08fb-e096-4972-827e-5e9a4dbbbe83 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:28.748548 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] 10.222.0.70 "DELETE /v2.0/networks/5fb5eabc-da3e-417c-a2c3-d7d4efa449ac HTTP/1.1" status: 204 len: 168 time: 1.5674579 Nov 24 13:59:28.750029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:28.753724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 348e08fb-e096-4972-827e-5e9a4dbbbe83, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=348e08fb-e096-4972-827e-5e9a4dbbbe83,segment=NetworkSegment(8b5c5607-b717-44a7-aa93-a0adf92cd04d),segment_id=8b5c5607-b717-44a7-aa93-a0adf92cd04d)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:28.754209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.837059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Deleting port bf72844d-11fe-45b7-9a59-cd37c071e67c {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:28.837438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.880369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.936231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fd4edd79-da8f-44e6-8647-d8d0412647a6 None None] The port 'bf72844d-11fe-45b7-9a59-cd37c071e67c' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:28.946785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:28.954072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-53e6b718-6f74-41c6-88a5-46d9cbf85bb9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:29.025493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40930) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:29.096624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Pushing event deleted for resources: {'Port': ['ID=348e08fb-e096-4972-827e-5e9a4dbbbe83,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:29.098870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] No DVR routers for this DVR port 348e08fb-e096-4972-827e-5e9a4dbbbe83 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:29.106443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:29.146142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 348e08fb-e096-4972-827e-5e9a4dbbbe83 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:29.224263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.240621 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6b91489f-2e80-4244-932e-e44c81a5cba2 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=8d1ebffadec64974b7bb8bd05493b745&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2132907 Nov 24 13:59:29.242983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40942) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:29.317729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.346336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.408101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.411946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c1a0721e-bfe0-46cd-81ea-64bbcdc1fbb6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:29.424024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55bd2e3e-a1b7-4413-becd-3ff2ee0c5db4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:29.427973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:29.431490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.432799 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/55bd2e3e-a1b7-4413-becd-3ff2ee0c5db4 HTTP/1.1" status: 204 len: 168 time: 0.1887181 Nov 24 13:59:29.450386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for 0ca99164-2ff5-42fb-9a57-593e92cd372c owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:29.482139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.713793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for 423688c9-9cac-4588-8c0a-b30bbad6a842 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:29.740411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:29.740601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40960) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:29.741087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:29.862885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 75bea202-20c4-4b49-ae93-6ac33488937b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:29.863501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.882185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1382379577'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:29.888056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:29.892050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:29.895746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:29.902181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:29.914102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:29.917660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:29.933058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.045984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.057569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-77d1dbe4-8149-469d-8ba1-d61328921a6f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:30.157025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Port': ['ID=0ca99164-2ff5-42fb-9a57-593e92cd372c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:30.163639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:30.185094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.197857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:30.203384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group_rule and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:30.206732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:30.213949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:30.219822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e383465-6b46-45e1-ad9c-96ca68552007 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:30.275346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 348e08fb-e096-4972-827e-5e9a4dbbbe83 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:30.275693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.311819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.320203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.327106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6b9f9a18-cfa4-472a-bf9a-0f7c4ccf61c5 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:30.370908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:30.379016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40978) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:30.386318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=423688c9-9cac-4588-8c0a-b30bbad6a842,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:30.395790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b73c0956-253e-4714-8770-4861f0cc1ba6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:30.410346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.410711 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment 1e68820c-505e-471b-8ec4-c754b46e3d28 of type vlan for network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 Nov 24 13:59:30.411677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:30.412250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:30.453014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.457970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] The port '348e08fb-e096-4972-827e-5e9a4dbbbe83' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:30.460146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.489720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.495462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:30.496439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.502788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa758fc1-8e27-4a3d-b1d7-f639798e2e34 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:30.629732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=8aeb6176-eff5-4042-baaa-de8b7dcc3ca1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:30.635593 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 0.8914449 Nov 24 13:59:30.635593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:30.635953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40984) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:30.643593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'name': 'tempest-PortsTestJSON-915829167'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:30.647341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:30.771961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:30.775691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:30.778684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:30.784485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:30.794621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:30.798122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.810897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1205981149'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:30.821601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 7f566d0c-ccf2-483a-820a-d1541294c9d2 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:30.874819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:30.890620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 75bea202-20c4-4b49-ae93-6ac33488937b owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:30.950376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:31.018752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:31.029591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:31.046340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.052115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:31.073641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.080167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:31.087443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.099835 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/ports/0ca99164-2ff5-42fb-9a57-593e92cd372c HTTP/1.1" status: 204 len: 168 time: 3.6267440 Nov 24 13:59:31.110506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40988) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:31.127969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:31.130889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.162596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=7f566d0c-ccf2-483a-820a-d1541294c9d2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:31.166450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:31.180927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': '1e68820c-505e-471b-8ec4-c754b46e3d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:31.181278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:31.205609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:31.218053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:31.222217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:31.226446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:31.227034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.232180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-686e3537-2bde-4015-b297-6088c331e0b5 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:31.243840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ff74eaa9-bb45-4cf5-93f7-684d6e9d8563']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:31.257216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b5c5607-b717-44a7-aa93-a0adf92cd04d') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:31.257547 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 0.6203680 Nov 24 13:59:31.257721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b5c5607-b717-44a7-aa93-a0adf92cd04d') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:31.260914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 40992) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:31.268183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1600194257'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:31.270803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.273785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:31.279070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:31.282679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:31.287887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.289437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:31.294503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 883 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:31.295016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.304227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:31.308133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:31.320695 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:31.346548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 889} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:31.355781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.356366 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment f9517663-710c-4668-a125-b26aec84577a of type vlan for network e3dc9c49-751d-4570-b34e-4c47854aa3c1 Nov 24 13:59:31.369607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.392744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.430188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.435885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:31.436053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.442528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:31.488372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.492233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/ports/423688c9-9cac-4588-8c0a-b30bbad6a842 HTTP/1.1" status: 204 len: 168 time: 3.6598496 Nov 24 13:59:31.515905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 40996) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:31.534685 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2715993 Nov 24 13:59:31.547407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41000) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:31.555639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'ports': [{'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'}, {'network_id': 'e3dc9c49-751d-4570-b34e-4c47854aa3c1'}]} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:31.555978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:31.556437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': 'e3dc9c49-751d-4570-b34e-4c47854aa3c1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:31.580933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=e3dc9c49-751d-4570-b34e-4c47854aa3c1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:31.583610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:31.593952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network e3dc9c49-751d-4570-b34e-4c47854aa3c1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:31.607375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:31.611054 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-58219a99-4442-4e23-a54a-179597f2d1eb tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] GET failed (client error): The resource could not be found. Nov 24 13:59:31.611561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-58219a99-4442-4e23-a54a-179597f2d1eb tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Synchronizing usage tracker for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:31.613891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.668738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:security_group_rule and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:31.671289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:31.686996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.692310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:31.712761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:31.717006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=ff74eaa9-bb45-4cf5-93f7-684d6e9d8563,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:31.730924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:31.750730 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/ff74eaa9-bb45-4cf5-93f7-684d6e9d8563 HTTP/1.1" status: 204 len: 168 time: 4.3449690 Nov 24 13:59:31.756690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41004) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:31.792108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-58219a99-4442-4e23-a54a-179597f2d1eb tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Unset dirty status for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:31.793751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-58219a99-4442-4e23-a54a-179597f2d1eb tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "GET /v2.0/ports/423688c9-9cac-4588-8c0a-b30bbad6a842 HTTP/1.1" status: 404 len: 333 time: 0.2762496 Nov 24 13:59:31.809041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-369090613'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:31.812160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41008) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:31.837492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:31.880720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:31.896750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:31.900423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:31.903907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:31.909138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:31.910731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 2 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:31.921140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 2} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:31.924906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.932836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:31.942657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:31.957688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting subnet a9d59020-6118-4b61-85b7-abab2d903c4f {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:31.974099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.020383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.025361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port 3e754d2d-58b3-4039-9a0e-0e72202e90e6 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:32.025737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.060584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7dc51fbd-4616-47ba-9d4f-26fa4501538e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:32.069381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 7972d53d-8c95-44ea-94e8-bf4d17f83ab2 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:32.109347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:32.112271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.150514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=75bea202-20c4-4b49-ae93-6ac33488937b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:32.173735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:32.193324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.207628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.249897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.329134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.338966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 9aeeb8bf-8117-493b-be52-e2b17d5fe10b yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:32.390625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6784b0d3-6f86-440e-91c1-82732440f9b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:32.490111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.519483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.525070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-48132b45-a69f-4201-878f-9185286e2af4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:32.560436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 861} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:32.593892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:32.601075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:32.605347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:32.606542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.615130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=7972d53d-8c95-44ea-94e8-bf4d17f83ab2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:32.618159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:32.618647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e368c91f-6e9a-4ab7-a69c-5e885a28c9db tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.005s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:32.628610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 887} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:32.693227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.693571 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment d4dddcd3-3c48-48d9-b0ff-8413ceb11f59 of type vlan for network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d Nov 24 13:59:32.703627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d3ccd0b6-1cf6-4e75-8862-da47da5f6cfc,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:32.703890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=9aeeb8bf-8117-493b-be52-e2b17d5fe10b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:32.707526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:32.717447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': 'f9517663-710c-4668-a125-b26aec84577a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'e3dc9c49-751d-4570-b34e-4c47854aa3c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:32.717801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: e3dc9c49-751d-4570-b34e-4c47854aa3c1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:32.739717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network e3dc9c49-751d-4570-b34e-4c47854aa3c1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:32.749390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, e3dc9c49-751d-4570-b34e-4c47854aa3c1) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:32.753358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:32.756617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.756970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment 9462ed27-21aa-44c9-8c05-9beadbd4ad5b of type vlan for network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 Nov 24 13:59:32.758699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:32.759231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf4865eb-f8f2-4151-9ef4-78644521b49a None None] Network e3dc9c49-751d-4570-b34e-4c47854aa3c1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:32.763356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:32.764059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.777301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:32.791247 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 1.2406242 Nov 24 13:59:32.791507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:32.841349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.847873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.859338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.864590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 9aeeb8bf-8117-493b-be52-e2b17d5fe10b {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:32.865421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:32.903524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.021163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.087263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.125583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fe193130-3678-4635-b975-4348bc418ff6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.209579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 9aeeb8bf-8117-493b-be52-e2b17d5fe10b owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:33.236718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for 3e754d2d-58b3-4039-9a0e-0e72202e90e6 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:33.263851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.267616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:33.268407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.283500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9eebf1fe-1df2-47fe-bf7a-877faa3155bf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:33.294366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.300296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aeff2ea0-b38d-49ab-8525-a51558ca8c3d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:33.312112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.315852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:33.316431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.344553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=9aeeb8bf-8117-493b-be52-e2b17d5fe10b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:33.348030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:33.353081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.362064 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/9aeeb8bf-8117-493b-be52-e2b17d5fe10b HTTP/1.1" status: 204 len: 168 time: 0.5694983 Nov 24 13:59:33.362639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41016) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:33.432386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.444635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf628c55-96f1-457d-84fb-c98f7faa0baf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:33.448594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf628c55-96f1-457d-84fb-c98f7faa0baf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:33.449426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cf628c55-96f1-457d-84fb-c98f7faa0baf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:33.464711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=8b3ad505-d2fe-4c6f-8e42-e7174720ec4d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:33.466754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cf628c55-96f1-457d-84fb-c98f7faa0baf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:33.475111 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cf628c55-96f1-457d-84fb-c98f7faa0baf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1451 time: 0.1043737 Nov 24 13:59:33.475309 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 3.0836365 Nov 24 13:59:33.475503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41020) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:33.481731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:33.486508 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.6892002 Nov 24 13:59:33.486508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ca89d16e-f1e6-4340-b413-21c00e2c348e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:33.500137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41024) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:33.501575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:33.558234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 7972d53d-8c95-44ea-94e8-bf4d17f83ab2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:33.560321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.576122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:33.601464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64d387f6-c775-469b-a2e0-7ae8231895e6 None None] Network 336d79b0-b678-4519-960c-1d6db0696693 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:33.631868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.654811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.659208 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/subnets/a9d59020-6118-4b61-85b7-abab2d903c4f HTTP/1.1" status: 204 len: 168 time: 2.5443125 Nov 24 13:59:33.668260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41028) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:33.904823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=cb19ec64-b023-4aad-b4ad-fb107cd2f9c0,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:33.918759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] DHCP port deletion for 336d79b0-b678-4519-960c-1d6db0696693 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:33.925557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Deleting port 2a736275-7784-4a1a-8be5-0f1a93368c5f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:33.926302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.981575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:33.988957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.504s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:34.009877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.562s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:34.112495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 7972d53d-8c95-44ea-94e8-bf4d17f83ab2 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:34.185738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] For port 2a736275-7784-4a1a-8be5-0f1a93368c5f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2a736275-7784-4a1a-8be5-0f1a93368c5f,segment=NetworkSegment(d835348b-9d02-474a-b714-2386d2846663),segment_id=d835348b-9d02-474a-b714-2386d2846663)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:34.186492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.196778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Subnet': ['ID=a9d59020-6118-4b61-85b7-abab2d903c4f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:34.206389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.208585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:34.222248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8aa6ed3d-ba01-4cc4-a5cd-dd7ba75bbf53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:34.270864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:34.274255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.281344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:34.286491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=7972d53d-8c95-44ea-94e8-bf4d17f83ab2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:34.296400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:34.298985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/7972d53d-8c95-44ea-94e8-bf4d17f83ab2 HTTP/1.1" status: 204 len: 168 time: 0.8271482 Nov 24 13:59:34.301991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41032) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:34.302419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:34.376347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.378284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:34.405670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.413864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:34.432648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Calling delete_port for 2a736275-7784-4a1a-8be5-0f1a93368c5f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:34.483130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:34.498591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71444a6b-9866-4e98-9400-9e406e24a2d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:34.499628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-71444a6b-9866-4e98-9400-9e406e24a2d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:34.503177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port 2a736275-7784-4a1a-8be5-0f1a93368c5f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:34.503517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.517605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:34.519747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-71444a6b-9866-4e98-9400-9e406e24a2d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:34.521658 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-71444a6b-9866-4e98-9400-9e406e24a2d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.2180011 Nov 24 13:59:34.524438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41036) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:34.527422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=3e754d2d-58b3-4039-9a0e-0e72202e90e6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:34.548321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:34.584164 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-74cd7cb6-f1c7-4fc6-ba79-0140aa771cba tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 13:59:34.586193 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-74cd7cb6-f1c7-4fc6-ba79-0140aa771cba tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/9aeeb8bf-8117-493b-be52-e2b17d5fe10b HTTP/1.1" status: 404 len: 333 time: 0.0603127 Nov 24 13:59:34.589070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41040) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:34.643873 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-9f1d5bf9-ad30-40d4-93f2-36f971966255 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 13:59:34.646347 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9f1d5bf9-ad30-40d4-93f2-36f971966255 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/7972d53d-8c95-44ea-94e8-bf4d17f83ab2 HTTP/1.1" status: 404 len: 333 time: 0.0552735 Nov 24 13:59:34.649874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41044) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:34.714409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.729381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2a736275-7784-4a1a-8be5-0f1a93368c5f no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:34.775939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.799743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Router 9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:59:34.852915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.860289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:34.864942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:34.915972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] No DVR routers for this DVR port 2a736275-7784-4a1a-8be5-0f1a93368c5f on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:34.973915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Pushing event deleted for resources: {'Port': ['ID=2a736275-7784-4a1a-8be5-0f1a93368c5f,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:34.977278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:34.977868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port 2a736275-7784-4a1a-8be5-0f1a93368c5f update to DOWN by agent not found {{(pid=83527) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2088}} Nov 24 13:59:34.989441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/ports/3e754d2d-58b3-4039-9a0e-0e72202e90e6 HTTP/1.1" status: 204 len: 168 time: 3.1608617 Nov 24 13:59:35.015180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:35.052583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.084069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3dc9c49-751d-4570-b34e-4c47854aa3c1']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.099624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f9517663-710c-4668-a125-b26aec84577a') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.099972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f9517663-710c-4668-a125-b26aec84577a') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.114826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.133412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.140473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 889 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:35.140819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:35.155747 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:35.190771 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-53c5d7a1-6cdb-4f4a-8cae-1e13113d52a4 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] GET failed (client error): The resource could not be found. Nov 24 13:59:35.191434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-53c5d7a1-6cdb-4f4a-8cae-1e13113d52a4 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Synchronizing usage tracker for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:35.239696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.249321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-191adcad-9ed8-47d1-9329-eebf1b17501c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:35.264945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.276375 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/e3dc9c49-751d-4570-b34e-4c47854aa3c1 HTTP/1.1" status: 204 len: 168 time: 0.6205728 Nov 24 13:59:35.276561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41052) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:35.286875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-220167992'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:35.292616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:35.299196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:35.303442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:35.309045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] For port 2a736275-7784-4a1a-8be5-0f1a93368c5f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2a736275-7784-4a1a-8be5-0f1a93368c5f,segment=NetworkSegment(d835348b-9d02-474a-b714-2386d2846663),segment_id=d835348b-9d02-474a-b714-2386d2846663)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:35.310244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.312083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:35.321259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=e3dc9c49-751d-4570-b34e-4c47854aa3c1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:35.326686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-53c5d7a1-6cdb-4f4a-8cae-1e13113d52a4 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Unset dirty status for tenant:bf4eb15856244358b02c2c7e03cc6aad on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:35.332409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-53c5d7a1-6cdb-4f4a-8cae-1e13113d52a4 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "GET /v2.0/ports/3e754d2d-58b3-4039-9a0e-0e72202e90e6 HTTP/1.1" status: 404 len: 333 time: 0.3090434 Nov 24 13:59:35.332603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:35.333421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41056) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:35.336038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:35.341259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.434352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port 810f5737-7579-4f6d-8560-ed366b895529 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:35.434685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.463010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 896} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:35.485412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.485742 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment 238905b5-5d73-4cee-bbb3-aa37212e812f of type vlan for network c0255553-5ced-4e6f-8c52-4c6030e54c5c Nov 24 13:59:35.489284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Calling delete_port for 2a736275-7784-4a1a-8be5-0f1a93368c5f owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:35.520823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:35.536061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] Sync routers for ids ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:35.554655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] Routers {'9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:35.555964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.557268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-981c59a5-f315-4ab7-a328-54797e158609 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/routers/9d1a8e5f-39ea-43e3-910c-c2576ed0cd98/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 9.3802197 Nov 24 13:59:35.557916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41060) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:35.634373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b793e63-7878-4f9c-b33b-3039b02e7e31 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:59:35.634905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7b793e63-7878-4f9c-b33b-3039b02e7e31 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:35.635858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.657602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] Routers {'9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:35.658528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.681607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:35.681927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:35.697917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.714627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:35.728720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.734239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.736526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:35.736933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fba02ac-72dd-4094-98e5-ae3d02a1ce46 None None] The sync data for ids ['9d1a8e5f-39ea-43e3-910c-c2576ed0cd98'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:35.761220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d871144a-058b-43eb-beb2-f65c868f7933 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.765019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7b793e63-7878-4f9c-b33b-3039b02e7e31 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:35.768775 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7b793e63-7878-4f9c-b33b-3039b02e7e31 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/75bea202-20c4-4b49-ae93-6ac33488937b HTTP/1.1" status: 404 len: 333 time: 0.1991343 Nov 24 13:59:35.774795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:35.864763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for 810f5737-7579-4f6d-8560-ed366b895529 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:35.892605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:59:35.927941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.931676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:35.932281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:35.940419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0245199d-64b5-408f-9a3f-3dae03498cdf tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:36.047208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=cdfca3a5-73d9-41ca-b022-7f05a6bf09f7,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:36.052533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.338s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:36.068970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:36.069327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:36.078146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.157918 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.8769593 Nov 24 13:59:36.158146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41068) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:36.166505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:36.191560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Deleting port 2a736275-7784-4a1a-8be5-0f1a93368c5f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:36.192080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.231688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=c0255553-5ced-4e6f-8c52-4c6030e54c5c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:36.239538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.299s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:36.249449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network c0255553-5ced-4e6f-8c52-4c6030e54c5c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:36.274581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] The port '2a736275-7784-4a1a-8be5-0f1a93368c5f' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:36.344870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:36.348795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.350768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:36.357501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:36.365499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:36.388782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:36.407178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:36.412603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=810f5737-7579-4f6d-8560-ed366b895529,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:36.417774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:36.460725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:36.494187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.578852 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/ports/810f5737-7579-4f6d-8560-ed366b895529 HTTP/1.1" status: 204 len: 168 time: 1.2416885 Nov 24 13:59:36.580085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41072) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:36.623555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.638368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:36.662247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:36.663019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.677055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.690052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f015b03-379e-4abf-9f47-cbf8b342b50e None None] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:36.735687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.768649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Performing IP validity checks on allocation pools {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 13:59:36.769214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 13:59:36.882011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['336d79b0-b678-4519-960c-1d6db0696693']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:36.898676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.3397183 Nov 24 13:59:36.900601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41076) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:36.902925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.907662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd835348b-9d02-474a-b714-2386d2846663') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:36.908115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd835348b-9d02-474a-b714-2386d2846663') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:36.912086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41080) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:36.924135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-54757793', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:36.924801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:36.934861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.942280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:36.951858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.958966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:36.964424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:36.964754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-8b3ad505-d2fe-4c6f-8e42-e7174720ec4d', 'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': 'cdfca3a5-73d9-41ca-b022-7f05a6bf09f7'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:36.965683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.971746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:36.975625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:36.985035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Releasing vlan 871 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:36.985608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:37.006244 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:37.035653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.037392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.048515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting subnet 51009db1-2b8a-4b29-afa1-2b1aba84cd14 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:37.062384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.108001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:37.119582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:37.125312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:37.134678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:37.137088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.137733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Fanout notify agent at l3_agent the message router_deleted on router 9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:59:37.139510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.151086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.152776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Allocated IP 172.20.0.2 (8b3ad505-d2fe-4c6f-8e42-e7174720ec4d/cdfca3a5-73d9-41ca-b022-7f05a6bf09f7/d7760a9a-4b7a-4336-b1aa-8825991ea575) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:37.158946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.165395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-92657cb5-6ed1-405d-947a-e3b5f1921ea5 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:37.184569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.201908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:37.209587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Pushing event deleted for resources: {'Network': ['ID=336d79b0-b678-4519-960c-1d6db0696693,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:37.217815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:37.227703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] 10.222.0.70 "DELETE /v2.0/networks/336d79b0-b678-4519-960c-1d6db0696693 HTTP/1.1" status: 204 len: 168 time: 3.5478594 Nov 24 13:59:37.233681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.235971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a889147f-38bd-481b-b168-c31e599c9c10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/routers/9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 HTTP/1.1" status: 204 len: 168 time: 1.4593790 Nov 24 13:59:37.241760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41086) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:37.251513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.355864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.357591 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-29ede55d-f2a7-466a-9339-b1adef170585 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.4523768 Nov 24 13:59:37.361318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41090) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:37.415723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.423397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.429199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Transition to ACTIVE for port object d7760a9a-4b7a-4336-b1aa-8825991ea575 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:37.449832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Transition to ACTIVE for port object d7760a9a-4b7a-4336-b1aa-8825991ea575 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:37.458628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.472737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3d753f81-3773-45c3-b33f-d71a4f616275 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:37.489256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.555660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:37.561821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:37.566271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Pushing event updated for resources: {'Port': ['ID=d7760a9a-4b7a-4336-b1aa-8825991ea575,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:37.570757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:37.573634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:37.679614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.685746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41096) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:37.688104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4e5c4c5f-8f74-4d89-9eaa-c48f86aceb0d tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:37.689252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Attempting to bind port d7760a9a-4b7a-4336-b1aa-8825991ea575 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:37.689626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Attempting to bind port d7760a9a-4b7a-4336-b1aa-8825991ea575 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:37.689991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Attempting to bind port d7760a9a-4b7a-4336-b1aa-8825991ea575 on network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:37.696822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:37.697195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Checking segment: {'id': 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:37.697598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.697992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Bound using segment: {'id': 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:37.698451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Bound port: d7760a9a-4b7a-4336-b1aa-8825991ea575, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '8b3ad505-d2fe-4c6f-8e42-e7174720ec4d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:37.698859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.735114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Subnet': ['ID=51009db1-2b8a-4b29-afa1-2b1aba84cd14,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:37.741271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:37.742259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.750090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af051ca7-64ac-4e41-be02-559f04a54edd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:37.795669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.800239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8606a3e2-a3bc-412a-9a7f-5e8a64eb0ff2 None None] Network 1c8e456a-762d-4344-9670-e5d3a55cd60d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:37.810044 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/subnets/51009db1-2b8a-4b29-afa1-2b1aba84cd14 HTTP/1.1" status: 204 len: 168 time: 1.2260604 Nov 24 13:59:37.811799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41102) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:37.816386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] For port d7760a9a-4b7a-4336-b1aa-8825991ea575, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:37.841509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet a84152c6-7f00-40d3-a765-70d962ef8e04 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:37.850957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.878502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] For port d7760a9a-4b7a-4336-b1aa-8825991ea575, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d7760a9a-4b7a-4336-b1aa-8825991ea575,segment=NetworkSegment(d4dddcd3-3c48-48d9-b0ff-8413ceb11f59),segment_id=d4dddcd3-3c48-48d9-b0ff-8413ceb11f59)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:37.894734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:37.900628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-73e16492-cb9c-4a98-8bd0-d49d8ae33452 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:37.970280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.098775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Pushing event updated for resources: {'Port': ['ID=d7760a9a-4b7a-4336-b1aa-8825991ea575,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:38.102511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:38.128907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=d7f6341c-2aa7-458e-bb35-ce009d2902f2,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:38.145125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:38.199403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.209154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': '238905b5-5d73-4cee-bbb3-aa37212e812f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:38.209422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: c0255553-5ced-4e6f-8c52-4c6030e54c5c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:38.216223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.250350 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d1a16fd6-722d-4234-a0f7-891472435b46 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=a4a56793d07e455186fd2fc1eb5e9e6c&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5307362 Nov 24 13:59:38.253997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41106) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:38.258829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.275873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] DHCP port deletion for 1c8e456a-762d-4344-9670-e5d3a55cd60d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:38.281966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc783f61-4697-4509-8ea5-3dd2b2a24c65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:38.283048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Deleting port f72a7729-96f9-4002-8f07-de2621d1e126 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:38.283593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.315294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Deleting port f72a7729-96f9-4002-8f07-de2621d1e126 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:38.315663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.358843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.468322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.482319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network c0255553-5ced-4e6f-8c52-4c6030e54c5c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:38.490340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=38b82bda-dda1-4e46-81b2-1aa2272a43f5,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:38.520680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.529410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:38.564235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, c0255553-5ced-4e6f-8c52-4c6030e54c5c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:38.598270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:38.600341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d7760a9a-4b7a-4336-b1aa-8825991ea575 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:38.606465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.620107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:38.621259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.633669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-414a6983-0e3a-44ed-84bd-8920f0079beb None None] Network c0255553-5ced-4e6f-8c52-4c6030e54c5c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:38.653409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=a84152c6-7f00-40d3-a765-70d962ef8e04,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:38.659234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:38.669128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': '9462ed27-21aa-44c9-8c05-9beadbd4ad5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:38.669535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: cb19ec64-b023-4aad-b4ad-fb107cd2f9c0, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:38.704289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.729546 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/a84152c6-7f00-40d3-a765-70d962ef8e04 HTTP/1.1" status: 204 len: 168 time: 1.4823425 Nov 24 13:59:38.729767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41b8d9cd-9c48-42bd-95de-d34ccbe7e6ba None None] Network 25c148b8-41b8-4c0d-a895-3a676614a606 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:38.731235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41110) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:38.744241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.772635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.6110895 Nov 24 13:59:38.775261 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41114) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:38.798137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c', 'name': 'tempest-PortsTestJSON-127103479'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:38.931035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] For port f72a7729-96f9-4002-8f07-de2621d1e126, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f72a7729-96f9-4002-8f07-de2621d1e126,segment=NetworkSegment(7f01240a-2983-4237-852e-c085968bc54f),segment_id=7f01240a-2983-4237-852e-c085968bc54f)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:38.931469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.936751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] For port f72a7729-96f9-4002-8f07-de2621d1e126, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f72a7729-96f9-4002-8f07-de2621d1e126,segment=NetworkSegment(7f01240a-2983-4237-852e-c085968bc54f),segment_id=7f01240a-2983-4237-852e-c085968bc54f)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:38.937147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:38.942550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.006403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port 11072b39-7584-4ebf-abcf-bef9eade3ac1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:39.006753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.067012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.20.0.1 (8b3ad505-d2fe-4c6f-8e42-e7174720ec4d/cdfca3a5-73d9-41ca-b022-7f05a6bf09f7/208527e9-3d19-4d51-9836-4b7b365ecf03) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:39.104422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Calling delete_port for f72a7729-96f9-4002-8f07-de2621d1e126 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:39.113320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Calling delete_port for f72a7729-96f9-4002-8f07-de2621d1e126 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:39.201949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:39.212383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:39.240096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:39.252884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, cb19ec64-b023-4aad-b4ad-fb107cd2f9c0) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:39.257034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:39.257804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.264918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d7760a9a-4b7a-4336-b1aa-8825991ea575 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:39.283595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:39.288094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.289909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5086a7ee-d6ca-4557-bea6-e18c77d0978c None None] Network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:39.322004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 9dc19d65-507e-4fae-9d8f-717d1cc42b82 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:39.410659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.419378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee4382e8-2b03-4b52-a215-4866395f2d39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:39.429141 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.5145841 Nov 24 13:59:39.459612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:39.468661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f72a7729-96f9-4002-8f07-de2621d1e126 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:39.480326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1538570745'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:39.490478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb408cf9-bda5-4dad-ab8e-e9b7783f8993,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:39.491563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:39.493826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:39.519647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:39.523040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.524484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/bb408cf9-bda5-4dad-ab8e-e9b7783f8993 HTTP/1.1" status: 204 len: 168 time: 1.2688599 Nov 24 13:59:39.529890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:39.533539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.546694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:39.550818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2aad0866-a922-44d7-b45d-bbc05bd148a6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:39.552903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] For port 11072b39-7584-4ebf-abcf-bef9eade3ac1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=11072b39-7584-4ebf-abcf-bef9eade3ac1,segment=NetworkSegment(61dc770c-e764-4d87-acf1-c9432dc3d4b7),segment_id=61dc770c-e764-4d87-acf1-c9432dc3d4b7)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:39.553267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.561781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-333d1b88-5dfc-4678-9abf-fb344cbfe0ef None None] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:39.605128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] No DVR routers for this DVR port f72a7729-96f9-4002-8f07-de2621d1e126 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:39.609165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f72a7729-96f9-4002-8f07-de2621d1e126 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:59:39.609737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f72a7729-96f9-4002-8f07-de2621d1e126 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:59:39.637303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:39.640529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.642674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Port': ['ID=f72a7729-96f9-4002-8f07-de2621d1e126,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:39.656315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-c0255553-5ced-4e6f-8c52-4c6030e54c5c', 'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': 'd7f6341c-2aa7-458e-bb35-ce009d2902f2'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:39.657669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.659711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.8 (c0255553-5ced-4e6f-8c52-4c6030e54c5c/d7f6341c-2aa7-458e-bb35-ce009d2902f2/9dc19d65-507e-4fae-9d8f-717d1cc42b82) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:39.712849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.713263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:39.722668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for 11072b39-7584-4ebf-abcf-bef9eade3ac1 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:39.780511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:39.781279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:39.802403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 208527e9-3d19-4d51-9836-4b7b365ecf03 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:39.813185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 875} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:39.838555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.838894 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment 697209ef-89b6-4f14-ba98-0626865caca4 of type vlan for network e701d90c-1825-4b75-9ad9-32d14869a562 Nov 24 13:59:39.867084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.875687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce8b15dd-fba1-47d7-ac2b-ef1d5cd55ef0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:39.929266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.940868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=11072b39-7584-4ebf-abcf-bef9eade3ac1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:39.944681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:39.951438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:39.952541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:39.956271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.003024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c8e456a-762d-4344-9670-e5d3a55cd60d']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:40.003193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No DVR routers for this DVR port 11072b39-7584-4ebf-abcf-bef9eade3ac1 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:40.008209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21ec69c2-c2ee-430d-abc3-de3b16e138e5 None None] DHCP port deletion for 25c148b8-41b8-4c0d-a895-3a676614a606 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:40.011000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Provisioning for port d7760a9a-4b7a-4336-b1aa-8825991ea575 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:40.030757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Provisioning complete for port d7760a9a-4b7a-4336-b1aa-8825991ea575 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:40.031336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.073798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7f01240a-2983-4237-852e-c085968bc54f') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:40.074583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7f01240a-2983-4237-852e-c085968bc54f') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:40.087512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.096068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.124747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object 9dc19d65-507e-4fae-9d8f-717d1cc42b82 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:40.126300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.135699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Releasing vlan 895 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:40.136447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:40.157520 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:40.202698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=208527e9-3d19-4d51-9836-4b7b365ecf03,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:40.206514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:40.209981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:40.211128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:40.215197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.223828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:40.283504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-cb19ec64-b023-4aad-b4ad-fb107cd2f9c0', 'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '38b82bda-dda1-4e46-81b2-1aa2272a43f5'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:40.284687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.287601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.316428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.319837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Deleting port f72a7729-96f9-4002-8f07-de2621d1e126 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:40.321695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:40.322295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.330353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44a5f166-66d4-407d-ac1a-f3fac4650956 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:40.331210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.406581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.423788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-68dfe11f-d563-418d-b314-8cfb02c74d64 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:40.468957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['25c148b8-41b8-4c0d-a895-3a676614a606']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:40.524900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 11072b39-7584-4ebf-abcf-bef9eade3ac1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:40.528680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network c0255553-5ced-4e6f-8c52-4c6030e54c5c is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:40.534364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:40.539387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:40.556678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '61dc770c-e764-4d87-acf1-c9432dc3d4b7') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:40.557069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '61dc770c-e764-4d87-acf1-c9432dc3d4b7') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:40.578488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9c370796-4cbb-445c-ac8b-b4062416e850 None None] The port 'f72a7729-96f9-4002-8f07-de2621d1e126' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:40.589175 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.1284857 Nov 24 13:59:40.597138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41138) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:40.601079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.610124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=e701d90c-1825-4b75-9ad9-32d14869a562,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:40.627467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': 'e701d90c-1825-4b75-9ad9-32d14869a562', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:40.635931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 11072b39-7584-4ebf-abcf-bef9eade3ac1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:59:40.637013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 11072b39-7584-4ebf-abcf-bef9eade3ac1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:59:40.638741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network e701d90c-1825-4b75-9ad9-32d14869a562 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:40.643423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:40.644699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.673619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.678167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.689914 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] 10.222.0.70 "DELETE /v2.0/networks/1c8e456a-762d-4344-9670-e5d3a55cd60d HTTP/1.1" status: 204 len: 168 time: 2.8766618 Nov 24 13:59:40.700917 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.9223285 Nov 24 13:59:40.707132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41146) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:40.709893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=9dc19d65-507e-4fae-9d8f-717d1cc42b82,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:40.746395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.322s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:40.746908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1a073a8b-9f43-498e-898c-2dd0b7c24d1f tempest-ExternalNetworksTestJSON-1649952733 tempest-ExternalNetworksTestJSON-1649952733-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:40.772667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.779559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Pushing event deleted for resources: {'Network': ['ID=1c8e456a-762d-4344-9670-e5d3a55cd60d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:40.783858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:40.804469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 9dc19d65-507e-4fae-9d8f-717d1cc42b82 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:40.804864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.809631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:40.813591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:40.816572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:40.822327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:40.830540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.500s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:40.841546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:40.860686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.962672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 879 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:40.963062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41150) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:40.984255 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:40.993532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Allocated IP 2001:db8:0:ffff::2 (cb19ec64-b023-4aad-b4ad-fb107cd2f9c0/38b82bda-dda1-4e46-81b2-1aa2272a43f5/ae1df932-8fe8-4b82-a8f3-381d544ecfa7) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:40.997803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.031266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Allocated IP 172.20.0.2 (c0255553-5ced-4e6f-8c52-4c6030e54c5c/d7f6341c-2aa7-458e-bb35-ce009d2902f2/fa9ab254-0a4d-4b3a-9878-6fdac4f109aa) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:41.117307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.188744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41158) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:41.214265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] For port d7760a9a-4b7a-4336-b1aa-8825991ea575, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d7760a9a-4b7a-4336-b1aa-8825991ea575,segment=NetworkSegment(d4dddcd3-3c48-48d9-b0ff-8413ceb11f59),segment_id=d4dddcd3-3c48-48d9-b0ff-8413ceb11f59)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:41.250763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.275597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.286249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:41.408927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'networks': [{'name': 'tempest-network--1616512045'}, {'name': 'tempest-network--1647913116'}]} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:41.409252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'network': {'name': 'tempest-network--1616512045'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:41.409700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'network': {'name': 'tempest-network--1647913116'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:41.415607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:41.454904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 9dc19d65-507e-4fae-9d8f-717d1cc42b82 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:41.498935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.501871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Usage tracker for resource:network and tenant:f0d8ccca93984618ad200eead84e76c2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:41.512113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:41.529514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:41.549690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.575133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 2 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:41.593040 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 13:59:41.594426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Pushing event updated for resources: {'Port': ['ID=d7760a9a-4b7a-4336-b1aa-8825991ea575,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:41.605589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:41.610609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=25c148b8-41b8-4c0d-a895-3a676614a606,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:41.625016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:41.669041 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/25c148b8-41b8-4c0d-a895-3a676614a606 HTTP/1.1" status: 204 len: 168 time: 2.9360888 Nov 24 13:59:41.675424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'network': 2} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:41.679826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.691874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41168) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:41.701147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.707246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.727563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Transition to ACTIVE for port object fa9ab254-0a4d-4b3a-9878-6fdac4f109aa will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:41.731599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Transition to ACTIVE for port object ae1df932-8fe8-4b82-a8f3-381d544ecfa7 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:41.776204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Transition to ACTIVE for port object fa9ab254-0a4d-4b3a-9878-6fdac4f109aa will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:41.778180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.781894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.782481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Transition to ACTIVE for port object ae1df932-8fe8-4b82-a8f3-381d544ecfa7 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:41.791180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f49d0886-9d7d-45c3-9582-bf79f08fd81e tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:41.791741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.798069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1532e4d5-2f97-4023-a4de-50cd9fcd098e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:41.833546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:41.887824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:41.895160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=9dc19d65-507e-4fae-9d8f-717d1cc42b82,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:41.896300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:41.896527 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2fefbe73-77d6-4b1c-9bd8-ca8b1a608c4d admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=bf4eb15856244358b02c2c7e03cc6aad&name=default HTTP/1.1" status: 200 len: 2647 time: 0.7024519 Nov 24 13:59:41.902152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:41.907095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41172) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:41.920164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:41.967903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Network c0255553-5ced-4e6f-8c52-4c6030e54c5c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:41.987147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Pushing event updated for resources: {'Port': ['ID=fa9ab254-0a4d-4b3a-9878-6fdac4f109aa,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:41.989978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:42.010099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eef39681-276a-4fd6-843a-93b24dfccce6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:42.017018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eef39681-276a-4fd6-843a-93b24dfccce6 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/ee13f173-2516-40d9-8098-80f4ac125ec3 HTTP/1.1" status: 200 len: 844 time: 0.3228424 Nov 24 13:59:42.018043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41176) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:42.024378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4db5dda3-b1f0-42ef-ae45-960ea46d21b9 None None] Provisioning for port 208527e9-3d19-4d51-9836-4b7b365ecf03 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:42.028746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.030803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:42.031667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:42.047313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a39b21a6-8c46-4a7a-b4aa-365306712299 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.191s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:42.052430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Usage tracker for resource:security_group_rule and tenant:f0d8ccca93984618ad200eead84e76c2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:42.062355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:42.078024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:42.124038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.135352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:42.152863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4db5dda3-b1f0-42ef-ae45-960ea46d21b9 None None] Provisioning complete for port 208527e9-3d19-4d51-9836-4b7b365ecf03 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:42.153197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4db5dda3-b1f0-42ef-ae45-960ea46d21b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.162240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.176687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.190558 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/9dc19d65-507e-4fae-9d8f-717d1cc42b82 HTTP/1.1" status: 204 len: 168 time: 1.4820685 Nov 24 13:59:42.190889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41180) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:42.244965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.266302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0360676e-81b7-4e95-9811-df174f1966a7 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/ee13f173-2516-40d9-8098-80f4ac125ec3?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.1667380 Nov 24 13:59:42.267033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41184) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:42.275083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:42.292555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.325961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Attempting to bind port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:42.326247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Attempting to bind port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '238905b5-5d73-4cee-bbb3-aa37212e812f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:42.326625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Attempting to bind port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa on network c0255553-5ced-4e6f-8c52-4c6030e54c5c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:42.327839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.334228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Attempting to bind port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:42.334639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Attempting to bind port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9462ed27-21aa-44c9-8c05-9beadbd4ad5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:42.334958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Attempting to bind port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 on network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:42.335411 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-7eadb672-4a52-47e4-9eee-ab56ff7b6aae tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 13:59:42.335887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7eadb672-4a52-47e4-9eee-ab56ff7b6aae tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:59:42.369227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Pushing event updated for resources: {'Port': ['ID=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:42.380133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.380932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:42.381312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Checking segment: {'id': '9462ed27-21aa-44c9-8c05-9beadbd4ad5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:42.381808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.382104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Bound using segment: {'id': '9462ed27-21aa-44c9-8c05-9beadbd4ad5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:42.382596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Bound port: ae1df932-8fe8-4b82-a8f3-381d544ecfa7, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9462ed27-21aa-44c9-8c05-9beadbd4ad5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'cb19ec64-b023-4aad-b4ad-fb107cd2f9c0'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:42.382976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.393867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:42.394418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Checking segment: {'id': '238905b5-5d73-4cee-bbb3-aa37212e812f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:42.394684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.395041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=6c1623fd-aadd-4b45-a8db-30755ea690d5,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:42.395224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Bound using segment: {'id': '238905b5-5d73-4cee-bbb3-aa37212e812f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:42.395540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Bound port: fa9ab254-0a4d-4b3a-9878-6fdac4f109aa, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '238905b5-5d73-4cee-bbb3-aa37212e812f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'c0255553-5ced-4e6f-8c52-4c6030e54c5c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:42.397261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.430494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.436653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3b25dd8-35ba-473e-b55e-3f8416c3b7f4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.137s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:42.491141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.504725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bee430b8-3d2b-4879-aba9-6a9e6c94b72c tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:42.510949 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7eadb672-4a52-47e4-9eee-ab56ff7b6aae tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/9dc19d65-507e-4fae-9d8f-717d1cc42b82 HTTP/1.1" status: 404 len: 333 time: 0.3131878 Nov 24 13:59:42.515326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.515848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41188) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:42.524109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9d88955-7413-452e-af7c-12451011b19e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:42.526346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.528682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.530004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] For port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:42.533263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] For port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=fa9ab254-0a4d-4b3a-9878-6fdac4f109aa,segment=NetworkSegment(238905b5-5d73-4cee-bbb3-aa37212e812f),segment_id=238905b5-5d73-4cee-bbb3-aa37212e812f)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:42.534995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.535412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.540067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d7760a9a-4b7a-4336-b1aa-8825991ea575 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:42.571482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': '697209ef-89b6-4f14-ba98-0626865caca4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': 'e701d90c-1825-4b75-9ad9-32d14869a562'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:42.571482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: e701d90c-1825-4b75-9ad9-32d14869a562, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:42.577961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4db5dda3-b1f0-42ef-ae45-960ea46d21b9 None None] Port 208527e9-3d19-4d51-9836-4b7b365ecf03 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:42.580658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=208527e9-3d19-4d51-9836-4b7b365ecf03,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:42.581184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:42.584617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.585724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d9d88955-7413-452e-af7c-12451011b19e HTTP/1.1" status: 204 len: 168 time: 0.6773975 Nov 24 13:59:42.587232 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-4afe8b85-a5e7-4c67-b750-33c4742156c7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 13:59:42.587676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4afe8b85-a5e7-4c67-b750-33c4742156c7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:42.589371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.593986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:42.597660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:42.599699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:42.605931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:42.618201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.621902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4afe8b85-a5e7-4c67-b750-33c4742156c7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:42.622305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-be47f3f7-63a4-4367-baf4-da2050cb2824 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.070s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:42.623279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4afe8b85-a5e7-4c67-b750-33c4742156c7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/9dc19d65-507e-4fae-9d8f-717d1cc42b82 HTTP/1.1" status: 404 len: 333 time: 0.1022401 Nov 24 13:59:42.624476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:42.639894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41194) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:42.685596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Pushing event updated for resources: {'Port': ['ID=fa9ab254-0a4d-4b3a-9878-6fdac4f109aa,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:42.699209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 851} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:42.711329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.712392 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Added segment 9e72c1c7-3287-4f7c-a62e-c821b9b38672 of type vlan for network cbf58fd4-9884-4779-99b7-097e914de78d Nov 24 13:59:42.720862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.773166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.805932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4db5dda3-b1f0-42ef-ae45-960ea46d21b9 None None] Provisioning complete for port d7760a9a-4b7a-4336-b1aa-8825991ea575 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:42.806483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4db5dda3-b1f0-42ef-ae45-960ea46d21b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.816069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ad26aa81-6a56-43cd-b546-a064dd1c9f6c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:42.830787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:42.880700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] For port ae1df932-8fe8-4b82-a8f3-381d544ecfa7, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:42.882837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d7760a9a-4b7a-4336-b1aa-8825991ea575 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:42.883322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.895592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network e701d90c-1825-4b75-9ad9-32d14869a562 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:42.915823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.917625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, e701d90c-1825-4b75-9ad9-32d14869a562) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:42.930752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:42.931354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:42.941772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d119a454-1ca0-491c-b297-3a171a4400c2 None None] Network e701d90c-1825-4b75-9ad9-32d14869a562 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:42.966717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] For port ae1df932-8fe8-4b82-a8f3-381d544ecfa7, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,segment=NetworkSegment(9462ed27-21aa-44c9-8c05-9beadbd4ad5b),segment_id=9462ed27-21aa-44c9-8c05-9beadbd4ad5b)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:42.986721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 881} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:42.989961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 2.3917561 Nov 24 13:59:42.999959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41202) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:43.002963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.014447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:43.067997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.068632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Added segment ce984801-2ac5-4159-ad33-7c066e80dbd8 of type vlan for network 4793ce17-d4fc-4a60-b0c6-ad59de362d60 Nov 24 13:59:43.100336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.221315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet d7f6341c-2aa7-458e-bb35-ce009d2902f2 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:43.225641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.286145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:59:43.344233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:43.349545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:43.351044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Pushing event updated for resources: {'Port': ['ID=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:43.401330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.387s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:43.438276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.535045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.536279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.549405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:43.552964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:43.553618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.589244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:43.600854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.715746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8e4e402-76fc-43e5-8b3a-d8946d772998 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-e701d90c-1825-4b75-9ad9-32d14869a562', 'network_id': 'e701d90c-1825-4b75-9ad9-32d14869a562', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '6c1623fd-aadd-4b45-a8db-30755ea690d5'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:43.716630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c8e4e402-76fc-43e5-8b3a-d8946d772998 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.768468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.780602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.787653 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 2.8010297 Nov 24 13:59:43.797295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41216) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:43.798022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83465495-fcb1-4b4a-8888-53469c4a0426 tempest-ExtraDHCPOptionsTestJSON-405351757 tempest-ExtraDHCPOptionsTestJSON-405351757-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:43.806875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Network': ['ID=cbf58fd4-9884-4779-99b7-097e914de78d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:43.843971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network cbf58fd4-9884-4779-99b7-097e914de78d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:43.844404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.886929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:43.900248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:43.904150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:43.914472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:43.915066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.006590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6eaeaf05-313e-420b-afc8-2968089ce14c None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:44.044666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41222) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:44.137326 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/d7f6341c-2aa7-458e-bb35-ce009d2902f2 HTTP/1.1" status: 204 len: 168 time: 1.4943976 Nov 24 13:59:44.141604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41226) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:44.157782 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8876300 Nov 24 13:59:44.166774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41230) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:44.239524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Network': ['ID=4793ce17-d4fc-4a60-b0c6-ad59de362d60,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:44.248723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.659s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:44.328066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 4793ce17-d4fc-4a60-b0c6-ad59de362d60 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:44.366338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.368512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=960509e9-34f1-4442-91dc-9e489a019924,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:44.380133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'security_group': {'name': 'tempest-secgroup-784756729'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:44.392949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.788s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:44.393348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:44.397509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:44.405018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:44.412828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.419286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:44.427556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:44.442496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.644s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:44.448217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7b2d83a9-c20e-4eac-b8e2-efbb0dc7fc3d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.564s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:44.514980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.578764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1080495039'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:44.594539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=d7f6341c-2aa7-458e-bb35-ce009d2902f2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:44.601788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:44.602234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:44.602923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.611810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:44.618272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:44.626513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d31452e4-8046-45cb-b299-475c7b9d6606 None None] Provisioning complete for port 208527e9-3d19-4d51-9836-4b7b365ecf03 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:44.626838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d31452e4-8046-45cb-b299-475c7b9d6606 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.629433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:44.635526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.644440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:44.644630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-babcd024-b3cb-4f03-8a96-e11580d1753d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:44.666258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fa9ab254-0a4d-4b3a-9878-6fdac4f109aa up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:44.687556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43fb5945-5584-44e7-8899-7d37512c7396 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:44.693476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=6c1623fd-aadd-4b45-a8db-30755ea690d5,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:44.695473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43fb5945-5584-44e7-8899-7d37512c7396 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:44.695853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:44.698306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:44.700292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43fb5945-5584-44e7-8899-7d37512c7396 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:44.702807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.709576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43fb5945-5584-44e7-8899-7d37512c7396 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:44.715218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-43fb5945-5584-44e7-8899-7d37512c7396 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2407 time: 0.8835523 Nov 24 13:59:44.717134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41236) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:44.793720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1ee4364-0172-4330-9f41-3364a6705d2d None None] Network c0255553-5ced-4e6f-8c52-4c6030e54c5c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:44.823187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server [None req-c8e4e402-76fc-43e5-8b3a-d8946d772998 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6c1623fd-aadd-4b45-a8db-30755ea690d5: This subnet is being modified by another concurrent operation. Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 274, in create_dhcp_port Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 99, in _port_action Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 335, in create_port Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 685, in inner Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 13:59:44.834266 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1423, in create_port Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1390, in _create_port_db Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1440, in create_port_db Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 669, in _ipam_get_subnets Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise exception Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 6c1623fd-aadd-4b45-a8db-30755ea690d5: This subnet is being modified by another concurrent operation. Nov 24 13:59:44.838835 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Nov 24 13:59:44.870840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.873047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:44.910535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:44.920622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e701d90c-1825-4b75-9ad9-32d14869a562']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:44.926797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group_rule and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:44.932523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:44.947058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '697209ef-89b6-4f14-ba98-0626865caca4') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:44.947374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '697209ef-89b6-4f14-ba98-0626865caca4') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:44.967216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:44.976018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:44.977554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-588d6546-4c0a-4a81-b924-795a6a090cb0 None None] Network e701d90c-1825-4b75-9ad9-32d14869a562 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:44.979282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.000756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:security_group_rule and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:45.004911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:45.018478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:45.020665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.040980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 875 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:45.041378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:45.057421 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:45.062967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d31452e4-8046-45cb-b299-475c7b9d6606 None None] Port 208527e9-3d19-4d51-9836-4b7b365ecf03 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:45.083494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.110479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cbf58fd4-9884-4779-99b7-097e914de78d']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.124192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9e72c1c7-3287-4f7c-a62e-c821b9b38672') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.124584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9e72c1c7-3287-4f7c-a62e-c821b9b38672') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.137163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.155252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.163570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Releasing vlan 851 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:45.164420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.184186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 13:59:45.186569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.192313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35ad7204-cebe-4654-9431-b72a07f2c82c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:45.218940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.221057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-d1d0487a-60e7-49df-8f6a-8133f5eb276b', 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'tenant_id': '5a0a3f13e5494d5db442bf11517640e4', 'fixed_ips': [{'subnet_id': '960509e9-34f1-4442-91dc-9e489a019924'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:45.222009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.237698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=e701d90c-1825-4b75-9ad9-32d14869a562,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:45.243834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:45.249301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:45.269369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.271591 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/e701d90c-1825-4b75-9ad9-32d14869a562 HTTP/1.1" status: 204 len: 168 time: 2.2686605 Nov 24 13:59:45.280924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:45.282501 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:45.287774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41240) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:45.304477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ae1df932-8fe8-4b82-a8f3-381d544ecfa7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:45.334550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.345729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ae3766a0-2de2-427a-b71d-fe932ecee8ba tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:45.370819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41140bdb-b21a-4335-a781-84bdb8f878b9 None None] Network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:45.377779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1910201962'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:45.383216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:45.387564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.411112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:45.413671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:45.430236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:45.436440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 864} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:45.448074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'SecurityGroup': ['ID=85221422-5477-44d6-a70e-46a24d5cc781,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:45.455737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:45.456639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:45.461884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.462330 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 9ec604a5-fcfa-4738-9bf3-f895431479d4 of type vlan for network 6f950245-e4b2-4735-849a-ee586a874fa7 Nov 24 13:59:45.507411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.547904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b1592314-fd42-481d-b82f-15b185dc8e5f None None] Provisioning for port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:45.555221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.559719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:45.560754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.565371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:45.568800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:45.576032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b1592314-fd42-481d-b82f-15b185dc8e5f None None] Provisioning complete for port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:45.576296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b1592314-fd42-481d-b82f-15b185dc8e5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.580954 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] Sync routers for ids ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:45.594307 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] Routers {'d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:45.595175 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.615017 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/d98b2ea8-f759-4b1e-a231-a4ef92eebbd1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2523756 Nov 24 13:59:45.620767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41244) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:45.643783 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.5688329 Nov 24 13:59:45.683443 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.728664 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] Routers {'d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:45.729292 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.734098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4e23a2b2-51bc-43e4-b454-8bccb99ebde0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:45.745328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:45.748114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.750485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.751794 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 1.3913064 Nov 24 13:59:45.752827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:45.754512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41248) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:45.762520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'security_group': {'name': 'tempest-secgroup-1826104142'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:45.766548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=6f950245-e4b2-4735-849a-ee586a874fa7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:45.772131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b2f735e-7c4f-43c3-9620-7dfd2c642f69 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:45.774127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3a308f3-7200-4805-9733-017fee8886ec tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:45.775031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3a308f3-7200-4805-9733-017fee8886ec tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:45.779299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:45.820666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:45.820996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41252) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:45.823798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.830610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:45.842083 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:45.842525 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9137f0e-50c9-43f1-a8be-7a4f80e1b154 None None] The sync data for ids ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:45.857134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3a308f3-7200-4805-9733-017fee8886ec tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:45.858019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:45.861172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f3a308f3-7200-4805-9733-017fee8886ec tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports/208527e9-3d19-4d51-9836-4b7b365ecf03 HTTP/1.1" status: 200 len: 910 time: 0.2348552 Nov 24 13:59:45.863374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:45.863512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41256) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:45.865505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6f950245-e4b2-4735-849a-ee586a874fa7 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:45.866435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.871556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=fa9ab254-0a4d-4b3a-9878-6fdac4f109aa,segment=NetworkSegment(238905b5-5d73-4cee-bbb3-aa37212e812f),segment_id=238905b5-5d73-4cee-bbb3-aa37212e812f)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:45.872041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.878350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc650585-fbd1-44a3-ae34-f0a059081f11 None None] DHCP port deletion for c0255553-5ced-4e6f-8c52-4c6030e54c5c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:45.882194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:45.894426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Network': ['ID=cbf58fd4-9884-4779-99b7-097e914de78d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:45.896972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:45.897885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:45.907211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-dc650585-fbd1-44a3-ae34-f0a059081f11 None None] Deleting port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:45.907595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc650585-fbd1-44a3-ae34-f0a059081f11 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:45.958899 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/networks/cbf58fd4-9884-4779-99b7-097e914de78d HTTP/1.1" status: 204 len: 168 time: 1.2358639 Nov 24 13:59:45.976692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41260) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:46.029391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for fa9ab254-0a4d-4b3a-9878-6fdac4f109aa owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:46.073615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.087553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 865} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:46.118380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.118814 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment cc1a691e-407a-44e6-b50b-27dc00a19891 of type vlan for network be6e4471-74b1-4989-9702-628e500e616c Nov 24 13:59:46.182049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b1592314-fd42-481d-b82f-15b185dc8e5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.182183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:46.188704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.193138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group_rule and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:46.196532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.202325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:46.206290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6bce8084-4919-4214-949a-fe7ed4f013a9 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:46.232290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-dc650585-fbd1-44a3-ae34-f0a059081f11 None None] The port 'fa9ab254-0a4d-4b3a-9878-6fdac4f109aa' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 13:59:46.254217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:46.257839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=fa9ab254-0a4d-4b3a-9878-6fdac4f109aa,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:46.260472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:46.282905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port fa9ab254-0a4d-4b3a-9878-6fdac4f109aa on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:46.285409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Allocated IP 2001:db8::2 (d1d0487a-60e7-49df-8f6a-8133f5eb276b/960509e9-34f1-4442-91dc-9e489a019924/afbb30e1-0766-4741-97b5-1b18534c3291) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:46.290495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:46.302629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:46.309710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.312890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:46.325383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:46.375664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:46.419523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.424755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:46.425573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.454048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-be510aff-1954-4451-b4f8-56c3ca9ae143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:46.479285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fa9ab254-0a4d-4b3a-9878-6fdac4f109aa no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 13:59:46.528356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: fa9ab254-0a4d-4b3a-9878-6fdac4f109aa {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 13:59:46.528991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fa9ab254-0a4d-4b3a-9878-6fdac4f109aa not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 13:59:46.547184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.552108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.581150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.598340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.626966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4793ce17-d4fc-4a60-b0c6-ad59de362d60']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:46.637293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.644870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.659651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Transition to ACTIVE for port object afbb30e1-0766-4741-97b5-1b18534c3291 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:46.671167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ce984801-2ac5-4159-ad33-7c066e80dbd8') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:46.671501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ce984801-2ac5-4159-ad33-7c066e80dbd8') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:46.691605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c0255553-5ced-4e6f-8c52-4c6030e54c5c']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:46.692438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Transition to ACTIVE for port object afbb30e1-0766-4741-97b5-1b18534c3291 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:46.704640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.4095564 Nov 24 13:59:46.712858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41264) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:46.714530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.717180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '238905b5-5d73-4cee-bbb3-aa37212e812f') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:46.717517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '238905b5-5d73-4cee-bbb3-aa37212e812f') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:46.726272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=be6e4471-74b1-4989-9702-628e500e616c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:46.729147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.275s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:46.734471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:46.738751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': 'be6e4471-74b1-4989-9702-628e500e616c', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:46.753526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-91c72b4c-bf93-460c-a6e8-fc4aacb39383 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.142s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:46.773151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.776827 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 1.0187259 Nov 24 13:59:46.776827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.790167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41268) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:46.801758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.807023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-170273115', 'security_groups': ['d5163791-bd90-4352-a802-99be1f071e03'], 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '960509e9-34f1-4442-91dc-9e489a019924'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:46.827812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Provisioning for port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:46.830832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network be6e4471-74b1-4989-9702-628e500e616c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:46.869809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Provisioning complete for port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:46.871005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.892994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.909878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Releasing vlan 881 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:46.910278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.911643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:46.929184 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:46.968876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d5163791-bd90-4352-a802-99be1f071e03,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:46.969793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:46.982656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:46.984826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:46.987394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:46.994159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Pushing event updated for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:46.995258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:46.999167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:47.000774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:47.002281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:47.008200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:47.014195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 896 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:47.014748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:47.032032 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:47.038767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.048612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-75768d4d-a960-4fc0-8e7d-161b144fdfc4 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:47.066592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.117624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Network': ['ID=4793ce17-d4fc-4a60-b0c6-ad59de362d60,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:47.122997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:47.125405 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/networks/4793ce17-d4fc-4a60-b0c6-ad59de362d60 HTTP/1.1" status: 204 len: 168 time: 1.1477492 Nov 24 13:59:47.129293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41272) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:47.135541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Attempting to bind port afbb30e1-0766-4741-97b5-1b18534c3291 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:47.135838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Attempting to bind port afbb30e1-0766-4741-97b5-1b18534c3291 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '88f19f83-091c-4d89-aa79-2ae8ba5b119e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:47.138921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Attempting to bind port afbb30e1-0766-4741-97b5-1b18534c3291 on network d1d0487a-60e7-49df-8f6a-8133f5eb276b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:47.144635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:47.183885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:47.184575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Checking segment: {'id': '88f19f83-091c-4d89-aa79-2ae8ba5b119e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:47.185268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.185952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Bound using segment: {'id': '88f19f83-091c-4d89-aa79-2ae8ba5b119e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:47.186436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Bound port: afbb30e1-0766-4741-97b5-1b18534c3291, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88f19f83-091c-4d89-aa79-2ae8ba5b119e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:47.187004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.245161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:47.246559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.247361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.253830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.255484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:47.281366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.298066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:47.301622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=c0255553-5ced-4e6f-8c52-4c6030e54c5c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:47.306823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.327525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] For port ae1df932-8fe8-4b82-a8f3-381d544ecfa7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,segment=NetworkSegment(9462ed27-21aa-44c9-8c05-9beadbd4ad5b),segment_id=9462ed27-21aa-44c9-8c05-9beadbd4ad5b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:47.328328 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/c0255553-5ced-4e6f-8c52-4c6030e54c5c HTTP/1.1" status: 204 len: 168 time: 3.1822889 Nov 24 13:59:47.329169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41276) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:47.330067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:47.332455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:47.333242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.338093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=afbb30e1-0766-4741-97b5-1b18534c3291,segment=NetworkSegment(88f19f83-091c-4d89-aa79-2ae8ba5b119e),segment_id=88f19f83-091c-4d89-aa79-2ae8ba5b119e)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:47.339113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5caee820-317f-4955-86fc-eec92f1b836c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:47.351089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-471266490'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:47.358597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:47.377123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.412824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:47.418574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.424626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:47.428564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:47.431145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:47.436668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Pushing event updated for resources: {'Port': ['ID=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:47.437336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.440327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:47.441477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.050s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:47.455027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:47.494271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:47.498329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.509351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port e2f52d74-ccd7-499d-9080-f709d76ecebe yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:47.514811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b759fecc-2eac-424a-ae15-ec65d4460425 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:47.520960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b759fecc-2eac-424a-ae15-ec65d4460425 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:47.521744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b759fecc-2eac-424a-ae15-ec65d4460425 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Synchronizing usage tracker for tenant:f0d8ccca93984618ad200eead84e76c2 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:47.549680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=54f3d445-a1ce-4f48-818a-bed6a59f09f3,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:47.563742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:47.565572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-928dfb5b-dd0a-4982-8f27-f5333af816d4 None None] Provisioning complete for port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:47.565794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-928dfb5b-dd0a-4982-8f27-f5333af816d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.593189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.598348 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Pushing event updated for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:47.601710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:47.614109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b759fecc-2eac-424a-ae15-ec65d4460425 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Unset dirty status for tenant:f0d8ccca93984618ad200eead84e76c2 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:47.619364 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b759fecc-2eac-424a-ae15-ec65d4460425 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.4888971 Nov 24 13:59:47.626422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41280) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:47.639280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1264417125'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:47.650638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:47.680374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:47.682684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '9ec604a5-fcfa-4738-9bf3-f895431479d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:47.683075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 6f950245-e4b2-4735-849a-ee586a874fa7, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:47.778614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:47.781545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.797037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:47.849692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:47.850055 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment d2e92926-0eb4-47c9-8ed7-9db78f28d57d of type vlan for network 74d84999-8cdf-4085-bda3-8841876409a7 Nov 24 13:59:47.968184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.029512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 6f950245-e4b2-4735-849a-ee586a874fa7 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:48.047001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 869} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:48.061956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::28d (d1d0487a-60e7-49df-8f6a-8133f5eb276b/960509e9-34f1-4442-91dc-9e489a019924/e2f52d74-ccd7-499d-9080-f709d76ecebe) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:48.062372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6f950245-e4b2-4735-849a-ee586a874fa7) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:48.066271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.076460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-656ea782-87f4-473e-8c62-2103d7d4ece5 None None] Network 6f950245-e4b2-4735-849a-ee586a874fa7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:48.077534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:48.086845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:48.088042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.095513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.095952 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Added segment 422f27c8-71d7-4cbd-a2b2-7eec4849b2ae of type vlan for network a65bfe60-3c16-4f6e-a417-ef593a1a934d Nov 24 13:59:48.142599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.146386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:48.146976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.190515 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 2.3649564 Nov 24 13:59:48.191019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.200373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41284) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:48.209712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-88801835'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:48.218645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:48.219581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=03e718a2-d2ca-43e8-a6a1-1815ea229650,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:48.228163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:48.229194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:48.232290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:48.233955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1fd18cfb-4dbe-4dfd-89a0-cd5b102ff79e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:48.257070 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.9204988 Nov 24 13:59:48.261658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41288) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:48.280014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:48.297688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '74d84999-8cdf-4085-bda3-8841876409a7', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:48.402437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:48.405836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.429573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.433402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:48.433986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.449541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-6f950245-e4b2-4735-849a-ee586a874fa7', 'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': '54f3d445-a1ce-4f48-818a-bed6a59f09f3'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:48.450156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b3c4d65-a4b6-461e-a475-478e28c2bf7a tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:48.450945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.455982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'cc1a691e-407a-44e6-b50b-27dc00a19891', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 865, 'network_id': 'be6e4471-74b1-4989-9702-628e500e616c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:48.456597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: be6e4471-74b1-4989-9702-628e500e616c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:48.473467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=74d84999-8cdf-4085-bda3-8841876409a7,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:48.490793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:48.541816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.549660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network be6e4471-74b1-4989-9702-628e500e616c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:48.573583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object e2f52d74-ccd7-499d-9080-f709d76ecebe will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:48.577789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, be6e4471-74b1-4989-9702-628e500e616c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:48.583033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:48.589980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.623669 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 1.9096830 Nov 24 13:59:48.625842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.627817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41292) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:48.639222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-236239756'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:48.644039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-651d598b-47c5-45b7-a7cc-4e5d82376840 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:48.655448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:48.658438 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 1.0310478 Nov 24 13:59:48.669943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 74d84999-8cdf-4085-bda3-8841876409a7 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:48.673975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41296) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:48.682903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cda2a1e6-0037-4d0d-85af-a03ffb7f6df0 None None] Network be6e4471-74b1-4989-9702-628e500e616c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:48.684567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:48.692287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-2136961296'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:48.696893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:48.698309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:48.703816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:48.706383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Network': ['ID=a65bfe60-3c16-4f6e-a417-ef593a1a934d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:48.711892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:48.712070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:48.718278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:48.718744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:48.721079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:48.745387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:48.747905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=e2f52d74-ccd7-499d-9080-f709d76ecebe,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:48.755562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:48.758674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:48.760516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:48.765795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:48.769843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:48.770454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.772011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ae1df932-8fe8-4b82-a8f3-381d544ecfa7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:48.774102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:48.776061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:48.779642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.781278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.781454 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 2cd25388-6088-474a-8cb4-b32419d071f1 of type vlan for network 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 Nov 24 13:59:48.805295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:48.813766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network a65bfe60-3c16-4f6e-a417-ef593a1a934d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:48.819209 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.0201600 Nov 24 13:59:48.819842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41300) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:48.829115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:48.848895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Allocated IP 172.20.255.242 (6f950245-e4b2-4735-849a-ee586a874fa7/54f3d445-a1ce-4f48-818a-bed6a59f09f3/d327ff90-a67e-4f45-bb97-210f52dde0af) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:48.860648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:48.863530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.926497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.974074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 863} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:48.979992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:48.985821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:48.989999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:48.992936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:48.993270 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment ca6cefc0-6d2b-42c4-82eb-688fd9045d74 of type vlan for network f8ac2805-72a0-426a-98a5-e7cbbabc008a Nov 24 13:59:48.994574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.001727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:49.028228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:49.047857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.108741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.112495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:49.113045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.151491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe857ae9-36f1-4042-9d78-e594097792d3 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:49.183233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Retry wrapper got retriable exception: Unable to create the network. No available network found in maximum allowed attempts. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:49.183804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:49.186403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.190401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:49.191157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.199587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8c3c57af-eadc-420b-b1d6-eae5cb292fcb tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:49.325858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.347092 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.7184777 Nov 24 13:59:49.354108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41304) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:49.355320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 208527e9-3d19-4d51-9836-4b7b365ecf03 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:49.355912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.360543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=f8ac2805-72a0-426a-98a5-e7cbbabc008a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:49.365327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:49.385693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:49.386883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.389466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=159a661c-7f67-47cf-9bcb-c79d0ff7d5c7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:49.399387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 1.1980636 Nov 24 13:59:49.400662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:49.407016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': 'f8ac2805-72a0-426a-98a5-e7cbbabc008a', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:49.418599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41308) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:49.429708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '159a661c-7f67-47cf-9bcb-c79d0ff7d5c7', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:49.463961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network f8ac2805-72a0-426a-98a5-e7cbbabc008a details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:49.494954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b2e23ca8-979a-4ef4-9fdc-c6fdc4dc5358 None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:49.495680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b2e23ca8-979a-4ef4-9fdc-c6fdc4dc5358 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.519511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:49.596767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-be6e4471-74b1-4989-9702-628e500e616c', 'network_id': 'be6e4471-74b1-4989-9702-628e500e616c', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '03e718a2-d2ca-43e8-a6a1-1815ea229650'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:49.597929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.604814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:49.608869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:49.611801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:49.617615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:49.640596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 960509e9-34f1-4442-91dc-9e489a019924 (CIDR: 2001:db8::/64) Nov 24 13:59:49.642796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:49.677484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 13:59:49.678075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 13:59:49.735927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.774210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:49.797625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:49.817070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:49.831478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b2e23ca8-979a-4ef4-9fdc-c6fdc4dc5358 None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:49.840789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:49.872430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:49.891278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.899068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:49.904648 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8e40f059-3dc8-46e8-bead-fd003351ee5c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.0836785 Nov 24 13:59:49.907302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41312) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:49.921550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:49.935123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.954968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.956349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:49.959844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:49.993419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b2e23ca8-979a-4ef4-9fdc-c6fdc4dc5358 None None] Provisioning for port afbb30e1-0766-4741-97b5-1b18534c3291 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:50.006572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Transition to ACTIVE for port object d327ff90-a67e-4f45-bb97-210f52dde0af will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:50.088440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.088841 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Added segment f0d9b166-e675-4d56-8868-37d9d668b826 of type vlan for network 3f8727a3-f1ec-4af3-86ec-51dd8bb7278a Nov 24 13:59:50.091805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:50.127707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Transition to ACTIVE for port object d327ff90-a67e-4f45-bb97-210f52dde0af will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:50.159864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.169789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:50.175309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:50.180599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:50.185046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:50.192102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:50.203695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Allocated IP 2001:db8::1 (be6e4471-74b1-4989-9702-628e500e616c/03e718a2-d2ca-43e8-a6a1-1815ea229650/33a99f93-54f2-463e-9678-da68a2bc30f0) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:50.228998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 208527e9-3d19-4d51-9836-4b7b365ecf03 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:50.278431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Network 6f950245-e4b2-4735-849a-ee586a874fa7 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:50.282455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-55ac3fb9-51f3-43d8-8096-210e35b79097 None None] Provisioning for port e2f52d74-ccd7-499d-9080-f709d76ecebe completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:50.290415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:50.298174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:50.299171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:50.302302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.344402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Pushing event updated for resources: {'Port': ['ID=d327ff90-a67e-4f45-bb97-210f52dde0af,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:50.353343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:50.358396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-55ac3fb9-51f3-43d8-8096-210e35b79097 None None] Provisioning complete for port e2f52d74-ccd7-499d-9080-f709d76ecebe triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:50.358774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-55ac3fb9-51f3-43d8-8096-210e35b79097 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.381832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=18d22814-9c3e-48ab-8d48-53c0ae9706bd,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:50.393973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.495s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:50.413637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.425409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.450027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port afbb30e1-0766-4741-97b5-1b18534c3291 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:50.485059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.491381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-55b0da84-b6b4-437a-b568-a82e30bf10bd tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:50.515488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:50.515899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.538031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-55ac3fb9-51f3-43d8-8096-210e35b79097 None None] Port e2f52d74-ccd7-499d-9080-f709d76ecebe cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:50.577375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.ipam_backend_mixin [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Performing IP validity checks on allocation pools {{(pid=83526) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 13:59:50.578200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.ipam_backend_mixin [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83526) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 13:59:50.581552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '74d84999-8cdf-4085-bda3-8841876409a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:50.582096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: 74d84999-8cdf-4085-bda3-8841876409a7, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:50.590522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Attempting to bind port d327ff90-a67e-4f45-bb97-210f52dde0af on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:50.590905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Attempting to bind port d327ff90-a67e-4f45-bb97-210f52dde0af by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9ec604a5-fcfa-4738-9bf3-f895431479d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:50.591269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Attempting to bind port d327ff90-a67e-4f45-bb97-210f52dde0af on network 6f950245-e4b2-4735-849a-ee586a874fa7 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:50.601501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=54140a24-8764-4f1d-8830-56abd9ff4083,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:50.611462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.615412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:50.616049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.626548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-be5ffe5a-4dca-4416-ab8b-f50b5ca04511 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:50.644921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:50.654402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:50.654830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Checking segment: {'id': '9ec604a5-fcfa-4738-9bf3-f895431479d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:50.655296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.655571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Bound using segment: {'id': '9ec604a5-fcfa-4738-9bf3-f895431479d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:50.656169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Bound port: d327ff90-a67e-4f45-bb97-210f52dde0af, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9ec604a5-fcfa-4738-9bf3-f895431479d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 864, 'network_id': '6f950245-e4b2-4735-849a-ee586a874fa7'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:50.656571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.673713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '2cd25388-6088-474a-8cb4-b32419d071f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '159a661c-7f67-47cf-9bcb-c79d0ff7d5c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:50.674092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:50.714755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:50.732257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:50.743332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.746152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:50.746760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.784668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64722a40-7e8e-4d68-b02d-83efb52a7e83 None None] Network 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:50.800534 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 1.3778214 Nov 24 13:59:50.800737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Transition to ACTIVE for port object 33a99f93-54f2-463e-9678-da68a2bc30f0 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:50.800829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.803200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41316) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:50.803935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1a05bf1f-d8d6-4ef1-b4b3-d2969b8f3fc1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:50.819444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Network': ['ID=3f8727a3-f1ec-4af3-86ec-51dd8bb7278a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:50.830893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:50.835449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Transition to ACTIVE for port object 33a99f93-54f2-463e-9678-da68a2bc30f0 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:50.878319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 74d84999-8cdf-4085-bda3-8841876409a7 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:50.892229 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 2.2097259 Nov 24 13:59:50.898988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41320) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:50.899632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 74d84999-8cdf-4085-bda3-8841876409a7) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:50.919596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'ports': [{'network_id': 'a65bfe60-3c16-4f6e-a417-ef593a1a934d', 'name': 'tempest-port--1484791304', 'admin_state_up': True}, {'network_id': '3f8727a3-f1ec-4af3-86ec-51dd8bb7278a', 'admin_state_up': False}]} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:50.919977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'port': {'network_id': 'a65bfe60-3c16-4f6e-a417-ef593a1a934d', 'name': 'tempest-port--1484791304', 'admin_state_up': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:50.920434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'port': {'network_id': '3f8727a3-f1ec-4af3-86ec-51dd8bb7278a', 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:50.935825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:50.936412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.961849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:50.967462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 3f8727a3-f1ec-4af3-86ec-51dd8bb7278a details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:50.969382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:50.973657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=a0a69375-08b2-4745-bb36-2edd70a8f808,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:50.975878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:50.976465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:50.989849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:50.991929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-878590fe-0276-4472-a702-50484e1b8d87 None None] Network 74d84999-8cdf-4085-bda3-8841876409a7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:51.006080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.021881 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 1.1087432 Nov 24 13:59:51.021881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41324) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:51.029543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1847121999', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'a0a69375-08b2-4745-bb36-2edd70a8f808'}], 'security_groups': ['4e23a2b2-51bc-43e4-b454-8bccb99ebde0']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:51.029770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.032499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31d2b89b-dbf4-48df-888b-21954378cd59 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:51.045007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d9b568c6-13ef-4324-b49c-b5e28e4ca0c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:51.048972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-90126dbd-a0ed-4fd3-9266-6afba5aeee02 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:51.084973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.090170 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.8190341 Nov 24 13:59:51.095245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41328) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:51.111634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '74d84999-8cdf-4085-bda3-8841876409a7', 'security_groups': [], 'name': 'tempest-PortsTestJSON-1576381488'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:51.127427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=208527e9-3d19-4d51-9836-4b7b365ecf03,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:51.138103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:51.143055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Pushing event updated for resources: {'Port': ['ID=33a99f93-54f2-463e-9678-da68a2bc30f0,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:51.184093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.196275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0192c12f-60b7-4e05-87d4-6d144c927e7d tempest-FloatingIPAdminTestJSON-557961735 tempest-FloatingIPAdminTestJSON-557961735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:51.341062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:51.362681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:51.363380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.387712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:51.418357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:51.449208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=20efb27a-2359-4236-8bbf-9028a4356f18,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:51.451298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.458611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:51.469602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:51.471573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.514947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] For port d327ff90-a67e-4f45-bb97-210f52dde0af, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:51.523239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:51.533050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'ca6cefc0-6d2b-42c4-82eb-688fd9045d74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f8ac2805-72a0-426a-98a5-e7cbbabc008a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:51.533401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: f8ac2805-72a0-426a-98a5-e7cbbabc008a, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:51.544774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Network be6e4471-74b1-4989-9702-628e500e616c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:51.560899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:51.566426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=afbb30e1-0766-4741-97b5-1b18534c3291,segment=NetworkSegment(88f19f83-091c-4d89-aa79-2ae8ba5b119e),segment_id=88f19f83-091c-4d89-aa79-2ae8ba5b119e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:51.580115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:51.582640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:51.583714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.592301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Usage tracker for resource:port and tenant:f0d8ccca93984618ad200eead84e76c2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:51.595429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:51.611064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 2 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:51.617747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.631347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] For port d327ff90-a67e-4f45-bb97-210f52dde0af, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d327ff90-a67e-4f45-bb97-210f52dde0af,segment=NetworkSegment(9ec604a5-fcfa-4738-9bf3-f895431479d4),segment_id=9ec604a5-fcfa-4738-9bf3-f895431479d4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:51.637076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'port': 2} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:51.639133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:51.640703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.657072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.664822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network f8ac2805-72a0-426a-98a5-e7cbbabc008a is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:51.672718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.704830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 114b5268-2eaa-4442-aa58-76c7889f060b yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:51.723279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.744051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.753989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-372602b3-5234-4480-b4ea-e5ac71d14b11 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:51.803663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=54140a24-8764-4f1d-8830-56abd9ff4083,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:51.817075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:51.855552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, f8ac2805-72a0-426a-98a5-e7cbbabc008a) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:51.894532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04deb863-c28a-4d19-8985-f6379a4c9be2 None None] Network f8ac2805-72a0-426a-98a5-e7cbbabc008a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:51.939010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:51.939599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:51.990409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:52.048373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 2.6603160 Nov 24 13:59:52.052605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41332) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:52.058410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] device_id is not set on port 0bbcaab5-c35b-47ba-92ec-516e1e1709c6 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:52.088112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.449s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:52.089495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fd357fa-3a51-40f8-bb46-2b54fab6e953 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-159a661c-7f67-47cf-9bcb-c79d0ff7d5c7', 'network_id': '159a661c-7f67-47cf-9bcb-c79d0ff7d5c7', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': '54140a24-8764-4f1d-8830-56abd9ff4083'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:52.091070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fd357fa-3a51-40f8-bb46-2b54fab6e953 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.100314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c84c6a20-fc74-4070-887e-9d122dbec571 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.357s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:52.171889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Attempting to bind port 33a99f93-54f2-463e-9678-da68a2bc30f0 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:52.172260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Attempting to bind port 33a99f93-54f2-463e-9678-da68a2bc30f0 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'cc1a691e-407a-44e6-b50b-27dc00a19891', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 865, 'network_id': 'be6e4471-74b1-4989-9702-628e500e616c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:52.172625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Attempting to bind port 33a99f93-54f2-463e-9678-da68a2bc30f0 on network be6e4471-74b1-4989-9702-628e500e616c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:52.186191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.218007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-74d84999-8cdf-4085-bda3-8841876409a7', 'network_id': '74d84999-8cdf-4085-bda3-8841876409a7', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': '18d22814-9c3e-48ab-8d48-53c0ae9706bd'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:52.219105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.254118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['159a661c-7f67-47cf-9bcb-c79d0ff7d5c7']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:52.285429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2cd25388-6088-474a-8cb4-b32419d071f1') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:52.286008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2cd25388-6088-474a-8cb4-b32419d071f1') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:52.338499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.13 (74d84999-8cdf-4085-bda3-8841876409a7/18d22814-9c3e-48ab-8d48-53c0ae9706bd/114b5268-2eaa-4442-aa58-76c7889f060b) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:52.342619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.348757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:52.349410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Checking segment: {'id': 'cc1a691e-407a-44e6-b50b-27dc00a19891', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 865, 'network_id': 'be6e4471-74b1-4989-9702-628e500e616c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:52.350122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.350703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Bound using segment: {'id': 'cc1a691e-407a-44e6-b50b-27dc00a19891', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 865, 'network_id': 'be6e4471-74b1-4989-9702-628e500e616c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:52.351401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Bound port: 33a99f93-54f2-463e-9678-da68a2bc30f0, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cc1a691e-407a-44e6-b50b-27dc00a19891', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 865, 'network_id': 'be6e4471-74b1-4989-9702-628e500e616c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:52.352035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.378725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.400423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 871 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:52.401108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:52.418848 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:52.476646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Pushing event updated for resources: {'Port': ['ID=d327ff90-a67e-4f45-bb97-210f52dde0af,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:52.541112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.441s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:52.633514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.678760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.703157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aca3633d-61d2-429e-b19b-81accbf6b66a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:52.721386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.737235 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 HTTP/1.1" status: 204 len: 168 time: 1.8997955 Nov 24 13:59:52.745649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41336) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:52.757478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Delete allocated IP 2001:db8::28d (d1d0487a-60e7-49df-8f6a-8133f5eb276b/960509e9-34f1-4442-91dc-9e489a019924) {{(pid=83525) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 13:59:52.771851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=159a661c-7f67-47cf-9bcb-c79d0ff7d5c7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:52.782140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:52.794430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de5fd5ab-f9ef-4456-9230-f8f2ed9e63fe None None] Network 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:52.796499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8:0:1::258 (d1d0487a-60e7-49df-8f6a-8133f5eb276b/a0a69375-08b2-4745-bb36-2edd70a8f808/e2f52d74-ccd7-499d-9080-f709d76ecebe) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:52.800171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1124095650'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:52.808793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.814108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:52.822868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:52.835195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de5fd5ab-f9ef-4456-9230-f8f2ed9e63fe None None] Network 159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 could not be found, it might have been deleted concurrently. {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:205}} Nov 24 13:59:52.837830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] For port 33a99f93-54f2-463e-9678-da68a2bc30f0, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:52.841914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] For port 33a99f93-54f2-463e-9678-da68a2bc30f0, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33a99f93-54f2-463e-9678-da68a2bc30f0,segment=NetworkSegment(cc1a691e-407a-44e6-b50b-27dc00a19891),segment_id=cc1a691e-407a-44e6-b50b-27dc00a19891)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:52.845304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.847542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ce91ad5-89f8-4313-be99-1a43831d8504 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-f8ac2805-72a0-426a-98a5-e7cbbabc008a', 'network_id': 'f8ac2805-72a0-426a-98a5-e7cbbabc008a', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '20efb27a-2359-4236-8bbf-9028a4356f18'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:52.848717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0ce91ad5-89f8-4313-be99-1a43831d8504 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.851243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:52.864368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.867303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:52.871665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:52.875992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object 114b5268-2eaa-4442-aa58-76c7889f060b will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:52.928507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 13:59:52.946610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:52.984778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:52.987673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.015356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.021346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:53.029703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] device_id is not set on port 7dfb989c-1945-4e1e-977b-f6daf5cb4cb7 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 13:59:53.145161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 74d84999-8cdf-4085-bda3-8841876409a7 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:53.148206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:53.150483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:53.154714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Pushing event updated for resources: {'Port': ['ID=33a99f93-54f2-463e-9678-da68a2bc30f0,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:53.158021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:53.159858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=114b5268-2eaa-4442-aa58-76c7889f060b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:53.163573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:53.195189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:53.214024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.222420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Allocated IP 172.20.0.2 (74d84999-8cdf-4085-bda3-8841876409a7/18d22814-9c3e-48ab-8d48-53c0ae9706bd/637b36b0-55fb-4441-8d0b-08b0d3386043) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:53.227123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Update dhcp port {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'fixed_ips': [{'subnet_id': '960509e9-34f1-4442-91dc-9e489a019924', 'ip_address': '2001:db8::2'}, {'subnet_id': 'a0a69375-08b2-4745-bb36-2edd70a8f808'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': 'afbb30e1-0766-4741-97b5-1b18534c3291'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 13:59:53.232448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object e2f52d74-ccd7-499d-9080-f709d76ecebe will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:53.250888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.281713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db83cac3-6a76-42f5-a242-7d625c63797d tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:53.315299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.336377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.336886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 055fc437-8611-4805-996f-ed91a8e4986b of type vlan for network 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 Nov 24 13:59:53.338409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.361529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f44beeac-24e4-4b27-acde-00356b056f95 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server [None req-0ce91ad5-89f8-4313-be99-1a43831d8504 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 20efb27a-2359-4236-8bbf-9028a4356f18: This subnet is being modified by another concurrent operation. Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 274, in create_dhcp_port Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 99, in _port_action Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 335, in create_port Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 685, in inner Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 13:59:53.368983 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1423, in create_port Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1390, in _create_port_db Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1440, in create_port_db Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 669, in _ipam_get_subnets Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise exception Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 20efb27a-2359-4236-8bbf-9028a4356f18: This subnet is being modified by another concurrent operation. Nov 24 13:59:53.376290 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Nov 24 13:59:53.430856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=e2f52d74-ccd7-499d-9080-f709d76ecebe,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:53.440383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:53.446715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:53.449935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.452056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bfad9aa-aa4f-477d-a2b1-6cbecf818ea1 None None] Network f8ac2805-72a0-426a-98a5-e7cbbabc008a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:53.496156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=20efb27a-2359-4236-8bbf-9028a4356f18,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:53.507700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:53.535397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] In _notify_port_updated(), no bound segment for port e2f52d74-ccd7-499d-9080-f709d76ecebe on network d1d0487a-60e7-49df-8f6a-8133f5eb276b {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 13:59:53.537659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 13:59:53.552382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:53.553534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.555147 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/ports/e2f52d74-ccd7-499d-9080-f709d76ecebe HTTP/1.1" status: 200 len: 931 time: 2.5335591 Nov 24 13:59:53.559428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41340) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:53.572362 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 887 time: 2.4760072 Nov 24 13:59:53.574402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41344) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:53.607042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] Sync routers for ids ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 13:59:53.692229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port e2f52d74-ccd7-499d-9080-f709d76ecebe {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:53.692761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.851694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 114b5268-2eaa-4442-aa58-76c7889f060b {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:53.851959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.878373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.908869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:53.926225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.932488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-315ca7d1-93a4-4d01-bee1-395a80f9871d None None] Network 6f950245-e4b2-4735-849a-ee586a874fa7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:53.954048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:53.978505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f8ac2805-72a0-426a-98a5-e7cbbabc008a']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:53.984770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] Routers {'d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:53.985671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:53.998221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca6cefc0-6d2b-42c4-82eb-688fd9045d74') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:53.998644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca6cefc0-6d2b-42c4-82eb-688fd9045d74') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:54.028542 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/d98b2ea8-f759-4b1e-a231-a4ef92eebbd1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1606081 Nov 24 13:59:54.030124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.034999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41348) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:54.053583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.059544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.063810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:54.064361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.069161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:54.089639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.097071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 863 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:54.097475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:54.114323 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:54.149429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:54.291483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Allocated IP 2001:db8:0:1::2 (d1d0487a-60e7-49df-8f6a-8133f5eb276b/a0a69375-08b2-4745-bb36-2edd70a8f808/afbb30e1-0766-4741-97b5-1b18534c3291) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 13:59:54.317653 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.5297832 Nov 24 13:59:54.331479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41352) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:54.354171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '464ab7ec-0ada-4110-aabf-1ad2e7c9eac0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:54.414679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0868582a-cfe2-4094-9b9c-c6b25b6b1b6b None None] Provisioning for port d327ff90-a67e-4f45-bb97-210f52dde0af completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:54.420609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=464ab7ec-0ada-4110-aabf-1ad2e7c9eac0,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:54.435917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.438788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.369s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:54.439507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Checking segment: {'id': '422f27c8-71d7-4cbd-a2b2-7eec4849b2ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': 'a65bfe60-3c16-4f6e-a417-ef593a1a934d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:54.439958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network hostable DHCP agents. Network: a65bfe60-3c16-4f6e-a417-ef593a1a934d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:54.460097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d85467d3-fedc-49ea-a392-2291b2c997aa tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.330s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:54.468645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7f59628a-98cd-4d1b-ac44-fa2766a8fded tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:54.481739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:54.523397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.534627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/f8ac2805-72a0-426a-98a5-e7cbbabc008a HTTP/1.1" status: 204 len: 168 time: 2.4808860 Nov 24 13:59:54.539150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41356) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:54.545860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1547811986'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:54.560452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:54.575605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c788b983-2aac-490b-bc68-fc152e4d89ea None None] Network be6e4471-74b1-4989-9702-628e500e616c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:54.576032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:54.578528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:54.587414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] Routers {'d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 13:59:54.588057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:54.588832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network a65bfe60-3c16-4f6e-a417-ef593a1a934d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:54.600189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:54.603154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Port': ['ID=0bbcaab5-c35b-47ba-92ec-516e1e1709c6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:54.606901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:54.607600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-460e945a-23de-47b3-a911-460f6ddf166c tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.098s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:54.625636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.643479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:54.645527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, a65bfe60-3c16-4f6e-a417-ef593a1a934d) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:54.648136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=f8ac2805-72a0-426a-98a5-e7cbbabc008a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:54.652012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:54.652700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:54.653656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.656233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:54.659481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.672844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d23e5b1-3714-44e7-ab45-cb64c24af223 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:54.704145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.713256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7f59628a-98cd-4d1b-ac44-fa2766a8fded tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:54.717447 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7f59628a-98cd-4d1b-ac44-fa2766a8fded tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 HTTP/1.1" status: 200 len: 205 time: 0.6755886 Nov 24 13:59:54.721867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41360) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:54.723567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33307281-eecd-44e0-86dc-c4af939f503f None None] Network a65bfe60-3c16-4f6e-a417-ef593a1a934d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:54.788990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 114b5268-2eaa-4442-aa58-76c7889f060b owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:54.820783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:54.831504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:54.843885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:54.844311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22e2a51b-7614-43c0-8d87-8540482855ff None None] The sync data for ids ['d98b2ea8-f759-4b1e-a231-a4ef92eebbd1'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 13:59:54.888208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Port': ['ID=7dfb989c-1945-4e1e-977b-f6daf5cb4cb7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:54.896459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:54.898556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.901321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 899} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 13:59:54.919589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.920010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment a3c748f2-83a7-49b5-bd50-438f0b58c920 of type vlan for network 5b56fd90-6946-415b-b771-ba46b2067f23 Nov 24 13:59:54.939557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Checking segment: {'id': 'f0d9b166-e675-4d56-8868-37d9d668b826', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '3f8727a3-f1ec-4af3-86ec-51dd8bb7278a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:54.940043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network hostable DHCP agents. Network: 3f8727a3-f1ec-4af3-86ec-51dd8bb7278a, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:54.956089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:54.962082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:54.963571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for e2f52d74-ccd7-499d-9080-f709d76ecebe owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:55.021291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.038216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:55.048782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Transition to ACTIVE for port object 637b36b0-55fb-4441-8d0b-08b0d3386043 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:55.084061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:55.084388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.121235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=afbb30e1-0766-4741-97b5-1b18534c3291,segment=NetworkSegment(88f19f83-091c-4d89-aa79-2ae8ba5b119e),segment_id=88f19f83-091c-4d89-aa79-2ae8ba5b119e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:55.125660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network 3f8727a3-f1ec-4af3-86ec-51dd8bb7278a is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:55.144789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-45a9bce3-e57d-49ac-a5e7-6b15e89c8909 None None] Provisioning for port 33a99f93-54f2-463e-9678-da68a2bc30f0 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:55.188916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.192213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:55.193099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.277235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 13:59:55.284225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.305150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d75487d6-0614-4615-ba92-9396d0a29df1 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:55.327684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.345748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Transition to ACTIVE for port object 637b36b0-55fb-4441-8d0b-08b0d3386043 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:55.348195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 3f8727a3-f1ec-4af3-86ec-51dd8bb7278a) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:55.368673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98ca6fc0-8f97-4c4f-9702-54092d784e18 None None] Network 3f8727a3-f1ec-4af3-86ec-51dd8bb7278a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:55.399675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.403254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.408679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Transition to ACTIVE for port object afbb30e1-0766-4741-97b5-1b18534c3291 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 13:59:55.409403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:55.411381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5b2efdbb-ce26-4cc3-be4a-cb8f313135a1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:55.453718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing IP validity checks on allocation pools {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 13:59:55.454625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 13:59:55.456931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.467179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:55.471748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:55.473361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.475486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:55.476289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.477896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=114b5268-2eaa-4442-aa58-76c7889f060b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:55.481567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:55.488634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae0b8e39-f753-40ff-91ad-e49c970d5c8b tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:55.578271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=e2f52d74-ccd7-499d-9080-f709d76ecebe,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:55.581285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:55.670432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.673687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Network 74d84999-8cdf-4085-bda3-8841876409a7 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 13:59:55.696655 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.1536336 Nov 24 13:59:55.696655 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 4.7934203 Nov 24 13:59:55.699036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:55.699174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41370) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:55.701301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=5b56fd90-6946-415b-b771-ba46b2067f23,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:55.705636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.400s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:55.709353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.715315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.720688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Pushing event updated for resources: {'Port': ['ID=637b36b0-55fb-4441-8d0b-08b0d3386043,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:55.751126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:55.753885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.754428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 13:59:55.764346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.355s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:55.765123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5b56fd90-6946-415b-b771-ba46b2067f23 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 13:59:55.766173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': '5b56fd90-6946-415b-b771-ba46b2067f23', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 13:59:55.768874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.770005 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3e576418-2646-4359-a8c0-3899c67e341d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 HTTP/1.1" status: 204 len: 168 time: 1.0471926 Nov 24 13:59:55.772737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41376) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:55.784027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-289263b3-9e4a-4f5f-9d33-59ce03350ab6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.233s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:55.787254 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/e2f52d74-ccd7-499d-9080-f709d76ecebe HTTP/1.1" status: 204 len: 168 time: 2.2264259 Nov 24 13:59:55.801495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:55.806434 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/114b5268-2eaa-4442-aa58-76c7889f060b HTTP/1.1" status: 204 len: 168 time: 2.1190364 Nov 24 13:59:55.806434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41380) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:55.816407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41382) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:55.891985 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b3a4e3e6-7ae3-4c1b-8182-83c5f4523e9b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 13:59:55.898283 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3a4e3e6-7ae3-4c1b-8182-83c5f4523e9b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/114b5268-2eaa-4442-aa58-76c7889f060b HTTP/1.1" status: 404 len: 333 time: 0.0803833 Nov 24 13:59:55.903182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41386) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:55.973450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 13:59:56.001585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Pushing event updated for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:56.033233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33a99f93-54f2-463e-9678-da68a2bc30f0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:56.061713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:56.096646 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9169f4b-03db-448f-aba0-09c683482e94 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 13:59:56.097183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c9169f4b-03db-448f-aba0-09c683482e94 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:56.171603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 13:59:56.179062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c9169f4b-03db-448f-aba0-09c683482e94 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 13:59:56.180161 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c9169f4b-03db-448f-aba0-09c683482e94 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/e2f52d74-ccd7-499d-9080-f709d76ecebe HTTP/1.1" status: 404 len: 333 time: 0.2089772 Nov 24 13:59:56.184445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41392) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:56.189655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 13:59:56.200560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 13:59:56.209735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 13:59:56.236994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91eb9334-edad-46b1-9980-37303e357e58 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:56.242558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91eb9334-edad-46b1-9980-37303e357e58 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:56.244444 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-91eb9334-edad-46b1-9980-37303e357e58 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.5357985 Nov 24 13:59:56.248547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.258639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41396) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:56.262069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4a91bf87-1513-48b4-aa51-4f20c595a78a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:56.273424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet 18d22814-9c3e-48ab-8d48-53c0ae9706bd {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:56.299336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet cdfca3a5-73d9-41ca-b022-7f05a6bf09f7 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:56.303663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.318690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Attempting to bind port 637b36b0-55fb-4441-8d0b-08b0d3386043 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 13:59:56.319072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Attempting to bind port 637b36b0-55fb-4441-8d0b-08b0d3386043 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '74d84999-8cdf-4085-bda3-8841876409a7'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 13:59:56.319454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Attempting to bind port 637b36b0-55fb-4441-8d0b-08b0d3386043 on network 74d84999-8cdf-4085-bda3-8841876409a7 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 13:59:56.341009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 13:59:56.346018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 13, 59, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 13:59:56.346346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Checking segment: {'id': 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '74d84999-8cdf-4085-bda3-8841876409a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:56.346753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.347149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Bound using segment: {'id': 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '74d84999-8cdf-4085-bda3-8841876409a7'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 13:59:56.347633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Bound port: 637b36b0-55fb-4441-8d0b-08b0d3386043, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '74d84999-8cdf-4085-bda3-8841876409a7'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 13:59:56.348034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.368487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.451874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 33a99f93-54f2-463e-9678-da68a2bc30f0 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:56.469286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.491249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] For port 637b36b0-55fb-4441-8d0b-08b0d3386043, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 13:59:56.494887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] For port 637b36b0-55fb-4441-8d0b-08b0d3386043, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=637b36b0-55fb-4441-8d0b-08b0d3386043,segment=NetworkSegment(d2e92926-0eb4-47c9-8ed7-9db78f28d57d),segment_id=d2e92926-0eb4-47c9-8ed7-9db78f28d57d)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 13:59:56.497466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 33a99f93-54f2-463e-9678-da68a2bc30f0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:56.497993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.525692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.601140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.664616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.669503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.671990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:56.721911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.753696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.782369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Pushing event updated for resources: {'Port': ['ID=637b36b0-55fb-4441-8d0b-08b0d3386043,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:56.791341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.795746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:56.854108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-215df899-0a6c-4c8a-b9af-d911c6ed8138 None None] Provisioning complete for port 33a99f93-54f2-463e-9678-da68a2bc30f0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:56.854606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-215df899-0a6c-4c8a-b9af-d911c6ed8138 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.877688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting port 0bbcaab5-c35b-47ba-92ec-516e1e1709c6 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:56.878647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.922154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.932424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bcd6fd64-9ea7-4a10-a9c3-e10b56ba79da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:56.959995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5163791-bd90-4352-a802-99be1f071e03,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:56.974139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:56.986149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.988175 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/security-groups/d5163791-bd90-4352-a802-99be1f071e03 HTTP/1.1" status: 204 len: 168 time: 0.7913201 Nov 24 13:59:56.989699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.994521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:56.997876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41400) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:56.998632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:57.043835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=cdfca3a5-73d9-41ca-b022-7f05a6bf09f7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:57.050484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=637530f1-644e-4238-9f71-60707f9324d0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:57.090976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.807s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:57.127683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:57.129776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-215df899-0a6c-4c8a-b9af-d911c6ed8138 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.138137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.150839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.151330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 33a99f93-54f2-463e-9678-da68a2bc30f0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33a99f93-54f2-463e-9678-da68a2bc30f0,segment=NetworkSegment(cc1a691e-407a-44e6-b50b-27dc00a19891),segment_id=cc1a691e-407a-44e6-b50b-27dc00a19891)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:57.159447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e60bf590-7e89-40a7-82c9-c0e9f1bb413c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:57.159687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99849c72-5a33-4720-b7a4-e6caf2393357 None None] Network 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:57.185063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.186362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d327ff90-a67e-4f45-bb97-210f52dde0af up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:57.209538 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/cdfca3a5-73d9-41ca-b022-7f05a6bf09f7 HTTP/1.1" status: 204 len: 168 time: 1.4355769 Nov 24 13:59:57.213304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.215248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=18d22814-9c3e-48ab-8d48-53c0ae9706bd,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:57.216903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41404) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:57.234531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '055fc437-8611-4805-996f-ed91a8e4986b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '464ab7ec-0ada-4110-aabf-1ad2e7c9eac0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:57.234951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:57.254578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:57.280076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.284846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/18d22814-9c3e-48ab-8d48-53c0ae9706bd HTTP/1.1" status: 204 len: 168 time: 1.3802037 Nov 24 13:59:57.291096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41408) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:57.318680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.382791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b83e739a-ac7e-4a03-a142-f08a60ee7d68 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:57.383855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.453036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-00e29b5f-8759-4f65-8309-faf94188d7de tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:57.549236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.557405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:57.566674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.589940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.591819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=858eff41-9115-44ff-b497-4052830a5589,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:57.598752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:57.610688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.621009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port d7760a9a-4b7a-4336-b1aa-8825991ea575 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:57.621613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.638898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-215df899-0a6c-4c8a-b9af-d911c6ed8138 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:57.639401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-215df899-0a6c-4c8a-b9af-d911c6ed8138 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:57.646000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=33a99f93-54f2-463e-9678-da68a2bc30f0,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:57.655853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e23a2b2-51bc-43e4-b454-8bccb99ebde0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:57.658512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:57.667459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:57.682068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.684267 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/security-groups/4e23a2b2-51bc-43e4-b454-8bccb99ebde0 HTTP/1.1" status: 204 len: 168 time: 0.6463866 Nov 24 13:59:57.688660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41412) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:57.710084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:57.724315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Calling delete_port for 0bbcaab5-c35b-47ba-92ec-516e1e1709c6 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:57.734774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 637b36b0-55fb-4441-8d0b-08b0d3386043 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:57.735217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.737460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d327ff90-a67e-4f45-bb97-210f52dde0af completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:57.744470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d327ff90-a67e-4f45-bb97-210f52dde0af triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:57.744857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.761857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:57.787094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:57.788017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:57.788524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2aac932b-12c3-4883-9937-a09efa6708f0 None None] Network 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:57.840923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'a3c748f2-83a7-49b5-bd50-438f0b58c920', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': '5b56fd90-6946-415b-b771-ba46b2067f23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 13:59:57.841911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: 5b56fd90-6946-415b-b771-ba46b2067f23, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 13:59:57.852010 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 3.5118899 Nov 24 13:59:57.868148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41416) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:57.998077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] DHCP port deletion for 8b3ad505-d2fe-4c6f-8e42-e7174720ec4d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:58.007135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.021818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Deleting port d7760a9a-4b7a-4336-b1aa-8825991ea575 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:58.022340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.024617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-34115a6b-503c-4948-a4b4-e7de292d9238 tempest-PortsAdminExtendedAttrsTestJSON-2093329377 tempest-PortsAdminExtendedAttrsTestJSON-2093329377-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:58.137310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.139382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Port': ['ID=0bbcaab5-c35b-47ba-92ec-516e1e1709c6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:58.150663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:58.157884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network 5b56fd90-6946-415b-b771-ba46b2067f23 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 13:59:58.174068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 5b56fd90-6946-415b-b771-ba46b2067f23) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 13:59:58.176310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.187129 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/ports/0bbcaab5-c35b-47ba-92ec-516e1e1709c6 HTTP/1.1" status: 204 len: 168 time: 1.8169949 Nov 24 13:59:58.189458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41420) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:58.197282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 13:59:58.197885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.234938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2826b88e-5801-4910-9028-e38cf9a73e62 None None] Network 5b56fd90-6946-415b-b771-ba46b2067f23 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:58.290194 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 2.5832756 Nov 24 13:59:58.305486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41424) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:58.329840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7642c39-d869-48b2-8cec-f4113d4e4840 None None] Network 74d84999-8cdf-4085-bda3-8841876409a7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:58.345184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port d7760a9a-4b7a-4336-b1aa-8825991ea575, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d7760a9a-4b7a-4336-b1aa-8825991ea575,segment=NetworkSegment(d4dddcd3-3c48-48d9-b0ff-8413ceb11f59),segment_id=d4dddcd3-3c48-48d9-b0ff-8413ceb11f59)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:58.345750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.496583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting port 7dfb989c-1945-4e1e-977b-f6daf5cb4cb7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 13:59:58.496583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.504182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.545469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for d7760a9a-4b7a-4336-b1aa-8825991ea575 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:58.572490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.635182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port 637b36b0-55fb-4441-8d0b-08b0d3386043, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=637b36b0-55fb-4441-8d0b-08b0d3386043,segment=NetworkSegment(d2e92926-0eb4-47c9-8ed7-9db78f28d57d),segment_id=d2e92926-0eb4-47c9-8ed7-9db78f28d57d)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:58.636449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.647411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 960509e9-34f1-4442-91dc-9e489a019924 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 13:59:58.665554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.741833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Could not find standard attr ID for object e2f52d74-ccd7-499d-9080-f709d76ecebe. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 13:59:58.771619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f4127d4-a311-4b43-b2a7-9c227cac0773 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-464ab7ec-0ada-4110-aabf-1ad2e7c9eac0', 'network_id': '464ab7ec-0ada-4110-aabf-1ad2e7c9eac0', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': '637530f1-644e-4238-9f71-60707f9324d0'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:58.772464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f4127d4-a311-4b43-b2a7-9c227cac0773 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.794503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.827277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 637b36b0-55fb-4441-8d0b-08b0d3386043 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:58.881013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.882720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d327ff90-a67e-4f45-bb97-210f52dde0af, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d327ff90-a67e-4f45-bb97-210f52dde0af,segment=NetworkSegment(9ec604a5-fcfa-4738-9bf3-f895431479d4),segment_id=9ec604a5-fcfa-4738-9bf3-f895431479d4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:58.889902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23bc0ea3-da50-4d1f-b6ba-749b8e06ec05 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:58.890708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.930543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.944129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:58.963395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:58.969936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=637530f1-644e-4238-9f71-60707f9324d0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:58.970757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4c36a836-c3e9-426f-9e05-7e107bc948d4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:58.985339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:58.987401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.007641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=d7760a9a-4b7a-4336-b1aa-8825991ea575,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:59.010144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:59.023378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Provisioning for port 637b36b0-55fb-4441-8d0b-08b0d3386043 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:59.031193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No DVR routers for this DVR port d7760a9a-4b7a-4336-b1aa-8825991ea575 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:59.088316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] For port d7760a9a-4b7a-4336-b1aa-8825991ea575, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d7760a9a-4b7a-4336-b1aa-8825991ea575,segment=NetworkSegment(d4dddcd3-3c48-48d9-b0ff-8413ceb11f59),segment_id=d4dddcd3-3c48-48d9-b0ff-8413ceb11f59)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 13:59:59.089565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.102432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.113053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:59.170965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Calling delete_port for 7dfb989c-1945-4e1e-977b-f6daf5cb4cb7 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:59.215483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.255789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=637b36b0-55fb-4441-8d0b-08b0d3386043,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:59.258622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:59.262795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.266582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d327ff90-a67e-4f45-bb97-210f52dde0af,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:59.275485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port 637b36b0-55fb-4441-8d0b-08b0d3386043 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 13:59:59.280320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Calling delete_port for d7760a9a-4b7a-4336-b1aa-8825991ea575 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 13:59:59.320458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:59.321519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33a99f93-54f2-463e-9678-da68a2bc30f0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 13:59:59.358789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.384068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:59.385124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d144b64-0214-4099-9ae0-23527a538382 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-5b56fd90-6946-415b-b771-ba46b2067f23', 'network_id': '5b56fd90-6946-415b-b771-ba46b2067f23', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '858eff41-9115-44ff-b497-4052830a5589'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 13:59:59.386521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d144b64-0214-4099-9ae0-23527a538382 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.404344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8b3ad505-d2fe-4c6f-8e42-e7174720ec4d']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.408240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57387272-b956-4c43-a795-0a8fb85c6da4 None None] Network 464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:59.421254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.424481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.424797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4dddcd3-3c48-48d9-b0ff-8413ceb11f59') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.440728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.467674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=858eff41-9115-44ff-b497-4052830a5589,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:59.476474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:59.484589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['464ab7ec-0ada-4110-aabf-1ad2e7c9eac0']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.511292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:59.512431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.535287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '055fc437-8611-4805-996f-ed91a8e4986b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.535585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '055fc437-8611-4805-996f-ed91a8e4986b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.623589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.633719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7657e251-5e0b-4157-acfa-dc0a95201d60 None None] DHCP port deletion for 74d84999-8cdf-4085-bda3-8841876409a7 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 13:59:59.636090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.639077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.660136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51d754a7-634c-4d46-bd90-45bd748c951c tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:59.685597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.708189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.712669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 13:59:59.713091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 13:59:59.716436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Port': ['ID=7dfb989c-1945-4e1e-977b-f6daf5cb4cb7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 13:59:59.726674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.729012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 13:59:59.736827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5b56fd90-6946-415b-b771-ba46b2067f23']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.743257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.745533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.754002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 876 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:59.754299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.759300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:59.773458 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:59.776276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 861 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:59.777066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.783161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a3c748f2-83a7-49b5-bd50-438f0b58c920') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.783665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a3c748f2-83a7-49b5-bd50-438f0b58c920') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.800368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 33a99f93-54f2-463e-9678-da68a2bc30f0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:59.800575 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/ports/7dfb989c-1945-4e1e-977b-f6daf5cb4cb7 HTTP/1.1" status: 204 len: 168 time: 1.6031244 Nov 24 13:59:59.800725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.802619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41430) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:59.806723 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:59.827316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74d84999-8cdf-4085-bda3-8841876409a7']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.828288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20bf31a3-7a5f-4e55-8db7-11f340c413d3 None None] Network 5b56fd90-6946-415b-b771-ba46b2067f23 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 13:59:59.852343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Provisioning for port afbb30e1-0766-4741-97b5-1b18534c3291 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 13:59:59.853067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.867057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 13:59:59.867435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a0461d92-de4c-45fb-a331-538250fc8289 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.905200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.905437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd2e92926-0eb4-47c9-8ed7-9db78f28d57d') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 13:59:59.926758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.927932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bf40194b-2bfd-4cae-8829-56e1f4b64444 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Synchronizing usage tracker for tenant:f0d8ccca93984618ad200eead84e76c2 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 13:59:59.931842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.942973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 899 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 13:59:59.943402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.946943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.952038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.954142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-400b73b5-0f75-464c-921a-17f0d31d2132 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 13:59:59.958208 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 13:59:59.970027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.976051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a30573b1-bf9a-4b44-a4fe-4eca1d77559a tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 13:59:59.984549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.989222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 13:59:59.993921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.003320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bf40194b-2bfd-4cae-8829-56e1f4b64444 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Unset dirty status for tenant:f0d8ccca93984618ad200eead84e76c2 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:00.008229 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bf40194b-2bfd-4cae-8829-56e1f4b64444 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.2006774 Nov 24 14:00:00.008529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=960509e9-34f1-4442-91dc-9e489a019924,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:00.011569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 897 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:00.012006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:00.029117 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:00.031482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41434) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.031482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:00.039221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44b349fc-521d-4dbb-9397-0325213d6869 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:00.076450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1015757671'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.082569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.092311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=8b3ad505-d2fe-4c6f-8e42-e7174720ec4d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:00.096134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:00.098749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03fb6902-c76f-4e49-8653-1be198549083 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:00.160547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.171304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=464ab7ec-0ada-4110-aabf-1ad2e7c9eac0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:00.178924 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/8b3ad505-d2fe-4c6f-8e42-e7174720ec4d HTTP/1.1" status: 204 len: 168 time: 2.9585085 Nov 24 14:00:00.186341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41438) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.187257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Usage tracker for resource:network and tenant:f0d8ccca93984618ad200eead84e76c2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.187401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:00.200094 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 HTTP/1.1" status: 204 len: 168 time: 2.3193934 Nov 24 14:00:00.200292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:00.200292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/960509e9-34f1-4442-91dc-9e489a019924 HTTP/1.1" status: 204 len: 168 time: 2.5033360 Nov 24 14:00:00.200721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41442) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.200721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41446) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.201784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:00.205795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1982769480'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.205980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.210037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8546fa21-d663-45bc-9ca1-7fcb45228ae4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:00.212500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-270284928', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.222814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.231818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.239895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.243456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.244502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=74d84999-8cdf-4085-bda3-8841876409a7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:00.251507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.256296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.258357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/74d84999-8cdf-4085-bda3-8841876409a7 HTTP/1.1" status: 204 len: 168 time: 2.9657869 Nov 24 14:00:00.258849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41450) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.260284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:00.262069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:00.264929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:00.268368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.268625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:00.279706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.281980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:00.288070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'name': 'tempest-PortsTestJSON-935974624'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.334221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:00.344951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fef26a74-9a56-4b6a-b0d6-5ffa397296ab tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:00.362842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.384589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=5b56fd90-6946-415b-b771-ba46b2067f23,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:00.389640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Deleting port d7760a9a-4b7a-4336-b1aa-8825991ea575 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:00.390213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.395891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:00.402639 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5b56fd90-6946-415b-b771-ba46b2067f23 HTTP/1.1" status: 204 len: 168 time: 2.0887895 Nov 24 14:00:00.402848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.403809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.406865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:00.408675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41454) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.409747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.412850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 861} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:00.421261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1877987858'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.432239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.442154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.444658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.447512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.448611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Added segment 15639694-360e-4201-b3ca-c31a90490fed of type vlan for network daf858ef-c98b-4940-a851-61a3f47346db Nov 24 14:00:00.451174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:00.459295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.466791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:00.471288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:00.480973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:00.489002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.491175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 850} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:00.497756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.508148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.509507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.511563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e96349be-6eda-493c-a039-7028b113e4cd None None] The port 'd7760a9a-4b7a-4336-b1aa-8825991ea575' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:00:00.514709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:00.514901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:00.517665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.517882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.518341 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 588e5c75-cb31-4413-b98c-d39768a15b86 of type vlan for network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 Nov 24 14:00:00.529107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:00.538741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:00.542191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 637b36b0-55fb-4441-8d0b-08b0d3386043 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:00.542708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.587402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port d795bf51-5d44-41e3-8fce-cb4f7b3542b9 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:00.602218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 637b36b0-55fb-4441-8d0b-08b0d3386043 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:00.602582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 637b36b0-55fb-4441-8d0b-08b0d3386043 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:284}} Nov 24 14:00:00.616097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.619672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:00.639459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:00.642362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port 637b36b0-55fb-4441-8d0b-08b0d3386043 not found, will not notify nova. {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:294}} Nov 24 14:00:00.642790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:00.665855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.670165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:00.670866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.678510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e264a390-c8da-4eb0-a6c9-c0df3f3d45d6 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:00.702806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.703698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment e86cd9be-9338-48b0-9d95-e547187ced4f of type vlan for network 5056ad91-892d-44f2-ae6f-f9acdcef87ef Nov 24 14:00:00.820544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:00.820544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.821052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.825056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:00.825642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.832466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-90699f4d-ae78-4d6a-9dd2-62c5fe13146e tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:00.848403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.854016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.866129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Network': ['ID=daf858ef-c98b-4940-a851-61a3f47346db,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:00.875307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.8355246 Nov 24 14:00:00.880860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41458) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.907104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-342781648'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:00.921369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:00.924310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.924789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.925273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.925733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.926188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.926642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.927091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.927541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.928018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.928464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.928922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:00.943841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:00.945359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Usage tracker for resource:network and tenant:f0d8ccca93984618ad200eead84e76c2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:00.959897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:00.986330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network daf858ef-c98b-4940-a851-61a3f47346db details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:00.986564 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.7874005 Nov 24 14:00:00.992889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41462) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:00.993768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:01.009043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:01.017770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:01.017930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:01.028425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:01.114169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:01.131315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d7760a9a-4b7a-4336-b1aa-8825991ea575 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:01.145473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.149508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:01.150364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.155608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:01.158729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.182430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ad303cf-b781-4548-a697-46dd5c9a8264 tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:01.259421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.263649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d7760a9a-4b7a-4336-b1aa-8825991ea575 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:01.264034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d7760a9a-4b7a-4336-b1aa-8825991ea575 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:01.363452 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.9535515 Nov 24 14:00:01.374351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41466) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:01.386742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:01.392719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:01.408967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d327ff90-a67e-4f45-bb97-210f52dde0af up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:01.424176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=5056ad91-892d-44f2-ae6f-f9acdcef87ef,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:01.437579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:01.439799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5056ad91-892d-44f2-ae6f-f9acdcef87ef details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:01.442836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:01.446368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:01.451579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.457691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 851} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:01.472684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:01.502662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.555970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.555970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Added segment 4f27d341-d6cb-441c-820d-e469097c3eb2 of type vlan for network 691aaa8d-2ea8-45a5-a42e-1d1064132413 Nov 24 14:00:01.587496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:01.596205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d327ff90-a67e-4f45-bb97-210f52dde0af triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:01.596638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.642227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:01.645718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.701628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.26.4.192 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/4bbc1672-6723-4337-8c13-2111f57c5751) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:01.710192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:01.714734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.716311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:01.733582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2e7c4aa6-42e2-4921-ba61-c9ac20d7ad9b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:01.779876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:01.806990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 637b36b0-55fb-4441-8d0b-08b0d3386043 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:01.844003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c3b388a-a4ef-42a3-adb4-5056fa3f8fa2 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:00:01.880103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 637b36b0-55fb-4441-8d0b-08b0d3386043 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:01.880450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 637b36b0-55fb-4441-8d0b-08b0d3386043 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:01.924677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-825dab5a-81e8-4111-94c5-882e2c352001 None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:01.925053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-825dab5a-81e8-4111-94c5-882e2c352001 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.927096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:01.928679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.942249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.945908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddbd08fa-fa48-4686-b4f6-2fbbe9083a5d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:01.959011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:01.988200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:01.995286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:01.998808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:02.003487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:02.006473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:02.007068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.011076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:02.012976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=d795bf51-5d44-41e3-8fce-cb4f7b3542b9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:02.020932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-825dab5a-81e8-4111-94c5-882e2c352001 None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:02.043643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-825dab5a-81e8-4111-94c5-882e2c352001 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:02.044103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-825dab5a-81e8-4111-94c5-882e2c352001 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.049299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=ca91fd7c-9569-4d83-8191-7efefe816151,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:02.054660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:02.063216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:02.067623 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8637080 Nov 24 14:00:02.067927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:02.067927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.068133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41470) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:02.075394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'security_group': {'name': 'tempest-secgroup-766154222'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:02.081620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:02.084463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.090731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c3cc94c-aa8f-4d75-ac77-c680f0831360 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:02.110122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c3b388a-a4ef-42a3-adb4-5056fa3f8fa2 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:00:02.117444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.384s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:02.157684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.161494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:02.162088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.174281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4a81055-102a-4c28-9c04-35eb162f0a33 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:02.236926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:02.252965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:02.264852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:02.295164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.308664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:02.314846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:02.318841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=4bbc1672-6723-4337-8c13-2111f57c5751,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:02.321298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:02.343693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.348092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:02.383083 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.5009844 Nov 24 14:00:02.386959 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 2.1220279 Nov 24 14:00:02.392016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:02.443465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Network': ['ID=691aaa8d-2ea8-45a5-a42e-1d1064132413,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:02.457142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 691aaa8d-2ea8-45a5-a42e-1d1064132413 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:02.471081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:02.476522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group_rule and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:02.480829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:02.488487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:02.491422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.317s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:02.518048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:02.537794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'subnets': [{'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1536796463', 'ip_version': 4}, {'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:02.538103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'subnet': {'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1536796463', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:02.539010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Request body: {'subnet': {'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:02.590942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.602770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.609542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:02.628553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port d795bf51-5d44-41e3-8fce-cb4f7b3542b9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:02.629197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.658619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.659955 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 0.5910828 Nov 24 14:00:02.661508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'SecurityGroup': ['ID=14436c92-9776-4f4f-a0c0-6e5dee1f6915,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:02.664626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:02.670010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41482) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:02.676982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'security_group': {'name': 'tempest-secgroup-1597717305'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:02.689006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:02.694238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:02.697556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:02.705655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:02.722326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.734728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8b2ed17-9463-4a2a-bf61-4b838e079280 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:00:02.735429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.736186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.830706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:02.836100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group_rule and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:02.840604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:02.847231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:02.866489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8b2ed17-9463-4a2a-bf61-4b838e079280 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:00:02.988575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:02.998747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.005021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-072b4266-6727-45f6-b812-ae15ea64213f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:03.027411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.049739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4482af8-6834-4ea9-a5b5-900b0d108ee2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:03.064016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'SecurityGroup': ['ID=548aeaef-9f5c-4dbd-93ed-92743a27a3f2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:03.067377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:03.072058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.074158 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.4028661 Nov 24 14:00:03.076550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41486) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:03.087743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'security_group': {'name': 'tempest-secgroup-1127094934'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:03.095295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:03.097430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:03.100778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:03.105497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:03.112601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:03.123069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Usage tracker for resource:subnet and tenant:f0d8ccca93984618ad200eead84e76c2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:03.138784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.144785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8dda46b9-f1a9-4c7a-9091-6ab75dfce826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.172350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:03.196062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:03.200488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 24311646-1e87-4d0c-9d2d-92cc6b5057ed is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:00:03.202667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:security_group_rule and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:03.206046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:03.213091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:03.222825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attempting to reserve 2 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:03.283854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13536adf-e243-4779-af3e-af60499e6a31 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:03.291058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Made reservation on behalf of f0d8ccca93984618ad200eead84e76c2 for: {'subnet': 2} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:03.314798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.352101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.355055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.361872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.368163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c9e00d4a-1549-45d2-9632-f5e35434901a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:03.451871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=af2d8161-0b36-44d8-96df-feaefffa2bed,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:03.469726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0c6d24e1-5253-4ea4-8642-618a025348ad,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:03.481021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.485376 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.4028337 Nov 24 14:00:03.488966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41492) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:03.504184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-187493689', 'security_groups': ['0c6d24e1-5253-4ea4-8642-618a025348ad'], 'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'ca91fd7c-9569-4d83-8191-7efefe816151'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:03.523686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.524086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.524462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.524949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.525468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.525941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.526652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.527196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.527690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.528169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.528533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:03.536738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:03.539913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.650988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.601s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:03.658781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for d795bf51-5d44-41e3-8fce-cb4f7b3542b9 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:03.672595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Update dhcp port {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'fixed_ips': [{'subnet_id': 'a0a69375-08b2-4745-bb36-2edd70a8f808', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'ca91fd7c-9569-4d83-8191-7efefe816151'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': 'afbb30e1-0766-4741-97b5-1b18534c3291'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:00:03.689793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fa413a92-e996-4128-9d9b-74287777c962 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.238s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:03.692602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:03.703319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:03.714864 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] Sync routers for ids ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:03.717637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:03.727630 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] Routers {'24311646-1e87-4d0c-9d2d-92cc6b5057ed'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:03.727630 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:03.745503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.750577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.753165 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 879 time: 3.5648499 Nov 24 14:00:03.754990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:03.763744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:03.773676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41496) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:03.790826 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:03.805089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] device_id is not set on port aaca1f92-cd17-4f38-bde9-f2ecc8927877 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:03.809502 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] Routers {'24311646-1e87-4d0c-9d2d-92cc6b5057ed'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:03.810375 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T13:59:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:03.840230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '588e5c75-cb31-4413-b98c-d39768a15b86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:03.840612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:03.883947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:03.885359 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54929f75-0eba-4701-8deb-886f5ea02b06 None None] The sync data for ids ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:03.966505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Allocated IP 2001:db8::2 (d1d0487a-60e7-49df-8f6a-8133f5eb276b/ca91fd7c-9569-4d83-8191-7efefe816151/afbb30e1-0766-4741-97b5-1b18534c3291) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:03.980226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=f33906ec-ec54-4296-93fb-8e8e38df0c3a,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:03.987547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:04.039370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.052068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1e10fa73-9910-4aaf-aad6-82890eec5eaf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:04.090830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'e86cd9be-9338-48b0-9d95-e547187ced4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:04.091190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: 5056ad91-892d-44f2-ae6f-f9acdcef87ef, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:04.097075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.097400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.109168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=afbb30e1-0766-4741-97b5-1b18534c3291,segment=NetworkSegment(88f19f83-091c-4d89-aa79-2ae8ba5b119e),segment_id=88f19f83-091c-4d89-aa79-2ae8ba5b119e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:04.134473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.137975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=d795bf51-5d44-41e3-8fce-cb4f7b3542b9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:04.145684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:04.153454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Transition to ACTIVE for port object afbb30e1-0766-4741-97b5-1b18534c3291 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:04.155726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:04.157624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.162271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8f77105c-7aa5-412d-8762-08ecd95abe9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:04.252198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8::29a (d1d0487a-60e7-49df-8f6a-8133f5eb276b/ca91fd7c-9569-4d83-8191-7efefe816151/aaca1f92-cd17-4f38-bde9-f2ecc8927877) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:04.308523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Pushing event updated for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:04.310673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.311670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:04.313747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:04.327106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f521f3c0-014f-42ee-87bf-9b3bdf3757ce None None] Network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:04.337005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:04.337592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.373475 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 3.3755245 Nov 24 14:00:04.374273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network 5056ad91-892d-44f2-ae6f-f9acdcef87ef is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:04.376477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41500) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:04.381917 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/d795bf51-5d44-41e3-8fce-cb4f7b3542b9 HTTP/1.1" status: 204 len: 168 time: 1.9847262 Nov 24 14:00:04.389932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:04.397456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'mac_address': 'fa:16:3e:97:25:53', 'name': 'tempest-PortsTestJSON-1299627159'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:04.518758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.539868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Transition to ACTIVE for port object aaca1f92-cd17-4f38-bde9-f2ecc8927877 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:04.559225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 5056ad91-892d-44f2-ae6f-f9acdcef87ef) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:04.564418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:04.565007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.573374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.577253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b15bd13-9df8-4b06-bfa4-5f8d7dcb02b0 None None] Network 5056ad91-892d-44f2-ae6f-f9acdcef87ef requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:04.582612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:04.586875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9dca1a9a-06f9-41f7-80b0-982378e6ad0e tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:04.663544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:04.674859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:04.681345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:04.687151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:04.694383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:04.701765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:04.702586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.710852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:04.722559 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 3.3438840 Nov 24 14:00:04.724288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1', 'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': 'af2d8161-0b36-44d8-96df-feaefffa2bed'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:04.725531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:04.735147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41508) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:04.743332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=aaca1f92-cd17-4f38-bde9-f2ecc8927877,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:04.754907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:04.759842 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.2655563 Nov 24 14:00:04.760126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41512) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:04.766583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:04.828824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:05.019934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-5056ad91-892d-44f2-ae6f-f9acdcef87ef', 'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': 'f33906ec-ec54-4296-93fb-8e8e38df0c3a'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:05.020159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.021705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.044615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:05.048834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:05.051994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:05.058274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:05.070234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:05.074199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.093761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Allocated IP 172.20.0.1 (6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1/af2d8161-0b36-44d8-96df-feaefffa2bed/7d9ccb97-5e98-451d-9213-80cb9b21aaa3) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:05.097640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.119366 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-279d03c8-ee0f-4177-86f5-dfb22814d284 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/routers/24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 200 len: 880 time: 1.3472686 Nov 24 14:00:05.149963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41516) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:05.227589 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet ca91fd7c-9569-4d83-8191-7efefe816151 (CIDR: 2001:db8::/64) Nov 24 14:00:05.231565 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:00:05.232047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:05.259587 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0f8a88d1-d549-42e8-a508-b79745906710 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4956961 Nov 24 14:00:05.259799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41520) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:05.266441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:05.352047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.433239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:05.441935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:05.446295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:05.449527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:05.455639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:05.468566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:05.473086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.481477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5fe3020e-5003-4b6a-bcd0-1d249ff285e9 None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:05.481873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5fe3020e-5003-4b6a-bcd0-1d249ff285e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.511384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Allocated IP 2001:db8::1 (5056ad91-892d-44f2-ae6f-f9acdcef87ef/f33906ec-ec54-4296-93fb-8e8e38df0c3a/6c0b9269-01e7-4dd6-b2c9-6624f47240bc) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:05.599072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 5962e3bb-cfe1-4811-b2a2-6f567a28ea51 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:05.616010 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet a0a69375-08b2-4745-bb36-2edd70a8f808 (CIDR: 2001:db8:0:1::/64) Nov 24 14:00:05.620409 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:00:05.620952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:05.643273 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-89ddb6bc-2875-439d-ac8d-85ba8173dd02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.3823266 Nov 24 14:00:05.643974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41524) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:05.649545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'subnet': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:05.660572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5fe3020e-5003-4b6a-bcd0-1d249ff285e9 None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:05.775773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.797269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-de34c6f7-b400-4325-8872-f53e409016e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.799178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Transition to ACTIVE for port object 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:05.803244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:05.807937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Usage tracker for resource:subnet and tenant:5a0a3f13e5494d5db442bf11517640e4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:05.808720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5fe3020e-5003-4b6a-bcd0-1d249ff285e9 None None] Provisioning for port afbb30e1-0766-4741-97b5-1b18534c3291 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:05.811599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:05.817796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:05.828419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Made reservation on behalf of 5a0a3f13e5494d5db442bf11517640e4 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:05.831921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.833890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.842205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5fe3020e-5003-4b6a-bcd0-1d249ff285e9 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:05.842596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5fe3020e-5003-4b6a-bcd0-1d249ff285e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.865466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:05.865727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.907942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Transition to ACTIVE for port object 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:05.931892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:05.943036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-65113f93-f85a-4a03-8864-29c23dd4824e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:05.952972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.101030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:06.105562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.112027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c1df170a-46fc-4ba7-afb8-219074221a02 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:06.115381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:06.117643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Pushing event updated for resources: {'Port': ['ID=7d9ccb97-5e98-451d-9213-80cb9b21aaa3,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:06.120839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:06.154981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.192768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:06.195973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:06.200797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:06.201385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.205042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Subnet': ['ID=9e91cbca-3ae5-41b4-b88e-acbc770299fe,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:06.208726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:06.225023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 0.5801253 Nov 24 14:00:06.227702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41528) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:06.233848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-214572857', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '9e91cbca-3ae5-41b4-b88e-acbc770299fe'}], 'security_groups': ['14436c92-9776-4f4f-a0c0-6e5dee1f6915', '548aeaef-9f5c-4dbd-93ed-92743a27a3f2']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:06.259958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.261014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.261913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.262339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.262794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.264244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.264971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.265309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.265751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.266165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.266486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:00:06.269854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.285475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.342s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:06.285625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a3ce193-9f98-4791-956d-4e4058dc95ef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:06.330805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-83cb3621-d593-4363-aa21-093e8e54790b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:router {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:06.381502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7b7972c-0837-4314-849f-38cb63ed838f None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:06.409505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Transition to ACTIVE for port object 6c0b9269-01e7-4dd6-b2c9-6624f47240bc will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:06.427084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=af2d8161-0b36-44d8-96df-feaefffa2bed,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:06.454130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:06.457730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.498401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.513100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-caa40422-7a33-44c7-87be-012090b21b75 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:06.519992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.544210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.557144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-83cb3621-d593-4363-aa21-093e8e54790b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:router {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:06.560226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-83cb3621-d593-4363-aa21-093e8e54790b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 883 time: 1.4010327 Nov 24 14:00:06.562879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41532) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:06.568750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Transition to ACTIVE for port object 6c0b9269-01e7-4dd6-b2c9-6624f47240bc will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:06.572206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:06.580054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-270284928'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:06.584650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Attempting to bind port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:06.584902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Attempting to bind port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '588e5c75-cb31-4413-b98c-d39768a15b86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:06.585273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Attempting to bind port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 on network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:06.597006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '588e5c75-cb31-4413-b98c-d39768a15b86') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:06.597334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '588e5c75-cb31-4413-b98c-d39768a15b86') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:06.617749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.624275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-40081510-abac-452b-95cc-96cd90401bb6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:06.641968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.666269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:06.667968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Checking segment: {'id': '588e5c75-cb31-4413-b98c-d39768a15b86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:06.667968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.668440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Bound using segment: {'id': '588e5c75-cb31-4413-b98c-d39768a15b86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:06.669114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Bound port: 7d9ccb97-5e98-451d-9213-80cb9b21aaa3, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '588e5c75-cb31-4413-b98c-d39768a15b86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:06.669603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.681917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Subnet': ['ID=7bb5d714-2270-4b23-a809-e29a858fd3e2,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:06.689485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:06.699898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.712127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.720608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:06.757586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 850 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:06.757989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:06.774237 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:06.785283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Checking segment: {'id': '15639694-360e-4201-b3ca-c31a90490fed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:06.785889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network hostable DHCP agents. Network: daf858ef-c98b-4940-a851-61a3f47346db, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:06.791969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.804661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=f33906ec-ec54-4296-93fb-8e8e38df0c3a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:06.806932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:06.812476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3cbb028-5580-43fa-bee5-8b390ec331d4 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.008s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:06.814674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Network 5056ad91-892d-44f2-ae6f-f9acdcef87ef is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:06.821610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:06.827002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:06.828747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Pushing event updated for resources: {'Port': ['ID=6c0b9269-01e7-4dd6-b2c9-6624f47240bc,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:06.837107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:06.844968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:06.904308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-980c404d-7d4e-4d55-9544-e827acf16bb8 None None] Provisioning for port aaca1f92-cd17-4f38-bde9-f2ecc8927877 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:06.969048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-980c404d-7d4e-4d55-9544-e827acf16bb8 None None] Provisioning complete for port aaca1f92-cd17-4f38-bde9-f2ecc8927877 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:06.969441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-980c404d-7d4e-4d55-9544-e827acf16bb8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.051405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] For port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:07.070509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:07.070732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Attempting to bind port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:07.071135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Attempting to bind port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'e86cd9be-9338-48b0-9d95-e547187ced4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:07.071632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Attempting to bind port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc on network 5056ad91-892d-44f2-ae6f-f9acdcef87ef {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:07.076664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=5962e3bb-cfe1-4811-b2a2-6f567a28ea51,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:07.086793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] For port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7d9ccb97-5e98-451d-9213-80cb9b21aaa3,segment=NetworkSegment(588e5c75-cb31-4413-b98c-d39768a15b86),segment_id=588e5c75-cb31-4413-b98c-d39768a15b86)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:07.091192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.098274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-980c404d-7d4e-4d55-9544-e827acf16bb8 None None] Port aaca1f92-cd17-4f38-bde9-f2ecc8927877 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:07.100155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.105109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:07.122828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5056ad91-892d-44f2-ae6f-f9acdcef87ef']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:07.136875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e86cd9be-9338-48b0-9d95-e547187ced4f') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:07.137648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e86cd9be-9338-48b0-9d95-e547187ced4f') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:07.140065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:07.140251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Checking segment: {'id': 'e86cd9be-9338-48b0-9d95-e547187ced4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:07.140623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.141026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Bound using segment: {'id': 'e86cd9be-9338-48b0-9d95-e547187ced4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:07.141511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Bound port: 6c0b9269-01e7-4dd6-b2c9-6624f47240bc, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e86cd9be-9338-48b0-9d95-e547187ced4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:07.141897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.155058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:00:07.155058 dv-neutron-818151-2-hyperv neutron-server[83526]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:00:07.155058 dv-neutron-818151-2-hyperv neutron-server[83526]: [parameters: {'id': '6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1'}] Nov 24 14:00:07.155058 dv-neutron-818151-2-hyperv neutron-server[83526]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:07.155903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:07.156670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:07.160385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.169371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:07.175715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:07.179836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:07.180429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.202442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.222393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 871 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:07.224020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.250953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Pushing event updated for resources: {'Port': ['ID=7d9ccb97-5e98-451d-9213-80cb9b21aaa3,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:07.292308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:07.310068 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:07.312507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network daf858ef-c98b-4940-a851-61a3f47346db is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:07.330148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Delete allocated IP 2001:db8::29a (d1d0487a-60e7-49df-8f6a-8133f5eb276b/ca91fd7c-9569-4d83-8191-7efefe816151) {{(pid=83525) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 14:00:07.350316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Allocated IP 2001:db8:0:2::33b (d1d0487a-60e7-49df-8f6a-8133f5eb276b/9e91cbca-3ae5-41b4-b88e-acbc770299fe/aaca1f92-cd17-4f38-bde9-f2ecc8927877) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:07.403503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] For port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:07.405836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df3643ce-3edb-4313-bb84-4d415bf11df4 None None] Network 6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 3.0160317 Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: [parameters: {'id': '5056ad91-892d-44f2-ae6f-f9acdcef87ef'}] Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:07.409397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, daf858ef-c98b-4940-a851-61a3f47346db) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:07.411552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41536) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:07.423192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9534ab46-e159-452b-a9db-504b45db5174 None None] Network daf858ef-c98b-4940-a851-61a3f47346db requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:07.449370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.458274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e9da0926-6fd5-453e-b7f2-ebd86cb3ec43 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:07.519450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] For port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=6c0b9269-01e7-4dd6-b2c9-6624f47240bc,segment=NetworkSegment(e86cd9be-9338-48b0-9d95-e547187ced4f),segment_id=e86cd9be-9338-48b0-9d95-e547187ced4f)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:07.580519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.595395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce5299fd-bf87-40c4-adaf-6374ed37176c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:07.632031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Update dhcp port {'port': {'network_id': 'd1d0487a-60e7-49df-8f6a-8133f5eb276b', 'fixed_ips': [{'subnet_id': 'a0a69375-08b2-4745-bb36-2edd70a8f808', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'ca91fd7c-9569-4d83-8191-7efefe816151', 'ip_address': '2001:db8::2'}, {'subnet_id': '9e91cbca-3ae5-41b4-b88e-acbc770299fe'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': 'afbb30e1-0766-4741-97b5-1b18534c3291'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:00:07.657703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.672447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33fa2ceb-4112-4ffd-891b-c524e5e29f70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:07.673031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-33fa2ceb-4112-4ffd-891b-c524e5e29f70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:07.687056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event updated for resources: {'Subnet': ['ID=e170d306-f00c-487d-98c3-6ecc425d318d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:07.699677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:07.717008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:07.717480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.748965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-33fa2ceb-4112-4ffd-891b-c524e5e29f70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:07.752745 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-33fa2ceb-4112-4ffd-891b-c524e5e29f70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/5962e3bb-cfe1-4811-b2a2-6f567a28ea51 HTTP/1.1" status: 200 len: 841 time: 0.3375928 Nov 24 14:00:07.757007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41540) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:07.802685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Checking segment: {'id': '4f27d341-d6cb-441c-820d-e469097c3eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:07.803086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network hostable DHCP agents. Network: 691aaa8d-2ea8-45a5-a42e-1d1064132413, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:07.826079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.850170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.853888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Ignored duplicate provisioning block setup for port aaca1f92-cd17-4f38-bde9-f2ecc8927877 by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} Nov 24 14:00:07.860784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.867681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23094332-2cbc-4b99-a63f-d0077b0c1ef6 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:07.870958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Pushing event updated for resources: {'Port': ['ID=6c0b9269-01e7-4dd6-b2c9-6624f47240bc,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:07.876491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.893672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 5962e3bb-cfe1-4811-b2a2-6f567a28ea51 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:07.894018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.911261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:07.912492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:07.929846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.034329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3ceece3-1934-4afd-9e28-bc0cccc94cc8 None None] Network 5056ad91-892d-44f2-ae6f-f9acdcef87ef requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:08.042462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] In _notify_port_updated(), no bound segment for port aaca1f92-cd17-4f38-bde9-f2ecc8927877 on network d1d0487a-60e7-49df-8f6a-8133f5eb276b {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:00:08.043806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Network 691aaa8d-2ea8-45a5-a42e-1d1064132413 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:08.046338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:08.047289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.051077 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "PUT /v2.0/ports/aaca1f92-cd17-4f38-bde9-f2ecc8927877 HTTP/1.1" status: 200 len: 969 time: 1.8195257 Nov 24 14:00:08.051077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event updated for resources: {'Port': ['ID=aaca1f92-cd17-4f38-bde9-f2ecc8927877,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:08.053268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41544) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:08.056336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:08.071069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:08.071642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.129372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port aaca1f92-cd17-4f38-bde9-f2ecc8927877 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:08.129757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.159101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 691aaa8d-2ea8-45a5-a42e-1d1064132413) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:08.174671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] For port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7d9ccb97-5e98-451d-9213-80cb9b21aaa3,segment=NetworkSegment(588e5c75-cb31-4413-b98c-d39768a15b86),segment_id=588e5c75-cb31-4413-b98c-d39768a15b86)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:08.175033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.183662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:08.184069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:08.184689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.230586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8be54a93-4c01-4385-a31d-40d91d672fc7 None None] Network 691aaa8d-2ea8-45a5-a42e-1d1064132413 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:08.252586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-daf858ef-c98b-4940-a851-61a3f47346db', 'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db', 'tenant_id': 'f0d8ccca93984618ad200eead84e76c2', 'fixed_ips': [{'subnet_id': '7bb5d714-2270-4b23-a809-e29a858fd3e2'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:08.253413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.360973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Calling delete_port for 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:08.433292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 5.9140072 Nov 24 14:00:08.460441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41548) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:08.556711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.588159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-482f969e-06a7-46f1-ad24-c4f1804635b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:08.589645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-482f969e-06a7-46f1-ad24-c4f1804635b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:08.590969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-482f969e-06a7-46f1-ad24-c4f1804635b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:08.592557 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-482f969e-06a7-46f1-ad24-c4f1804635b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.1299636 Nov 24 14:00:08.593470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.596609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41552) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:08.600040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.713780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Allocated IP 2001:db8:0:2::2 (d1d0487a-60e7-49df-8f6a-8133f5eb276b/9e91cbca-3ae5-41b4-b88e-acbc770299fe/afbb30e1-0766-4741-97b5-1b18534c3291) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:08.795319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 5962e3bb-cfe1-4811-b2a2-6f567a28ea51 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:08.824520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.835335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e8a85cbb-a981-48ee-96f9-4a616dcdd581 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:08.887818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] For port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=6c0b9269-01e7-4dd6-b2c9-6624f47240bc,segment=NetworkSegment(e86cd9be-9338-48b0-9d95-e547187ced4f),segment_id=e86cd9be-9338-48b0-9d95-e547187ced4f)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:08.888260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.892585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 24311646-1e87-4d0c-9d2d-92cc6b5057ed has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:00:08.897500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Allocated IP 172.20.0.2 (daf858ef-c98b-4940-a851-61a3f47346db/7bb5d714-2270-4b23-a809-e29a858fd3e2/d040b669-1d25-4a57-bc0a-291097cbb936) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:08.901961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for aaca1f92-cd17-4f38-bde9-f2ecc8927877 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:08.918774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Port': ['ID=7d9ccb97-5e98-451d-9213-80cb9b21aaa3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:08.956663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-691aaa8d-2ea8-45a5-a42e-1d1064132413', 'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413', 'tenant_id': 'f0d8ccca93984618ad200eead84e76c2', 'fixed_ips': [{'subnet_id': 'e170d306-f00c-487d-98c3-6ecc425d318d'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:08.957320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:08.999346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:09.021686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=afbb30e1-0766-4741-97b5-1b18534c3291,segment=NetworkSegment(88f19f83-091c-4d89-aa79-2ae8ba5b119e),segment_id=88f19f83-091c-4d89-aa79-2ae8ba5b119e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:09.066210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Calling delete_port for 6c0b9269-01e7-4dd6-b2c9-6624f47240bc owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:09.157516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:09.198367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.207891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No DVR routers for this DVR port 7d9ccb97-5e98-451d-9213-80cb9b21aaa3 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:09.256974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting subnet 7bb5d714-2270-4b23-a809-e29a858fd3e2 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:09.328777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Transition to ACTIVE for port object afbb30e1-0766-4741-97b5-1b18534c3291 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:09.334825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.344677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dbd2834b-59d5-410a-bb1d-35a37e7eebaf tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:09.345043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.352722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:09.393986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=aaca1f92-cd17-4f38-bde9-f2ecc8927877,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:09.396616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:09.410725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.419303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.428762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ee5ea1d0-d0a0-451f-a19e-6efc5ae6110f tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:09.429039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Allocated IP 172.20.0.18 (691aaa8d-2ea8-45a5-a42e-1d1064132413/e170d306-f00c-487d-98c3-6ecc425d318d/a8ba0fc0-8a61-4c85-ae87-166667371449) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:09.478766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.492106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=5962e3bb-cfe1-4811-b2a2-6f567a28ea51,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:09.493891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.498393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:09.498905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:09.506792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.529399 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/aaca1f92-cd17-4f38-bde9-f2ecc8927877 HTTP/1.1" status: 204 len: 168 time: 1.4735961 Nov 24 14:00:09.529612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:09.529715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:09.539782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Transition to ACTIVE for port object d040b669-1d25-4a57-bc0a-291097cbb936 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:09.556503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '588e5c75-cb31-4413-b98c-d39768a15b86') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:09.556815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '588e5c75-cb31-4413-b98c-d39768a15b86') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:09.565704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Port': ['ID=6c0b9269-01e7-4dd6-b2c9-6624f47240bc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:09.571826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.575198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:09.579394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.585806 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-370baedc-b29e-4ae0-8dfa-693deb321eef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] GET failed (client error): The resource could not be found. Nov 24 14:00:09.586380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-370baedc-b29e-4ae0-8dfa-693deb321eef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Synchronizing usage tracker for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:09.587787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No DVR routers for this DVR port 6c0b9269-01e7-4dd6-b2c9-6624f47240bc on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:09.600542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Pushing event updated for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:09.613950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:09.628689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-370baedc-b29e-4ae0-8dfa-693deb321eef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Unset dirty status for tenant:5a0a3f13e5494d5db442bf11517640e4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:09.632304 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-370baedc-b29e-4ae0-8dfa-693deb321eef tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports/aaca1f92-cd17-4f38-bde9-f2ecc8927877 HTTP/1.1" status: 404 len: 333 time: 0.1006427 Nov 24 14:00:09.633223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41562) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:09.642648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.650868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:09.663946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.668814 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4afe8174-48d7-44ef-8552-f7dafff91958 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 200 len: 887 time: 3.0961194 Nov 24 14:00:09.669009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41566) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:09.695646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 850 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:09.696385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:09.717846 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:09.731589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] Sync routers for ids ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:09.740569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Transition to ACTIVE for port object d040b669-1d25-4a57-bc0a-291097cbb936 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:09.751275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.759531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.766797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dcbb3158-3efb-4579-a4f9-dd5a16e34fd0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:09.778460 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-afc8c5fc-79c2-4317-8a27-1ee54fb2c4f5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/5962e3bb-cfe1-4811-b2a2-6f567a28ea51 HTTP/1.1" status: 204 len: 168 time: 2.0187471 Nov 24 14:00:09.801596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41570) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:09.826740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.915861 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-9c4e3588-08b6-4321-b43d-2bfb04d85f2c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:00:09.917075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9c4e3588-08b6-4321-b43d-2bfb04d85f2c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:09.922951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.934729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Transition to ACTIVE for port object a8ba0fc0-8a61-4c85-ae87-166667371449 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:09.939080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.954254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Transition to ACTIVE for port object a8ba0fc0-8a61-4c85-ae87-166667371449 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:09.963542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:09.966518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] Routers {'24311646-1e87-4d0c-9d2d-92cc6b5057ed'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:09.967425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:09.978325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.028240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5056ad91-892d-44f2-ae6f-f9acdcef87ef']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:10.028911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.045835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9c4e3588-08b6-4321-b43d-2bfb04d85f2c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:10.047182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9c4e3588-08b6-4321-b43d-2bfb04d85f2c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/5962e3bb-cfe1-4811-b2a2-6f567a28ea51 HTTP/1.1" status: 404 len: 333 time: 0.2407317 Nov 24 14:00:10.050294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Network daf858ef-c98b-4940-a851-61a3f47346db is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:10.051179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e86cd9be-9338-48b0-9d95-e547187ced4f') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:10.051580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e86cd9be-9338-48b0-9d95-e547187ced4f') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:10.057864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:10.060411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.062558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41574) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:10.064690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:10.069610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.072248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:10.077435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Pushing event updated for resources: {'Port': ['ID=d040b669-1d25-4a57-bc0a-291097cbb936,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.080860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d21671cf-601b-4a11-9a65-4a08e6db93ba tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.081882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.091360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'name': 'tempest-PortsTestJSON-1269383501'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:10.099900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.101655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Network 691aaa8d-2ea8-45a5-a42e-1d1064132413 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:10.102672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.054s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.106101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.128736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.128970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.141709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.146230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.152409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 HTTP/1.1" status: 204 len: 168 time: 5.7656512 Nov 24 14:00:10.153357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41578) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:10.156307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.161829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-92941212'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:10.164587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] Routers {'24311646-1e87-4d0c-9d2d-92cc6b5057ed'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:10.165493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:10.171149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:10.176258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 871 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:10.176665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:10.197285 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:10.200034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:10.207036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:10.221905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:10.237119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:10.245158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Subnet': ['ID=7bb5d714-2270-4b23-a809-e29a858fd3e2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.247821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.258126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:10.263947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:10.264672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfd3e2bb-010c-4e5a-95a3-8864ce637429 None None] The sync data for ids ['24311646-1e87-4d0c-9d2d-92cc6b5057ed'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:10.303717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.314945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.356289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c6d24e1-5253-4ea4-8642-618a025348ad,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.360668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.361635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:10.364971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.373570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.389031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.392947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.394061 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/security-groups/0c6d24e1-5253-4ea4-8642-618a025348ad HTTP/1.1" status: 204 len: 168 time: 0.7560859 Nov 24 14:00:10.397783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.398857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Pushing event updated for resources: {'Port': ['ID=a8ba0fc0-8a61-4c85-ae87-166667371449,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.400330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:10.418426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.432735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=5056ad91-892d-44f2-ae6f-f9acdcef87ef,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.436236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.436617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.334s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.441076 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5056ad91-892d-44f2-ae6f-f9acdcef87ef HTTP/1.1" status: 204 len: 168 time: 5.6953974 Nov 24 14:00:10.443522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41586) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:10.451383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/subnets/7bb5d714-2270-4b23-a809-e29a858fd3e2 HTTP/1.1" status: 204 len: 168 time: 1.8513479 Nov 24 14:00:10.451592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1840585506'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:10.456668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41590) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:10.459545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 894} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:10.462476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:10.484069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:10.498011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Attempting to bind port d040b669-1d25-4a57-bc0a-291097cbb936 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:10.498390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Attempting to bind port d040b669-1d25-4a57-bc0a-291097cbb936 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '15639694-360e-4201-b3ca-c31a90490fed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:10.498758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Attempting to bind port d040b669-1d25-4a57-bc0a-291097cbb936 on network daf858ef-c98b-4940-a851-61a3f47346db {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:10.510574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Attempting to bind port a8ba0fc0-8a61-4c85-ae87-166667371449 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:10.510961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Attempting to bind port a8ba0fc0-8a61-4c85-ae87-166667371449 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '4f27d341-d6cb-441c-820d-e469097c3eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:10.511514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Attempting to bind port a8ba0fc0-8a61-4c85-ae87-166667371449 on network 691aaa8d-2ea8-45a5-a42e-1d1064132413 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:10.514294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:10.514675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Checking segment: {'id': '15639694-360e-4201-b3ca-c31a90490fed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:10.515201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.515469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Bound using segment: {'id': '15639694-360e-4201-b3ca-c31a90490fed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:10.515970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Bound port: d040b669-1d25-4a57-bc0a-291097cbb936, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '15639694-360e-4201-b3ca-c31a90490fed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': 'daf858ef-c98b-4940-a851-61a3f47346db'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:10.516356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.521672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:10.522293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.522630 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 18300d97-46f2-4d94-878d-6e4d4e766669 of type vlan for network 4862f14a-b211-4e69-a305-563ddb9c83b6 Nov 24 14:00:10.534675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:10.548334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:10.554022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:10.557578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.565375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:10.572988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:10.573443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Checking segment: {'id': '4f27d341-d6cb-441c-820d-e469097c3eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:10.573860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.574264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Bound using segment: {'id': '4f27d341-d6cb-441c-820d-e469097c3eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:10.574753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Bound port: a8ba0fc0-8a61-4c85-ae87-166667371449, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f27d341-d6cb-441c-820d-e469097c3eb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '691aaa8d-2ea8-45a5-a42e-1d1064132413'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:10.575144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.597336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port df1c48b5-c142-4812-bd09-ae16ee2deea0 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:10.603090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.607803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Could not find standard attr ID for object aaca1f92-cd17-4f38-bde9-f2ecc8927877. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:00:10.633836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:10.637325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.708031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] For port d040b669-1d25-4a57-bc0a-291097cbb936, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:10.709923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:10.710471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.773330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] For port d040b669-1d25-4a57-bc0a-291097cbb936, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d040b669-1d25-4a57-bc0a-291097cbb936,segment=NetworkSegment(15639694-360e-4201-b3ca-c31a90490fed),segment_id=15639694-360e-4201-b3ca-c31a90490fed)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:10.800944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.805598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 896} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:10.806114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] For port a8ba0fc0-8a61-4c85-ae87-166667371449, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:10.810516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.814033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.819201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:10.820095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.824038 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8148a87b-6594-41e8-8964-6ecd5dacccad tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/routers/24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 200 len: 887 time: 1.1534529 Nov 24 14:00:10.827613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6d830899-ec9c-4084-bb83-b30911beab00 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.829549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:10.847024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:10.869539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] For port a8ba0fc0-8a61-4c85-ae87-166667371449, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a8ba0fc0-8a61-4c85-ae87-166667371449,segment=NetworkSegment(4f27d341-d6cb-441c-820d-e469097c3eb2),segment_id=4f27d341-d6cb-441c-820d-e469097c3eb2)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:10.873628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.876336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.876884 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0 of type vlan for network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 Nov 24 14:00:10.883814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.908986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:10.927212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Pushing event updated for resources: {'Port': ['ID=d040b669-1d25-4a57-bc0a-291097cbb936,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:10.930038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:10.930497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.032s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:10.978863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Provisioning for port afbb30e1-0766-4741-97b5-1b18534c3291 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:10.997955 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7b3225b8-0c6c-4561-a301-828e3df7c065 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 200 len: 205 time: 0.1618662 Nov 24 14:00:10.998470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:11.028498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting subnet e170d306-f00c-487d-98c3-6ecc425d318d {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:11.031233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:11.031624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3de2da9a-dd0b-4fd5-9dde-6051430085fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.050059 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.8930292 Nov 24 14:00:11.052936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.090530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41602) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:11.091408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=4862f14a-b211-4e69-a305-563ddb9c83b6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:11.095717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:11.097620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.118120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 4862f14a-b211-4e69-a305-563ddb9c83b6 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:11.121787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:11.134805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.142757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b8867d2d-65a1-44a4-816e-76a7ae32963e tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:11.175717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=548aeaef-9f5c-4dbd-93ed-92743a27a3f2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:11.191623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.201743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:11.248986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Pushing event updated for resources: {'Port': ['ID=a8ba0fc0-8a61-4c85-ae87-166667371449,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:11.256193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89edeb84-e1a3-4dda-a5ca-80c21f0e31ba None None] Network daf858ef-c98b-4940-a851-61a3f47346db requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:11.304903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.374s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:11.382898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.392253 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/security-groups/548aeaef-9f5c-4dbd-93ed-92743a27a3f2 HTTP/1.1" status: 204 len: 168 time: 0.9689243 Nov 24 14:00:11.396309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41606) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:11.548950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a8ba0fc0-8a61-4c85-ae87-166667371449 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:11.557826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.586820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.590650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:11.591288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.598741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-421a74bd-36ac-4b1e-aa18-a24ca5cf3ff3 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:11.631720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:11.634611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.642697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:11.648293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:11.667066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.686162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3d01a80b-e84f-4f01-8c30-ca5540c8a2b9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:11.705961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.2613950 Nov 24 14:00:11.708901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:11.724155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41610) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:11.733786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.751438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.778075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:11.811443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port a8ba0fc0-8a61-4c85-ae87-166667371449 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:11.815975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=b44ba3f1-4dca-4bbb-b72d-64df0deaa233,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:11.821796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=df1c48b5-c142-4812-bd09-ae16ee2deea0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:11.824831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:11.828689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:11.831616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:11.832841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:11.836152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.855524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:11.861968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:11.891431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:11.906384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:11.909066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:11.909660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.939213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.941948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:11.943153 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/security-groups/14436c92-9776-4f4f-a0c0-6e5dee1f6915 HTTP/1.1" status: 204 len: 168 time: 0.5337272 Nov 24 14:00:11.946719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63c48ae7-5c2f-43f1-9062-dc1c37f93ab5 tempest-PortsAdminExtendedAttrsTestJSON-1273181875 tempest-PortsAdminExtendedAttrsTestJSON-1273181875-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:11.958775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41614) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:11.984042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-45b02f7c-3fe7-40e5-ab36-6bcb4340fec4 None None] Could not find standard attr ID for object aaca1f92-cd17-4f38-bde9-f2ecc8927877. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:00:12.023238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:12.023655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.051731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.064323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=14436c92-9776-4f4f-a0c0-6e5dee1f6915,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:12.075997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:12.083063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:12.086102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:12.092125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.169638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:12.203143 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 2.1347482 Nov 24 14:00:12.204270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:12.210229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:12.210779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:12.234074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Subnet': ['ID=e170d306-f00c-487d-98c3-6ecc425d318d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:12.239338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:12.243345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.243549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:12.254182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:12.289018 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/subnets/e170d306-f00c-487d-98c3-6ecc425d318d HTTP/1.1" status: 204 len: 168 time: 1.8290949 Nov 24 14:00:12.290240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41622) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:12.366824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet ca91fd7c-9569-4d83-8191-7efefe816151 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:12.383788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.430374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cde00589-686e-4056-97cc-bad4ce7da70b None None] Network 691aaa8d-2ea8-45a5-a42e-1d1064132413 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:12.459157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.499356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d662fb1-5b31-4e90-9103-52bf57cf9949 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:12.500103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7d662fb1-5b31-4e90-9103-52bf57cf9949 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Synchronizing usage tracker for tenant:f0d8ccca93984618ad200eead84e76c2 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:12.507886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.565910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.584510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Provisioning for port a8ba0fc0-8a61-4c85-ae87-166667371449 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:12.624001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Provisioning complete for port a8ba0fc0-8a61-4c85-ae87-166667371449 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:12.624480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.629532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7d662fb1-5b31-4e90-9103-52bf57cf9949 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Unset dirty status for tenant:f0d8ccca93984618ad200eead84e76c2 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:12.636111 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7d662fb1-5b31-4e90-9103-52bf57cf9949 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.3397315 Nov 24 14:00:12.636111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41626) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:12.686700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.741666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1019fb1c-3370-405a-b6c7-f42f12f1c62a tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:12.747123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.777914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.827483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] DHCP port deletion for 691aaa8d-2ea8-45a5-a42e-1d1064132413 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:00:12.833792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Deleting port a8ba0fc0-8a61-4c85-ae87-166667371449 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:12.834451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.851578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.866403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] For port a8ba0fc0-8a61-4c85-ae87-166667371449, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a8ba0fc0-8a61-4c85-ae87-166667371449,segment=NetworkSegment(4f27d341-d6cb-441c-820d-e469097c3eb2),segment_id=4f27d341-d6cb-441c-820d-e469097c3eb2)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:12.876518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.880571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a419b8bf-0fce-4f78-b847-211b4f4298c5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:12.904297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:12.906151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=dcb0dcf2-a541-4ec4-8885-885eae25818f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:12.919009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:12.969047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting port a8ba0fc0-8a61-4c85-ae87-166667371449 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:12.969388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.001542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 4bbc1672-6723-4337-8c13-2111f57c5751 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:13.001881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.009818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '18300d97-46f2-4d94-878d-6e4d4e766669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:13.009818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 4862f14a-b211-4e69-a305-563ddb9c83b6, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:13.020230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.026880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Pushing event updated for resources: {'Port': ['ID=a8ba0fc0-8a61-4c85-ae87-166667371449,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:13.027460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e32a5131-8419-4b2f-ab94-45c18669f645 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:13.029661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:13.111595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.115452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.145842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] For port a8ba0fc0-8a61-4c85-ae87-166667371449, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a8ba0fc0-8a61-4c85-ae87-166667371449,segment=NetworkSegment(4f27d341-d6cb-441c-820d-e469097c3eb2),segment_id=4f27d341-d6cb-441c-820d-e469097c3eb2)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:13.146613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.165722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7878b697-f6f7-495a-855a-c296c874f422 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:13.177465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=6f1c8f54-9558-4f32-9a44-ac6ae00612fa,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:13.185539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:13.200794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.207367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 4862f14a-b211-4e69-a305-563ddb9c83b6 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:13.275272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Calling delete_port for a8ba0fc0-8a61-4c85-ae87-166667371449 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:13.305776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.318918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=ca91fd7c-9569-4d83-8191-7efefe816151,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:13.326697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] In _notify_port_updated(), no bound segment for port df1c48b5-c142-4812-bd09-ae16ee2deea0 on network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:00:13.330530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:13.331138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.332609 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/ports/df1c48b5-c142-4812-bd09-ae16ee2deea0 HTTP/1.1" status: 200 len: 818 time: 1.1122470 Nov 24 14:00:13.337040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:13.337576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d42b26e-7bac-4b28-a2cf-ba2b6836839b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.127s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:13.374153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41630) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:13.375696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.382319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e99f8c80-1196-4b60-9511-1085c285dc4f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:13.393835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 4862f14a-b211-4e69-a305-563ddb9c83b6) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:13.397172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:13.397459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: b44ba3f1-4dca-4bbb-b72d-64df0deaa233, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:13.417685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:13.418272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.427575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] For port a8ba0fc0-8a61-4c85-ae87-166667371449, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a8ba0fc0-8a61-4c85-ae87-166667371449,segment=NetworkSegment(4f27d341-d6cb-441c-820d-e469097c3eb2),segment_id=4f27d341-d6cb-441c-820d-e469097c3eb2)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:13.427950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.429160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a8ba0fc0-8a61-4c85-ae87-166667371449 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:13.454356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1cca4d2-8e25-4752-803d-db47a6fa13e0 None None] Network 4862f14a-b211-4e69-a305-563ddb9c83b6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:13.481486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49ea1ddc-c48b-4d4d-b742-1be779f063e3 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:13.505075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Pushing event deleted for resources: {'Port': ['ID=a8ba0fc0-8a61-4c85-ae87-166667371449,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:13.514214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: a8ba0fc0-8a61-4c85-ae87-166667371449 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:13.514564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a8ba0fc0-8a61-4c85-ae87-166667371449 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:13.518659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:13.536365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 4bbc1672-6723-4337-8c13-2111f57c5751 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:13.562685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.564992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Calling delete_port for a8ba0fc0-8a61-4c85-ae87-166667371449 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:13.573204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] No DVR routers for this DVR port a8ba0fc0-8a61-4c85-ae87-166667371449 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:13.605817 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/ca91fd7c-9569-4d83-8191-7efefe816151 HTTP/1.1" status: 204 len: 168 time: 1.6408286 Nov 24 14:00:13.606932 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.5128605 Nov 24 14:00:13.612089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41634) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:13.612567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41636) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:13.624817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=df1c48b5-c142-4812-bd09-ae16ee2deea0,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:13.631412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:13.653984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port df1c48b5-c142-4812-bd09-ae16ee2deea0 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:13.654427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.714633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:13.801525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, b44ba3f1-4dca-4bbb-b72d-64df0deaa233) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:13.815466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:13.816552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.834139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d0f867e-ca93-4c32-862f-f9acdabf47ab None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:13.868137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:13.868824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:13.927781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:13.944085 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.2175467 Nov 24 14:00:13.955579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41642) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:13.966789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:13.985627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-4862f14a-b211-4e69-a305-563ddb9c83b6', 'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': 'dcb0dcf2-a541-4ec4-8885-885eae25818f'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:13.986453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.011191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.080246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for df1c48b5-c142-4812-bd09-ae16ee2deea0 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:14.156135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet 9e91cbca-3ae5-41b4-b88e-acbc770299fe {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:14.178341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.185301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.191473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f750bfc2-be22-45fa-b28e-c46f978667b3 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:14.234676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Allocated IP 172.20.0.2 (4862f14a-b211-4e69-a305-563ddb9c83b6/dcb0dcf2-a541-4ec4-8885-885eae25818f/0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:14.246924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=df1c48b5-c142-4812-bd09-ae16ee2deea0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:14.249479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:14.254899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.302244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.328029 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/df1c48b5-c142-4812-bd09-ae16ee2deea0 HTTP/1.1" status: 204 len: 168 time: 0.9495313 Nov 24 14:00:14.328029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41646) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:14.333583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:14.342548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.384638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting port a8ba0fc0-8a61-4c85-ae87-166667371449 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:14.385261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.413934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-b44ba3f1-4dca-4bbb-b72d-64df0deaa233', 'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '6f1c8f54-9558-4f32-9a44-ac6ae00612fa'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:14.414706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.416950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.428751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e19c77d4-faa4-4379-855e-ac33d92c9223 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:14.435830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:subnet and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:14.453051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:14.509484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=4bbc1672-6723-4337-8c13-2111f57c5751,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:14.515333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:14.520534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:14.532611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] The port 'a8ba0fc0-8a61-4c85-ae87-166667371449' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:00:14.674881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.723681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40e3131a-722d-4a8f-8393-d4df4e2ece34 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:14.725123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-40e3131a-722d-4a8f-8393-d4df4e2ece34 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:14.759587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:14.764276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.774305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-40e3131a-722d-4a8f-8393-d4df4e2ece34 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:14.780451 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-40e3131a-722d-4a8f-8393-d4df4e2ece34 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.4514015 Nov 24 14:00:14.785953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.786685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41650) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:14.789673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.798545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Allocated IP 2001:db8::2 (b44ba3f1-4dca-4bbb-b72d-64df0deaa233/6f1c8f54-9558-4f32-9a44-ac6ae00612fa/8b0a6063-b5cd-4e86-828e-4d929cbd7a73) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:14.800226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f140d4b1-0312-4e34-9873-8513f3c91459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:14.812308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Transition to ACTIVE for port object 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:14.863017 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-e336c2ac-df00-4252-8fa0-3729c7577f21 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:00:14.870596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e336c2ac-df00-4252-8fa0-3729c7577f21 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/df1c48b5-c142-4812-bd09-ae16ee2deea0 HTTP/1.1" status: 404 len: 333 time: 0.0826268 Nov 24 14:00:14.871233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41654) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:14.879475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Transition to ACTIVE for port object 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:14.892499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:14.897607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fb45fef-a1cf-4b21-989b-1d6b0bbe7e55 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:14.908098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=9e91cbca-3ae5-41b4-b88e-acbc770299fe,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:14.945596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:15.011738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.071750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.084977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['691aaa8d-2ea8-45a5-a42e-1d1064132413']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:15.095901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.122329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27ed1f95-b290-4375-9c70-3222dd9f29fd tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:15.207669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-647845055'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:15.209025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3bb0d6fe-ce6b-4206-9784-19a121708e32 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:15.214849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.235575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Network 4862f14a-b211-4e69-a305-563ddb9c83b6 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:15.254832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:15.267190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:15.269411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Pushing event updated for resources: {'Port': ['ID=0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:15.272236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.321112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:15.324648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f27d341-d6cb-441c-820d-e469097c3eb2') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:15.324941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f27d341-d6cb-441c-820d-e469097c3eb2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:15.330884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.433s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:15.344718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/9e91cbca-3ae5-41b4-b88e-acbc770299fe HTTP/1.1" status: 204 len: 168 time: 1.7241623 Nov 24 14:00:15.344718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=dcb0dcf2-a541-4ec4-8885-885eae25818f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:15.345775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Transition to ACTIVE for port object 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:15.356693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.363798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:15.364246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41660) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:15.393882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:15.404239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:15.413013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:15.456274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Transition to ACTIVE for port object 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:15.463986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5cf7b212-e437-4995-a730-6a8f6cd49a79 None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:15.464250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5cf7b212-e437-4995-a730-6a8f6cd49a79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.473673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-774931cc-5dcb-4ed1-814f-677972b1a229 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:15.474117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-774931cc-5dcb-4ed1-814f-677972b1a229 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:15.478115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-774931cc-5dcb-4ed1-814f-677972b1a229 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/ca91fd7c-9569-4d83-8191-7efefe816151 HTTP/1.1" status: 404 len: 337 time: 0.1105888 Nov 24 14:00:15.490636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.499136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Releasing vlan 851 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:15.499607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.515698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41664) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:15.519159 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:15.531230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.535042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.546700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:15.554140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:15.558510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.580978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.591141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.601735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 873} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:15.624745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.625278 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment 15a5a84f-1167-41b0-ab16-80791aaacdf5 of type vlan for network 2ad89193-4f35-4528-b799-6f2d3f48883c Nov 24 14:00:15.655444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.655968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router 24311646-1e87-4d0c-9d2d-92cc6b5057ed {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:00:15.661999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.691796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Attempting to bind port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:15.692443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Attempting to bind port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '18300d97-46f2-4d94-878d-6e4d4e766669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:15.692808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Attempting to bind port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb on network 4862f14a-b211-4e69-a305-563ddb9c83b6 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:15.694683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4862f14a-b211-4e69-a305-563ddb9c83b6']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:15.706125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.711325 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 204 len: 168 time: 4.7078528 Nov 24 14:00:15.711732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5cf7b212-e437-4995-a730-6a8f6cd49a79 None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:15.711858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41668) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:15.718509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-128417615'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:15.725213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:15.725871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '18300d97-46f2-4d94-878d-6e4d4e766669') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:15.725986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '18300d97-46f2-4d94-878d-6e4d4e766669') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:15.732410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:15.736621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:15.743520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:15.747655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.751833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:15.752437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.755905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:15.756414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Checking segment: {'id': '18300d97-46f2-4d94-878d-6e4d4e766669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:15.756936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.757469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Bound using segment: {'id': '18300d97-46f2-4d94-878d-6e4d4e766669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:15.758064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Bound port: 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '18300d97-46f2-4d94-878d-6e4d4e766669', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '4862f14a-b211-4e69-a305-563ddb9c83b6'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:15.758556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.759172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-922a3fc1-b0ce-48b1-ad17-c45ec9c51553 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:15.769394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:15.773723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.780005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Pushing event updated for resources: {'Port': ['ID=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:15.781512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.782765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:15.788331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:15.790001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:15.793387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:15.801691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:15.804939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.815160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting subnet a0a69375-08b2-4745-bb36-2edd70a8f808 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:15.823036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.830424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.867384 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.9947150 Nov 24 14:00:15.868365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41672) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:15.887174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Network': ['ID=691aaa8d-2ea8-45a5-a42e-1d1064132413,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:15.889277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.896593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:15.899043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:15.908703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/networks/691aaa8d-2ea8-45a5-a42e-1d1064132413 HTTP/1.1" status: 204 len: 168 time: 3.2707698 Nov 24 14:00:15.908703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 894 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:15.908703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.911193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5cf7b212-e437-4995-a730-6a8f6cd49a79 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:15.911193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5cf7b212-e437-4995-a730-6a8f6cd49a79 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:15.918083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41676) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:15.932520 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:15.958092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=2ad89193-4f35-4528-b799-6f2d3f48883c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:15.960909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:15.996175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:16.012237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.102796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:00:16.102796 dv-neutron-818151-2-hyperv neutron-server[83526]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:00:16.102796 dv-neutron-818151-2-hyperv neutron-server[83526]: [parameters: {'id': '4862f14a-b211-4e69-a305-563ddb9c83b6'}] Nov 24 14:00:16.102796 dv-neutron-818151-2-hyperv neutron-server[83526]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:16.103310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:16.108233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 859} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:16.145874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.146242 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment 040bd5fb-5ea0-4107-add1-d003de065701 of type vlan for network 793f3831-f3f5-426a-a5d5-dab329ae309c Nov 24 14:00:16.156524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Attempting to bind port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:16.157009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Attempting to bind port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:16.157672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Attempting to bind port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 on network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:16.160770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.161843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] For port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:16.183733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:16.186794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.193485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:16.194105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-164fe403-5d92-4570-b96f-7b52cc0539e8 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:16.199165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:16.202770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.209762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] For port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb,segment=NetworkSegment(18300d97-46f2-4d94-878d-6e4d4e766669),segment_id=18300d97-46f2-4d94-878d-6e4d4e766669)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:16.211277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:16.220240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:16.220972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Checking segment: {'id': 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:16.221558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.222114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Bound using segment: {'id': 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:16.222815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Bound port: 8b0a6063-b5cd-4e86-828e-4d929cbd7a73, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 896, 'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:16.223386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.242577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.251391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:16.270248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.282739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Deleting port d040b669-1d25-4a57-bc0a-291097cbb936 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:16.283271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.314333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:16.320006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:16.325873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=5cf032f8-f974-4876-9477-1e50aea9e301,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:16.334520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.335099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.344633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:16.346815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.351505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.352229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.360026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e1c9d205-bbb0-48fc-8771-e15bd6b862dd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:16.381147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0aba17-12ac-43db-96fc-b955d13ef486 req-9c7a94a4-949a-4966-a0b9-719b5b3ca552 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.382614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cd0aba17-12ac-43db-96fc-b955d13ef486 req-9c7a94a4-949a-4966-a0b9-719b5b3ca552 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.2510338 Nov 24 14:00:16.389663 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.4299242 Nov 24 14:00:16.390442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41682) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:16.437164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:16.456134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Pushing event updated for resources: {'Port': ['ID=0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:16.466898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:16.489074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.496371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4bd52c02-87df-42d1-8d9d-ebd9c5bdfb45 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:16.529570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] For port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:16.543730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] For port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,segment=NetworkSegment(b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0),segment_id=b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:16.552566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.553896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.555218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.557382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.558960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:16.559337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.559928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Synchronizing usage tracker for tenant:c68ea59217504ce9802abf43743e4c8f on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:16.563225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Subnet': ['ID=a0a69375-08b2-4745-bb36-2edd70a8f808,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:16.565895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9f51bca-bdf6-45e1-aa8a-e04524a46209 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:16.567387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:16.585205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.592585 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cd0aba17-12ac-43db-96fc-b955d13ef486 req-ef554784-54ea-4ed7-ac06-080e7841b5b4 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1543396 Nov 24 14:00:16.595160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.605111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a6a7936-cf78-4bb6-a143-60169d88f452 None None] Network 4862f14a-b211-4e69-a305-563ddb9c83b6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:16.610388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.627216 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/a0a69375-08b2-4745-bb36-2edd70a8f808 HTTP/1.1" status: 204 len: 168 time: 1.1072342 Nov 24 14:00:16.631787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41688) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:16.675741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Unset dirty status for tenant:c68ea59217504ce9802abf43743e4c8f on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:16.681267 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8096c9fe-a3d3-4850-a4cd-9fc0d4524cf7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.2884705 Nov 24 14:00:16.683020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41692) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:16.691583 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-9093fe38-5e4c-4829-acc6-15df7a20d26d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:16.692271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9093fe38-5e4c-4829-acc6-15df7a20d26d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:16.696779 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9093fe38-5e4c-4829-acc6-15df7a20d26d tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/960509e9-34f1-4442-91dc-9e489a019924 HTTP/1.1" status: 404 len: 337 time: 0.0640349 Nov 24 14:00:16.698498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:16.699211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:16.735837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41696) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:16.738623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-162885862'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:16.757273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:16.765878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:16.770803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:16.802182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:17.001815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=793f3831-f3f5-426a-a5d5-dab329ae309c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:17.006537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Pushing event updated for resources: {'Port': ['ID=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:17.015878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.450s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:17.025559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 793f3831-f3f5-426a-a5d5-dab329ae309c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:17.063546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:17.064757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.088924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.728s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:17.110984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:17.133939 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-42b9004a-146f-429c-943e-eb027e08fe21 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "GET /v2.0/ports?device_id=9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 HTTP/1.1" status: 200 len: 205 time: 0.3851297 Nov 24 14:00:17.134181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.134181 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment cf983b02-fe80-4171-b6da-8fd12e5bda00 of type vlan for network 5f72029d-372b-45b6-9e41-b150794fa59d Nov 24 14:00:17.137574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41702) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:17.140859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] For port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb,segment=NetworkSegment(18300d97-46f2-4d94-878d-6e4d4e766669),segment_id=18300d97-46f2-4d94-878d-6e4d4e766669)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:17.141221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.213802 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.5009832 Nov 24 14:00:17.221143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41706) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:17.248091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:17.462020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:17.525031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Calling delete_port for 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:17.533942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] For port d040b669-1d25-4a57-bc0a-291097cbb936, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d040b669-1d25-4a57-bc0a-291097cbb936,segment=NetworkSegment(15639694-360e-4201-b3ca-c31a90490fed),segment_id=15639694-360e-4201-b3ca-c31a90490fed)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:17.534312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.539953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.546392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:17.556113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:17.588333 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-0dd5d19c-2ed7-4db9-8ff2-6201efd5cbfb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] delete failed (client error): The resource could not be found. Nov 24 14:00:17.593149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0dd5d19c-2ed7-4db9-8ff2-6201efd5cbfb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/routers/9d1a8e5f-39ea-43e3-910c-c2576ed0cd98 HTTP/1.1" status: 404 len: 336 time: 0.4397340 Nov 24 14:00:17.593714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41710) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:17.601385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-866eb895-3bf3-4cb9-aec1-34915aa8a0e4 None None] Network d1d0487a-60e7-49df-8f6a-8133f5eb276b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:17.621375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:17.627082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:17.656661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.678581 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-cfc324b6-f128-47c0-b62e-43b9d045269e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:17.679282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cfc324b6-f128-47c0-b62e-43b9d045269e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:17.694689 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cfc324b6-f128-47c0-b62e-43b9d045269e tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/a84152c6-7f00-40d3-a765-70d962ef8e04 HTTP/1.1" status: 404 len: 337 time: 0.0907049 Nov 24 14:00:17.697730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41716) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:17.704787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Calling delete_port for d040b669-1d25-4a57-bc0a-291097cbb936 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:17.712501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.718142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bbfbff08-7c03-4ac6-b75c-5ecf70ca8a09 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:17.720278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5090c6c8-902d-467c-a7dc-fcfd025751e7 None None] Provisioning complete for port ee13f173-2516-40d9-8098-80f4ac125ec3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:17.720666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5090c6c8-902d-467c-a7dc-fcfd025751e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.738021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:17.764600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Port': ['ID=0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:17.766660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.770574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:17.771502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.790656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.794894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:17.795977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:17.803637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:17.820703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 1.1314690 Nov 24 14:00:17.821995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41720) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:17.835795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d852dfd4-4c22-431a-9c5c-579a6c7db4a7 req-82b58cb8-bd8d-4cb0-83a3-abb9d030d753 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:17.837581 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d852dfd4-4c22-431a-9c5c-579a6c7db4a7 req-82b58cb8-bd8d-4cb0-83a3-abb9d030d753 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.8436711 Nov 24 14:00:17.840445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'New_network'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:17.846513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5090c6c8-902d-467c-a7dc-fcfd025751e7 None None] Port ee13f173-2516-40d9-8098-80f4ac125ec3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:17.846739 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a3a93a9c-7d03-4deb-a6a0-13f1f9092d3c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:17.847217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a3a93a9c-7d03-4deb-a6a0-13f1f9092d3c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:17.851183 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a3a93a9c-7d03-4deb-a6a0-13f1f9092d3c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/af993afa-a669-418f-9f70-aaa8fa208134 HTTP/1.1" status: 404 len: 337 time: 0.1153953 Nov 24 14:00:17.860951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No DVR routers for this DVR port 0377ebff-61a2-4a9f-bf6e-fefa1e5b23bb on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:17.862531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41724) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:17.885340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5090c6c8-902d-467c-a7dc-fcfd025751e7 None None] Provisioning complete for port afbb30e1-0766-4741-97b5-1b18534c3291 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:17.885340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5090c6c8-902d-467c-a7dc-fcfd025751e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:17.888291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:18.051389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=1779010f-68b3-4ec7-a60a-89ab2050355b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:18.068383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:18.074810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] DHCP port deletion for d1d0487a-60e7-49df-8f6a-8133f5eb276b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:00:18.092958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Deleting port afbb30e1-0766-4741-97b5-1b18534c3291 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:18.093678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.102753 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d852dfd4-4c22-431a-9c5c-579a6c7db4a7 req-0a73fe91-460b-4570-8eb5-b7bf8b2806a5 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2352438 Nov 24 14:00:18.110395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.113162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-dca6fcd6-2592-40ed-86b2-559ec70a31a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:18.113681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dca6fcd6-2592-40ed-86b2-559ec70a31a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:18.117875 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dca6fcd6-2592-40ed-86b2-559ec70a31a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/8f1d66b5-e969-4d53-8dcb-c22e468d4dbd HTTP/1.1" status: 404 len: 337 time: 0.2489817 Nov 24 14:00:18.118663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=5f72029d-372b-45b6-9e41-b150794fa59d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:18.126928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41728) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:18.136238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.140189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5f72029d-372b-45b6-9e41-b150794fa59d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:18.142625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.347s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:18.149787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-10fd9c53-e83d-4d10-92e4-a574115e4644 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:18.227320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': '15a5a84f-1167-41b0-ab16-80791aaacdf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:18.227736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: 2ad89193-4f35-4528-b799-6f2d3f48883c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:18.233253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Port': ['ID=d040b669-1d25-4a57-bc0a-291097cbb936,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:18.240146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-d14fb1be-66ed-49e0-9e18-6fe453222bcf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:18.240654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d14fb1be-66ed-49e0-9e18-6fe453222bcf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:18.245344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:18.249829 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d14fb1be-66ed-49e0-9e18-6fe453222bcf tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/27a076c7-09d9-494d-9b81-0e19786c30b3 HTTP/1.1" status: 404 len: 333 time: 0.1198022 Nov 24 14:00:18.262910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41736) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:18.362639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] No DVR routers for this DVR port d040b669-1d25-4a57-bc0a-291097cbb936 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:18.456337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68268d28-735a-4394-80f5-f752c460c03f None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:18.458395 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-75225f00-10fe-4c18-a426-c12b3cef8de4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:18.458840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-75225f00-10fe-4c18-a426-c12b3cef8de4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:18.462261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-75225f00-10fe-4c18-a426-c12b3cef8de4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/11da58e8-5a02-4ba3-9f9b-df944ea7c144 HTTP/1.1" status: 404 len: 337 time: 0.1982563 Nov 24 14:00:18.495327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.525090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41740) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:18.558059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] For port afbb30e1-0766-4741-97b5-1b18534c3291, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=afbb30e1-0766-4741-97b5-1b18534c3291,segment=NetworkSegment(88f19f83-091c-4d89-aa79-2ae8ba5b119e),segment_id=88f19f83-091c-4d89-aa79-2ae8ba5b119e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:18.558663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.576183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.587905 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-c62ceee5-43e4-4e7e-a2ef-cc5a80431677 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:18.587905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c62ceee5-43e4-4e7e-a2ef-cc5a80431677 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:18.591628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 2ad89193-4f35-4528-b799-6f2d3f48883c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:18.598214 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:00:18.664737 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c62ceee5-43e4-4e7e-a2ef-cc5a80431677 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/83e94be3-5294-4789-b6e2-18af20c8f444 HTTP/1.1" status: 404 len: 337 time: 0.1367695 Nov 24 14:00:18.665428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 2ad89193-4f35-4528-b799-6f2d3f48883c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:18.678304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41746) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:18.688959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:18.689469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.695560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['daf858ef-c98b-4940-a851-61a3f47346db']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:18.706724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.709870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20052e3f-0d6f-45ff-b4c3-e98591fc6936 None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:18.735143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Calling delete_port for afbb30e1-0766-4741-97b5-1b18534c3291 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:18.741522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.751719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3705bdc0-9e06-4070-875d-01538c8ab512 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:18.766487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4862f14a-b211-4e69-a305-563ddb9c83b6']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:18.792122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '18300d97-46f2-4d94-878d-6e4d4e766669') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:18.792470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '18300d97-46f2-4d94-878d-6e4d4e766669') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:18.797856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Provisioning for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:18.802194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '15639694-360e-4201-b3ca-c31a90490fed') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:18.802780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '15639694-360e-4201-b3ca-c31a90490fed') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:18.812323 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-56270d21-60bf-4607-8de1-7c43ef8a0040 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:18.812782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-56270d21-60bf-4607-8de1-7c43ef8a0040 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:18.816923 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-56270d21-60bf-4607-8de1-7c43ef8a0040 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/8bd455e2-c24a-4cd9-994e-012f514f313e HTTP/1.1" status: 404 len: 333 time: 0.1352663 Nov 24 14:00:18.822437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41750) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:18.839171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.852778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network 5f72029d-372b-45b6-9e41-b150794fa59d is not hosted by any dhcp agent {{(pid=83526) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:226}} Nov 24 14:00:18.856923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:18.857896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.862118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "PUT /v2.0/networks/5f72029d-372b-45b6-9e41-b150794fa59d HTTP/1.1" status: 200 len: 723 time: 1.0305026 Nov 24 14:00:18.873956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41754) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:18.879911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Provisioning complete for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:18.880382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.880584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:18.893967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:18.926862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=5f72029d-372b-45b6-9e41-b150794fa59d,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:18.929602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:18.975986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5f72029d-372b-45b6-9e41-b150794fa59d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:18.987748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.014582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 894 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:19.015023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:19.031664 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:19.036277 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.1513810 Nov 24 14:00:19.042864 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f15ea64d-e880-4535-926e-5fd4d47b63a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:19.043569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f15ea64d-e880-4535-926e-5fd4d47b63a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:19.048368 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f15ea64d-e880-4535-926e-5fd4d47b63a4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/11288f35-f08d-439a-bc56-30b6110364f1 HTTP/1.1" status: 404 len: 337 time: 0.2104952 Nov 24 14:00:19.048368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41758) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:19.051492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41760) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:19.058539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:19.076609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.088581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.100059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:19.102375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-11d0230d-7f16-4538-b9f3-8927f24401c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:19.102811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-11d0230d-7f16-4538-b9f3-8927f24401c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:19.107560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-11d0230d-7f16-4538-b9f3-8927f24401c1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/subnets/3eb4706f-8477-441e-b441-04081be9264b HTTP/1.1" status: 404 len: 337 time: 0.0525296 Nov 24 14:00:19.109409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41766) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:19.132787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Releasing vlan 861 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:19.133464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.137255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:19.149021 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:19.156751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7c1d26cc-2c5d-47c0-b096-3050d44c0bef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:19.209708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:19.278283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Pushing event deleted for resources: {'Port': ['ID=afbb30e1-0766-4741-97b5-1b18534c3291,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:19.287516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:19.297536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] No DVR routers for this DVR port afbb30e1-0766-4741-97b5-1b18534c3291 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:19.302709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Deleting port ee13f173-2516-40d9-8098-80f4ac125ec3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:19.302709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.380308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f227ca64-55cd-4f3e-b98b-a7ad47e7dda1 req-65e3f7c0-66ef-4cd3-a15c-3645a1c7dede tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:19.382294 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f227ca64-55cd-4f3e-b98b-a7ad47e7dda1 req-65e3f7c0-66ef-4cd3-a15c-3645a1c7dede tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6485219 Nov 24 14:00:19.383213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=e5c1ff5f-e903-4fb1-a5c7-688946c34c0c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:19.408757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:19.424628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.432965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.440956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:19.441801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:19.448766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d19b51cb-cb15-426b-9025-ebcab2f4a8d9 tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:19.464116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.468738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.472264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.476509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-2ad89193-4f35-4528-b799-6f2d3f48883c', 'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': '1779010f-68b3-4ec7-a60a-89ab2050355b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:19.478034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.478673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fbd0e59d-5abe-4c23-9de7-5f6623be2ae5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:19.497050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Network': ['ID=daf858ef-c98b-4940-a851-61a3f47346db,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:19.502632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=4862f14a-b211-4e69-a305-563ddb9c83b6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:19.505040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:19.505704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:19.506161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: afbb30e1-0766-4741-97b5-1b18534c3291 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:19.506584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device afbb30e1-0766-4741-97b5-1b18534c3291 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:19.522633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/networks/daf858ef-c98b-4940-a851-61a3f47346db HTTP/1.1" status: 204 len: 168 time: 3.6036758 Nov 24 14:00:19.523913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41770) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:19.524527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:19.553476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:19.565466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': '040bd5fb-5ea0-4107-add1-d003de065701', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:19.566039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: 793f3831-f3f5-426a-a5d5-dab329ae309c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:19.570100 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/4862f14a-b211-4e69-a305-563ddb9c83b6 HTTP/1.1" status: 204 len: 168 time: 5.9537020 Nov 24 14:00:19.570918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:19.573346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:19.576346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] For port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,segment=NetworkSegment(b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0),segment_id=b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:19.583595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41774) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:19.588011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:19.594549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-95859016'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:19.611972 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f227ca64-55cd-4f3e-b98b-a7ad47e7dda1 req-ed72ad63-1f4e-4e82-8081-d88f47d245e5 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2019145 Nov 24 14:00:19.613091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:19.630306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:19.635531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:19.679364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.691546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ca427ef0-d9fc-4d3a-baee-e65c2688f9b4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:19.722335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:19.725424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:19.728062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.839306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:19.842427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.847438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Update dhcp port {'port': {'network_id': 'b44ba3f1-4dca-4bbb-b72d-64df0deaa233', 'fixed_ips': [{'subnet_id': '6f1c8f54-9558-4f32-9a44-ac6ae00612fa', 'ip_address': '2001:db8::2'}, {'subnet_id': '5cf032f8-f974-4876-9477-1e50aea9e301'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8b0a6063-b5cd-4e86-828e-4d929cbd7a73'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:00:19.863024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 793f3831-f3f5-426a-a5d5-dab329ae309c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:19.872259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Pushing event updated for resources: {'Port': ['ID=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:19.876287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.886947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:19.912049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.913178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 793f3831-f3f5-426a-a5d5-dab329ae309c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:19.922587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Allocated IP 172.20.0.2 (2ad89193-4f35-4528-b799-6f2d3f48883c/1779010f-68b3-4ec7-a60a-89ab2050355b/8b37a6c8-c72a-40be-9fb0-ec417ef75899) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:19.925786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-507de81f-519d-4be7-b67a-572e5d0603b3 None None] Network 793f3831-f3f5-426a-a5d5-dab329ae309c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:19.940790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:19.941709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:19.947864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 874} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:19.952075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.031592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.032050 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 99d91a48-15cd-44a0-be59-dd02fb59aa0c of type vlan for network ceb040a6-705b-4e6e-b930-4b7d3a909566 Nov 24 14:00:20.034510 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 1779010f-68b3-4ec7-a60a-89ab2050355b (CIDR: 172.20.0.0/28) Nov 24 14:00:20.056133 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:00:20.056702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:20.068023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.8389804 Nov 24 14:00:20.115964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41778) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.139240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-74488106', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:20.161544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.165189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:20.168945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.177715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-991e6951-6fbd-4d7d-a955-e2405731d234 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:20.185092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.189314 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec0b78c3-43a0-49ab-ba38-debba8644ae7 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.1374180 Nov 24 14:00:20.190594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:20.203383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41782) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.204001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:20.223185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:20.230535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.243961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:20.248431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3f8727a3-f1ec-4af3-86ec-51dd8bb7278a']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:20.305805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f0d9b166-e675-4d56-8868-37d9d668b826') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:20.306062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f0d9b166-e675-4d56-8868-37d9d668b826') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:20.361549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.362670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.379411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.394336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.397469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:20.398068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.403574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Calling delete_port for ee13f173-2516-40d9-8098-80f4ac125ec3 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:20.407823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b4b34817-338d-4975-af09-43567dfbdcd4 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:20.408729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.433893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Transition to ACTIVE for port object 8b37a6c8-c72a-40be-9fb0-ec417ef75899 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:20.455252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.487798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=c919dab8-eb5d-4d04-b77e-e5fb108e8ab3,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:20.495393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.317s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:20.504148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'cf983b02-fe80-4171-b6da-8fd12e5bda00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:20.504367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: 5f72029d-372b-45b6-9e41-b150794fa59d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:20.534369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:20.534770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.541596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.542264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-793f3831-f3f5-426a-a5d5-dab329ae309c', 'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': 'e5c1ff5f-e903-4fb1-a5c7-688946c34c0c'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:20.543074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.547611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:20.550447 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:20.565470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.9793601 Nov 24 14:00:20.581269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41786) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.589546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network 5f72029d-372b-45b6-9e41-b150794fa59d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:20.594528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.602054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:20.620444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Allocated IP 172.20.0.1 (b44ba3f1-4dca-4bbb-b72d-64df0deaa233/5cf032f8-f974-4876-9477-1e50aea9e301/8b0a6063-b5cd-4e86-828e-4d929cbd7a73) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:20.621071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Port': ['ID=ee13f173-2516-40d9-8098-80f4ac125ec3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:20.631884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:20.644791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.652061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=ceb040a6-705b-4e6e-b930-4b7d3a909566,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:20.675981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ceb040a6-705b-4e6e-b930-4b7d3a909566 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:20.712274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Transition to ACTIVE for port object 8b37a6c8-c72a-40be-9fb0-ec417ef75899 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:20.733711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 5f72029d-372b-45b6-9e41-b150794fa59d) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:20.753193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:20.753947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.755751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.770233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:20.771102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.804057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/ports/ee13f173-2516-40d9-8098-80f4ac125ec3 HTTP/1.1" status: 204 len: 168 time: 1.6934474 Nov 24 14:00:20.809190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-018d9b09-e111-4a7f-a92c-8d4d08ac6943 None None] Network 5f72029d-372b-45b6-9e41-b150794fa59d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:20.811643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:20.815477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-19ffc473-a408-4264-a3fb-8b2f5e8cfa16 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:20.824436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.843259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41792) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.846670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.850622 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/networks/3f8727a3-f1ec-4af3-86ec-51dd8bb7278a HTTP/1.1" status: 204 len: 168 time: 1.3199766 Nov 24 14:00:20.856655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Network': ['ID=3f8727a3-f1ec-4af3-86ec-51dd8bb7278a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:20.864554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:20.866018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:20.867248 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2e87d7f-fe2a-4ac6-8858-d789cb1e3042 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.7353032 Nov 24 14:00:20.868680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:20.872700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41796) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.873024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41798) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.878060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:20.897771 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.0198014 Nov 24 14:00:20.902724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:20.904994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41804) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:20.965885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:20.971633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] For port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,segment=NetworkSegment(b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0),segment_id=b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:20.989693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:20.995768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:21.019368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:21.040091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:21.075226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.085415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.101595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Transition to ACTIVE for port object 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:21.145976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:21.168878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.194359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89d2f21-3bed-43ed-b62a-02830dd2f1de req-1f71feff-114e-445a-9962-96769d11df03 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:21.202561 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b89d2f21-3bed-43ed-b62a-02830dd2f1de req-1f71feff-114e-445a-9962-96769d11df03 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.3969085 Nov 24 14:00:21.203051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:21.252724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:21.266664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Pushing event updated for resources: {'Port': ['ID=8b37a6c8-c72a-40be-9fb0-ec417ef75899,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:21.310073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:21.314818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.320294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:21.324214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.417719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:21.421555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.432s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:21.423572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.236s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:21.448002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8240703'] for subnet, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.472938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:21.507862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Allocated IP 172.20.0.2 (793f3831-f3f5-426a-a5d5-dab329ae309c/e5c1ff5f-e903-4fb1-a5c7-688946c34c0c/7da14b50-cc36-4f2e-b51b-dbd5ff071da7) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:21.599907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.637865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a65bfe60-3c16-4f6e-a417-ef593a1a934d']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:21.702049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.730231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.772367 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b89d2f21-3bed-43ed-b62a-02830dd2f1de req-ca9aee89-62fb-4c35-b4be-08bdf22faa42 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5688372 Nov 24 14:00:21.797939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '422f27c8-71d7-4cbd-a2b2-7eec4849b2ae') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:21.798243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '422f27c8-71d7-4cbd-a2b2-7eec4849b2ae') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:21.832292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.870583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.ipam_backend_mixin [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing IP validity checks on allocation pools {{(pid=83526) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 14:00:21.871770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.ipam_backend_mixin [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83526) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 14:00:21.878167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d1d0487a-60e7-49df-8f6a-8133f5eb276b']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:21.936708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88f19f83-091c-4d89-aa79-2ae8ba5b119e') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:21.937041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88f19f83-091c-4d89-aa79-2ae8ba5b119e') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:21.970375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:21.990367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Pushing event updated for resources: {'Port': ['ID=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.016349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.027294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.603s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:22.030690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Releasing vlan 869 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:22.031394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.032580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Attempting to bind port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:22.032961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Attempting to bind port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '15a5a84f-1167-41b0-ab16-80791aaacdf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:22.033332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Attempting to bind port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 on network 2ad89193-4f35-4528-b799-6f2d3f48883c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:22.054040 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:22.102523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9d93df9-c23e-478c-8e42-62e43f59b927 None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:22.121697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.123492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.126131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-5f72029d-372b-45b6-9e41-b150794fa59d', 'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': 'c919dab8-eb5d-4d04-b77e-e5fb108e8ab3'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:22.127349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.148034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Releasing vlan 882 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:22.148258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.154220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:22.154588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Checking segment: {'id': '15a5a84f-1167-41b0-ab16-80791aaacdf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:22.155174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.155582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Bound using segment: {'id': '15a5a84f-1167-41b0-ab16-80791aaacdf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:22.156085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Bound port: 8b37a6c8-c72a-40be-9fb0-ec417ef75899, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '15a5a84f-1167-41b0-ab16-80791aaacdf5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 873, 'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:22.156465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:22.163494 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:22.186405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Transition to ACTIVE for port object 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:22.233923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.245604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18dc9e5b-8996-4596-9133-7599fce54932 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.260752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.284250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Pushing event deleted for resources: {'Network': ['ID=a65bfe60-3c16-4f6e-a417-ef593a1a934d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.305612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:22.318289 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] 10.222.0.70 "DELETE /v2.0/networks/a65bfe60-3c16-4f6e-a417-ef593a1a934d HTTP/1.1" status: 204 len: 168 time: 1.4440610 Nov 24 14:00:22.325341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8771276033028', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8272494'] for subnet, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.331355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7436b156-1967-40ce-9f9c-3f5789c5dc46 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.362002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.371901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.378446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.401395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.430637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:22.431226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.433743 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "PUT /v2.0/subnets/c919dab8-eb5d-4d04-b77e-e5fb108e8ab3 HTTP/1.1" status: 200 len: 826 time: 1.5275044 Nov 24 14:00:22.443027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41810) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:22.493579 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] 10.222.0.70 "DELETE /v2.0/networks/d1d0487a-60e7-49df-8f6a-8133f5eb276b HTTP/1.1" status: 204 len: 168 time: 1.6437473 Nov 24 14:00:22.503011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=c919dab8-eb5d-4d04-b77e-e5fb108e8ab3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.521057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Transition to ACTIVE for port object 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:22.522868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] For port 8b37a6c8-c72a-40be-9fb0-ec417ef75899, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:22.537768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6a4a0732-49bb-4953-a012-69364ad21706 None None] Provisioning for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:22.551564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:22.559361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a16f961-fd11-4397-9ddd-c55dddffe64f tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.167s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.578132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.581885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6a4a0732-49bb-4953-a012-69364ad21706 None None] Provisioning complete for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:22.582340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6a4a0732-49bb-4953-a012-69364ad21706 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.601742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.608795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-01b9edef-bb41-413e-a969-c76b5e2c7ef0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.614557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] For port 8b37a6c8-c72a-40be-9fb0-ec417ef75899, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b37a6c8-c72a-40be-9fb0-ec417ef75899,segment=NetworkSegment(15a5a84f-1167-41b0-ab16-80791aaacdf5),segment_id=15a5a84f-1167-41b0-ab16-80791aaacdf5)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:22.626992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.658211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Allocated IP 2001:db8::2 (5f72029d-372b-45b6-9e41-b150794fa59d/c919dab8-eb5d-4d04-b77e-e5fb108e8ab3/4f04ab8e-49d3-46bf-b98c-040ff25b213b) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:22.696188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.770347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41818) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:22.851369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Network 793f3831-f3f5-426a-a5d5-dab329ae309c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:22.861759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:22.863960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '99d91a48-15cd-44a0-be59-dd02fb59aa0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:22.867160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:22.872626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: ceb040a6-705b-4e6e-b930-4b7d3a909566, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:22.872816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Pushing event updated for resources: {'Port': ['ID=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.875528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:22.889848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-01301828-b6b7-4b56-a728-d44c8eb8cc02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.175s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.891227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=ddd83803-7b14-4e33-b4c4-0512401f5709,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.901705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 2ad89193-4f35-4528-b799-6f2d3f48883c is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:22.926757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:22.932806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.376s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:22.933312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d9589731-c6ad-4d2f-a985-a04df74a4d07 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.538s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:22.950625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:22.951042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:22.962635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=069052fe-ffd3-4364-a970-a83ecc7ff028,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.988477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.379s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:22.989537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Pushing event deleted for resources: {'Network': ['ID=d1d0487a-60e7-49df-8f6a-8133f5eb276b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:22.998199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.000417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:23.000870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41828) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:23.103882 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 2.8960366 Nov 24 14:00:23.110471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41834) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:23.116011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network ceb040a6-705b-4e6e-b930-4b7d3a909566 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:23.183569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.20.0.1 (793f3831-f3f5-426a-a5d5-dab329ae309c/e5c1ff5f-e903-4fb1-a5c7-688946c34c0c/acf78bc2-292b-4419-9aa7-35e9254e5162) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:23.186398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'fixed_ips': [{'subnet_id': '1779010f-68b3-4ec7-a60a-89ab2050355b'}, {'subnet_id': '069052fe-ffd3-4364-a970-a83ecc7ff028'}], 'name': 'tempest-PortsTestJSON-362491289'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:23.221764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce07809-82b8-433a-a0dc-cb3b8337c0ca req-d00d2775-99f8-4c40-9023-b1b1ecfd05db tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:23.223243 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cce07809-82b8-433a-a0dc-cb3b8337c0ca req-d00d2775-99f8-4c40-9023-b1b1ecfd05db tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.2301979 Nov 24 14:00:23.225541 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b0d52eb8-73aa-4622-9928-75a52d48151c admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=f0d8ccca93984618ad200eead84e76c2&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4474671 Nov 24 14:00:23.230749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41838) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:23.234522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ceb040a6-705b-4e6e-b930-4b7d3a909566) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:23.261289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:23.262917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.286948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a715a34-5281-49f7-a452-a57d4fa5cf06 None None] Network ceb040a6-705b-4e6e-b930-4b7d3a909566 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:23.390486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Pushing event updated for resources: {'Port': ['ID=8b37a6c8-c72a-40be-9fb0-ec417ef75899,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:23.396718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.507s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:23.398361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.498810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cce07809-82b8-433a-a0dc-cb3b8337c0ca req-0486ff80-f6e7-42c2-985b-7af83cb75f8c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2389598 Nov 24 14:00:23.543462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.552035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:23.589189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-798ba45e-7658-476f-b007-37a28c5e21fd admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=5a0a3f13e5494d5db442bf11517640e4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5832169 Nov 24 14:00:23.589189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 3.0009987 Nov 24 14:00:23.593238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.596794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Attempting to bind port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:23.597172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Attempting to bind port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '040bd5fb-5ea0-4107-add1-d003de065701', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:23.597541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Attempting to bind port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 on network 793f3831-f3f5-426a-a5d5-dab329ae309c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:23.615785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41842) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:23.615999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41844) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:23.617046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object acf78bc2-292b-4419-9aa7-35e9254e5162 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:23.643566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.655822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.666972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-82008103-8a35-4a9b-92b3-9b2fa57a2b65 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:23.717917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:23.718297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Checking segment: {'id': '040bd5fb-5ea0-4107-add1-d003de065701', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:23.718711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.719113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Bound using segment: {'id': '040bd5fb-5ea0-4107-add1-d003de065701', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:23.719599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Bound port: 7da14b50-cc36-4f2e-b51b-dbd5ff071da7, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '040bd5fb-5ea0-4107-add1-d003de065701', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '793f3831-f3f5-426a-a5d5-dab329ae309c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:23.720022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.798201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=acf78bc2-292b-4419-9aa7-35e9254e5162,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:23.800718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 793f3831-f3f5-426a-a5d5-dab329ae309c is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:23.803589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:23.803589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:23.809973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:23.860843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:23.866479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.874150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e652f642-5fed-449a-bdaf-2208b396e5d8 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:23.891038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.891261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:23.893642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad26aa81-6a56-43cd-b546-a064dd1c9f6c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:23.896214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:23.903813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.910129 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/ad26aa81-6a56-43cd-b546-a064dd1c9f6c HTTP/1.1" status: 204 len: 168 time: 0.6735401 Nov 24 14:00:23.922385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:23.925667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.948167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:23.965017 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-d6e21d26-514b-4600-88d3-778eae8095fb service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.8557630 Nov 24 14:00:23.975593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.977503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:23.983079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:23.996153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Transition to ACTIVE for port object 4f04ab8e-49d3-46bf-b98c-040ff25b213b will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:24.013918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.017145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:24.018404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.092367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] For port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:24.122741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Transition to ACTIVE for port object 4f04ab8e-49d3-46bf-b98c-040ff25b213b will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:24.133511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] For port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,segment=NetworkSegment(040bd5fb-5ea0-4107-add1-d003de065701),segment_id=040bd5fb-5ea0-4107-add1-d003de065701)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:24.138041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ceb040a6-705b-4e6e-b930-4b7d3a909566', 'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': 'ddd83803-7b14-4e33-b4c4-0512401f5709'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:24.138902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.172705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.176638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.262843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:24.465969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Network 5f72029d-372b-45b6-9e41-b150794fa59d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:24.508097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.562181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Pushing event updated for resources: {'Port': ['ID=4f04ab8e-49d3-46bf-b98c-040ff25b213b,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:24.582478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:24.682012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.719047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:24.744962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:24.755877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Pushing event updated for resources: {'Port': ['ID=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:24.792612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.801722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.812439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.550s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:24.820760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.499s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:24.821124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:24.844191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-40af184a-f8f1-4ebd-9d22-0b8f73e11e28 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:24.860233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2db8bac-b9c4-4794-897b-07148157f1e2 None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:24.869785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=c919dab8-eb5d-4d04-b77e-e5fb108e8ab3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:24.872325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.910445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:24.967454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.969011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:24.975403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=acf78bc2-292b-4419-9aa7-35e9254e5162,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:24.980322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:24.999845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcdde806-076f-4073-81a6-34309482fd1d req-45dc040a-047e-44f7-9e29-ab642b7e2269 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:25.001820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-45dc040a-047e-44f7-9e29-ab642b7e2269 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.9881465 Nov 24 14:00:25.134710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Allocated IP 172.20.0.3 (ceb040a6-705b-4e6e-b930-4b7d3a909566/ddd83803-7b14-4e33-b4c4-0512401f5709/4618eb51-9ace-4406-aa4b-142663991bf6) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:25.139180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-da0e1ea9-12fb-451d-8186-0a5cb5081e15 None None] Provisioning complete for port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:25.139552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da0e1ea9-12fb-451d-8186-0a5cb5081e15 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.187211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 793f3831-f3f5-426a-a5d5-dab329ae309c is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:25.187422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Attempting to bind port 4f04ab8e-49d3-46bf-b98c-040ff25b213b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:25.187676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Attempting to bind port 4f04ab8e-49d3-46bf-b98c-040ff25b213b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'cf983b02-fe80-4171-b6da-8fd12e5bda00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:25.188049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Attempting to bind port 4f04ab8e-49d3-46bf-b98c-040ff25b213b on network 5f72029d-372b-45b6-9e41-b150794fa59d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:25.189120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:25.249837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port ed33b300-d2a1-43db-9034-2375609e0cb4 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:25.295028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:25.295028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Checking segment: {'id': 'cf983b02-fe80-4171-b6da-8fd12e5bda00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:25.295028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.295780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Bound using segment: {'id': 'cf983b02-fe80-4171-b6da-8fd12e5bda00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:25.296008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Bound port: 4f04ab8e-49d3-46bf-b98c-040ff25b213b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf983b02-fe80-4171-b6da-8fd12e5bda00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '5f72029d-372b-45b6-9e41-b150794fa59d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:25.299329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.345588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41872) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:25.448658 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-5df282eb-27b7-4876-bb9a-9edad1968425 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.4325509 Nov 24 14:00:25.479870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.497370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.593989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cdfb8907-6a90-40dc-9deb-62fb1b75d014 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:25.601240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b37a6c8-c72a-40be-9fb0-ec417ef75899 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:25.643909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1762c4bc-b5fc-44f4-8363-a51e577c8a0a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:25.667349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:25.678500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5f72029d-372b-45b6-9e41-b150794fa59d']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:25.742808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf983b02-fe80-4171-b6da-8fd12e5bda00') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:25.743456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf983b02-fe80-4171-b6da-8fd12e5bda00') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:25.753989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-127248766'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:25.773306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4adf299-daf4-4532-8e0a-d001868307c6 req-7e20d433-7e0e-464d-a1b5-e8e362997809 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:25.774768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4adf299-daf4-4532-8e0a-d001868307c6 req-7e20d433-7e0e-464d-a1b5-e8e362997809 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.9975436 Nov 24 14:00:25.786602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:25.789654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.803560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] For port 4f04ab8e-49d3-46bf-b98c-040ff25b213b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:25.818423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcdde806-076f-4073-81a6-34309482fd1d req-695e4c43-4bf5-409a-87ba-5f328ab5246c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:25.819627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-695e4c43-4bf5-409a-87ba-5f328ab5246c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.3241384 Nov 24 14:00:25.830502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:25.843937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] For port 4f04ab8e-49d3-46bf-b98c-040ff25b213b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4f04ab8e-49d3-46bf-b98c-040ff25b213b,segment=NetworkSegment(cf983b02-fe80-4171-b6da-8fd12e5bda00),segment_id=cf983b02-fe80-4171-b6da-8fd12e5bda00)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:25.848123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:25.883231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.891741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:25.902890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:25.911549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.935138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:25.936281 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/1762c4bc-b5fc-44f4-8363-a51e577c8a0a HTTP/1.1" status: 204 len: 168 time: 2.3179593 Nov 24 14:00:25.976172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Pushing event updated for resources: {'Port': ['ID=4f04ab8e-49d3-46bf-b98c-040ff25b213b,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:25.980073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 897 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:25.980476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:26.000821 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:26.023312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:26.026486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.062551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 9914b2df-11c0-4062-9d63-2bc0e07c4c82 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:00:26.067312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:26.079674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:26.093447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:26.128669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.142025 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4adf299-daf4-4532-8e0a-d001868307c6 req-eb1ada29-2b3c-4708-a999-7abd51701d47 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3456283 Nov 24 14:00:26.170974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:00:26.170974 dv-neutron-818151-2-hyperv neutron-server[83526]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:00:26.170974 dv-neutron-818151-2-hyperv neutron-server[83526]: [parameters: {'id': '5f72029d-372b-45b6-9e41-b150794fa59d'}] Nov 24 14:00:26.170974 dv-neutron-818151-2-hyperv neutron-server[83526]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:26.171335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:26.190250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.201486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Update dhcp port {'port': {'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'fixed_ips': [{'subnet_id': '1779010f-68b3-4ec7-a60a-89ab2050355b', 'ip_address': '172.20.0.2'}, {'subnet_id': '069052fe-ffd3-4364-a970-a83ecc7ff028'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8b37a6c8-c72a-40be-9fb0-ec417ef75899'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:00:26.281002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-4d6b0084-fe18-4d58-a7dc-b0b3c7dc50bc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4476144 Nov 24 14:00:26.289571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Provisioning for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:26.295875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:26.307509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Transition to ACTIVE for port object 4618eb51-9ace-4406-aa4b-142663991bf6 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:26.313026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Provisioning complete for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:26.313735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.329628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:26.353974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:security_group_rule and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:26.367030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:26.421958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.450322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Transition to ACTIVE for port object 4618eb51-9ace-4406-aa4b-142663991bf6 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:26.467937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:26.494370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:26.504936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c005f42-cd52-4950-b022-606d6a236757 None None] Network 5f72029d-372b-45b6-9e41-b150794fa59d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:26.505360 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] Sync routers for ids ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:26.533158 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/9914b2df-11c0-4062-9d63-2bc0e07c4c82/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6559317 Nov 24 14:00:26.535007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41882) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:26.536830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73da0479-4f1b-4841-8de6-fc6a94cd105b None None] Network 793f3831-f3f5-426a-a5d5-dab329ae309c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:26.536965 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] Routers {'9914b2df-11c0-4062-9d63-2bc0e07c4c82'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:26.537569 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:26.563037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.579838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-70b844da-4f0a-4c33-b69a-6e0fb2cf937e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:26.583785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.594074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-23df4f74-1bb1-43b2-b753-da36cbdebc19 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:26.635520 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:26.659606 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] Routers {'9914b2df-11c0-4062-9d63-2bc0e07c4c82'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:26.660251 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:26.699741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11851134-822d-4009-bed6-30d3518ca1e7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:26.703394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11851134-822d-4009-bed6-30d3518ca1e7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:26.742916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11851134-822d-4009-bed6-30d3518ca1e7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:26.747843 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-11851134-822d-4009-bed6-30d3518ca1e7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports/acf78bc2-292b-4419-9aa7-35e9254e5162 HTTP/1.1" status: 200 len: 910 time: 0.2117260 Nov 24 14:00:26.748511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41890) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:26.756209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'port': {'fixed_ips': [{'subnet_id': 'e5c1ff5f-e903-4fb1-a5c7-688946c34c0c'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:26.762480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.6 (2ad89193-4f35-4528-b799-6f2d3f48883c/1779010f-68b3-4ec7-a60a-89ab2050355b/ed33b300-d2a1-43db-9034-2375609e0cb4) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:26.770701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.28 (2ad89193-4f35-4528-b799-6f2d3f48883c/069052fe-ffd3-4364-a970-a83ecc7ff028/ed33b300-d2a1-43db-9034-2375609e0cb4) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:26.799721 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:26.800190 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c663f6d1-5178-433c-a61c-d2b30dbf4735 None None] The sync data for ids ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:26.813407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-5baf2cae-0022-4bfb-92f5-93722303e7df service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5208616 Nov 24 14:00:26.813956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.818046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:26.889644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Pushing event updated for resources: {'Port': ['ID=4618eb51-9ace-4406-aa4b-142663991bf6,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:26.929592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Network ceb040a6-705b-4e6e-b930-4b7d3a909566 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:26.947407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:26.958319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:27.007732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:27.031454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=ddd83803-7b14-4e33-b4c4-0512401f5709,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:27.035976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.442s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:27.045570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.093061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.126081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.158275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b922843a-26d1-4d42-b645-080126e0a789 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:27.176690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.235317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Attempting to bind port 4618eb51-9ace-4406-aa4b-142663991bf6 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:27.235689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Attempting to bind port 4618eb51-9ace-4406-aa4b-142663991bf6 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '99d91a48-15cd-44a0-be59-dd02fb59aa0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:27.236080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Attempting to bind port 4618eb51-9ace-4406-aa4b-142663991bf6 on network ceb040a6-705b-4e6e-b930-4b7d3a909566 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:27.241216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] For port 8b37a6c8-c72a-40be-9fb0-ec417ef75899, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b37a6c8-c72a-40be-9fb0-ec417ef75899,segment=NetworkSegment(15a5a84f-1167-41b0-ab16-80791aaacdf5),segment_id=15a5a84f-1167-41b0-ab16-80791aaacdf5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:27.284168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.287108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ceb040a6-705b-4e6e-b930-4b7d3a909566']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:27.295117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:27.320809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '99d91a48-15cd-44a0-be59-dd02fb59aa0c') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:27.321092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '99d91a48-15cd-44a0-be59-dd02fb59aa0c') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:27.339046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:27.339425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Checking segment: {'id': '99d91a48-15cd-44a0-be59-dd02fb59aa0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:27.343957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.344519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Bound using segment: {'id': '99d91a48-15cd-44a0-be59-dd02fb59aa0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:27.345043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Bound port: 4618eb51-9ace-4406-aa4b-142663991bf6, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '99d91a48-15cd-44a0-be59-dd02fb59aa0c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:27.345446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.376117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a0fbb33-bb37-4faf-b258-387fdb79fa0c None None] Network 5f72029d-372b-45b6-9e41-b150794fa59d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:27.540504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Pushing event updated for resources: {'Port': ['ID=8b37a6c8-c72a-40be-9fb0-ec417ef75899,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:27.559363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:27.614645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 853} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:27.618040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.635659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port 4f04ab8e-49d3-46bf-b98c-040ff25b213b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:27.636104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Provisioning for port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:27.636510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.670333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41908) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:27.779968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9393a0b9-1033-4d62-8bdb-8d27b11e2e5d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:27.799477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Provisioning complete for port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:27.801631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.807496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.651s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:27.810932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.818149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.818636 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment d8281e69-477b-4a55-86eb-2b602d615a01 of type vlan for network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b Nov 24 14:00:27.847459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 874 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:27.848010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:27.874204 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:27.895239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.905062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] For port 4618eb51-9ace-4406-aa4b-142663991bf6, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:27.908943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:27.940494 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcdde806-076f-4073-81a6-34309482fd1d req-7c040249-96c4-4415-8307-2a211f579bc2 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9508319 Nov 24 14:00:27.998598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-213135650', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:28.010630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:28.059935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.098255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:28.105606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.118019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:router and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:28.121960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] For port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,segment=NetworkSegment(040bd5fb-5ea0-4107-add1-d003de065701),segment_id=040bd5fb-5ea0-4107-add1-d003de065701)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:28.129464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.135817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] For port 4618eb51-9ace-4406-aa4b-142663991bf6, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4618eb51-9ace-4406-aa4b-142663991bf6,segment=NetworkSegment(99d91a48-15cd-44a0-be59-dd02fb59aa0c),segment_id=99d91a48-15cd-44a0-be59-dd02fb59aa0c)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:28.137357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7837c5e1-008d-4917-b274-440bc713fdec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:28.149422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:00:28.149422 dv-neutron-818151-2-hyperv neutron-server[83526]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:00:28.149422 dv-neutron-818151-2-hyperv neutron-server[83526]: [parameters: {'id': 'ceb040a6-705b-4e6e-b930-4b7d3a909566'}] Nov 24 14:00:28.149422 dv-neutron-818151-2-hyperv neutron-server[83526]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:28.156166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:28.163074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:28.182725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.190815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:28.275071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Pushing event updated for resources: {'Port': ['ID=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:28.288190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:28.288686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1f624736-5c91-42b1-80dc-637301463e53 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.095s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:28.319935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] For port 4f04ab8e-49d3-46bf-b98c-040ff25b213b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4f04ab8e-49d3-46bf-b98c-040ff25b213b,segment=NetworkSegment(cf983b02-fe80-4171-b6da-8fd12e5bda00),segment_id=cf983b02-fe80-4171-b6da-8fd12e5bda00)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:28.320549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.374197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=acf78bc2-292b-4419-9aa7-35e9254e5162,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:28.381750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.382703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.393172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0576d79-5366-4629-b729-558f26688fc3 None None] Network ceb040a6-705b-4e6e-b930-4b7d3a909566 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:28.404476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.429782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:28.430512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.433090 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/ports/acf78bc2-292b-4419-9aa7-35e9254e5162 HTTP/1.1" status: 200 len: 910 time: 1.6829038 Nov 24 14:00:28.434632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.424s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:28.436949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41916) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:28.443999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.478730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Pushing event updated for resources: {'Port': ['ID=4618eb51-9ace-4406-aa4b-142663991bf6,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:28.492214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Calling delete_port for 4f04ab8e-49d3-46bf-b98c-040ff25b213b owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:28.492949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-378657b4-b9df-46ec-b39c-d49cfd9ee2d4 None None] Provisioning for port acf78bc2-292b-4419-9aa7-35e9254e5162 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:28.496099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:28.511350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-378657b4-b9df-46ec-b39c-d49cfd9ee2d4 None None] Provisioning complete for port acf78bc2-292b-4419-9aa7-35e9254e5162 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:28.511739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-378657b4-b9df-46ec-b39c-d49cfd9ee2d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.583294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] It took 0.46 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:28.613988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.621897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.627285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-245bcf6d-c92f-4e10-8203-60c87d0a8fde tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:28.629931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.631088 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bb339dd8-edfb-4323-86ca-f9fa672e9f4d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 711 time: 0.9590347 Nov 24 14:00:28.636147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41920) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:28.640948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-378657b4-b9df-46ec-b39c-d49cfd9ee2d4 None None] Port acf78bc2-292b-4419-9aa7-35e9254e5162 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:28.645396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-196594227'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:28.655518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace69d9e-9a1c-4043-9cde-8ef2ee2c9f13 req-51d8ba4b-2241-4790-86cc-f743dc885c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:28.657412 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ace69d9e-9a1c-4043-9cde-8ef2ee2c9f13 req-51d8ba4b-2241-4790-86cc-f743dc885c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.7742965 Nov 24 14:00:28.662719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:28.680987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-378657b4-b9df-46ec-b39c-d49cfd9ee2d4 None None] Provisioning complete for port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:28.681413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-378657b4-b9df-46ec-b39c-d49cfd9ee2d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.686258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:network and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:28.696851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:28.699672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.701788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Port': ['ID=4f04ab8e-49d3-46bf-b98c-040ff25b213b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:28.705832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:28.706599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.709529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:28.712241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:28.713962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.737050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d1215ea2-264d-421b-bc05-6442cc88c1c9 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:28.756842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:28.761351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.778120 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ace69d9e-9a1c-4043-9cde-8ef2ee2c9f13 req-8c9fb01c-1dfd-438f-b48f-5966e74eb282 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1126270 Nov 24 14:00:28.781009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.835539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:28.863242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object ed33b300-d2a1-43db-9034-2375609e0cb4 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:28.871688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No DVR routers for this DVR port 4f04ab8e-49d3-46bf-b98c-040ff25b213b on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:28.907388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:security_group_rule and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:28.937031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=12ac07b8-6349-4c6e-9bc5-fabd3af1869b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:28.939800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:28.953954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port 4618eb51-9ace-4406-aa4b-142663991bf6 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:28.954292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:28.954504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:28.963395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:28.982628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:28.996906 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 3.5533645 Nov 24 14:00:29.002319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41924) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:29.016087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-983977364'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:29.022228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:29.028946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:29.032985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:29.043134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:29.066401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1121a63a-29db-48d7-9850-987c15e0518e None None] Provisioning complete for port acf78bc2-292b-4419-9aa7-35e9254e5162 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:29.067274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1121a63a-29db-48d7-9850-987c15e0518e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.079537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.083534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:29.087068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.143136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.148433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5f72029d-372b-45b6-9e41-b150794fa59d']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:29.157105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.162801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1121a63a-29db-48d7-9850-987c15e0518e None None] Port acf78bc2-292b-4419-9aa7-35e9254e5162 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:29.165344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e5aef0cd-1682-4c80-aa0c-1895d530de38 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:29.175519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:29.185457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.262858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 885} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:29.294745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf983b02-fe80-4171-b6da-8fd12e5bda00') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:29.295042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf983b02-fe80-4171-b6da-8fd12e5bda00') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:29.304495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.316051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4df7ef06-db2c-4798-add3-94014d918c27 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:29.335063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.335363 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Added segment ea05a458-89e1-4c48-9ed4-3800bfecbaa1 of type vlan for network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d Nov 24 14:00:29.371379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.371576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Allocated IP 172.20.0.18 (2ad89193-4f35-4528-b799-6f2d3f48883c/069052fe-ffd3-4364-a970-a83ecc7ff028/8b37a6c8-c72a-40be-9fb0-ec417ef75899) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:29.372605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.381140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.381495 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment 4c66be1f-461b-43bb-83ba-3741548a7f5b of type vlan for network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 Nov 24 14:00:29.411295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.453508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b37a6c8-c72a-40be-9fb0-ec417ef75899 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:29.469954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9ab9fb15-a0cb-4dd2-85fa-639b44fe09ea,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:29.485270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:29.497541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.500074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.502734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:29.503440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.512225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=ed33b300-d2a1-43db-9034-2375609e0cb4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:29.513831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-098e14ef-0957-46d7-afd2-f2048d123932 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:29.517215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:29.520189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 2ad89193-4f35-4528-b799-6f2d3f48883c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:29.521312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 897 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:29.521853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:29.546421 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:29.554244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:29.557981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:29.638655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.642731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:29.643277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.669812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=ac1bda5c-7660-4f44-aab3-2ae0cf38a180,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:29.674465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:29.675364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-de62c2cc-6dd0-44b9-9176-03231b6efe4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.021s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:29.697297 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6933184 Nov 24 14:00:29.702993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] For port 4618eb51-9ace-4406-aa4b-142663991bf6, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4618eb51-9ace-4406-aa4b-142663991bf6,segment=NetworkSegment(99d91a48-15cd-44a0-be59-dd02fb59aa0c),segment_id=99d91a48-15cd-44a0-be59-dd02fb59aa0c)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:29.702993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.710878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41928) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:29.714212 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 1.0764632 Nov 24 14:00:29.718058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:29.721668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41932) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:29.724015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.727570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:29.727913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.730565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:29.731133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.735877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2cec712d-ba11-42c1-af7b-a738c35093c1 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:29.787873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] For port 8b37a6c8-c72a-40be-9fb0-ec417ef75899, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b37a6c8-c72a-40be-9fb0-ec417ef75899,segment=NetworkSegment(15a5a84f-1167-41b0-ab16-80791aaacdf5),segment_id=15a5a84f-1167-41b0-ab16-80791aaacdf5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:29.802185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'subnet': {'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:29.811609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:29.812771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.886361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Calling delete_port for 4618eb51-9ace-4406-aa4b-142663991bf6 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:29.948205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5f72029d-372b-45b6-9e41-b150794fa59d HTTP/1.1" status: 204 len: 168 time: 7.4917614 Nov 24 14:00:29.949371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=5f72029d-372b-45b6-9e41-b150794fa59d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:29.959104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41938) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:29.962166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:29.983693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:29.995303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Network': ['ID=81e8d49c-689b-4cea-8ae7-3a55b0bb002d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:30.006326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.331s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:30.015788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Transition to ACTIVE for port object 8b37a6c8-c72a-40be-9fb0-ec417ef75899 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:30.024879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:30.025624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c1b3dd6-536b-4386-b265-31b45ea04e66 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:30.026013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c1b3dd6-536b-4386-b265-31b45ea04e66 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:30.028040 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2c1b3dd6-536b-4386-b265-31b45ea04e66 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5f72029d-372b-45b6-9e41-b150794fa59d HTTP/1.1" status: 404 len: 339 time: 0.0566912 Nov 24 14:00:30.036403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41944) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:30.042533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:30.046619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1003 time: 6.9337935 Nov 24 14:00:30.049703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41948) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:30.066046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '1779010f-68b3-4ec7-a60a-89ab2050355b'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:30.081068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:30.086699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:30.092819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-950532984', 'description': 'd1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:30.098496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:subnet and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:30.107485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.108332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:30.116695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:30.119911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:30.120971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-562b81ef-5e50-4ae3-9544-8877dc0b5f15 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:30.124205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:30.132699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Usage tracker for resource:network and tenant:c68ea59217504ce9802abf43743e4c8f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:30.142930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:30.148360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:30.163825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.164270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:30.169066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:30.179280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-eab72146-8c9c-4251-8302-47cf5cb9a4ca None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:30.211143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Port': ['ID=4618eb51-9ace-4406-aa4b-142663991bf6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:30.220296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:30.327389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:30.332911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No DVR routers for this DVR port 4618eb51-9ace-4406-aa4b-142663991bf6 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:30.422274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Pushing event updated for resources: {'Port': ['ID=8b37a6c8-c72a-40be-9fb0-ec417ef75899,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:30.430958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:30.468020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:30.468324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.496432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:30.532516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.540515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:30.543219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.578107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 898} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:30.587199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.588095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment 2369d7f9-fe11-469d-b449-964e2ab6f7f6 of type vlan for network 3e788ede-d1dc-4162-9ec9-af902d8a4618 Nov 24 14:00:30.616264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ceb040a6-705b-4e6e-b930-4b7d3a909566']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:30.636717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9704a05-c925-4b83-aa19-0dff7236d6d1 req-e4858591-1b27-4846-add6-695c9ab69f8e tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:30.638347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9704a05-c925-4b83-aa19-0dff7236d6d1 req-e4858591-1b27-4846-add6-695c9ab69f8e tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6695468 Nov 24 14:00:30.649051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '99d91a48-15cd-44a0-be59-dd02fb59aa0c') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:30.649341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '99d91a48-15cd-44a0-be59-dd02fb59aa0c') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:30.657073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.687060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.706061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.722390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.770943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.785758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 874 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:30.786574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:30.801699 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:30.816828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.826195 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9704a05-c925-4b83-aa19-0dff7236d6d1 req-18d232af-3283-44dd-9f8b-4ec60602b043 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1790750 Nov 24 14:00:30.971148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:30.979623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9edb9ccc-e9b6-49f3-83ea-960666a43840 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:31.008312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.009589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.013897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:31.014710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.031024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-46efcbbf-be21-4fb6-b54e-190d041a36ca tempest-BulkNetworkOpsIpV6Test-1398805773 tempest-BulkNetworkOpsIpV6Test-1398805773-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:31.112786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-618819b6-fc56-4d26-b215-be50f9a438f2 None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:31.215026 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.1772165 Nov 24 14:00:31.217359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41956) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:31.229806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=ceb040a6-705b-4e6e-b930-4b7d3a909566,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:31.240375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:31.251148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=3e788ede-d1dc-4162-9ec9-af902d8a4618,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:31.261612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:31.269079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-93f0da23-1c29-48fa-bdc8-f6c7744507d6 None None] Provisioning for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:31.276884 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/ceb040a6-705b-4e6e-b930-4b7d3a909566 HTTP/1.1" status: 204 len: 168 time: 7.6599641 Nov 24 14:00:31.288598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41960) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:31.299850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-93f0da23-1c29-48fa-bdc8-f6c7744507d6 None None] Provisioning complete for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:31.300905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-93f0da23-1c29-48fa-bdc8-f6c7744507d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.315238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1956201102'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:31.367084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:31.379784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:31.400822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 3e788ede-d1dc-4162-9ec9-af902d8a4618 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:31.414672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:31.431900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:31.480203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df044280-4a5c-4bc4-8a28-f726dbf80840 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:31.480782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-df044280-4a5c-4bc4-8a28-f726dbf80840 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Synchronizing usage tracker for tenant:c68ea59217504ce9802abf43743e4c8f on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:31.486646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:31.489590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.508299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b37a6c8-c72a-40be-9fb0-ec417ef75899 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:31.568680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ba66cd-9d70-4cbb-a6ee-17ea087c9e95 req-cfc853e8-fa4c-4282-8416-7c36ca95e4f7 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:31.574988 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c9ba66cd-9d70-4cbb-a6ee-17ea087c9e95 req-cfc853e8-fa4c-4282-8416-7c36ca95e4f7 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.3392429 Nov 24 14:00:31.597909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-df044280-4a5c-4bc4-8a28-f726dbf80840 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Unset dirty status for tenant:c68ea59217504ce9802abf43743e4c8f on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:31.601854 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-df044280-4a5c-4bc4-8a28-f726dbf80840 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks?id=3e788ede-d1dc-4162-9ec9-af902d8a4618 HTTP/1.1" status: 200 len: 764 time: 0.3792238 Nov 24 14:00:31.606522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41964) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:31.625321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'description': 'd2'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:31.648605 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c9ba66cd-9d70-4cbb-a6ee-17ea087c9e95 req-fc320123-119e-41f8-8e7f-5bf07ecefd23 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638018 Nov 24 14:00:31.661035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.661885 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-06d634d1-597c-4903-bd77-24613fbfa1eb service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 0.3344059 Nov 24 14:00:31.662773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 858} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:31.709164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-efa14ff6-e6bf-47ee-ba8a-d562ecfecb66 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:31.765255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.794838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Delete allocated IP 172.20.0.28 (2ad89193-4f35-4528-b799-6f2d3f48883c/069052fe-ffd3-4364-a970-a83ecc7ff028) {{(pid=83526) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 14:00:31.804945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:31.805609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.806943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:31.807572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 64eed9d1-485f-453c-a743-6379bfef3ab9 of type vlan for network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 Nov 24 14:00:31.862782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=472eec3c-b375-4ea9-b4df-ba09d7003ada,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:31.876192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:31.933063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1828b083-4ca4-4e86-a682-9217f267d904 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.157s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:31.947375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-5e6609df-697e-47e1-af6d-0a57866b4a7a service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:31.948880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-5e6609df-697e-47e1-af6d-0a57866b4a7a service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.2751694 Nov 24 14:00:31.956354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.121871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-965a7ff7-64c6-4d5c-9beb-ec9e37d0e995 None None] Provisioning complete for port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:32.122911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-965a7ff7-64c6-4d5c-9beb-ec9e37d0e995 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.136888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.140889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:32.141509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.146740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5ab79c31-3c83-4161-8b48-75f0ec9b5983 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:32.162722 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-44736d55-f900-4854-9b80-5608e87b8125 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.2024388 Nov 24 14:00:32.248003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': 'd8281e69-477b-4a55-86eb-2b602d615a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:32.248561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: 12ac07b8-6349-4c6e-9bc5-fabd3af1869b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:32.257580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-f86205a2-df62-4056-95ae-fafaab6c5804 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:32.259025 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-f86205a2-df62-4056-95ae-fafaab6c5804 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.0730169 Nov 24 14:00:32.301285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Checking segment: {'id': 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 885, 'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:32.301501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network hostable DHCP agents. Network: 81e8d49c-689b-4cea-8ae7-3a55b0bb002d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:32.314159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Subnet': ['ID=07399c12-b132-41cc-ba04-9605a6e3af74,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:32.322351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.325037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.326827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-965a7ff7-64c6-4d5c-9beb-ec9e37d0e995 None None] Provisioning for port ed33b300-d2a1-43db-9034-2375609e0cb4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:32.333780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.402s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:32.338509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-875efcb3-1276-479d-929f-2b46783881e4 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:00:32.365398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port acf78bc2-292b-4419-9aa7-35e9254e5162 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:32.365906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.380690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-965a7ff7-64c6-4d5c-9beb-ec9e37d0e995 None None] Provisioning complete for port ed33b300-d2a1-43db-9034-2375609e0cb4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:32.380690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-965a7ff7-64c6-4d5c-9beb-ec9e37d0e995 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.386042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 1.0933652 Nov 24 14:00:32.396631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41968) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:32.400663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:32.407995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:32.409311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Ignored duplicate provisioning block setup for port ed33b300-d2a1-43db-9034-2375609e0cb4 by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} Nov 24 14:00:32.410306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.418959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': 'e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:32.422829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.429264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:32.429763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:32.441647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e8fffb87-ab63-46bf-bee3-78b503047d8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:32.479058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:32.509800 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-7822466a-f9bd-40d1-bc5b-ff36d59fc3be service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1886718 Nov 24 14:00:32.529571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network 3e788ede-d1dc-4162-9ec9-af902d8a4618 is not hosted by any dhcp agent {{(pid=83525) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:226}} Nov 24 14:00:32.533722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:32.534489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.538459 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "PUT /v2.0/networks/3e788ede-d1dc-4162-9ec9-af902d8a4618 HTTP/1.1" status: 200 len: 761 time: 0.9280391 Nov 24 14:00:32.539953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41972) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:32.573636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=ed33b300-d2a1-43db-9034-2375609e0cb4,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:32.631890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:32.633318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:32.642262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-965a7ff7-64c6-4d5c-9beb-ec9e37d0e995 None None] Port ed33b300-d2a1-43db-9034-2375609e0cb4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:32.663153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 12ac07b8-6349-4c6e-9bc5-fabd3af1869b) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:32.734454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:32.735192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.742283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 81e8d49c-689b-4cea-8ae7-3a55b0bb002d) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:32.756329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=3e788ede-d1dc-4162-9ec9-af902d8a4618,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:32.770449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.329s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:32.778478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:32.779252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.789532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 3e788ede-d1dc-4162-9ec9-af902d8a4618 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:32.820165 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-27ab769e-a93a-4044-9657-8f2426893fa9 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2745950 Nov 24 14:00:32.847479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:32.860754 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.1450698 Nov 24 14:00:32.871047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41978) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:32.877111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:32.883335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:32.904339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:32.910388 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.1652350 Nov 24 14:00:32.912143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:32.913381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-212e3010-73c2-44f4-9a1a-1cc241d9707a None None] Provisioning complete for port ed33b300-d2a1-43db-9034-2375609e0cb4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:32.913792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-212e3010-73c2-44f4-9a1a-1cc241d9707a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.915251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41982) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:32.925067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'network': {'name': 'tempest-router-network01--418407332'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:32.930645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.944727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:32.970526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] In _notify_port_updated(), no bound segment for port ed33b300-d2a1-43db-9034-2375609e0cb4 on network 2ad89193-4f35-4528-b799-6f2d3f48883c {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:00:32.974387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:32.974991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:32.979120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/ports/ed33b300-d2a1-43db-9034-2375609e0cb4 HTTP/1.1" status: 200 len: 918 time: 2.9255674 Nov 24 14:00:33.001003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:33.015148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 41986) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:33.016232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:network and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:33.051076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-212e3010-73c2-44f4-9a1a-1cc241d9707a None None] Port ed33b300-d2a1-43db-9034-2375609e0cb4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:33.082317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:33.091985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for acf78bc2-292b-4419-9aa7-35e9254e5162 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:33.124030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '1779010f-68b3-4ec7-a60a-89ab2050355b'}, {'subnet_id': '069052fe-ffd3-4364-a970-a83ecc7ff028'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:33.140118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3f0067ac-52cf-4a49-97b6-dcb6f79d95dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.183596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:33.185518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-875efcb3-1276-479d-929f-2b46783881e4 None None] Unable to find a vacant binding_index for network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d and agent 42153128-35a0-4d6f-8610-1ec654ed3b07 {{(pid=83527) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 24 14:00:33.203243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba3aefcd-3f96-423e-a057-3efa24adeedd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:33.204015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ba3aefcd-3f96-423e-a057-3efa24adeedd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Synchronizing usage tracker for tenant:c68ea59217504ce9802abf43743e4c8f on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:33.214435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-875efcb3-1276-479d-929f-2b46783881e4 None None] Unable to find a vacant binding_index for network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b and agent 42153128-35a0-4d6f-8610-1ec654ed3b07 {{(pid=83527) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:209}} Nov 24 14:00:33.230089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-875efcb3-1276-479d-929f-2b46783881e4 None None] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 81e8d49c-689b-4cea-8ae7-3a55b0bb002d), (DHCP agent, dv-neutron-818151-2-hyperv, 12ac07b8-6349-4c6e-9bc5-fabd3af1869b) {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:00:33.252503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ba3aefcd-3f96-423e-a057-3efa24adeedd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Unset dirty status for tenant:c68ea59217504ce9802abf43743e4c8f on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:33.257741 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ba3aefcd-3f96-423e-a057-3efa24adeedd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks?id=3e788ede-d1dc-4162-9ec9-af902d8a4618 HTTP/1.1" status: 200 len: 764 time: 0.7082598 Nov 24 14:00:33.258493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41990) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:33.323357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:33.326603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.329183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:33.373136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.395651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:33.403986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:33.410043 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a1e08f3-ac34-4343-abde-a91a0da25e90 req-bfcb7e55-3c2a-4124-84d4-214e8255247e service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5380602 Nov 24 14:00:33.416248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:33.429821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3063c3e5-a17a-446b-a4b3-46f9b32ac116 req-be0359ee-e2ea-4f5a-a827-315a927ec4f1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:33.431404 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3063c3e5-a17a-446b-a4b3-46f9b32ac116 req-be0359ee-e2ea-4f5a-a827-315a927ec4f1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6219974 Nov 24 14:00:33.452929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:33.535798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.544413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92a283a4-eb04-47b7-be88-b04478b4ec20 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:33.546019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-92a283a4-eb04-47b7-be88-b04478b4ec20 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.2777846 Nov 24 14:00:33.557842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41994) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:33.617246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5a519797-ed52-4218-85fd-59d18ab92dd6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Synchronizing usage tracker for tenant:c68ea59217504ce9802abf43743e4c8f on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:33.622795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 866} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:33.625809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.683130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.683434 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Added segment a488562a-2b1f-489f-9b06-8fff41be8d8d of type vlan for network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 Nov 24 14:00:33.694605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-12ac07b8-6349-4c6e-9bc5-fabd3af1869b', 'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': '472eec3c-b375-4ea9-b4df-ba09d7003ada'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:33.696296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.707648 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3063c3e5-a17a-446b-a4b3-46f9b32ac116 req-5a2784c5-3d4b-42d1-8d9c-daf541713498 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2221031 Nov 24 14:00:33.714897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-81e8d49c-689b-4cea-8ae7-3a55b0bb002d', 'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d', 'tenant_id': 'b8414925e97644acb99608415dc5b4ae', 'fixed_ips': [{'subnet_id': '07399c12-b132-41cc-ba04-9605a6e3af74'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:33.716020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.719303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5a519797-ed52-4218-85fd-59d18ab92dd6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Unset dirty status for tenant:c68ea59217504ce9802abf43743e4c8f on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:33.720492 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5a519797-ed52-4218-85fd-59d18ab92dd6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 207 time: 0.1617012 Nov 24 14:00:33.724370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 41998) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:33.842284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:33.993083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.002116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ab3b1eee-d8da-4dc1-8f34-9dda7eb4e323 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:34.020519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.030402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Allocated IP 2001:db8::2 (81e8d49c-689b-4cea-8ae7-3a55b0bb002d/07399c12-b132-41cc-ba04-9605a6e3af74/f2b0ead3-eede-48e5-b87d-8e28157c8010) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:34.032751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Allocated IP 2001:db8::2 (12ac07b8-6349-4c6e-9bc5-fabd3af1869b/472eec3c-b375-4ea9-b4df-ba09d7003ada/7dd4260c-a909-499b-9ce0-53e7b7e24a95) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:34.081733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.087391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.092356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.102221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.110100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.115848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.120272 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3f9e83f9-9e97-4767-af29-7e125af1d43e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3731 time: 0.3944809 Nov 24 14:00:34.125273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42002) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.183130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.187998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=eab0d0fe-90d2-4c39-b7fb-965833a7b41a,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:34.232082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:34.239961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:34.273439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': '4c66be1f-461b-43bb-83ba-3741548a7f5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:34.273712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: ac1bda5c-7660-4f44-aab3-2ae0cf38a180, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:34.282026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=acf78bc2-292b-4419-9aa7-35e9254e5162,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:34.283718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.287251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.288075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.299127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:34.299911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-81bf5c4e-471f-4090-9a24-68d415255eeb tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:34.345977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-268ffdbd-77d5-4d90-8820-f4609d44fe3b tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 813 time: 0.2143121 Nov 24 14:00:34.351573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42006) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.365463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.393646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:34.419874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ac1bda5c-7660-4f44-aab3-2ae0cf38a180) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:34.427300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.427897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.447474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d9353f7-65ac-4bdb-af3f-1833a22d4766 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.449373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d9353f7-65ac-4bdb-af3f-1833a22d4766 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.450694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d9353f7-65ac-4bdb-af3f-1833a22d4766 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.452042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d9353f7-65ac-4bdb-af3f-1833a22d4766 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.453469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d9353f7-65ac-4bdb-af3f-1833a22d4766 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.455149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3d9353f7-65ac-4bdb-af3f-1833a22d4766 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.1026196 Nov 24 14:00:34.460352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42010) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.467361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.470096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.486121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Transition to ACTIVE for port object f2b0ead3-eede-48e5-b87d-8e28157c8010 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:34.488742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Transition to ACTIVE for port object 7dd4260c-a909-499b-9ce0-53e7b7e24a95 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:34.505444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.5989163 Nov 24 14:00:34.511424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42014) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.518605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-770607332', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:34.521795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Transition to ACTIVE for port object f2b0ead3-eede-48e5-b87d-8e28157c8010 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:34.523202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Transition to ACTIVE for port object 7dd4260c-a909-499b-9ce0-53e7b7e24a95 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:34.527380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:34.530284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.535132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:34.538809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:router and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:34.544015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:34.553270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:34.565734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e77bef2-271d-4a43-af36-25d32cba6693 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.567178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e77bef2-271d-4a43-af36-25d32cba6693 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.568359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.568738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e77bef2-271d-4a43-af36-25d32cba6693 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.570133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e77bef2-271d-4a43-af36-25d32cba6693 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.571706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e77bef2-271d-4a43-af36-25d32cba6693 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.577619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8e77bef2-271d-4a43-af36-25d32cba6693 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.1094186 Nov 24 14:00:34.578265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42018) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.609234 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.6896439 Nov 24 14:00:34.610987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Network': ['ID=e653b4d3-8e0f-4ce9-894d-0a81384d4bc1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:34.611516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42022) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.615630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:34.618180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'network': {'name': 'tempest-router-network02--889351888'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:34.624493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Pushing event updated for resources: {'Port': ['ID=f2b0ead3-eede-48e5-b87d-8e28157c8010,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:34.624794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc21c05b-3935-4587-b211-a5f2e3cc1f6c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.255s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:34.628269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:34.632181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:34.633804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:34.636812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.056s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:34.639333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.641099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.689348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:34.702511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:network and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:34.708317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:34.714805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:34.723730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:34.729685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:34.732899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:34.743057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:34.756881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:34.769712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.773248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:34.776736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.820251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8bbfaec-b7d3-41c9-90c2-125c3b616816 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:34.822367 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d8bbfaec-b7d3-41c9-90c2-125c3b616816 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks/cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 HTTP/1.1" status: 200 len: 804 time: 0.2427084 Nov 24 14:00:34.826769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42028) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:34.917517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=6d3bf52e-bf10-43f6-b456-a077f6467a3c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:34.920868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:34.944594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '64eed9d1-485f-453c-a743-6379bfef3ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': 'e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:34.945231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:34.947897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 860} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:34.950726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:34.952106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Pushing event updated for resources: {'Port': ['ID=7dd4260c-a909-499b-9ce0-53e7b7e24a95,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:34.964964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:35.024272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Attempting to bind port f2b0ead3-eede-48e5-b87d-8e28157c8010 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:35.024502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Attempting to bind port f2b0ead3-eede-48e5-b87d-8e28157c8010 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 885, 'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:35.025438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Attempting to bind port f2b0ead3-eede-48e5-b87d-8e28157c8010 on network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:35.031653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.032344 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Added segment 540ab5bb-29ab-454c-be59-755229bb8240 of type vlan for network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 Nov 24 14:00:35.034054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Attempting to bind port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:35.034432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Attempting to bind port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd8281e69-477b-4a55-86eb-2b602d615a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:35.034794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Attempting to bind port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 on network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:35.039662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:35.039980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Checking segment: {'id': 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 885, 'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:35.040585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.041787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Bound using segment: {'id': 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 885, 'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:35.042267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Bound port: f2b0ead3-eede-48e5-b87d-8e28157c8010, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 885, 'network_id': '81e8d49c-689b-4cea-8ae7-3a55b0bb002d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:35.042653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.051853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.058922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:35.059326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Checking segment: {'id': 'd8281e69-477b-4a55-86eb-2b602d615a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:35.059704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.060126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Bound using segment: {'id': 'd8281e69-477b-4a55-86eb-2b602d615a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:35.060775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Bound port: 7dd4260c-a909-499b-9ce0-53e7b7e24a95, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8281e69-477b-4a55-86eb-2b602d615a01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '12ac07b8-6349-4c6e-9bc5-fabd3af1869b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:35.061370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.074484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:35.082032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.086068 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e8d497d3-decd-4e78-b85c-fca5d2ca44af tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.5736570 Nov 24 14:00:35.090090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42032) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:35.149427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.20 (2ad89193-4f35-4528-b799-6f2d3f48883c/069052fe-ffd3-4364-a970-a83ecc7ff028/ed33b300-d2a1-43db-9034-2375609e0cb4) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:35.213763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:35.223832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] For port f2b0ead3-eede-48e5-b87d-8e28157c8010, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:35.230097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] For port f2b0ead3-eede-48e5-b87d-8e28157c8010, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f2b0ead3-eede-48e5-b87d-8e28157c8010,segment=NetworkSegment(ea05a458-89e1-4c48-9ed4-3800bfecbaa1),segment_id=ea05a458-89e1-4c48-9ed4-3800bfecbaa1)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:35.247276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:35.248259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.248539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] For port 7dd4260c-a909-499b-9ce0-53e7b7e24a95, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:35.252402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] For port 7dd4260c-a909-499b-9ce0-53e7b7e24a95, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7dd4260c-a909-499b-9ce0-53e7b7e24a95,segment=NetworkSegment(d8281e69-477b-4a55-86eb-2b602d615a01),segment_id=d8281e69-477b-4a55-86eb-2b602d615a01)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:35.254994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.265491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0523f668-bdcc-4d76-acd0-c12ffdde773c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:35.280558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7657472b-0f61-41bf-b6aa-088ec366b51f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/networks/cb19ec64-b023-4aad-b4ad-fb107cd2f9c0?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 320 time: 0.4512110 Nov 24 14:00:35.292224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.295714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42036) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:35.328230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.361519 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 2.9635417 Nov 24 14:00:35.365780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42040) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:35.410207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Pushing event updated for resources: {'Port': ['ID=f2b0ead3-eede-48e5-b87d-8e28157c8010,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:35.417333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:35.417966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-33482a7a-22be-4f21-ac44-0ed7d06bfec8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:35.481694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef50f03b-72a3-4b61-8f5d-891c81c55d52 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:35.486510 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ef50f03b-72a3-4b61-8f5d-891c81c55d52 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/subnets/38b82bda-dda1-4e46-81b2-1aa2272a43f5 HTTP/1.1" status: 200 len: 843 time: 0.1862519 Nov 24 14:00:35.492204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8077cecd-c64c-4ec0-a6d0-d1f12f32233a req-ea121795-7bb9-4ede-9d63-63095e573260 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:35.499840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8077cecd-c64c-4ec0-a6d0-d1f12f32233a req-ea121795-7bb9-4ede-9d63-63095e573260 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5647101 Nov 24 14:00:35.502044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42044) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:35.516189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Pushing event updated for resources: {'Port': ['ID=7dd4260c-a909-499b-9ce0-53e7b7e24a95,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:35.519626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:35.521459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.525613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:35.526339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.563214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-97656bc5-b3f0-45ed-b48d-d769a8862c3f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:35.737562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2a785343-b10c-466b-addd-8b5f75d33b24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:35.879979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8077cecd-c64c-4ec0-a6d0-d1f12f32233a req-504efc6f-d4e3-4b62-9661-a8343479181e tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3790171 Nov 24 14:00:35.881688 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 1.2691901 Nov 24 14:00:35.889441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:35.901381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cd48ab2-235f-4532-8021-94e2fe248cb2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:35.902947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9cd48ab2-235f-4532-8021-94e2fe248cb2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "GET /v2.0/subnets/38b82bda-dda1-4e46-81b2-1aa2272a43f5?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.3978450 Nov 24 14:00:35.904500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Network': ['ID=782f26dd-d3ff-4e1a-8ad4-5783128b14d5,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:35.914308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42054) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:35.919854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'subnet': {'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:35.925991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:35.972069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.086101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.523s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:36.091623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1666266639'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:36.099461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:36.107727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:36.118247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:subnet and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:36.130672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object ed33b300-d2a1-43db-9034-2375609e0cb4 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:36.147608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.154180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.160243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d46c528-a939-4ce3-8cae-474f44e59a8a tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:36.169063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource network. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:36.171115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:36.191662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:36.255342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:36.256732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 9914b2df-11c0-4062-9d63-2bc0e07c4c82 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:00:36.258309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.280027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:36.290884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=ed33b300-d2a1-43db-9034-2375609e0cb4,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:36.326761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:36.380778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 850} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:36.477559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.478026 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Added segment c6a6c836-38d3-46f8-93b0-5469de5500d6 of type vlan for network 7fd9f3e6-c392-4d6c-8962-b410a532a8df Nov 24 14:00:36.483239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.522231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7985657-d3c8-4458-940a-6c6ccf896603 req-92a804c4-7471-4fb8-a1da-1ee310ec06e2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:36.523713 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e7985657-d3c8-4458-940a-6c6ccf896603 req-92a804c4-7471-4fb8-a1da-1ee310ec06e2 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.4504583 Nov 24 14:00:36.537586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.629420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.657756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.665716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] In _notify_port_updated(), no bound segment for port ed33b300-d2a1-43db-9034-2375609e0cb4 on network 2ad89193-4f35-4528-b799-6f2d3f48883c {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:00:36.666271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.670136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:36.670818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.672419 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/ports/ed33b300-d2a1-43db-9034-2375609e0cb4 HTTP/1.1" status: 200 len: 998 time: 3.5943496 Nov 24 14:00:36.681599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42058) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:36.738531 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e7985657-d3c8-4458-940a-6c6ccf896603 req-adc3e292-9135-443d-bb7b-4f29f0763133 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1750624 Nov 24 14:00:36.753476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:36.765069 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/9914b2df-11c0-4062-9d63-2bc0e07c4c82/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.3229313 Nov 24 14:00:36.771794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42062) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:36.777828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] Sync routers for ids ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:36.811567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] Routers {'9914b2df-11c0-4062-9d63-2bc0e07c4c82'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:36.812153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:36.812334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:36.833027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6653ba68-df2f-43b9-93e9-1a09666ee515 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774 tempest-ExtraDHCPOptionsIpV6TestJSON-346904774-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:36.884530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=6d3bf52e-bf10-43f6-b456-a077f6467a3c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:36.887580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-03b4a4e5-4f43-45e5-a7e6-b208da236389 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:36.895637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:36.925889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:36.946142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] Routers {'9914b2df-11c0-4062-9d63-2bc0e07c4c82'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:36.948223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:36.954819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-03b4a4e5-4f43-45e5-a7e6-b208da236389 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:36.958818 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-03b4a4e5-4f43-45e5-a7e6-b208da236389 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=9914b2df-11c0-4062-9d63-2bc0e07c4c82 HTTP/1.1" status: 200 len: 205 time: 0.1878421 Nov 24 14:00:36.961825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42068) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:37.049791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:37.050217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64f1fe8b-e507-483e-b035-76682158e4ea None None] The sync data for ids ['9914b2df-11c0-4062-9d63-2bc0e07c4c82'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:37.079681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-77324cb3-60f0-4dd6-8f55-7498eaca0684 None None] Provisioning for port f2b0ead3-eede-48e5-b87d-8e28157c8010 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:37.082831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] It took 0.39 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:37.132320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73f7b065-8888-438e-b1fa-1c5625645cc0 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:00:37.192205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.224839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:37.234178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port ed33b300-d2a1-43db-9034-2375609e0cb4 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:37.234820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.246201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.254991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9524e060-1eaa-47e2-9433-7bae0691c455 None None] Provisioning for port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:37.292911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.297213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:37.297789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.302463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '64eed9d1-485f-453c-a743-6379bfef3ab9') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:37.303309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '64eed9d1-485f-453c-a743-6379bfef3ab9') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:37.339849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e83e2f6e-1a21-4d5a-adf1-dafb84c309b4 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:37.350430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f7b065-8888-438e-b1fa-1c5625645cc0 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:00:37.516533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7dd4260c-a909-499b-9ce0-53e7b7e24a95 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:37.528389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.548260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.557185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 858 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:37.557894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:37.573148 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:37.655743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Network': ['ID=7fd9f3e6-c392-4d6c-8962-b410a532a8df,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:37.667450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:37.690501 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 1.6174881 Nov 24 14:00:37.691494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.699798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:37.706342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42072) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:37.707640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-001abf2e-604c-445d-8597-480a9b26b041 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:37.742084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:37.765806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-305edfa6-ba17-42f3-b69b-31cabe65333d req-7b50df59-db4b-4cff-8ed5-4afad9ebc813 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:37.767315 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-305edfa6-ba17-42f3-b69b-31cabe65333d req-7b50df59-db4b-4cff-8ed5-4afad9ebc813 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6647470 Nov 24 14:00:37.797685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'network_id': '7fd9f3e6-c392-4d6c-8962-b410a532a8df', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:37.806891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:37.807283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.887056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.955223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e877e3bf-0d1f-4d5e-855a-b712c56652dc tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:37.975287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Subnet': ['ID=926b5b49-d1e0-4718-b7d3-197256880fc2,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:37.976620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:37.990058 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 HTTP/1.1" status: 204 len: 168 time: 2.5619898 Nov 24 14:00:37.992768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:37.994991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42076) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:38.011893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-618008082'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:38.019744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8::1 (12ac07b8-6349-4c6e-9bc5-fabd3af1869b/472eec3c-b375-4ea9-b4df-ba09d7003ada/0033b20f-e38f-4165-87c0-a822bd77c119) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:38.036964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:38.046657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-305edfa6-ba17-42f3-b69b-31cabe65333d req-4c0e7410-76fc-45b2-a503-4348ebb7ddc8 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2618859 Nov 24 14:00:38.063159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:38.069855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Checking segment: {'id': 'a488562a-2b1f-489f-9b06-8fff41be8d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:38.070466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network hostable DHCP agents. Network: e653b4d3-8e0f-4ce9-894d-0a81384d4bc1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:38.076681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:38.079154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:38.092432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:38.099471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.103582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:38.122834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.126427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:38.139347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.146473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attempting to reserve 1 items for resource subnet. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:38.165560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ac1bda5c-7660-4f44-aab3-2ae0cf38a180', 'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': 'eab0d0fe-90d2-4c39-b7fb-965833a7b41a'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:38.166639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.174385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Made reservation on behalf of c68ea59217504ce9802abf43743e4c8f for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:38.197159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7dd4260c-a909-499b-9ce0-53e7b7e24a95, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7dd4260c-a909-499b-9ce0-53e7b7e24a95,segment=NetworkSegment(d8281e69-477b-4a55-86eb-2b602d615a01),segment_id=d8281e69-477b-4a55-86eb-2b602d615a01)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:38.210873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.256724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.256979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.257273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router 9914b2df-11c0-4062-9d63-2bc0e07c4c82 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:00:38.257580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f2b0ead3-eede-48e5-b87d-8e28157c8010 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:38.292503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-13363ab9-11bb-44cc-a9f0-89626e5b162f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:38.314925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.316678 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b237823c-1ad5-4f5a-a105-8044f7a528bf tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/9914b2df-11c0-4062-9d63-2bc0e07c4c82 HTTP/1.1" status: 204 len: 168 time: 1.3540044 Nov 24 14:00:38.319743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42082) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:38.362703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.408729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:38.411670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.423036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.429493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for ed33b300-d2a1-43db-9034-2375609e0cb4 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:38.468043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7dd4260c-a909-499b-9ce0-53e7b7e24a95,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:38.475228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:38.502187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Performing IP validity checks on allocation pools {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 14:00:38.502877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 14:00:38.526202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Allocated IP 2001:db8:1::2 (ac1bda5c-7660-4f44-aab3-2ae0cf38a180/eab0d0fe-90d2-4c39-b7fb-965833a7b41a/e6c679e7-cb66-4c24-83e7-2c4a45ce410c) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:38.586118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 886} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:38.591474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:38.620226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.620226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 31241fb6-2a44-4cc8-ab83-95447daa412b of type vlan for network c9646eb3-12b1-40d9-86ec-59f349fd38a8 Nov 24 14:00:38.623803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.636807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, e653b4d3-8e0f-4ce9-894d-0a81384d4bc1) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:38.641748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:38.642605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.698485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f2b0ead3-eede-48e5-b87d-8e28157c8010 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:38.703298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f2b0ead3-eede-48e5-b87d-8e28157c8010 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:38.703985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.722966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 0033b20f-e38f-4165-87c0-a822bd77c119 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:38.725987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet e5c1ff5f-e903-4fb1-a5c7-688946c34c0c {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:38.733853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.784712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.807920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.9144335 Nov 24 14:00:38.816167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42088) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:38.824000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.828239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.830811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'subnet': {'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:38.865425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f2b0ead3-eede-48e5-b87d-8e28157c8010, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f2b0ead3-eede-48e5-b87d-8e28157c8010,segment=NetworkSegment(ea05a458-89e1-4c48-9ed4-3800bfecbaa1),segment_id=ea05a458-89e1-4c48-9ed4-3800bfecbaa1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:38.870773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.872975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f61adf3b-6138-423c-9da3-951b6b8e1a29 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:38.892316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:38.899247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0d517138-8d6e-4280-a729-97c48396aa87 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:38.941115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f2b0ead3-eede-48e5-b87d-8e28157c8010,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:38.944288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:38.992435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=0b2d76d5-b6b9-4413-ac83-8217abd0dda6,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:38.998142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:39.018134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.055536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Checking segment: {'id': 'c6a6c836-38d3-46f8-93b0-5469de5500d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '7fd9f3e6-c392-4d6c-8962-b410a532a8df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:39.056460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network hostable DHCP agents. Network: 7fd9f3e6-c392-4d6c-8962-b410a532a8df, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:39.106244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:39.114531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.118720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-855d7e73-00dc-4469-a1d1-c62baae556e7 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:39.137803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.141575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:39.142148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.147243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7fd9f3e6-c392-4d6c-8962-b410a532a8df) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:39.152277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.155126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=e5c1ff5f-e903-4fb1-a5c7-688946c34c0c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:39.159259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:39.159879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.165123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:39.167200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4858a6d9-4248-44b9-8eed-f9402473ee8d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:39.177593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.194922 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/e5c1ff5f-e903-4fb1-a5c7-688946c34c0c HTTP/1.1" status: 204 len: 168 time: 0.8734577 Nov 24 14:00:39.198211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42092) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:39.204949 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 1.4894373 Nov 24 14:00:39.212886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42096) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:39.234139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:39.271498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.279511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77ce442-e201-4bff-8251-4b88813a7bf9 req-534e78ac-6088-4012-9a12-12e6a91fb45a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:39.281085 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d77ce442-e201-4bff-8251-4b88813a7bf9 req-534e78ac-6088-4012-9a12-12e6a91fb45a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5742767 Nov 24 14:00:39.315377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.346827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Transition to ACTIVE for port object e6c679e7-cb66-4c24-83e7-2c4a45ce410c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:39.382854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Transition to ACTIVE for port object e6c679e7-cb66-4c24-83e7-2c4a45ce410c will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:39.397429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.413358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9b985c96-8d3d-443d-8c90-2f621a5c4a16 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:39.431551 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.4303718 Nov 24 14:00:39.436736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42100) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:39.445558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': 'c9646eb3-12b1-40d9-86ec-59f349fd38a8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:39.463497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7dd4260c-a909-499b-9ce0-53e7b7e24a95 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:39.499469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:39.512194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:39.518547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:39.520525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=c9646eb3-12b1-40d9-86ec-59f349fd38a8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:39.524055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:39.526380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.359s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:39.527812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:39.538714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:39.539430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.541444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network c9646eb3-12b1-40d9-86ec-59f349fd38a8 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:39.546763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:39.551037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc3e7832-6ca4-4191-8178-f969bc62194b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.367s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:39.552277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.576660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Pushing event updated for resources: {'Port': ['ID=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:39.582891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:39.585415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:39.587681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:39.588047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.596108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:subnet and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:39.611548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:39.618408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:39.630477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:39.677237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:39.679953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:39.707259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:39.758531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Attempting to bind port e6c679e7-cb66-4c24-83e7-2c4a45ce410c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:39.759250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Attempting to bind port e6c679e7-cb66-4c24-83e7-2c4a45ce410c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '4c66be1f-461b-43bb-83ba-3741548a7f5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:39.759394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Attempting to bind port e6c679e7-cb66-4c24-83e7-2c4a45ce410c on network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:39.763665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:39.764366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.804553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:39.804834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Checking segment: {'id': '4c66be1f-461b-43bb-83ba-3741548a7f5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:39.805245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.805783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Bound using segment: {'id': '4c66be1f-461b-43bb-83ba-3741548a7f5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:39.806551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Bound port: e6c679e7-cb66-4c24-83e7-2c4a45ce410c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4c66be1f-461b-43bb-83ba-3741548a7f5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'ac1bda5c-7660-4f44-aab3-2ae0cf38a180'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:39.806805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.822824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d77ce442-e201-4bff-8251-4b88813a7bf9 req-81058b41-141e-4927-84da-aeb54d6874f6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4739447 Nov 24 14:00:39.856285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:39.876855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:39.889563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=0033b20f-e38f-4165-87c0-a822bd77c119,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:39.964480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] For port e6c679e7-cb66-4c24-83e7-2c4a45ce410c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:39.967205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f2b0ead3-eede-48e5-b87d-8e28157c8010 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:40.001288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,segment=NetworkSegment(040bd5fb-5ea0-4107-add1-d003de065701),segment_id=040bd5fb-5ea0-4107-add1-d003de065701)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:40.001649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.008682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] For port e6c679e7-cb66-4c24-83e7-2c4a45ce410c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,segment=NetworkSegment(4c66be1f-461b-43bb-83ba-3741548a7f5b),segment_id=4c66be1f-461b-43bb-83ba-3741548a7f5b)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:40.017709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.022082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=ed33b300-d2a1-43db-9034-2375609e0cb4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:40.028356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:40.071086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.520s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:40.077286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.732s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:40.077770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:40.109769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Pushing event updated for resources: {'Port': ['ID=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:40.114765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:40.126306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f2b0ead3-eede-48e5-b87d-8e28157c8010 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:40.126694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.140443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:40.156164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.158387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/ed33b300-d2a1-43db-9034-2375609e0cb4 HTTP/1.1" status: 204 len: 168 time: 3.4754941 Nov 24 14:00:40.171231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42104) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:40.253318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.289087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.296923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9ab5ab2-3892-4737-8071-1a424c4b65bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:40.321865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8240703'] for subnet, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.347017 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-8b7330b8-2180-4bd2-b90c-79c166dfe1f4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:00:40.347525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8b7330b8-2180-4bd2-b90c-79c166dfe1f4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:40.351790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.385647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=7da14b50-cc36-4f2e-b51b-dbd5ff071da7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:40.406312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No DVR routers for this DVR port 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:40.438133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:40.565977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8b7330b8-2180-4bd2-b90c-79c166dfe1f4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:40.567279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8b7330b8-2180-4bd2-b90c-79c166dfe1f4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/ed33b300-d2a1-43db-9034-2375609e0cb4 HTTP/1.1" status: 404 len: 333 time: 0.3922777 Nov 24 14:00:40.568020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.573471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.580196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42108) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:40.580879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bfb3d2b7-8272-4fbc-b9a4-b5a7182ab392 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:40.686259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['793f3831-f3f5-426a-a5d5-dab329ae309c']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:40.717427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '040bd5fb-5ea0-4107-add1-d003de065701') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:40.717708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '040bd5fb-5ea0-4107-add1-d003de065701') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:40.738533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.764480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=c65e22f1-d7f8-4a53-bcd7-9220155510be,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:40.767139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:40.795179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.821595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '31241fb6-2a44-4cc8-ab83-95447daa412b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 886, 'network_id': 'c9646eb3-12b1-40d9-86ec-59f349fd38a8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:40.822378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: c9646eb3-12b1-40d9-86ec-59f349fd38a8, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:40.827974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 859 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:40.828564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:40.848125 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:41.183635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8771276033028', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8272494'] for subnet, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.190706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:41.216749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.219431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab6f82fe-4395-4554-90e3-16d8f475e633 None None] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.225934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8318d42b-02f5-47b1-a49e-55e39a0650f1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:41.241892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bb63d7e-ce72-4c7e-b49b-4784e530e9eb None None] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.252342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.268626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3735a108-2de6-4f4e-9a1a-80fae2bc0bb8 None None] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.271294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=793f3831-f3f5-426a-a5d5-dab329ae309c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:41.278895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet 069052fe-ffd3-4364-a970-a83ecc7ff028 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:41.284842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:41.287588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.296033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d630839-57e7-488a-8cc4-5dad411cc658 None None] Network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.312183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f0a1c92-b78b-4c47-ba55-be82a4969ca2 None None] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.350017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae18b9c1-049b-4f8d-bd6e-a038a89d6850 None None] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.358978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network c9646eb3-12b1-40d9-86ec-59f349fd38a8 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:41.418693 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/793f3831-f3f5-426a-a5d5-dab329ae309c HTTP/1.1" status: 204 len: 168 time: 2.2147779 Nov 24 14:00:41.427894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event updated for resources: {'Subnet': ['ID=0b2d76d5-b6b9-4413-ac83-8217abd0dda6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:41.434054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:41.436019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42114) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:41.459469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.479519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:41.480155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.484473 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "PUT /v2.0/subnets/0b2d76d5-b6b9-4413-ac83-8217abd0dda6 HTTP/1.1" status: 200 len: 900 time: 2.2568278 Nov 24 14:00:41.495149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:41.518551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.525985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, c9646eb3-12b1-40d9-86ec-59f349fd38a8) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:41.531495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1037898234', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:41.551955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-81c881a3-e56a-4c38-97af-a265c5628e58 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:41.584119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:41.593831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.603068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:41.618778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d630839-57e7-488a-8cc4-5dad411cc658 None None] Network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 could not be found, it might have been deleted concurrently. {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:205}} Nov 24 14:00:41.625361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:41.643115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:41.660945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:41.673170 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 2.2352736 Nov 24 14:00:41.684401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24365563-d3da-4177-bb59-158a2a41b0da req-ed3b4acb-03a4-4729-bf4a-c345f579fa57 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:41.686198 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-24365563-d3da-4177-bb59-158a2a41b0da req-ed3b4acb-03a4-4729-bf4a-c345f579fa57 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5393205 Nov 24 14:00:41.690967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42122) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:41.763262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.764249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.787752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd1670ff-d183-4b34-bd3d-f5190844af9b None None] Network c9646eb3-12b1-40d9-86ec-59f349fd38a8 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.788773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:41.802082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-942d9d80-9dee-4f91-89ea-94d7756d4eba None None] Network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:41.851281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Subnet': ['ID=317499df-5667-4a3c-99c5-f2725d135ed1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:41.857899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.862719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.311s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:41.893500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.894781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.906437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74d85b6e-5d90-4a65-bf46-524d767e3af0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:41.918692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.922250 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-24365563-d3da-4177-bb59-158a2a41b0da req-92909bf7-e950-4843-8f05-ff59d035a166 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2009926 Nov 24 14:00:41.923693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:41.940717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e6c679e7-cb66-4c24-83e7-2c4a45ce410c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:41.988358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e95081d-5803-4f3c-b306-ebe0fa29648f None None] DHCP port deletion for 793f3831-f3f5-426a-a5d5-dab329ae309c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:00:41.989145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Checking segment: {'id': '540ab5bb-29ab-454c-be59-755229bb8240', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:41.989653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network hostable DHCP agents. Network: 782f26dd-d3ff-4e1a-8ad4-5783128b14d5, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:42.033078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.039076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.056799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.066527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=0033b20f-e38f-4165-87c0-a822bd77c119,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:42.143223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:42.166086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.168020 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a7a49e2-1a24-4487-9537-514cda4aa4b3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.7199109 Nov 24 14:00:42.175993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42130) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:42.196116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-620895897'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:42.216690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:42.223417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.232634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:42.238596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cf9ed7be-e230-4679-b04a-94cf5611a421 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:42.285951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:42.313655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:42.338893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.339123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 782f26dd-d3ff-4e1a-8ad4-5783128b14d5) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:42.362927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.396094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:42.402837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=069052fe-ffd3-4364-a970-a83ecc7ff028,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:42.418309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:42.431382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.436269 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/069052fe-ffd3-4364-a970-a83ecc7ff028 HTTP/1.1" status: 204 len: 168 time: 1.8275971 Nov 24 14:00:42.436979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:42.437301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.443989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42136) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:42.457600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-942d9d80-9dee-4f91-89ea-94d7756d4eba None None] Network e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 could not be found, it might have been deleted concurrently. {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:205}} Nov 24 14:00:42.471891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:42.475587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.522614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.526279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:42.532183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0dc5db51-4137-4538-9c32-ac7b7d35bf00 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:42.537512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:42.564193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21b6f1eb-568e-48e7-9616-c8a6c22228a3 None None] Network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:42.576764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f96c4df-040b-4970-91f6-5cd59a95543b None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:42.588691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 870} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:42.610685 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 3.7896073 Nov 24 14:00:42.611793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:42.619038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f87380d2-8541-4a93-a06c-8881120e69f4 None None] Provisioning for port e6c679e7-cb66-4c24-83e7-2c4a45ce410c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:42.660810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=c65e22f1-d7f8-4a53-bcd7-9220155510be,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:42.664014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:42.709582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.709937 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment 78b0ca0d-865e-42f7-acb6-95fcbd295329 of type vlan for network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 Nov 24 14:00:42.821814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.837180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.869865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c9646eb3-12b1-40d9-86ec-59f349fd38a8']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:42.892544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a3214c-a365-476b-b3f8-b2d3ba472b33 req-c957e068-72fe-4df3-a82c-b4efeb0ecb61 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:42.893912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8a3214c-a365-476b-b3f8-b2d3ba472b33 req-c957e068-72fe-4df3-a82c-b4efeb0ecb61 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.3022358 Nov 24 14:00:42.895719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '31241fb6-2a44-4cc8-ab83-95447daa412b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:42.896073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '31241fb6-2a44-4cc8-ab83-95447daa412b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:42.941201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.944827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-dd5b2b5f-fdef-4f26-92f8-e9e28c71b5d6 None None] Could not find standard attr ID for object ed33b300-d2a1-43db-9034-2375609e0cb4. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:00:42.982743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.985623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:42.989540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:42.990133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.000260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41daf819-54a6-47c4-9a63-9fa0b1470438 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:43.041698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 886 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:43.042234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:43.060733 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:43.126318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfb822d1-a0a1-41ab-91d4-6c5faf066e73 None None] Network c9646eb3-12b1-40d9-86ec-59f349fd38a8 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:43.202125 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8a3214c-a365-476b-b3f8-b2d3ba472b33 req-6f3be2ec-2d9c-4399-9566-0de817f756ae tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2952836 Nov 24 14:00:43.222672 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.0385959 Nov 24 14:00:43.229276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=ed9fdeca-b2cd-4a96-bfea-16bfc7348534,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:43.232620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:43.234597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42148) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:43.245984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:43.291927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.294062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:43.296553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.302293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.309933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:43.362612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79a6741a-c744-464e-b5ed-6914a64ecbd8 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:43.401489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=c9646eb3-12b1-40d9-86ec-59f349fd38a8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:43.404159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:43.408567 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/c9646eb3-12b1-40d9-86ec-59f349fd38a8 HTTP/1.1" status: 204 len: 168 time: 1.7163973 Nov 24 14:00:43.419774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42152) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:43.428386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-19583859'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:43.436188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:43.444195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:43.447879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:43.450338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:43.457123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:43.459840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:43.463290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:43.472379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:43.482682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:43.486226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.500297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:43.508239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port e6c679e7-cb66-4c24-83e7-2c4a45ce410c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:43.532612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=0b2d76d5-b6b9-4413-ac83-8217abd0dda6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:43.548865 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-1d5b9fc0-f7c6-46b6-8963-5279f376e1ab service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 1098 time: 1.0163562 Nov 24 14:00:43.553375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:43.561653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet 1779010f-68b3-4ec7-a60a-89ab2050355b {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:43.610077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.615362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 879} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:43.625514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.632715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e6c679e7-cb66-4c24-83e7-2c4a45ce410c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:43.633089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.657544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.657985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment e9932827-0473-4f49-9ee5-9ae9f3c80f46 of type vlan for network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e Nov 24 14:00:43.797226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.809520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.824176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-e653b4d3-8e0f-4ce9-894d-0a81384d4bc1', 'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1', 'tenant_id': 'b8414925e97644acb99608415dc5b4ae', 'fixed_ips': [{'subnet_id': '926b5b49-d1e0-4718-b7d3-197256880fc2'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:43.825004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.874963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.932604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-212232fe-ec85-440c-854b-979390106a07 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7fd9f3e6-c392-4d6c-8962-b410a532a8df', 'network_id': '7fd9f3e6-c392-4d6c-8962-b410a532a8df', 'tenant_id': 'c68ea59217504ce9802abf43743e4c8f', 'fixed_ips': [{'subnet_id': '0b2d76d5-b6b9-4413-ac83-8217abd0dda6'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:43.933709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-212232fe-ec85-440c-854b-979390106a07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.947335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7fd9f3e6-c392-4d6c-8962-b410a532a8df']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:43.961128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.967166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:43.967692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:43.968496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c6a6c836-38d3-46f8-93b0-5469de5500d6') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:43.968794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c6a6c836-38d3-46f8-93b0-5469de5500d6') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:43.975429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3f7718eb-b6b4-4c56-a3b3-85ffae7b430f tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:44.063821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.108061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.109955 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 778 time: 0.6890900 Nov 24 14:00:44.114338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42156) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:44.120141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 850 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:44.120697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.130747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:44.134757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:44.138096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'New_network'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:44.195337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:44.209102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-782f26dd-d3ff-4e1a-8ad4-5783128b14d5', 'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5', 'tenant_id': 'b8414925e97644acb99608415dc5b4ae', 'fixed_ips': [{'subnet_id': '317499df-5667-4a3c-99c5-f2725d135ed1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:44.210214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:44.217267 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:44.222117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-103b1dcc-61b0-4560-bc72-0271fd94784c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:44.223572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-103b1dcc-61b0-4560-bc72-0271fd94784c service neutron] 10.222.0.47 "GET /v2.0/networks?id=7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 200 len: 912 time: 0.6598387 Nov 24 14:00:44.254388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.261282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e30435fb-8426-4b83-aea8-157fbc9aace9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:44.407555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.484377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.486033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=4c338938-af44-4fa4-90ed-2e1169df03ce,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:44.508217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.553139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3154c1fc-e4a7-46a8-ad5b-0ae1f9fa93a1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:44.561452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:44.580192 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-ea2737cc-6538-47cf-83f4-0e415eb4a002 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 200 len: 1001 time: 0.3459146 Nov 24 14:00:44.585764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/7fd9f3e6-c392-4d6c-8962-b410a532a8df HTTP/1.1" status: 204 len: 168 time: 3.0854337 Nov 24 14:00:44.597275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42162) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:44.685206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:44.685804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: ed9fdeca-b2cd-4a96-bfea-16bfc7348534, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:44.693135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Allocated IP 2001:db8::2 (e653b4d3-8e0f-4ce9-894d-0a81384d4bc1/926b5b49-d1e0-4718-b7d3-197256880fc2/0ad2af51-d7ae-4e48-8f37-10145e30fae9) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:44.693741 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f56270e-03ba-402b-890e-39adff1d347e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:44.694022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f56270e-03ba-402b-890e-39adff1d347e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:44.695798 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3f56270e-03ba-402b-890e-39adff1d347e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/0b2d76d5-b6b9-4413-ac83-8217abd0dda6 HTTP/1.1" status: 404 len: 337 time: 0.0975242 Nov 24 14:00:44.719808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42166) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:44.751460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.782868 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-0f8cf001-ac5a-4b1d-952a-03f923952b0f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:44.783305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0f8cf001-ac5a-4b1d-952a-03f923952b0f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:44.785021 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0f8cf001-ac5a-4b1d-952a-03f923952b0f tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/7fd9f3e6-c392-4d6c-8962-b410a532a8df HTTP/1.1" status: 404 len: 339 time: 0.0637197 Nov 24 14:00:44.795651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42170) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:44.843775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.855348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-82187051-5ceb-483f-bc53-85067cfa7fa7 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:44.976700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:44.979796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e is not hosted by any dhcp agent {{(pid=83525) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:226}} Nov 24 14:00:44.982209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-6070c95a-840e-47b7-ad44-e22bbdf7f375 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:44.983945 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-6070c95a-840e-47b7-ad44-e22bbdf7f375 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 200 len: 850 time: 0.1050231 Nov 24 14:00:44.984707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:44.985287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:44.989442 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "PUT /v2.0/networks/2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e HTTP/1.1" status: 200 len: 723 time: 0.8720670 Nov 24 14:00:44.996191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42174) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:45.012832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.019124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=7fd9f3e6-c392-4d6c-8962-b410a532a8df,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:45.027872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.475s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:45.064822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:45.094773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b0849a9-49c9-4298-80bc-c5b2945eecce None None] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:45.127901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ed9fdeca-b2cd-4a96-bfea-16bfc7348534) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:45.145182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:45.146199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.149472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:45.196996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 42b1bdf4-68b9-47df-8d46-bae330c84cdb is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:00:45.215252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.219487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.230666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.244446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.388s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:45.256879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:45.287516 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0500233 Nov 24 14:00:45.289198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port e6c679e7-cb66-4c24-83e7-2c4a45ce410c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,segment=NetworkSegment(4c66be1f-461b-43bb-83ba-3741548a7f5b),segment_id=4c66be1f-461b-43bb-83ba-3741548a7f5b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:45.296720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42178) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:45.350182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=1779010f-68b3-4ec7-a60a-89ab2050355b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:45.353266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6686c3c-ca47-415e-b720-628ff416bf19 None None] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:45.361574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:45.365075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:45.372201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2df20f-f11f-470d-abd6-f27dcae2dbe4 req-d664850c-001d-4cb6-aaf3-5921d3907787 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:45.373726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b2df20f-f11f-470d-abd6-f27dcae2dbe4 req-d664850c-001d-4cb6-aaf3-5921d3907787 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.7896721 Nov 24 14:00:45.373982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92a0f071-12ee-46d4-954e-5203ed3022d0 None None] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:45.386513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:45.419685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db730be8-d382-4daf-90e2-afb95a97f3a7 None None] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:45.455032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.486579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Allocated IP 2001:db8::2 (782f26dd-d3ff-4e1a-8ad4-5783128b14d5/317499df-5667-4a3c-99c5-f2725d135ed1/4b2646de-ed4e-43ae-acc9-d946a1160cdd) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:45.489963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f4faa88-6038-4278-971a-fba6ca014278 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:45.522000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b0849a9-49c9-4298-80bc-c5b2945eecce None None] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df could not be found, it might have been deleted concurrently. {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:205}} Nov 24 14:00:45.533672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.569256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:45.576939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:45.590312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:45.611711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:45.635998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c43c35a0-ba7c-4dc1-aa69-12a92d1033a3 None None] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:45.675567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.690353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:45.736246 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/1779010f-68b3-4ec7-a60a-89ab2050355b HTTP/1.1" status: 204 len: 168 time: 3.2870526 Nov 24 14:00:45.737191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42182) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:45.816918 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-d349d409-5e06-496a-87e6-401053c4036e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7c23cefd-d4e1-4241-a3d2-42622a5131e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.7875340 Nov 24 14:00:45.871540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:45.872227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7da14b50-cc36-4f2e-b51b-dbd5ff071da7 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:45.874935 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b2df20f-f11f-470d-abd6-f27dcae2dbe4 req-5812b715-4a2a-4038-8f2f-1c495c0611dd tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4405024 Nov 24 14:00:45.890869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c43c35a0-ba7c-4dc1-aa69-12a92d1033a3 None None] Network 7fd9f3e6-c392-4d6c-8962-b410a532a8df could not be found, it might have been deleted concurrently. {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:205}} Nov 24 14:00:45.958881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:45.963409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.045887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-517d2902-c58f-4f93-bdd2-c0e8507ec13e None None] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:46.081340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.119939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Transition to ACTIVE for port object 0ad2af51-d7ae-4e48-8f37-10145e30fae9 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:46.133067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3e788ede-d1dc-4162-9ec9-af902d8a4618']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.147153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ddc1db1a-7a30-49a5-8698-88c48d59cf7a None None] Provisioning complete for port e6c679e7-cb66-4c24-83e7-2c4a45ce410c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:46.147529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ddc1db1a-7a30-49a5-8698-88c48d59cf7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.175971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:46.175971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.220350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2369d7f9-fe11-469d-b449-964e2ab6f7f6') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.220642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2369d7f9-fe11-469d-b449-964e2ab6f7f6') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.245615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.246265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:46.249148 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-807a825a-0d4c-4551-8dee-37530ddfbd03 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4218993 Nov 24 14:00:46.266364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.776s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:46.333379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.334492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:46.352869 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] Sync routers for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:46.381482 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:46.386710 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.413123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 898 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:46.413123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.415609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Transition to ACTIVE for port object 0ad2af51-d7ae-4e48-8f37-10145e30fae9 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:46.426288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/42b1bdf4-68b9-47df-8d46-bae330c84cdb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.3306613 Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:46.433877 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:46.438969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42186) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:46.509585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.551826 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.570517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:46.571517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.582240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.587556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.620948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:46.622520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-66ac0644-2679-41e9-8c8c-0cd6fdc7e36e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:46.670130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=3e788ede-d1dc-4162-9ec9-af902d8a4618,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:46.672627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:46.690910 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/3e788ede-d1dc-4162-9ec9-af902d8a4618 HTTP/1.1" status: 204 len: 168 time: 1.8934617 Nov 24 14:00:46.693641 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:46.694830 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f1f3550-7627-4ed3-b47f-1875a020ec98 None None] The sync data for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:46.701916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42190) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:46.763994 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-2beb7fc9-f0d8-41e5-99ed-e881c9cd44d7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:46.764439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2beb7fc9-f0d8-41e5-99ed-e881c9cd44d7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:46.766110 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2beb7fc9-f0d8-41e5-99ed-e881c9cd44d7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/c919dab8-eb5d-4d04-b77e-e5fb108e8ab3 HTTP/1.1" status: 404 len: 337 time: 0.0632830 Nov 24 14:00:46.771250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42194) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:46.795033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71eec7fe-fe4b-4441-9ee6-68a54a73374b None None] Update dhcp port {'port': {'network_id': '2ad89193-4f35-4528-b799-6f2d3f48883c', 'fixed_ips': [{'subnet_id': '1779010f-68b3-4ec7-a60a-89ab2050355b'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8b37a6c8-c72a-40be-9fb0-ec417ef75899'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:00:46.828436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.835114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port 8b37a6c8-c72a-40be-9fb0-ec417ef75899, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b37a6c8-c72a-40be-9fb0-ec417ef75899,segment=NetworkSegment(15a5a84f-1167-41b0-ab16-80791aaacdf5),segment_id=15a5a84f-1167-41b0-ab16-80791aaacdf5)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:46.835660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.847564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ed739b5-1cbb-484b-98fd-a14c8b83cf3e tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:46.848090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7ed739b5-1cbb-484b-98fd-a14c8b83cf3e tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:46.859636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Allocated IP 2001:db8::1 (e653b4d3-8e0f-4ce9-894d-0a81384d4bc1/926b5b49-d1e0-4718-b7d3-197256880fc2/5558ef3a-d1ee-402e-baa2-fed4abd2597d) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:46.863261 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-07f0bdde-0468-4dbe-804b-5aa3a85968cd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:46.863710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-07f0bdde-0468-4dbe-804b-5aa3a85968cd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:46.869033 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-07f0bdde-0468-4dbe-804b-5aa3a85968cd tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5f72029d-372b-45b6-9e41-b150794fa59d HTTP/1.1" status: 404 len: 339 time: 0.0933554 Nov 24 14:00:46.869291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42198) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:46.871118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb65a2cb-4791-43b4-9a4a-978a0aae4c82 req-cfcab4b8-c579-4554-9f2e-393742447413 service neutron] 10.222.0.47 "GET /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5927520 Nov 24 14:00:46.902554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:46.970589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:46.990924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 8b37a6c8-c72a-40be-9fb0-ec417ef75899 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:47.012412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:47.032494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-13652e53-fd83-48ce-8ca5-42c2a17c0abe tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:47.063984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7ed739b5-1cbb-484b-98fd-a14c8b83cf3e tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:47.065140 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7ed739b5-1cbb-484b-98fd-a14c8b83cf3e tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports/0033b20f-e38f-4165-87c0-a822bd77c119 HTTP/1.1" status: 200 len: 911 time: 0.6241093 Nov 24 14:00:47.067874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Pushing event updated for resources: {'Port': ['ID=0ad2af51-d7ae-4e48-8f37-10145e30fae9,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:47.070464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:47.082936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42204) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:47.106513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.484s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:47.146304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-71eec7fe-fe4b-4441-9ee6-68a54a73374b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.173582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:47.175214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.192652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.197932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:47.252924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=8b37a6c8-c72a-40be-9fb0-ec417ef75899,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:47.258357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:47.262380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.271599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:47.332071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Transition to ACTIVE for port object 5558ef3a-d1ee-402e-baa2-fed4abd2597d will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:47.352219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.422887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.448079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71eec7fe-fe4b-4441-9ee6-68a54a73374b None None] Host dv-neutron-818151-2-hyperv tried to update port 8b37a6c8-c72a-40be-9fb0-ec417ef75899 which no longer exists. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:313}} Nov 24 14:00:47.452838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2ad89193-4f35-4528-b799-6f2d3f48883c']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:47.456072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Transition to ACTIVE for port object 4b2646de-ed4e-43ae-acc9-d946a1160cdd will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:47.466799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '15a5a84f-1167-41b0-ab16-80791aaacdf5') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:47.467075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '15a5a84f-1167-41b0-ab16-80791aaacdf5') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:47.486534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.512271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c2980665-37be-4832-82c0-1dead3b5fed4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:47.525669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Attempting to bind port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:47.526128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Attempting to bind port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'a488562a-2b1f-489f-9b06-8fff41be8d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:47.526504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Attempting to bind port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 on network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:47.551948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.569459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Transition to ACTIVE for port object 4b2646de-ed4e-43ae-acc9-d946a1160cdd will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:47.581636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=bc156b09-3e50-468f-8987-fbed0a846862,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:47.583652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.551s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:47.596226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:47.596600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Checking segment: {'id': 'a488562a-2b1f-489f-9b06-8fff41be8d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:47.597045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.597385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Bound using segment: {'id': 'a488562a-2b1f-489f-9b06-8fff41be8d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:47.597871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Bound port: 0ad2af51-d7ae-4e48-8f37-10145e30fae9, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a488562a-2b1f-489f-9b06-8fff41be8d8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 866, 'network_id': 'e653b4d3-8e0f-4ce9-894d-0a81384d4bc1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:47.598248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.606827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.623436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.630180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:47.633376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:47.635942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 873 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:47.636191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.651985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:47.653854 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:47.656297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:47.656297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.667185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Port': ['ID=5558ef3a-d1ee-402e-baa2-fed4abd2597d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:47.673599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:47.680659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Provisioning complete for port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:47.681057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.756969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.757996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-026780ad-51cb-47d4-a774-094e95aebfa2 None None] Network 2ad89193-4f35-4528-b799-6f2d3f48883c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:47.827208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.837719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:47.895304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:47.903151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=2ad89193-4f35-4528-b799-6f2d3f48883c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:47.911394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e6c679e7-cb66-4c24-83e7-2c4a45ce410c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:47.921661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:47.937751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': 'e9932827-0473-4f49-9ee5-9ae9f3c80f46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:47.938379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:48.037264 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/2ad89193-4f35-4528-b799-6f2d3f48883c HTTP/1.1" status: 204 len: 168 time: 2.2850971 Nov 24 14:00:48.041160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting subnet 5cf032f8-f974-4876-9477-1e50aea9e301 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:48.042840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42208) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:48.044351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.111484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.118878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.185171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:48.185983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Pushing event updated for resources: {'Port': ['ID=4b2646de-ed4e-43ae-acc9-d946a1160cdd,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:48.198201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a4a8c6-493c-42b0-a225-7d21e8464654 req-817f7721-a914-43ff-b384-7b3eea68828c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:48.209476 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a4a8c6-493c-42b0-a225-7d21e8464654 req-817f7721-a914-43ff-b384-7b3eea68828c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 1.0408435 Nov 24 14:00:48.210873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:48.228899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.595s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:48.232113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Allocated IP 172.20.0.2 (ed9fdeca-b2cd-4a96-bfea-16bfc7348534/4c338938-af44-4fa4-90ed-2e1169df03ce/076ab8d4-d3e1-4483-9297-704d0d112470) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:48.234600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:48.328703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] For port 0ad2af51-d7ae-4e48-8f37-10145e30fae9, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:48.430126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] For port 0ad2af51-d7ae-4e48-8f37-10145e30fae9, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0ad2af51-d7ae-4e48-8f37-10145e30fae9,segment=NetworkSegment(a488562a-2b1f-489f-9b06-8fff41be8d8d),segment_id=a488562a-2b1f-489f-9b06-8fff41be8d8d)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:48.543433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.547316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dc9a24d-ce8d-4f45-bd5f-6b2cf31af355 None None] DHCP port deletion for 2ad89193-4f35-4528-b799-6f2d3f48883c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:00:48.558852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:48.559099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:48.568386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64b0fc0b-2e0b-4fe0-9b5c-ac5a714a4143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:48.569531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64b0fc0b-2e0b-4fe0-9b5c-ac5a714a4143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:00:48.580773 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a4a8c6-493c-42b0-a225-7d21e8464654 req-4c341f8b-a80c-4f3b-8f00-94a588d319d6 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3553262 Nov 24 14:00:48.582703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.628984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:48.647943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64b0fc0b-2e0b-4fe0-9b5c-ac5a714a4143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:00:48.648211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:48.648599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.649114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-64b0fc0b-2e0b-4fe0-9b5c-ac5a714a4143 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 843 time: 0.6050770 Nov 24 14:00:48.656249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42212) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:48.722189 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.7237263 Nov 24 14:00:48.725177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42216) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:48.741927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:48.762076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.777732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.778100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.783597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eae7ec1b-e5b4-43ee-b0eb-a7d2bfcbd2af tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:48.821355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85425c90-41c9-43fa-a96d-e8eb43d5584b None None] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:48.861877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e6c679e7-cb66-4c24-83e7-2c4a45ce410c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:48.862066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.862322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.871436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-269895eb-66e2-49b2-8e5c-ae749887ae9b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:48.918406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Attempting to bind port 4b2646de-ed4e-43ae-acc9-d946a1160cdd on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:48.919404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Attempting to bind port 4b2646de-ed4e-43ae-acc9-d946a1160cdd by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '540ab5bb-29ab-454c-be59-755229bb8240', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:48.919965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Attempting to bind port 4b2646de-ed4e-43ae-acc9-d946a1160cdd on network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:48.922500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=5cf032f8-f974-4876-9477-1e50aea9e301,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:48.940000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:48.949437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2023922'] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:48.979036 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fbd2bf93-ccc8-4805-839f-2a876a4a2e54 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.3160763 Nov 24 14:00:48.979990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42220) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:48.987523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Pushing event updated for resources: {'Port': ['ID=0ad2af51-d7ae-4e48-8f37-10145e30fae9,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:48.990464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b51729ad-78b2-474f-ae68-89aec1d16808 None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:49.011625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8100982'] for subnet, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.013507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-585061243'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:49.016663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.458s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:49.030478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:49.062088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:49.062469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Checking segment: {'id': '540ab5bb-29ab-454c-be59-755229bb8240', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:49.063093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.063657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Bound using segment: {'id': '540ab5bb-29ab-454c-be59-755229bb8240', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:49.064335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Bound port: 4b2646de-ed4e-43ae-acc9-d946a1160cdd, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '540ab5bb-29ab-454c-be59-755229bb8240', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 860, 'network_id': '782f26dd-d3ff-4e1a-8ad4-5783128b14d5'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:49.064720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.084280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:49.090870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Port': ['ID=5558ef3a-d1ee-402e-baa2-fed4abd2597d,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:49.095685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:49.099999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.317s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:49.105870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:49.123893 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/5cf032f8-f974-4876-9477-1e50aea9e301 HTTP/1.1" status: 204 len: 168 time: 2.2535436 Nov 24 14:00:49.129026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42224) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:49.159601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Provisioning for port 0033b20f-e38f-4165-87c0-a822bd77c119 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:49.189974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:49.192964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.200232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Provisioning complete for port 0033b20f-e38f-4165-87c0-a822bd77c119 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:49.200585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.258117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:49.262961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:49.447159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:00:49.520382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8771276033028', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-7895437'] for subnet, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.536420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:49.558625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.558983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment b9307727-f5cf-42b9-89ca-97f472e49f3e of type vlan for network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 Nov 24 14:00:49.576870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:49.578107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.581661 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "PUT /v2.0/subnets/bc156b09-3e50-468f-8987-fbed0a846862 HTTP/1.1" status: 200 len: 806 time: 0.8518720 Nov 24 14:00:49.592115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42228) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:49.629696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Port 0033b20f-e38f-4165-87c0-a822bd77c119 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:49.679789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting subnet 6f1c8f54-9558-4f32-9a44-ac6ae00612fa {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:49.690965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.713111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.729383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.738496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.749374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=bc156b09-3e50-468f-8987-fbed0a846862,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:49.779230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e', 'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': 'bc156b09-3e50-468f-8987-fbed0a846862'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:49.780094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.794227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Transition to ACTIVE for port object 076ab8d4-d3e1-4483-9297-704d0d112470 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:49.805949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] For port 4b2646de-ed4e-43ae-acc9-d946a1160cdd, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:49.876802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Transition to ACTIVE for port object 076ab8d4-d3e1-4483-9297-704d0d112470 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:49.878158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] For port 4b2646de-ed4e-43ae-acc9-d946a1160cdd, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b2646de-ed4e-43ae-acc9-d946a1160cdd,segment=NetworkSegment(540ab5bb-29ab-454c-be59-755229bb8240),segment_id=540ab5bb-29ab-454c-be59-755229bb8240)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:49.879240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Provisioning complete for port f2b0ead3-eede-48e5-b87d-8e28157c8010 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:49.879620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8dfa9820-e09c-470a-a3f0-22abcd1aa609 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.951540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:49.963918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:49.978669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] It took 0.23 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:49.998438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.462s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:50.000808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0ad2af51-d7ae-4e48-8f37-10145e30fae9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:50.017125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.023742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.078723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.082488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:50.083067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.091802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:50.127885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:50.162802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:50.182159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:50.195369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.196773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=1e1d2ca2-a61a-4d37-86a8-9ec104229521,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:50.200478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:50.234156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.20.0.1 (ed9fdeca-b2cd-4a96-bfea-16bfc7348534/4c338938-af44-4fa4-90ed-2e1169df03ce/3fb16aee-b0cc-4ee2-879b-e7b58265fce7) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:50.272535 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 1.2914414 Nov 24 14:00:50.275983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42234) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:50.282709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:50.332665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Allocated IP 172.20.0.2 (2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e/bc156b09-3e50-468f-8987-fbed0a846862/409138ad-a211-40f2-b72d-97e091ac2ef8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:50.396796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a666aa6-0f2f-45aa-8b49-89aadd8d4e6a req-d4bae060-076b-4ab6-81eb-844b5d255c2a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:50.404339 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1a666aa6-0f2f-45aa-8b49-89aadd8d4e6a req-d4bae060-076b-4ab6-81eb-844b5d255c2a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.4742837 Nov 24 14:00:50.430164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Pushing event updated for resources: {'Port': ['ID=4b2646de-ed4e-43ae-acc9-d946a1160cdd,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:50.469978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.484705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:00:50.508160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.544s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:50.512391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:50.518014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-305d9133-e3fe-441d-89e9-babc09b95fdc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.474s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:50.533192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.555813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:50.556635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:50.564946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:50.581886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:50.596201 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1a666aa6-0f2f-45aa-8b49-89aadd8d4e6a req-fb35d01b-8d6d-4c87-b1be-8ae2700403e9 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1909223 Nov 24 14:00:50.613882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.625025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:50.627047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2d2e672-8979-49a2-a151-8c40c95239b8 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:50.717175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.849331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3b8320c-3ba8-4e05-9e24-0ea3268adc9d None None] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:50.900236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8:1::1 (ac1bda5c-7660-4f44-aab3-2ae0cf38a180/eab0d0fe-90d2-4c39-b7fb-965833a7b41a/989a4f85-5419-4ef4-884f-2ae1dc8f5397) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:50.917851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:50.918587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a5434a92-2c0d-40e9-8b54-8ad940d6325d tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:50.933189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:50.972226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=6f1c8f54-9558-4f32-9a44-ac6ae00612fa,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:50.975338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:50.990757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:50.997279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.000659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.026978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Router d8199beb-49b1-48d9-ab92-543c1469b3ae is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:00:51.031984 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/6f1c8f54-9558-4f32-9a44-ac6ae00612fa HTTP/1.1" status: 204 len: 168 time: 1.9015272 Nov 24 14:00:51.052970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42240) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:51.079650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Attempting to bind port 076ab8d4-d3e1-4483-9297-704d0d112470 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:51.080329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Attempting to bind port 076ab8d4-d3e1-4483-9297-704d0d112470 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:51.080534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Attempting to bind port 076ab8d4-d3e1-4483-9297-704d0d112470 on network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:51.109027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Pushing event updated for resources: {'Port': ['ID=076ab8d4-d3e1-4483-9297-704d0d112470,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:51.124984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.607s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:51.127813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:51.139847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:51.152811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:51.165901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:51.167599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:51.168088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Checking segment: {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:51.168549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.169107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Bound using segment: {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:51.169644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Bound port: 076ab8d4-d3e1-4483-9297-704d0d112470, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:51.170045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.204897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b37a6c8-c72a-40be-9fb0-ec417ef75899 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:51.304384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8b37a6c8-c72a-40be-9fb0-ec417ef75899 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:51.304728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b37a6c8-c72a-40be-9fb0-ec417ef75899 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:51.358218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.390688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Could not find standard attr ID for object 8b37a6c8-c72a-40be-9fb0-ec417ef75899. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:00:51.425535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.434506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.439351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:51.442725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d3c47a6-759d-4735-886e-e0c7c8df9061 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:51.459375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Transition to ACTIVE for port object 409138ad-a211-40f2-b72d-97e091ac2ef8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:51.467070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.484363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] Sync routers for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:51.501906 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.8683484 Nov 24 14:00:51.508110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42244) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:51.512976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:51.513312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.569985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 989a4f85-5419-4ef4-884f-2ae1dc8f5397 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:51.588920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] For port 076ab8d4-d3e1-4483-9297-704d0d112470, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:51.591522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Transition to ACTIVE for port object 409138ad-a211-40f2-b72d-97e091ac2ef8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:51.595933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Provisioning complete for port e6c679e7-cb66-4c24-83e7-2c4a45ce410c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:51.596246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.652301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46314707-8d44-417d-9926-459d502ba573 req-4e54f3ac-d869-4c14-8846-55ecfd8b98f9 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:51.663055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.668072 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-46314707-8d44-417d-9926-459d502ba573 req-4e54f3ac-d869-4c14-8846-55ecfd8b98f9 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.7449214 Nov 24 14:00:51.671988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.673206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d5bbbfce-948c-4262-a09a-2972e0f8c618 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:51.677961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=96eb2a88-9c78-4914-a466-b197ad9fdbb0,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:51.681175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:51.689070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': 'b9307727-f5cf-42b9-89ca-97f472e49f3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:51.689431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: 1e1d2ca2-a61a-4d37-86a8-9ec104229521, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:00:51.719742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] For port 076ab8d4-d3e1-4483-9297-704d0d112470, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=076ab8d4-d3e1-4483-9297-704d0d112470,segment=NetworkSegment(78b0ca0d-865e-42f7-acb6-95fcbd295329),segment_id=78b0ca0d-865e-42f7-acb6-95fcbd295329)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:51.733618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:51.734351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:51.743643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:00:51.769970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 1e1d2ca2-a61a-4d37-86a8-9ec104229521) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:51.774789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:51.775941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.804298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.810630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.831511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:51.877024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.5988016 Nov 24 14:00:51.877908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42248) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:51.888031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Pushing event updated for resources: {'Port': ['ID=409138ad-a211-40f2-b72d-97e091ac2ef8,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:51.892347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521', 'name': 'tempest-PortsTestJSON-1720741424'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:51.898753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d2d8fee-22b6-44c6-bf46-855d2a9d8c12 None None] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:51.932393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:51.936346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:51.937363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:51.975848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=bc156b09-3e50-468f-8987-fbed0a846862,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:51.978074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:51.980026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:51.994371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-367d02e4-05a7-4b4f-90ca-c4776c370fc5 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:52.015685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:52.100434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:52.119727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:52.123648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:52.129684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:52.132743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:52.135531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b2646de-ed4e-43ae-acc9-d946a1160cdd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:52.152677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:52.155988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:52.193620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 7a9f37d1-dffe-421c-b160-76a485626e1b yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:52.345891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a0ede38-80fa-4bd9-95c0-1f9271ec36b1 None None] Network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:52.365963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:52.435888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Pushing event updated for resources: {'Port': ['ID=076ab8d4-d3e1-4483-9297-704d0d112470,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:52.446728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.431s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:52.465299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:52.470042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:52.588408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99063b27-4a83-4d01-8444-1ee5902043e2 None None] Network b44ba3f1-4dca-4bbb-b72d-64df0deaa233 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:52.673849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=989a4f85-5419-4ef4-884f-2ae1dc8f5397,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:52.683701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.10 (1e1d2ca2-a61a-4d37-86a8-9ec104229521/96eb2a88-9c78-4914-a466-b197ad9fdbb0/7a9f37d1-dffe-421c-b160-76a485626e1b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:52.687919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:52.688792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:52.774852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.780s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:52.777036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:52.777639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-631d6937-847e-4ac3-8565-8ee6c8008cb6 None None] The sync data for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:52.841724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-46314707-8d44-417d-9926-459d502ba573 req-f4cc615b-498a-4065-a3c7-ac9aa3fcbf3b tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.1722615 Nov 24 14:00:52.854882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] For port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,segment=NetworkSegment(b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0),segment_id=b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:52.859153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:52.875439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:52.888235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.059471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.201847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Calling delete_port for 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:53.204018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Provisioning for port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:53.250908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:53.259132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Provisioning complete for port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:53.259898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.317810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.380443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Attempting to bind port 409138ad-a211-40f2-b72d-97e091ac2ef8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:53.381082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Attempting to bind port 409138ad-a211-40f2-b72d-97e091ac2ef8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'e9932827-0473-4f49-9ee5-9ae9f3c80f46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:53.381818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Attempting to bind port 409138ad-a211-40f2-b72d-97e091ac2ef8 on network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:53.394059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e9932827-0473-4f49-9ee5-9ae9f3c80f46') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:53.394362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e9932827-0473-4f49-9ee5-9ae9f3c80f46') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:53.416392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:53.416780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Checking segment: {'id': 'e9932827-0473-4f49-9ee5-9ae9f3c80f46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:53.417191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.417590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Bound using segment: {'id': 'e9932827-0473-4f49-9ee5-9ae9f3c80f46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:53.418077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Bound port: 409138ad-a211-40f2-b72d-97e091ac2ef8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9932827-0473-4f49-9ee5-9ae9f3c80f46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:53.418460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.438034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.452838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object 7a9f37d1-dffe-421c-b160-76a485626e1b will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:53.479830 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-bc5c9ad9-4ae1-4bcf-84ca-0ed880a7d92e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:00:53.484376 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bc5c9ad9-4ae1-4bcf-84ca-0ed880a7d92e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.9747961 Nov 24 14:00:53.485050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42256) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:53.552091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] For port 409138ad-a211-40f2-b72d-97e091ac2ef8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:53.558159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] For port 409138ad-a211-40f2-b72d-97e091ac2ef8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=409138ad-a211-40f2-b72d-97e091ac2ef8,segment=NetworkSegment(e9932827-0473-4f49-9ee5-9ae9f3c80f46),segment_id=e9932827-0473-4f49-9ee5-9ae9f3c80f46)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:53.607465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.620519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fe4ad95f-4ff2-4ba4-8d1f-3eb4f09730be None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:53.708232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.720974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Pushing event updated for resources: {'Port': ['ID=409138ad-a211-40f2-b72d-97e091ac2ef8,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:53.722626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:53.821349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:53.830767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=7a9f37d1-dffe-421c-b160-76a485626e1b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:53.833192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4b2646de-ed4e-43ae-acc9-d946a1160cdd completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:53.834911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.845034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:53.856895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:53.858895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:53.867233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:53.873345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.894950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64b4be5f-56fa-4309-b703-555b36b06cb2 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:53.939820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:53.940444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.953372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No DVR routers for this DVR port 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:53.955787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:53.985992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 879 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:53.986504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.004568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Port': ['ID=8b0a6063-b5cd-4e86-828e-4d929cbd7a73,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:54.006933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:54.012012 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:54.042207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 2.1560602 Nov 24 14:00:54.072657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9490f427-e9b9-441f-a778-0a43d6fb4d7c None None] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:54.075425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42260) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:54.152317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] For port 0ad2af51-d7ae-4e48-8f37-10145e30fae9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0ad2af51-d7ae-4e48-8f37-10145e30fae9,segment=NetworkSegment(a488562a-2b1f-489f-9b06-8fff41be8d8d),segment_id=a488562a-2b1f-489f-9b06-8fff41be8d8d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:54.154407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 076ab8d4-d3e1-4483-9297-704d0d112470 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:54.203826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48b5ae1e-07ac-4b8d-984c-31654ff1324b None None] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:54.215378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.238959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.349910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:54.355911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.395625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57a611f5-de88-49b5-989b-0526e0652106 None None] DHCP port deletion for b44ba3f1-4dca-4bbb-b72d-64df0deaa233 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:00:54.429675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521', 'name': 'tempest-PortsTestJSON-1773402323'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:54.514601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-1e1d2ca2-a61a-4d37-86a8-9ec104229521', 'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': '96eb2a88-9c78-4914-a466-b197ad9fdbb0'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:00:54.515414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.530960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b44ba3f1-4dca-4bbb-b72d-64df0deaa233']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:54.548194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f7fa05-ac2f-43a7-82ef-f11879fa60d7 req-c06786f6-f426-4718-ba0c-874c3d65d995 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:54.556171 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-46f7fa05-ac2f-43a7-82ef-f11879fa60d7 req-c06786f6-f426-4718-ba0c-874c3d65d995 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 1.0907276 Nov 24 14:00:54.669240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Pushing event updated for resources: {'Port': ['ID=0ad2af51-d7ae-4e48-8f37-10145e30fae9,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:54.694437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:54.694649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b7e2ff9e-927d-43cb-b6cc-f2895ec0c3a0') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:54.713693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:00:54.713693 dv-neutron-818151-2-hyperv neutron-server[83525]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:00:54.713693 dv-neutron-818151-2-hyperv neutron-server[83525]: [parameters: {'id': '2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e'}] Nov 24 14:00:54.713693 dv-neutron-818151-2-hyperv neutron-server[83525]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:54.714230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:54.720047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Provisioning complete for port 0033b20f-e38f-4165-87c0-a822bd77c119 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:54.720405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.747791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.398s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:54.753012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.858133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Port 0033b20f-e38f-4165-87c0-a822bd77c119 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:54.864399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.866394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 076ab8d4-d3e1-4483-9297-704d0d112470 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:54.919411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port 5558ef3a-d1ee-402e-baa2-fed4abd2597d {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:54.920637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.937147 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-46f7fa05-ac2f-43a7-82ef-f11879fa60d7 req-823d8b34-cab3-4099-9302-6cbb7dae268f tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3798940 Nov 24 14:00:54.938114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 896 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:54.938510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:54.958706 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:54.970319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Provisioning complete for port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:54.970695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:54.993787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:55.013912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Allocated IP 172.20.0.2 (1e1d2ca2-a61a-4d37-86a8-9ec104229521/96eb2a88-9c78-4914-a466-b197ad9fdbb0/d580fe44-fe44-4bc6-a33e-8500c695acff) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:55.046057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:55.052369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1a41ebf-58a6-4b37-9b5b-9fbbf69992dd None None] Network 2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:55.076106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:55.097022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:55.109459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:00:55.128931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.129178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.138667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.140694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5671242d-2825-4153-9ad1-94dadebb10b5 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:55.155607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.161868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:55.165349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.185301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.186123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.195382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=b44ba3f1-4dca-4bbb-b72d-64df0deaa233,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:55.209310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:55.210460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4c980f2-6fad-465d-b1fb-ec1aed3bd370 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.016s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:55.302244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.324406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.340010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port b60d3a01-8a0b-4585-bfae-a8e7618619d3 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:55.388343 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/b44ba3f1-4dca-4bbb-b72d-64df0deaa233 HTTP/1.1" status: 204 len: 168 time: 4.3270621 Nov 24 14:00:55.414265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42266) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.426055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.430947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Calling delete_port for 5558ef3a-d1ee-402e-baa2-fed4abd2597d owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:55.506052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-449f9a34-4558-4136-b9b2-68993c6a8b57 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:55.506405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.506743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-449f9a34-4558-4136-b9b2-68993c6a8b57 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:55.511973 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-449f9a34-4558-4136-b9b2-68993c6a8b57 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/f33906ec-ec54-4296-93fb-8e8e38df0c3a HTTP/1.1" status: 404 len: 337 time: 0.0866578 Nov 24 14:00:55.512780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42270) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.529806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port 409138ad-a211-40f2-b72d-97e091ac2ef8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:55.530067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.539903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Provisioning complete for port f2b0ead3-eede-48e5-b87d-8e28157c8010 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:55.540374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.562990 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-a61f0df0-ba16-4aa6-8516-86be2cc38fe1 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:55.563592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a61f0df0-ba16-4aa6-8516-86be2cc38fe1 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:55.568018 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a61f0df0-ba16-4aa6-8516-86be2cc38fe1 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5056ad91-892d-44f2-ae6f-f9acdcef87ef HTTP/1.1" status: 404 len: 339 time: 0.0515373 Nov 24 14:00:55.568787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42274) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.599590 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:00:55.659871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c9644967-93a2-42a5-bd9f-7b8fd7d431af tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:55.660721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c9644967-93a2-42a5-bd9f-7b8fd7d431af tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:55.666666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c9644967-93a2-42a5-bd9f-7b8fd7d431af tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/858eff41-9115-44ff-b497-4052830a5589 HTTP/1.1" status: 404 len: 337 time: 0.0896056 Nov 24 14:00:55.668513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42278) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.725103 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-9c21bfbe-539c-417a-912a-669006252d0e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:55.725544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9c21bfbe-539c-417a-912a-669006252d0e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:55.730573 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9c21bfbe-539c-417a-912a-669006252d0e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/5b56fd90-6946-415b-b771-ba46b2067f23 HTTP/1.1" status: 404 len: 339 time: 0.0601537 Nov 24 14:00:55.734171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42282) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.737557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.775989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:55.788481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:55.789706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Transition to ACTIVE for port object d580fe44-fe44-4bc6-a33e-8500c695acff will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:55.795234 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-dea4b8d1-4558-41da-b88e-c1fc768733ee tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:55.795234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dea4b8d1-4558-41da-b88e-c1fc768733ee tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:55.799003 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dea4b8d1-4558-41da-b88e-c1fc768733ee tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/20efb27a-2359-4236-8bbf-9028a4356f18 HTTP/1.1" status: 404 len: 337 time: 0.0609331 Nov 24 14:00:55.803374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42286) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.831490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Transition to ACTIVE for port object d580fe44-fe44-4bc6-a33e-8500c695acff will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:55.838844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:55.845783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:55.884507 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-4bbffa21-68dc-4f27-b0a7-ec9781ca7695 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:55.885425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4bbffa21-68dc-4f27-b0a7-ec9781ca7695 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:55.894249 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4bbffa21-68dc-4f27-b0a7-ec9781ca7695 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/f8ac2805-72a0-426a-98a5-e7cbbabc008a HTTP/1.1" status: 404 len: 339 time: 0.0898638 Nov 24 14:00:55.902555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42290) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:55.921353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:55.925325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:55.929941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:55.932924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Pushing event updated for resources: {'Port': ['ID=d580fe44-fe44-4bc6-a33e-8500c695acff,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:55.936544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:55.970356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Could not find standard attr ID for object 8b0a6063-b5cd-4e86-828e-4d929cbd7a73. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:00:56.028216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=989a4f85-5419-4ef4-884f-2ae1dc8f5397,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:56.031900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.821s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:56.048926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.544s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:56.049345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0ad2af51-d7ae-4e48-8f37-10145e30fae9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:56.114062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Attempting to bind port d580fe44-fe44-4bc6-a33e-8500c695acff on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:00:56.114653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Attempting to bind port d580fe44-fe44-4bc6-a33e-8500c695acff by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b9307727-f5cf-42b9-89ca-97f472e49f3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:00:56.115794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Attempting to bind port d580fe44-fe44-4bc6-a33e-8500c695acff on network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:00:56.125125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning complete for port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:56.125667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.177991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:00:56.178551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Checking segment: {'id': 'b9307727-f5cf-42b9-89ca-97f472e49f3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:00:56.179081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.179594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Bound using segment: {'id': 'b9307727-f5cf-42b9-89ca-97f472e49f3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:00:56.180968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Bound port: d580fe44-fe44-4bc6-a33e-8500c695acff, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b9307727-f5cf-42b9-89ca-97f472e49f3e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1e1d2ca2-a61a-4d37-86a8-9ec104229521'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:00:56.181502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.296519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting subnet 03e718a2-d2ca-43e8-a6a1-1815ea229650 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:00:56.332950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.335532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:56.336051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.376324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] For port d580fe44-fe44-4bc6-a33e-8500c695acff, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:00:56.396967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] For port d580fe44-fe44-4bc6-a33e-8500c695acff, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d580fe44-fe44-4bc6-a33e-8500c695acff,segment=NetworkSegment(b9307727-f5cf-42b9-89ca-97f472e49f3e),segment_id=b9307727-f5cf-42b9-89ca-97f472e49f3e)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:00:56.397245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7d080579-737d-4dc3-a2de-9d449766c1e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:56.399435 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7d080579-737d-4dc3-a2de-9d449766c1e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.47 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.5962720 Nov 24 14:00:56.407583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.413402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.416413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c40d6237-557e-47f4-a8f0-358eeec1722e tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:56.421176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5b784943-0e65-4dad-a141-ed21ac253ba5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:56.452402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.457519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:56.472376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.423s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:56.529651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Pushing event updated for resources: {'Port': ['ID=d580fe44-fe44-4bc6-a33e-8500c695acff,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:56.537312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Port': ['ID=5558ef3a-d1ee-402e-baa2-fed4abd2597d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:56.541676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:56.545341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:56.548594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:56.566306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:56.566909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning for port 076ab8d4-d3e1-4483-9297-704d0d112470 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:56.581226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning complete for port 076ab8d4-d3e1-4483-9297-704d0d112470 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:56.581868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.630862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-382a442f-944f-4cf5-ad4c-fb48ade9aade {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:00:56.631173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:00:56.643067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Deleting port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:56.643299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.753776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:56.816780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e496a6-1cb3-41fc-ac88-74d0a6281a36 req-f7211a13-cfa1-4fa9-a832-5958cb769f49 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:56.821111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.826205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-43e496a6-1cb3-41fc-ac88-74d0a6281a36 req-f7211a13-cfa1-4fa9-a832-5958cb769f49 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6290593 Nov 24 14:00:56.840752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:56.841265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b0a6063-b5cd-4e86-828e-4d929cbd7a73 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:56.900725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] For port 076ab8d4-d3e1-4483-9297-704d0d112470, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=076ab8d4-d3e1-4483-9297-704d0d112470,segment=NetworkSegment(78b0ca0d-865e-42f7-acb6-95fcbd295329),segment_id=78b0ca0d-865e-42f7-acb6-95fcbd295329)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:56.908761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:56.913976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-26bdf746-8497-46d4-9951-9fc4da10e11f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:56.930975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] For port 409138ad-a211-40f2-b72d-97e091ac2ef8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=409138ad-a211-40f2-b72d-97e091ac2ef8,segment=NetworkSegment(e9932827-0473-4f49-9ee5-9ae9f3c80f46),segment_id=e9932827-0473-4f49-9ee5-9ae9f3c80f46)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:56.931347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.057622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning for port 4b2646de-ed4e-43ae-acc9-d946a1160cdd completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:57.065593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Pushing event updated for resources: {'Port': ['ID=076ab8d4-d3e1-4483-9297-704d0d112470,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:57.066890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-43e496a6-1cb3-41fc-ac88-74d0a6281a36 req-2fdd7205-8a95-4ad5-bf4d-aff1278bedec tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1776907 Nov 24 14:00:57.068330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning complete for port 4b2646de-ed4e-43ae-acc9-d946a1160cdd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:57.068711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.156935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.185068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:57.192073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Calling delete_port for 409138ad-a211-40f2-b72d-97e091ac2ef8 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:57.201697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.211890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.291568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.329168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] For port 4b2646de-ed4e-43ae-acc9-d946a1160cdd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b2646de-ed4e-43ae-acc9-d946a1160cdd,segment=NetworkSegment(540ab5bb-29ab-454c-be59-755229bb8240),segment_id=540ab5bb-29ab-454c-be59-755229bb8240)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:57.333891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.339074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7de9ee88-7bf2-437e-9c96-f33f36d34f9a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:57.349071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port bd85c8d5-a1a2-4789-a036-f40d08e3806b yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:00:57.370895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Could not find standard attr ID for object 5558ef3a-d1ee-402e-baa2-fed4abd2597d. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:00:57.473411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning for port 989a4f85-5419-4ef4-884f-2ae1dc8f5397 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:57.482953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning complete for port 989a4f85-5419-4ef4-884f-2ae1dc8f5397 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:57.482953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.552704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Port 989a4f85-5419-4ef4-884f-2ae1dc8f5397 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:57.569452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Pushing event updated for resources: {'Port': ['ID=4b2646de-ed4e-43ae-acc9-d946a1160cdd,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:57.574327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:57.576236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning for port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:57.582444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Provisioning complete for port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:57.582940 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.607522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.613872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-063dd76b-aa77-4109-ac1d-265d94bb07a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:57.650252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:57.666107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] For port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:57.666747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.686926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Port': ['ID=409138ad-a211-40f2-b72d-97e091ac2ef8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:57.696943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:57.716263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No DVR routers for this DVR port 409138ad-a211-40f2-b72d-97e091ac2ef8 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:57.731325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.743256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ac08a599-1793-4d8c-92d2-d9e32d940899 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:57.770816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.7 (1e1d2ca2-a61a-4d37-86a8-9ec104229521/96eb2a88-9c78-4914-a466-b197ad9fdbb0/bd85c8d5-a1a2-4789-a036-f40d08e3806b) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:00:57.787375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-68c79a39-68bc-42d2-b751-e0a3f15222f3 None None] Provisioning complete for port 989a4f85-5419-4ef4-884f-2ae1dc8f5397 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:57.788204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-68c79a39-68bc-42d2-b751-e0a3f15222f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.859262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-68c79a39-68bc-42d2-b751-e0a3f15222f3 None None] Port 989a4f85-5419-4ef4-884f-2ae1dc8f5397 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:57.873752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-68c79a39-68bc-42d2-b751-e0a3f15222f3 None None] Provisioning complete for port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:57.874128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-68c79a39-68bc-42d2-b751-e0a3f15222f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.907711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.910915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=03e718a2-d2ca-43e8-a6a1-1815ea229650,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:57.919540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:57.930222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:57.948696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-68c79a39-68bc-42d2-b751-e0a3f15222f3 None None] Port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:57.950744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6433df0-e68c-4da9-b625-9a89afc25fec None None] Network be6e4471-74b1-4989-9702-628e500e616c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:57.967071 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/03e718a2-d2ca-43e8-a6a1-1815ea229650 HTTP/1.1" status: 204 len: 168 time: 2.0526218 Nov 24 14:00:57.967237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 42b1bdf4-68b9-47df-8d46-bae330c84cdb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:00:57.986624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:58.021849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42298) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:58.077683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e9932827-0473-4f49-9ee5-9ae9f3c80f46') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:58.078009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e9932827-0473-4f49-9ee5-9ae9f3c80f46') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:58.126193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.131548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5280537d-0fd5-4349-af5c-bf87e2ba13be None None] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:00:58.338484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b2646de-ed4e-43ae-acc9-d946a1160cdd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:58.393522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.421627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.435275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:00:58.438911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Router d8199beb-49b1-48d9-ab92-543c1469b3ae has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:00:58.440590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port 33a99f93-54f2-463e-9678-da68a2bc30f0 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:58.440918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.468919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.469289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.469572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Floating IP 587378fb-8bc8-4a56-b90e-06f47db6479a disassociated. External IP: 172.26.4.113, port: 75f93e3f-615e-466c-8cd6-bd38c07aa8a9. Nov 24 14:00:58.469908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Calling delete_port for 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:58.480650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 879 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:00:58.480860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.494303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2ae628cc-8445-4e94-9773-603c422e63be None None] Provisioning for port 7a9f37d1-dffe-421c-b160-76a485626e1b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:00:58.506126 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:00:58.508977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2ae628cc-8445-4e94-9773-603c422e63be None None] Provisioning complete for port 7a9f37d1-dffe-421c-b160-76a485626e1b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:58.508977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ae628cc-8445-4e94-9773-603c422e63be None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.596509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2ae628cc-8445-4e94-9773-603c422e63be None None] Port 7a9f37d1-dffe-421c-b160-76a485626e1b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:58.599804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4b2646de-ed4e-43ae-acc9-d946a1160cdd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:58.600149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.677263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2ae628cc-8445-4e94-9773-603c422e63be None None] Provisioning for port d580fe44-fe44-4bc6-a33e-8500c695acff completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:58.758002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] DHCP port deletion for be6e4471-74b1-4989-9702-628e500e616c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:00:58.774934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Deleting port 33a99f93-54f2-463e-9678-da68a2bc30f0 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:00:58.775615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.795657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.809315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5ddb7728-b4d4-49b0-b508-eae30e5f0bef tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:58.815967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d580fe44-fe44-4bc6-a33e-8500c695acff up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:58.879479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.887857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:58.960793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:58.978578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:59.000580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e HTTP/1.1" status: 204 len: 168 time: 9.4026542 Nov 24 14:00:59.005055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42304) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.011100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.011876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object bd85c8d5-a1a2-4789-a036-f40d08e3806b will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:00:59.059446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d580fe44-fe44-4bc6-a33e-8500c695acff completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:00:59.064055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-970128fc-3784-4b86-8ce2-ac3c6f199524 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:59.065336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e13fd20-0d48-4c35-a2d0-18cc590436b0 req-23d93a14-0aac-4f33-8bf5-c12a9ceb6e01 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:59.072877 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0e13fd20-0d48-4c35-a2d0-18cc590436b0 req-23d93a14-0aac-4f33-8bf5-c12a9ceb6e01 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 945 time: 0.6484725 Nov 24 14:00:59.074101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d580fe44-fe44-4bc6-a33e-8500c695acff triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:59.074539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.088800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.106382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:59.123782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] For port 33a99f93-54f2-463e-9678-da68a2bc30f0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33a99f93-54f2-463e-9678-da68a2bc30f0,segment=NetworkSegment(cc1a691e-407a-44e6-b50b-27dc00a19891),segment_id=cc1a691e-407a-44e6-b50b-27dc00a19891)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:59.124163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.157844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event deleted for resources: {'Port': ['ID=75f93e3f-615e-466c-8cd6-bd38c07aa8a9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:59.160481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:59.179005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=bd85c8d5-a1a2-4789-a036-f40d08e3806b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:59.190053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:59.237143 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0e13fd20-0d48-4c35-a2d0-18cc590436b0 req-e5be8ac9-ce9f-4724-810e-4b6feae1232b tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups?id=749ded37-2936-483e-baa9-fad3a456a1a6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1633034 Nov 24 14:00:59.239688 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-faa6ea59-b710-4969-a28c-463117b9817e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:00:59.240173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-faa6ea59-b710-4969-a28c-463117b9817e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:00:59.261348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:59.264076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:00:59.272500 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7819345 Nov 24 14:00:59.272682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-89be8610-39bf-436a-ae4e-2729f4316216 None None] Provisioning complete for port 7a9f37d1-dffe-421c-b160-76a485626e1b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:59.277441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-89be8610-39bf-436a-ae4e-2729f4316216 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.281735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42308) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.286729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:00:59.293473 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] Sync routers for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:59.312187 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-faa6ea59-b710-4969-a28c-463117b9817e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e HTTP/1.1" status: 404 len: 339 time: 0.2801249 Nov 24 14:00:59.334612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Calling delete_port for 33a99f93-54f2-463e-9678-da68a2bc30f0 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:59.335179 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:59.335873 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:59.382885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:00:59.450273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42312) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.478575 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-289fbc4d-fc9d-4dda-b7c0-015026b67876 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] delete failed (client error): The resource could not be found. Nov 24 14:00:59.480011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1501511942', 'description': 'd1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:59.485239 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-289fbc4d-fc9d-4dda-b7c0-015026b67876 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/routers/tempest-non_exist_router-759314434 HTTP/1.1" status: 404 len: 334 time: 0.2009869 Nov 24 14:00:59.486426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:00:59.494258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:00:59.495550 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:59.495701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.497332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:59.510472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42316) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.524283 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:59.525083 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:59.530553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cf5efb50-18e5-4ac3-9e52-25b684985f18 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'router': {'external_gateway_info': {'network_id': 'd8199beb-49b1-48d9-ab92-543c1469b3ae'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:59.548559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:network and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:59.549221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:00:59.549577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:00:59.553528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-89be8610-39bf-436a-ae4e-2729f4316216 None None] Port 7a9f37d1-dffe-421c-b160-76a485626e1b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:00:59.564475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:59.618570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:00:59.645214 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:59.645450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.646868 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7eb01d7-da9f-4fa8-9f1e-aa3afa21a0a4 None None] The sync data for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:00:59.651569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-da0c994a-b666-4fce-8e79-6636a26fc739 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:59.679320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.688276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-89be8610-39bf-436a-ae4e-2729f4316216 None None] Provisioning complete for port d580fe44-fe44-4bc6-a33e-8500c695acff triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:00:59.688583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-89be8610-39bf-436a-ae4e-2729f4316216 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.710805 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 5.3329289 Nov 24 14:00:59.714606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42320) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.724533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:59.725793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] For port 33a99f93-54f2-463e-9678-da68a2bc30f0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33a99f93-54f2-463e-9678-da68a2bc30f0,segment=NetworkSegment(cc1a691e-407a-44e6-b50b-27dc00a19891),segment_id=cc1a691e-407a-44e6-b50b-27dc00a19891)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:59.726166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.732006 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/42b1bdf4-68b9-47df-8d46-bae330c84cdb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.6480069 Nov 24 14:00:59.737346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42324) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.737907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Pushing event deleted for resources: {'Port': ['ID=33a99f93-54f2-463e-9678-da68a2bc30f0,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:00:59.750479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] Sync routers for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:59.754844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:00:59.771628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:00:59.773336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] No DVR routers for this DVR port 33a99f93-54f2-463e-9678-da68a2bc30f0 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:00:59.774832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.777774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:00:59.782838 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/add_router_interface HTTP/1.1" status: 200 len: 503 time: 14.4271057 Nov 24 14:00:59.790499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42328) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:00:59.809128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d580fe44-fe44-4bc6-a33e-8500c695acff, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d580fe44-fe44-4bc6-a33e-8500c695acff,segment=NetworkSegment(b9307727-f5cf-42b9-89ca-97f472e49f3e),segment_id=b9307727-f5cf-42b9-89ca-97f472e49f3e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:00:59.811408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdbcf80f-9dd2-4f01-b4d1-893488a7b2f6 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:00:59.812863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-594702262'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:00:59.814121 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:00:59.825036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:00:59.834142 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:59.835197 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:59.844715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:00:59.845564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 076ab8d4-d3e1-4483-9297-704d0d112470 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:00:59.881841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f37735b-1a98-44d2-be3d-0870bb51178c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:00:59.894790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:00:59.916427 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:00:59.917079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:00:59.918740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:00:59.923624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Calling delete_port for 33a99f93-54f2-463e-9678-da68a2bc30f0 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:00:59.986655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 856} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:00.038004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:00.042383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.043335 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 8be7cdb7-682c-496d-9cc8-74db27af9557 of type vlan for network 23e1cf3f-a2a8-43ac-b801-d1e45af52b39 Nov 24 14:01:00.104462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9fab06b-41be-4c78-b640-36da9a1cf730 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:00.105497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a9fab06b-41be-4c78-b640-36da9a1cf730 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:00.108278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:00.108794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:00.112293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.125937 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:00.152135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:00.152490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d580fe44-fe44-4bc6-a33e-8500c695acff,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:00.160601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a9fab06b-41be-4c78-b640-36da9a1cf730 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:00.162130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a9fab06b-41be-4c78-b640-36da9a1cf730 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.10 HTTP/1.1" status: 200 len: 923 time: 0.4459050 Nov 24 14:01:00.163750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:00.166428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42336) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:00.172048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:00.172687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:00.177213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:00.192193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fc235c0-04d9-4aab-b4a0-bffa79535646 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:00.192835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0fc235c0-04d9-4aab-b4a0-bffa79535646 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:00.221858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:00.225321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.239308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.240468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0fc235c0-04d9-4aab-b4a0-bffa79535646 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:00.241692 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0fc235c0-04d9-4aab-b4a0-bffa79535646 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports/989a4f85-5419-4ef4-884f-2ae1dc8f5397 HTTP/1.1" status: 200 len: 913 time: 0.5013700 Nov 24 14:01:00.244852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:00.245752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.249716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42340) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:00.254922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b982c8af-4a71-4102-8411-801bb721a379 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:00.288896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:00.289366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01562fe9-1e3b-4eff-9716-8888c1f08d50 None None] The sync data for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:00.310213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 076ab8d4-d3e1-4483-9297-704d0d112470 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:00.310604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.377899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Provisioning for port bd85c8d5-a1a2-4789-a036-f40d08e3806b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:00.398495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Provisioning complete for port bd85c8d5-a1a2-4789-a036-f40d08e3806b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:00.399458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.474035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdbcf80f-9dd2-4f01-b4d1-893488a7b2f6 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:01:00.482921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port bd85c8d5-a1a2-4789-a036-f40d08e3806b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:00.483406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.550795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Port bd85c8d5-a1a2-4789-a036-f40d08e3806b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:00.580580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Provisioning complete for port 7a9f37d1-dffe-421c-b160-76a485626e1b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:00.580963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.583379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=23e1cf3f-a2a8-43ac-b801-d1e45af52b39,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:00.586851 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 782 time: 1.1158597 Nov 24 14:01:00.588745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-64b21e7b-bc3f-4649-81a5-7a87894206b6 req-4ee137a9-6612-4911-bf37-60e536804793 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Synchronizing usage tracker for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:00.591588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.337s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:00.595979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42346) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:00.618481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 878} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:00.638944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.639284 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment 97494fb6-9264-45f5-bf41-b9ed212d15c9 of type vlan for network 89cc7986-be93-42b0-bf08-7a1aa46579f1 Nov 24 14:01:00.660701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cf5efb50-18e5-4ac3-9e52-25b684985f18 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.666255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-402df0bb-cf9c-4358-867b-02428854b37f None None] Port 7a9f37d1-dffe-421c-b160-76a485626e1b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:00.670728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 23e1cf3f-a2a8-43ac-b801-d1e45af52b39 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:00.676067 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:00:52Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:00:54Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:00.684079 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:00.684883 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Updating router 8b1794c5-dde1-4c7a-a979-ba268c818d76 port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:01:00.695418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.718434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port 33a99f93-54f2-463e-9678-da68a2bc30f0 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:00.718942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.747567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6018509d-42da-4401-849c-d507638123b2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:00.748436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6018509d-42da-4401-849c-d507638123b2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Synchronizing usage tracker for tenant:5e936793ca53421b93b3d4209ca77990 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:00.756930 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-cf5efb50-18e5-4ac3-9e52-25b684985f18 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] update failed (client error): The resource could not be found. Nov 24 14:01:00.757964 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cf5efb50-18e5-4ac3-9e52-25b684985f18 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae HTTP/1.1" status: 404 len: 339 time: 1.2445607 Nov 24 14:01:00.764456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42350) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:00.767514 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.771207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1921071117'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:00.777875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:00.780690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.784364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:00.784935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:00.791997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3d7e908c-ac00-410d-8f7c-f519adf3f28c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:00.887125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:network and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:00.894827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:00.979031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:00.993673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-64b21e7b-bc3f-4649-81a5-7a87894206b6 req-4ee137a9-6612-4911-bf37-60e536804793 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Unset dirty status for tenant:a6e6213b81eb4772a787ef2b41ed785b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:00.995168 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-64b21e7b-bc3f-4649-81a5-7a87894206b6 req-4ee137a9-6612-4911-bf37-60e536804793 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 210 time: 0.4842091 Nov 24 14:01:01.005204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] The port '33a99f93-54f2-463e-9678-da68a2bc30f0' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:01.015713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d580fe44-fe44-4bc6-a33e-8500c695acff up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:01.106352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 1.3116653 Nov 24 14:01:01.119843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42354) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:01.131191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:01.144390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6018509d-42da-4401-849c-d507638123b2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Unset dirty status for tenant:5e936793ca53421b93b3d4209ca77990 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:01.146189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6018509d-42da-4401-849c-d507638123b2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks?id=23e1cf3f-a2a8-43ac-b801-d1e45af52b39 HTTP/1.1" status: 200 len: 761 time: 0.5493133 Nov 24 14:01:01.150842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:01.153956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.157417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42358) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:01.169230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=89cc7986-be93-42b0-bf08-7a1aa46579f1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:01.182401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.390s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:01.195273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d580fe44-fe44-4bc6-a33e-8500c695acff triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:01.196371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.198931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'description': 'd2'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:01.302844 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 898} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:01.327860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:01.329165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:01.330059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.332039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.332456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Added segment 9260e382-62db-4293-9abc-4bdf45c4d4c2 of type vlan for network 41c18b2a-c344-4766-be36-277eaa48676e Nov 24 14:01:01.339921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:01.343328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:01.352512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:01.361053 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.380341 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Transition to ACTIVE for port object 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:01.381265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.389761 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.412184 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:01.437200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.447044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:01.500242 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Pushing event updated for resources: {'Port': ['ID=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:01.509527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['be6e4471-74b1-4989-9702-628e500e616c']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:01.553676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cc1a691e-407a-44e6-b50b-27dc00a19891') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:01.554398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cc1a691e-407a-44e6-b50b-27dc00a19891') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:01.577457 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.577801 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.578113 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.578603 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.578939 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.579235 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.579674 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.580079 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.580526 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.580962 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.581306 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:01.592411 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:01.629336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.672926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.704850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.708665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:01.709241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.716797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0f7eee83-2afe-473d-9161-b8eb2938bbbc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:01.730454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.746788 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Attempting to bind port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:01.747348 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Attempting to bind port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:01.748061 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Attempting to bind port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 on network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:01.755676 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:01.756216 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Checking segment: {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:01.756741 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.757300 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Bound using segment: {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:01.757586 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Bound port: 3fb16aee-b0cc-4ee2-879b-e7b58265fce7, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78b0ca0d-865e-42f7-acb6-95fcbd295329', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:01.758006 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.759091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 865 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:01.759560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.771542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33a99f93-54f2-463e-9678-da68a2bc30f0 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:01.816107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 33a99f93-54f2-463e-9678-da68a2bc30f0 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:01.816555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33a99f93-54f2-463e-9678-da68a2bc30f0 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:01.835821 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:01.845956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.868366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Network': ['ID=41c18b2a-c344-4766-be36-277eaa48676e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:01.872315 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] For port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:01.876418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] For port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,segment=NetworkSegment(78b0ca0d-865e-42f7-acb6-95fcbd295329),segment_id=78b0ca0d-865e-42f7-acb6-95fcbd295329)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:01.880933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:01.881391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 41c18b2a-c344-4766-be36-277eaa48676e details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:01.886597 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:01.902329 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:01.927858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for bd85c8d5-a1a2-4789-a036-f40d08e3806b owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:02.014164 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Pushing event updated for resources: {'Port': ['ID=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:02.017704 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:02.018652 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:02.094896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.097661 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:02.214016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:02.226097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] Sync routers for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:02.241831 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:02.249749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:02.250469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:02.292396 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 1.5257528 Nov 24 14:01:02.293140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42366) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:02.330003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'subnet': {'network_id': '41c18b2a-c344-4766-be36-277eaa48676e', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:02.335438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.359472 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3454c5da-83e6-4f04-814d-494777188e26 req-ad3ca00b-a3e4-4c70-9da1-14844550a5bd tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/ports?device_id=74067c2c-7a30-436c-9ec3-d93d29c64a43 HTTP/1.1" status: 200 len: 210 time: 0.1674507 Nov 24 14:01:02.360126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e1377a64-567e-4363-b864-3ade0510d1d1 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:02.391669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.397010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] No DVR routers for this DVR port 75f93e3f-615e-466c-8cd6-bd38c07aa8a9 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:02.400662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.456253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.458651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8e084f4d-c52e-419e-9867-14a37169c6ea req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.47 "DELETE /v2.0/ports/75f93e3f-615e-466c-8cd6-bd38c07aa8a9 HTTP/1.1" status: 204 len: 173 time: 6.0440862 Nov 24 14:01:02.460228 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/be6e4471-74b1-4989-9702-628e500e616c HTTP/1.1" status: 204 len: 168 time: 4.4150376 Nov 24 14:01:02.463038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=be6e4471-74b1-4989-9702-628e500e616c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:02.469137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'name': 'network-vif-deleted', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:01:02.477663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42370) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:02.496876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 23e1cf3f-a2a8-43ac-b801-d1e45af52b39 is not hosted by any dhcp agent {{(pid=83526) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:226}} Nov 24 14:01:02.505135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:02.506703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.509523 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "PUT /v2.0/networks/23e1cf3f-a2a8-43ac-b801-d1e45af52b39 HTTP/1.1" status: 200 len: 758 time: 1.3374679 Nov 24 14:01:02.513073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42378) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:02.574890 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-5cb1b86a-ba2e-4434-9c0e-0d223410a5ff tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:02.575264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5cb1b86a-ba2e-4434-9c0e-0d223410a5ff tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:02.577040 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5cb1b86a-ba2e-4434-9c0e-0d223410a5ff tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/6c1623fd-aadd-4b45-a8db-30755ea690d5 HTTP/1.1" status: 404 len: 337 time: 0.0974941 Nov 24 14:01:02.584374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42382) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:02.619644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:02.671181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b976cbf0-f3d9-4151-8529-8be44362a3ba tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:02.673529 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b976cbf0-f3d9-4151-8529-8be44362a3ba tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks?id=23e1cf3f-a2a8-43ac-b801-d1e45af52b39 HTTP/1.1" status: 200 len: 761 time: 0.1456795 Nov 24 14:01:02.677270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42386) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:02.684443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.686302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.686687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.687160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.687490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.688995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.689379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.692151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.692553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.692923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.693289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:02.699077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:02.705913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.353s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:02.713673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-354827167'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:02.722547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.262s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:02.724049 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-021bfbe2-a547-4567-b5b1-62d59e17150d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:02.724572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-021bfbe2-a547-4567-b5b1-62d59e17150d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:02.727527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Usage tracker for resource:subnet and tenant:b8414925e97644acb99608415dc5b4ae is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:02.740050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:02.750849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:02.753976 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-021bfbe2-a547-4567-b5b1-62d59e17150d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/e701d90c-1825-4b75-9ad9-32d14869a562 HTTP/1.1" status: 404 len: 339 time: 0.1676571 Nov 24 14:01:02.762045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '74067c2c-7a30-436c-9ec3-d93d29c64a43', 'name': 'network-vif-deleted', 'tag': '75f93e3f-615e-466c-8cd6-bd38c07aa8a9', 'status': 'completed', 'code': 200} Nov 24 14:01:02.765397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42390) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:02.766422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:02.779942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:02.792883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.797882 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:00:52Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:01Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:02.802230 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9646e1ee-c92e-4919-aebf-d48d25573dc3 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:00:52Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:01Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:02.809046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:02.813371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:02.984313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Made reservation on behalf of b8414925e97644acb99608415dc5b4ae for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:03.146138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=23e1cf3f-a2a8-43ac-b801-d1e45af52b39,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:03.148442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:03.167029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 23e1cf3f-a2a8-43ac-b801-d1e45af52b39 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:03.189022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0277def3-440e-4416-a3d6-8d74ec810125 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.256337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.535s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:03.279569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42cdf7f1-7ba7-4766-91ed-9855cab97f01 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.445s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:03.380102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=bd85c8d5-a1a2-4789-a036-f40d08e3806b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:03.390173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.390516 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment e7ae358f-431a-4929-9f60-e11e9ce79588 of type vlan for network a453ffa9-1409-4817-9300-dbd08ded9f28 Nov 24 14:01:03.391795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:03.410981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:49Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:03.419272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] Checking router: 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:03.432957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:03.433869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:03.489791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.513374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.530328 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/bd85c8d5-a1a2-4789-a036-f40d08e3806b HTTP/1.1" status: 204 len: 168 time: 3.3626118 Nov 24 14:01:03.541040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42396) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:03.564545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.589695 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-7ceb6552-8760-4460-9322-88a20e0d4af4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:01:03.590196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7ceb6552-8760-4460-9322-88a20e0d4af4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:03.594266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.639720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.650317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:03.650926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.657069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:03.678601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7ceb6552-8760-4460-9322-88a20e0d4af4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:03.683212 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7ceb6552-8760-4460-9322-88a20e0d4af4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/bd85c8d5-a1a2-4789-a036-f40d08e3806b HTTP/1.1" status: 404 len: 333 time: 0.1411815 Nov 24 14:01:03.683808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42402) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:03.684130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42404) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:03.720914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:03.722914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.730044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting subnet 38b82bda-dda1-4e46-81b2-1aa2272a43f5 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:03.733305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.792436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:03.797225 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.1186893 Nov 24 14:01:03.824041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42410) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:03.875675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': 'a453ffa9-1409-4817-9300-dbd08ded9f28', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:03.882511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=a453ffa9-1409-4817-9300-dbd08ded9f28,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:03.893055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-698990bb-b555-4ad4-aa43-c5410bc24143 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:03.898393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network a453ffa9-1409-4817-9300-dbd08ded9f28 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:03.906450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 7a9f37d1-dffe-421c-b160-76a485626e1b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:03.906786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:03.964364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.007849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.044079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.108967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=680006ef-4d94-41e1-9d14-3fbf3d869aee,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:04.149069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:04.166340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.166714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.167081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.167444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.167829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.168185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.168542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.168888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.169247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.169586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.169931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:04.174546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Usage tracker for resource:subnet and tenant:5e936793ca53421b93b3d4209ca77990 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:04.180373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:04.184922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.393s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:04.205310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:04.205667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: 89cc7986-be93-42b0-bf08-7a1aa46579f1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:04.210148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:04.225810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:49Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:04.230310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49a7852d-eccf-468b-b5a6-32047f96bdf2 None None] The sync data for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv is: [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T13:55:20Z', 'revision_number': 4, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7cb017e9-125d-45ba-8dd7-703fb83b1b7e', 'name': '', 'network_id': '7c23cefd-d4e1-4241-a3d2-42622a5131e3', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'mac_address': 'fa:16:3e:43:12:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:18Z', 'updated_at': '2021-11-24T13:55:49Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'subnets': [{'id': 'd04c57a1-6813-42f8-932e-ab9506091c4e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:04.279606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.412035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 7a9f37d1-dffe-421c-b160-76a485626e1b owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:04.444930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:04.448347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.454080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cb531015-9aa6-4356-bda3-7b5c87763455 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:04.468417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=749ded37-2936-483e-baa9-fad3a456a1a6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:04.474783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:04.513000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.514209 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "DELETE /v2.0/security-groups/749ded37-2936-483e-baa9-fad3a456a1a6 HTTP/1.1" status: 204 len: 168 time: 0.8243268 Nov 24 14:01:04.517363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42418) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:04.553031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.574427 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-bb1549c6-5e65-4bc0-abcb-da4736aa1c7c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] show failed (client error): The resource could not be found. Nov 24 14:01:04.575497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bb1549c6-5e65-4bc0-abcb-da4736aa1c7c tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "GET /v2.0/security-groups/749ded37-2936-483e-baa9-fad3a456a1a6 HTTP/1.1" status: 404 len: 347 time: 0.0565493 Nov 24 14:01:04.578269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42422) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:04.616257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:04.671056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 89cc7986-be93-42b0-bf08-7a1aa46579f1) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:04.679034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.682753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed9b22a8-23bc-4fb2-87e0-96355682b8c7 None None] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:04.704596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.708701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:04.709276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.720162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-89db4b75-7b2f-4605-b527-0b4082c8dfc6 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:04.754308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Deleting port 98ed9fbb-e948-4054-82c6-6deb00f91272 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:04.754308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.787674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.795091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6190146c-fd07-413a-94cc-9475dc61c845 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:04.843418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=7a9f37d1-dffe-421c-b160-76a485626e1b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:04.855862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:04.933450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:04.938772 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.8164539 Nov 24 14:01:04.960984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-89cc7986-be93-42b0-bf08-7a1aa46579f1', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:04.964025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42426) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:04.965706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.033297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Subnet': ['ID=4643d209-20e3-4c62-b658-3a4fb8fffd9d,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:05.044875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:05.059541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:05.060083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5b171343-8425-4080-a76d-571f1cb681f7 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:05.158642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.175218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cccd13e-904b-4e40-9eb5-dab22f1bc7ae None None] Network cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:05.177019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 989a4f85-5419-4ef4-884f-2ae1dc8f5397 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:05.177181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.199096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.201480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Subnet': ['ID=38b82bda-dda1-4e46-81b2-1aa2272a43f5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:05.205767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.206296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.212354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:05.229790 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/subnets/38b82bda-dda1-4e46-81b2-1aa2272a43f5 HTTP/1.1" status: 204 len: 168 time: 2.4584804 Nov 24 14:01:05.234824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42430) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:05.262901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Checking segment: {'id': '9260e382-62db-4293-9abc-4bdf45c4d4c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '41c18b2a-c344-4766-be36-277eaa48676e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:05.263527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network hostable DHCP agents. Network: 41c18b2a-c344-4766-be36-277eaa48676e, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:05.281218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/7a9f37d1-dffe-421c-b160-76a485626e1b HTTP/1.1" status: 204 len: 168 time: 1.5895820 Nov 24 14:01:05.337284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42434) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:05.350652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Calling delete_port for 98ed9fbb-e948-4054-82c6-6deb00f91272 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:05.356065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:05.363360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Allocated IP 172.21.0.2 (89cc7986-be93-42b0-bf08-7a1aa46579f1/680006ef-4d94-41e1-9d14-3fbf3d869aee/a2af2a5c-8d84-4f05-9494-9efd65088629) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:05.374007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:05.374757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.523011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.539588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-56d95175-f4cd-4db4-a05d-5817e77e8155 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:05.589581 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-52c565df-3bf4-4c54-87b7-40f54520c84f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:01:05.590085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-52c565df-3bf4-4c54-87b7-40f54520c84f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:05.657290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.663687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Pushing event deleted for resources: {'Port': ['ID=98ed9fbb-e948-4054-82c6-6deb00f91272,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:05.670956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:05.701621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.713655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-52c565df-3bf4-4c54-87b7-40f54520c84f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:05.714795 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-52c565df-3bf4-4c54-87b7-40f54520c84f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/7a9f37d1-dffe-421c-b160-76a485626e1b HTTP/1.1" status: 404 len: 333 time: 0.2704511 Nov 24 14:01:05.720168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42438) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:05.741345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.750095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.752154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network 41c18b2a-c344-4766-be36-277eaa48676e is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:05.767916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:05.768114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.790240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,segment=NetworkSegment(78b0ca0d-865e-42f7-acb6-95fcbd295329),segment_id=78b0ca0d-865e-42f7-acb6-95fcbd295329)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:05.802676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.808201 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] 10.222.0.70 "DELETE /v2.0/floatingips/587378fb-8bc8-4a56-b90e-06f47db6479a HTTP/1.1" status: 204 len: 168 time: 1.2287023 Nov 24 14:01:05.809209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.809488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42442) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:05.814441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae0fd82d-32bf-4f76-8027-8686122a6e79 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:05.857953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6bd6899d-dcaf-44b9-a5fc-824a5f626621 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.860741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] DHCP port deletion for cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:05.910418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Deleting port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:05.910942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.912426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 41c18b2a-c344-4766-be36-277eaa48676e) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:05.914698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:05.925241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 989a4f85-5419-4ef4-884f-2ae1dc8f5397 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:05.946461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-642318d7-579e-48b9-a548-133f66c7f64c None None] Network 41c18b2a-c344-4766-be36-277eaa48676e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:05.998223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet 96eb2a88-9c78-4914-a466-b197ad9fdbb0 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:06.002886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.092307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.092538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9bf8e5d9-5d79-49d3-b0f4-d0ff9526fd2d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:06.122310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:06.122898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.151708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Transition to ACTIVE for port object a2af2a5c-8d84-4f05-9494-9efd65088629 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:06.166326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:06.168209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.169794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.355s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:06.378853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.392027 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 4.0686677 Nov 24 14:01:06.397406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Transition to ACTIVE for port object a2af2a5c-8d84-4f05-9494-9efd65088629 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:06.412281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42448) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:06.428908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3573d9d1-5ed2-48f8-8109-8d1d9f5329a5 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'router': {'external_gateway_info': {'network_id': '41c18b2a-c344-4766-be36-277eaa48676e'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:06.438810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=3cbec4cd-2564-4892-84de-e26f8cb2c4dd,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:06.442330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.350s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:06.449185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] For port ae1df932-8fe8-4b82-a8f3-381d544ecfa7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,segment=NetworkSegment(9462ed27-21aa-44c9-8c05-9beadbd4ad5b),segment_id=9462ed27-21aa-44c9-8c05-9beadbd4ad5b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:06.449638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.462729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.473814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:06.482556 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51cad8c3-449c-4355-af80-789b0fffcded None None] New status for floating IP 587378fb-8bc8-4a56-b90e-06f47db6479a: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:01:06.604816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': 'e7ae358f-431a-4929-9f60-e11e9ce79588', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'a453ffa9-1409-4817-9300-dbd08ded9f28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:06.605405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: a453ffa9-1409-4817-9300-dbd08ded9f28, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:06.637154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Calling delete_port for ae1df932-8fe8-4b82-a8f3-381d544ecfa7 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:06.646927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] For port ae1df932-8fe8-4b82-a8f3-381d544ecfa7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,segment=NetworkSegment(9462ed27-21aa-44c9-8c05-9beadbd4ad5b),segment_id=9462ed27-21aa-44c9-8c05-9beadbd4ad5b)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:06.647287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.756651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:06.766562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Pushing event updated for resources: {'Port': ['ID=a2af2a5c-8d84-4f05-9494-9efd65088629,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:06.769321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:06.776079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:06.796771 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.797682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-41c18b2a-c344-4766-be36-277eaa48676e', 'network_id': '41c18b2a-c344-4766-be36-277eaa48676e', 'tenant_id': 'b8414925e97644acb99608415dc5b4ae', 'fixed_ips': [{'subnet_id': '4643d209-20e3-4c62-b658-3a4fb8fffd9d'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:06.798488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.799118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Calling delete_port for ae1df932-8fe8-4b82-a8f3-381d544ecfa7 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:06.814673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.814673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.815008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.815389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.815738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.818606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.818942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.819275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.819605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.819955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.820313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:01:06.827441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.354s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:06.847801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.874638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:06.886459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network a453ffa9-1409-4817-9300-dbd08ded9f28 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:06.917872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:06.930783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, a453ffa9-1409-4817-9300-dbd08ded9f28) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:06.970738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:06.971666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.009610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50de1fd9-268e-45bb-b740-96412ea6d08f None None] Network a453ffa9-1409-4817-9300-dbd08ded9f28 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:07.039733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:07.055869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.067503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bd56242f-3862-4757-a7fa-e1faac2620fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:07.081389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Pushing event deleted for resources: {'Port': ['ID=ae1df932-8fe8-4b82-a8f3-381d544ecfa7,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:07.088625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afce238b-e766-43a6-a0de-b9120c280bb5 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:07.103591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:07.134724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.140296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=96eb2a88-9c78-4914-a466-b197ad9fdbb0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:07.152730 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/96eb2a88-9c78-4914-a466-b197ad9fdbb0 HTTP/1.1" status: 204 len: 168 time: 1.4290740 Nov 24 14:01:07.152730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:07.160725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42452) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:07.168692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55ec643f-9a65-4a26-a71e-4eed32a2bee6 None None] Network 1e1d2ca2-a61a-4d37-86a8-9ec104229521 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:07.186683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=989a4f85-5419-4ef4-884f-2ae1dc8f5397,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:07.188781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] No DVR routers for this DVR port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:07.190675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:07.191222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:07.192230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:07.206034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Attempting to bind port a2af2a5c-8d84-4f05-9494-9efd65088629 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:07.206423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Attempting to bind port a2af2a5c-8d84-4f05-9494-9efd65088629 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:07.206779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Attempting to bind port a2af2a5c-8d84-4f05-9494-9efd65088629 on network 89cc7986-be93-42b0-bf08-7a1aa46579f1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:07.227694 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.3738880 Nov 24 14:01:07.250372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42456) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:07.418133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.451641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Allocated IP 2001:db8:1::2 (41c18b2a-c344-4766-be36-277eaa48676e/4643d209-20e3-4c62-b658-3a4fb8fffd9d/d95da42e-dd93-436a-beb3-128304f0125e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:07.503024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port d580fe44-fe44-4bc6-a33e-8500c695acff {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:07.503362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.524584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.563720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:07.564514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Checking segment: {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:07.565095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.565602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Bound using segment: {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:07.566510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Bound port: a2af2a5c-8d84-4f05-9494-9efd65088629, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:07.567327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.593628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3573d9d1-5ed2-48f8-8109-8d1d9f5329a5 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.666429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.696725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Deleting port ae1df932-8fe8-4b82-a8f3-381d544ecfa7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:07.697765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.780110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] The port 'ae1df932-8fe8-4b82-a8f3-381d544ecfa7' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:07.801275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.878673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:07.879135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.896958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:07.909002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1747754f-6cf7-4cd6-8056-d4a5b036796e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:07.963188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=3cbec4cd-2564-4892-84de-e26f8cb2c4dd,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:07.966600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:08.018645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.090603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] For port a2af2a5c-8d84-4f05-9494-9efd65088629, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:08.094107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-613ba8d5-40cc-46fe-9e82-60b0ff865e6d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-a453ffa9-1409-4817-9300-dbd08ded9f28', 'network_id': 'a453ffa9-1409-4817-9300-dbd08ded9f28', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': '3cbec4cd-2564-4892-84de-e26f8cb2c4dd'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:08.095012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-613ba8d5-40cc-46fe-9e82-60b0ff865e6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.132000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] For port a2af2a5c-8d84-4f05-9494-9efd65088629, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a2af2a5c-8d84-4f05-9494-9efd65088629,segment=NetworkSegment(97494fb6-9264-45f5-bf41-b9ed212d15c9),segment_id=97494fb6-9264-45f5-bf41-b9ed212d15c9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:08.151587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.155793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.158690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.163108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:08.168966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cb19ec64-b023-4aad-b4ad-fb107cd2f9c0']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:08.187494 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-3573d9d1-5ed2-48f8-8109-8d1d9f5329a5 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:01:08.191984 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3573d9d1-5ed2-48f8-8109-8d1d9f5329a5 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae HTTP/1.1" status: 400 len: 364 time: 1.7702889 Nov 24 14:01:08.193532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42460) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:08.202210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9462ed27-21aa-44c9-8c05-9beadbd4ad5b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:08.202497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9462ed27-21aa-44c9-8c05-9beadbd4ad5b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:08.214837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port d580fe44-fe44-4bc6-a33e-8500c695acff, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d580fe44-fe44-4bc6-a33e-8500c695acff,segment=NetworkSegment(b9307727-f5cf-42b9-89ca-97f472e49f3e),segment_id=b9307727-f5cf-42b9-89ca-97f472e49f3e)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:08.214837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.250131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a453ffa9-1409-4817-9300-dbd08ded9f28']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:08.251212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Transition to ACTIVE for port object d95da42e-dd93-436a-beb3-128304f0125e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:08.267134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.279787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.330267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e7ae358f-431a-4929-9f60-e11e9ce79588') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:08.330798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e7ae358f-431a-4929-9f60-e11e9ce79588') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:08.375035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.400235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Transition to ACTIVE for port object d95da42e-dd93-436a-beb3-128304f0125e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:08.409808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.427889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:08.428630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.428979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for d580fe44-fe44-4bc6-a33e-8500c695acff owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:08.447849 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:08.455392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] DHCP port deletion for 1e1d2ca2-a61a-4d37-86a8-9ec104229521 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:08.470806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Deleting port d580fe44-fe44-4bc6-a33e-8500c695acff {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:08.471245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.529509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.534055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.535796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Pushing event updated for resources: {'Port': ['ID=a2af2a5c-8d84-4f05-9494-9efd65088629,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:08.551082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.552220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ae1df932-8fe8-4b82-a8f3-381d544ecfa7 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:08.595380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.432s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:08.596920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-17f25fd7-b83b-41fb-ac97-facea84f6d91 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:08.607588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Releasing vlan 887 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:08.608057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.630226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:08.639668 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:08.681880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: ae1df932-8fe8-4b82-a8f3-381d544ecfa7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:08.682388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device ae1df932-8fe8-4b82-a8f3-381d544ecfa7 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:08.703905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Network 41c18b2a-c344-4766-be36-277eaa48676e is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:08.710493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:08.714176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c0cea14-04bf-4d87-9959-32de49391aac None None] Network a453ffa9-1409-4817-9300-dbd08ded9f28 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:08.731650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:08.777635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.832776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Pushing event updated for resources: {'Port': ['ID=d95da42e-dd93-436a-beb3-128304f0125e,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:08.846273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd020b7e-9dba-4ea6-ac66-c7e9253c0611 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:08.866123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:08.940209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:08.952795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e3166c04-b468-440d-b07d-72729a1bdd63 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:08.973295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.008471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=a453ffa9-1409-4817-9300-dbd08ded9f28,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:09.022369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=d580fe44-fe44-4bc6-a33e-8500c695acff,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:09.031547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:09.036519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.045007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:09.061509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.072091 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/a453ffa9-1409-4817-9300-dbd08ded9f28 HTTP/1.1" status: 204 len: 168 time: 1.6975448 Nov 24 14:01:09.074369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:09.074960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port d580fe44-fe44-4bc6-a33e-8500c695acff on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:09.077528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42464) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:09.138544 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-62133c8f-58e1-4fc6-a68f-04588b1a9f13 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] GET failed (client error): The resource could not be found. Nov 24 14:01:09.139427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-62133c8f-58e1-4fc6-a68f-04588b1a9f13 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Synchronizing usage tracker for tenant:5e936793ca53421b93b3d4209ca77990 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:09.173390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d580fe44-fe44-4bc6-a33e-8500c695acff no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:09.173627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Pushing event deleted for resources: {'Network': ['ID=cb19ec64-b023-4aad-b4ad-fb107cd2f9c0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:09.181947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:09.230483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d580fe44-fe44-4bc6-a33e-8500c695acff {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:09.230747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d580fe44-fe44-4bc6-a33e-8500c695acff not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:09.245354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Attempting to bind port d95da42e-dd93-436a-beb3-128304f0125e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:09.245727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Attempting to bind port d95da42e-dd93-436a-beb3-128304f0125e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9260e382-62db-4293-9abc-4bdf45c4d4c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '41c18b2a-c344-4766-be36-277eaa48676e'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:09.246091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Attempting to bind port d95da42e-dd93-436a-beb3-128304f0125e on network 41c18b2a-c344-4766-be36-277eaa48676e {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:09.252332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] For port d580fe44-fe44-4bc6-a33e-8500c695acff, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d580fe44-fe44-4bc6-a33e-8500c695acff,segment=NetworkSegment(b9307727-f5cf-42b9-89ca-97f472e49f3e),segment_id=b9307727-f5cf-42b9-89ca-97f472e49f3e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:09.252667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.323004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:09.323425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Checking segment: {'id': '9260e382-62db-4293-9abc-4bdf45c4d4c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '41c18b2a-c344-4766-be36-277eaa48676e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:09.323867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.324385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Bound using segment: {'id': '9260e382-62db-4293-9abc-4bdf45c4d4c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '41c18b2a-c344-4766-be36-277eaa48676e'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:09.324867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Bound port: d95da42e-dd93-436a-beb3-128304f0125e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9260e382-62db-4293-9abc-4bdf45c4d4c2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '41c18b2a-c344-4766-be36-277eaa48676e'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:09.325246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.393159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-62133c8f-58e1-4fc6-a68f-04588b1a9f13 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Unset dirty status for tenant:5e936793ca53421b93b3d4209ca77990 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:09.393674 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] 10.222.0.70 "DELETE /v2.0/networks/cb19ec64-b023-4aad-b4ad-fb107cd2f9c0 HTTP/1.1" status: 204 len: 168 time: 4.1575341 Nov 24 14:01:09.395196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-62133c8f-58e1-4fc6-a68f-04588b1a9f13 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/subnets/3cbec4cd-2564-4892-84de-e26f8cb2c4dd HTTP/1.1" status: 404 len: 337 time: 0.3112116 Nov 24 14:01:09.399749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42470) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:09.467796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.479859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] For port d95da42e-dd93-436a-beb3-128304f0125e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:09.483388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] For port d95da42e-dd93-436a-beb3-128304f0125e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d95da42e-dd93-436a-beb3-128304f0125e,segment=NetworkSegment(9260e382-62db-4293-9abc-4bdf45c4d4c2),segment_id=9260e382-62db-4293-9abc-4bdf45c4d4c2)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:09.491062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Calling delete_port for d580fe44-fe44-4bc6-a33e-8500c695acff owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:09.505302 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-3d4ffc09-32a8-46c2-a01f-1029fd60c3d2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:09.505920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3d4ffc09-32a8-46c2-a01f-1029fd60c3d2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:09.508252 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3d4ffc09-32a8-46c2-a01f-1029fd60c3d2 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/a453ffa9-1409-4817-9300-dbd08ded9f28 HTTP/1.1" status: 404 len: 339 time: 0.1047339 Nov 24 14:01:09.519695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42474) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:09.521878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.534477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cee5d63a-d568-4437-a9dc-1a2558a12628 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:09.562470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1e1d2ca2-a61a-4d37-86a8-9ec104229521']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:09.615335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Pushing event updated for resources: {'Port': ['ID=d95da42e-dd93-436a-beb3-128304f0125e,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:09.620706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:09.655620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:09.675622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:09.676031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:09.781358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b9307727-f5cf-42b9-89ca-97f472e49f3e') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:09.781622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b9307727-f5cf-42b9-89ca-97f472e49f3e') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:09.862950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42480) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:09.884204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.013742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.062742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 880 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:10.067252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:10.165232 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:10.176884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Deleting port d580fe44-fe44-4bc6-a33e-8500c695acff {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:10.177284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.255053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Deleting port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:10.255622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.267147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d95ac820-654c-483c-a414-68ce9d6d3e11 None None] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:10.298665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-121ce404-88fa-4009-8385-7bda387261d4 None None] The port 'd580fe44-fe44-4bc6-a33e-8500c695acff' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:10.358849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Allocated IP 2001:db8::1 (81e8d49c-689b-4cea-8ae7-3a55b0bb002d/07399c12-b132-41cc-ba04-9605a6e3af74/b1495035-c1d4-4947-8317-7f30cb9130fb) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:10.379251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-114412e8-db88-46f4-be6e-a16630f54784 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:10.379874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-114412e8-db88-46f4-be6e-a16630f54784 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Synchronizing usage tracker for tenant:5e936793ca53421b93b3d4209ca77990 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:10.395681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.433412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-969c44e0-af3f-467c-96a5-6b4ebe6b627c None None] Provisioning for port a2af2a5c-8d84-4f05-9494-9efd65088629 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:10.465498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.486290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11f1c7af-d9e7-4f92-90d9-aae532d78131 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:10.521092 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6ee1ae1d-04fb-45d9-965e-48421f5951bb admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=c68ea59217504ce9802abf43743e4c8f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.6438334 Nov 24 14:01:10.527664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=1e1d2ca2-a61a-4d37-86a8-9ec104229521,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:10.530786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:10.531741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42486) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:10.553235 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/1e1d2ca2-a61a-4d37-86a8-9ec104229521 HTTP/1.1" status: 204 len: 168 time: 3.3720675 Nov 24 14:01:10.561303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.21.0.1 (89cc7986-be93-42b0-bf08-7a1aa46579f1/680006ef-4d94-41e1-9d14-3fbf3d869aee/d670b4ec-57fe-4eaa-abac-c1f52d488a15) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:10.569223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42490) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:10.578087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-462269391'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:10.585211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-114412e8-db88-46f4-be6e-a16630f54784 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Unset dirty status for tenant:5e936793ca53421b93b3d4209ca77990 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:10.587192 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-114412e8-db88-46f4-be6e-a16630f54784 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 1.0635636 Nov 24 14:01:10.604526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:10.606537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42494) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:10.679104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:10.691448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:10.701768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c124844f-60f2-4ec6-835f-3eb9368eb487 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Synchronizing usage tracker for tenant:5e936793ca53421b93b3d4209ca77990 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:10.720534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] For port 7cb017e9-125d-45ba-8dd7-703fb83b1b7e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:10.720907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.728573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:10.825746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c124844f-60f2-4ec6-835f-3eb9368eb487 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Unset dirty status for tenant:5e936793ca53421b93b3d4209ca77990 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:10.830078 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c124844f-60f2-4ec6-835f-3eb9368eb487 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 207 time: 0.2173777 Nov 24 14:01:10.830078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:10.830723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:10.842748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42498) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:10.905075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Calling delete_port for 7cb017e9-125d-45ba-8dd7-703fb83b1b7e owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:10.931442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.054112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d95da42e-dd93-436a-beb3-128304f0125e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:11.081566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.094450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.105821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 887} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:11.109017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Transition to ACTIVE for port object b1495035-c1d4-4947-8317-7f30cb9130fb will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:11.114956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.137503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 42b1bdf4-68b9-47df-8d46-bae330c84cdb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:11.191575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.191970 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment 26ddebb3-0e4d-48c6-a017-be48f7130c3b of type vlan for network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 Nov 24 14:01:11.193369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.195607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d95da42e-dd93-436a-beb3-128304f0125e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:11.201472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a2af2a5c-8d84-4f05-9494-9efd65088629 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:11.203817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object d670b4ec-57fe-4eaa-abac-c1f52d488a15 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:11.208076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:11.244651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f90a870-6d15-4f9b-b5c1-a4fdf9192c46 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:11.249202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f90a870-6d15-4f9b-b5c1-a4fdf9192c46 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:11.253353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f90a870-6d15-4f9b-b5c1-a4fdf9192c46 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:11.256818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.257315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f90a870-6d15-4f9b-b5c1-a4fdf9192c46 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:11.262601 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8f90a870-6d15-4f9b-b5c1-a4fdf9192c46 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2487 time: 0.4016805 Nov 24 14:01:11.271240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:11.272171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42502) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:11.276523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:11.284027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:11.284568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.287103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.372129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port a2af2a5c-8d84-4f05-9494-9efd65088629 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:11.380784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a2af2a5c-8d84-4f05-9494-9efd65088629 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:11.381394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.427102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Port': ['ID=b1495035-c1d4-4947-8317-7f30cb9130fb,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:11.435924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:11.438043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3fd0329c-e002-4135-88a5-852f9a9166dc tempest-ServersTestJSON-1719529448 tempest-ServersTestJSON-1719529448-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.168s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:11.456651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dc88cf5-0518-44cd-995c-ee56df603f3e None None] Network 41c18b2a-c344-4766-be36-277eaa48676e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:11.594056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Pushing event deleted for resources: {'Port': ['ID=7cb017e9-125d-45ba-8dd7-703fb83b1b7e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:11.607854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:11.701709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.719916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.735621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] It took 0.41 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:01:11.756581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port a2af2a5c-8d84-4f05-9494-9efd65088629, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a2af2a5c-8d84-4f05-9494-9efd65088629,segment=NetworkSegment(97494fb6-9264-45f5-bf41-b9ed212d15c9),segment_id=97494fb6-9264-45f5-bf41-b9ed212d15c9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:11.781218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.787575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Provisioning for port d95da42e-dd93-436a-beb3-128304f0125e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:11.788762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-89b8bba8-6d98-473b-a408-40ec3da02935 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:11.797262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.801463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-bee762a5-98c4-474f-ae42-6ef1b57bd152 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:11.816445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.824913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3ccd0b6-1cf6-4e75-8862-da47da5f6cfc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:11.827937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:11.835310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fb6aa59d-1afe-4e21-b102-1c0a7187686c tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.011s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:11.844279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Provisioning complete for port d95da42e-dd93-436a-beb3-128304f0125e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:11.844688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.865396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.869168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:11.869739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:11.976290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:11.991426 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e35a9f7b-39ed-4301-ab0b-6d2ae8651cc7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 576 time: 0.7082648 Nov 24 14:01:11.991643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=a2af2a5c-8d84-4f05-9494-9efd65088629,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:11.992184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:11.995632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:11.997944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:12.005587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42506) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:12.027708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.028890 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d3ccd0b6-1cf6-4e75-8862-da47da5f6cfc HTTP/1.1" status: 204 len: 168 time: 1.4869146 Nov 24 14:01:12.030470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 1.4588726 Nov 24 14:01:12.031891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=d670b4ec-57fe-4eaa-abac-c1f52d488a15,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:12.035310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:12.036278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42512) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:12.041970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee282d02-dcd0-46b2-8ec8-a0019f8b2f52 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.144s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:12.077363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:12.089998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.137687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] For port d95da42e-dd93-436a-beb3-128304f0125e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d95da42e-dd93-436a-beb3-128304f0125e,segment=NetworkSegment(9260e382-62db-4293-9abc-4bdf45c4d4c2),segment_id=9260e382-62db-4293-9abc-4bdf45c4d4c2)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:12.150304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.152337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:12.152611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c13687-64d9-425f-b2eb-b16e1a6288a6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:12.154155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c13687-64d9-425f-b2eb-b16e1a6288a6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:12.158885 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-28c13687-64d9-425f-b2eb-b16e1a6288a6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.1462381 Nov 24 14:01:12.162801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42516) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:12.357215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.363350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=c304fcb7-303a-4d94-ac20-b8fab9ee80a9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:12.368250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.326s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:12.390022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8d5eecbb-3f7e-4894-a902-687bfa892098 None None] Provisioning for port b1495035-c1d4-4947-8317-7f30cb9130fb completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:12.406153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:12.409838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:12.418164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:12.422162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:12.426120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:12.444177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:12.447962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] Sync routers for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:12.465282 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/42b1bdf4-68b9-47df-8d46-bae330c84cdb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 12.1236091 Nov 24 14:01:12.467460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8d5eecbb-3f7e-4894-a902-687bfa892098 None None] Provisioning complete for port b1495035-c1d4-4947-8317-7f30cb9130fb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:12.468278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8d5eecbb-3f7e-4894-a902-687bfa892098 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.470517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42522) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:12.475814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:12.489520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-486597af-f317-48e5-befb-341a62d67098 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:12.490942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-486597af-f317-48e5-befb-341a62d67098 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:12.492749 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-486597af-f317-48e5-befb-341a62d67098 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.3286076 Nov 24 14:01:12.497081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42526) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:12.552498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Pushing event updated for resources: {'Port': ['ID=d95da42e-dd93-436a-beb3-128304f0125e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:12.585575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.433s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:12.636564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:12.637419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:12.678205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.686093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.705774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8d5eecbb-3f7e-4894-a902-687bfa892098 None None] Port b1495035-c1d4-4947-8317-7f30cb9130fb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:12.718962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:12.733060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:12.733842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:12.796593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.806866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:12.807410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69e3711d-3aba-4928-ba23-6d905cdde35e None None] The sync data for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:12.831545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3aee6b22-a32e-448e-85a8-9e4898d2ffaf None None] Provisioning complete for port d95da42e-dd93-436a-beb3-128304f0125e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:12.832420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3aee6b22-a32e-448e-85a8-9e4898d2ffaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:12.947096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d5aa5f4-ad6c-453e-8c85-d04a21decf98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:12.947955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d5aa5f4-ad6c-453e-8c85-d04a21decf98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Synchronizing usage tracker for tenant:5e936793ca53421b93b3d4209ca77990 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:12.956981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.006426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.007470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.016107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-506834ec-3d3f-4ff2-b59e-bb8dd8de4232 tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:13.042206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3aee6b22-a32e-448e-85a8-9e4898d2ffaf None None] Provisioning for port d670b4ec-57fe-4eaa-abac-c1f52d488a15 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:13.047938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3aee6b22-a32e-448e-85a8-9e4898d2ffaf None None] Provisioning complete for port d670b4ec-57fe-4eaa-abac-c1f52d488a15 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:13.048432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3aee6b22-a32e-448e-85a8-9e4898d2ffaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.050647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4d5aa5f4-ad6c-453e-8c85-d04a21decf98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Unset dirty status for tenant:5e936793ca53421b93b3d4209ca77990 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:13.052020 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4d5aa5f4-ad6c-453e-8c85-d04a21decf98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks/6f950245-e4b2-4735-849a-ee586a874fa7 HTTP/1.1" status: 200 len: 800 time: 0.5526118 Nov 24 14:01:13.081651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42538) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:13.084829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a2af2a5c-8d84-4f05-9494-9efd65088629 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:13.161988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3aee6b22-a32e-448e-85a8-9e4898d2ffaf None None] Port d670b4ec-57fe-4eaa-abac-c1f52d488a15 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:13.184625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a2af2a5c-8d84-4f05-9494-9efd65088629 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:13.185150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.341161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event updated for resources: {'Port': ['ID=b1495035-c1d4-4947-8317-7f30cb9130fb,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:13.404692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.389s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:13.453026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42548) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:13.470484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d95da42e-dd93-436a-beb3-128304f0125e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:13.522461 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-982647cb-3dd7-400f-b877-a5c0ca04c03a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/networks/6f950245-e4b2-4735-849a-ee586a874fa7?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.4346545 Nov 24 14:01:13.526623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42554) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:13.546812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d95da42e-dd93-436a-beb3-128304f0125e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:13.546812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.585549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:13.589106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:13.765581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--1335473425'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:13.855605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:13.883007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7d9b9a4-11a0-43e1-96af-4e3b0050d7dc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:13.885696 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d7d9b9a4-11a0-43e1-96af-4e3b0050d7dc tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/subnets/54f3d445-a1ce-4f48-818a-bed6a59f09f3 HTTP/1.1" status: 200 len: 811 time: 0.3567114 Nov 24 14:01:13.897826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:13.897986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:13.904860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:13.918341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:13.954534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.967307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:13.993975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1dd9a037-b43c-4ffb-9ff8-7d3662474ef6 None None] Provisioning complete for port b1495035-c1d4-4947-8317-7f30cb9130fb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:13.994645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1dd9a037-b43c-4ffb-9ff8-7d3662474ef6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.029232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.035899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e495a5ca-8232-458f-be71-e8f431e22d4c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:14.054527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1dd9a037-b43c-4ffb-9ff8-7d3662474ef6 None None] Port b1495035-c1d4-4947-8317-7f30cb9130fb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:14.059232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.065786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.079079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.136575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d217fa91-5817-4739-a6e6-e4c12a3a53f3 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:14.137957 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d217fa91-5817-4739-a6e6-e4c12a3a53f3 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "GET /v2.0/subnets/54f3d445-a1ce-4f48-818a-bed6a59f09f3?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.2356269 Nov 24 14:01:14.145044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42562) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:14.169201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=d670b4ec-57fe-4eaa-abac-c1f52d488a15,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:14.184546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:14.186919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-04a0fd3d-6a58-47e7-8dce-79cc5e04162a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.118s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:14.213703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-659505617'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:14.266548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.412984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:14.453578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:14.454578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': '26ddebb3-0e4d-48c6-a017-be48f7130c3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:14.455284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: c304fcb7-303a-4d94-ac20-b8fab9ee80a9, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:14.455927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:14.464713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:14.467430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=fd0bbe78-0313-4109-a6b9-752f149c51ea,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:14.469289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:14.480290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:14.481072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:14.499020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:14.501932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.506059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:14.510586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:14.604594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:14.674989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:14.701024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, c304fcb7-303a-4d94-ac20-b8fab9ee80a9) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:14.712437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:14.712879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afdce275-ff68-41a1-a9b9-2fe752011f96 None None] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:14.713904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.715173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.715531 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Added segment 8740ccea-2a85-4f45-b26d-bc316f9062f0 of type vlan for network 7884b3d9-4301-4a6d-ac64-582469e84aee Nov 24 14:01:14.786247 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.7193637 Nov 24 14:01:14.797261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.801543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42566) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:14.805527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.815172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9', 'name': 'tempest-PortsTestJSON-1922425182', 'fixed_ips': [{'subnet_id': 'fd0bbe78-0313-4109-a6b9-752f149c51ea', 'ip_address': '172.20.0.10'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:14.834680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Router d8199beb-49b1-48d9-ab92-543c1469b3ae has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:14.845673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:14.856632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f3b6e28e-8f51-4770-90c5-b31beb42eebd tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:14.952319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.resource_extend [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:01:14.955424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b8000a4f-9316-4cc8-a03b-0e43587e9682 None None] Provisioning complete for port d670b4ec-57fe-4eaa-abac-c1f52d488a15 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:14.955844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b8000a4f-9316-4cc8-a03b-0e43587e9682 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.004463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:15.017575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1eac635a-978a-4288-83b2-a6a08203543c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:15.021569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:15.024223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:15.031005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:15.037269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.042516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:15.043149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.052335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-c304fcb7-303a-4d94-ac20-b8fab9ee80a9', 'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': 'fd0bbe78-0313-4109-a6b9-752f149c51ea'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:15.053186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.066834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b8000a4f-9316-4cc8-a03b-0e43587e9682 None None] Port d670b4ec-57fe-4eaa-abac-c1f52d488a15 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:15.119962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-51fc8768-39ed-41c0-aed0-33cc620187f0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:15.143906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:15.236851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Allocated IP 172.20.0.2 (c304fcb7-303a-4d94-ac20-b8fab9ee80a9/fd0bbe78-0313-4109-a6b9-752f149c51ea/32fa787f-2217-4daf-bd49-bb14cfaccac4) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:15.334261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:15.349636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:15.353370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:15.363413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Network': ['ID=7884b3d9-4301-4a6d-ac64-582469e84aee,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:15.375404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:15.376943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:15.384822 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 1.2378020 Nov 24 14:01:15.392547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7884b3d9-4301-4a6d-ac64-582469e84aee details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:15.417268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42570) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:15.441384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:15.549083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:15.571602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.588136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.599571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Transition to ACTIVE for port object 32fa787f-2217-4daf-bd49-bb14cfaccac4 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:15.611795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.621498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Transition to ACTIVE for port object 32fa787f-2217-4daf-bd49-bb14cfaccac4 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:15.621916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3dbe4875-1d2e-4f6b-bf6b-e50e19b40a73 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:15.629305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.636182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-778a7e5d-025f-49c0-8182-33a8301c8c7d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:15.663008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:15.673288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.7027795 Nov 24 14:01:15.673685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42574) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:15.678781 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:15.680492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-1542475618'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:15.695629 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:15.696774 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:15.712342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:15.713317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:15.716853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:15.719861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:15.721515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:15.723475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 0033b20f-e38f-4165-87c0-a822bd77c119 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:15.723615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Pushing event updated for resources: {'Port': ['ID=32fa787f-2217-4daf-bd49-bb14cfaccac4,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:15.724016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.727605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:15.751084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:15.769632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:15.802249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:15.807531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.829917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Attempting to bind port 32fa787f-2217-4daf-bd49-bb14cfaccac4 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:15.831061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Attempting to bind port 32fa787f-2217-4daf-bd49-bb14cfaccac4 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '26ddebb3-0e4d-48c6-a017-be48f7130c3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:15.831253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:15.831440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Attempting to bind port 32fa787f-2217-4daf-bd49-bb14cfaccac4 on network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:15.840620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:15.840926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Checking segment: {'id': '26ddebb3-0e4d-48c6-a017-be48f7130c3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:15.841460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.841911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Bound using segment: {'id': '26ddebb3-0e4d-48c6-a017-be48f7130c3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:15.842388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Bound port: 32fa787f-2217-4daf-bd49-bb14cfaccac4, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '26ddebb3-0e4d-48c6-a017-be48f7130c3b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:15.842821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.890295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.894626 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 2.4340043 Nov 24 14:01:15.895983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7aa1d0ef-2a96-4f37-872e-e4fd41e24180,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:15.908825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:15.911796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42578) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:15.916715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:15.919924 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:15.940684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 884} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:15.968626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.968926 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment 8e40795f-cd8f-4b38-9f6f-a81082879b19 of type vlan for network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 Nov 24 14:01:15.971586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] For port 32fa787f-2217-4daf-bd49-bb14cfaccac4, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:15.975543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] For port 32fa787f-2217-4daf-bd49-bb14cfaccac4, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32fa787f-2217-4daf-bd49-bb14cfaccac4,segment=NetworkSegment(26ddebb3-0e4d-48c6-a017-be48f7130c3b),segment_id=26ddebb3-0e4d-48c6-a017-be48f7130c3b)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:15.981859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:15.988092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c09b3bfc-7341-4fc4-9104-130eb0300889 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:16.000884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.028530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.032650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port efbb740c-867d-470b-843c-4c3f1cab73b1 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:01:16.037816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.075653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Pushing event updated for resources: {'Port': ['ID=32fa787f-2217-4daf-bd49-bb14cfaccac4,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:16.088673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:16.169607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 0033b20f-e38f-4165-87c0-a822bd77c119 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:16.211988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:01:16.282482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.286769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:16.291489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.310459 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:12Z', 'revision_number': 3, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:13Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:16.318495 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:16.319253 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Updating router 8b1794c5-dde1-4c7a-a979-ba268c818d76 port d670b4ec-57fe-4eaa-abac-c1f52d488a15 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:01:16.326000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Made reservation on behalf of 5e936793ca53421b93b3d4209ca77990 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:16.331606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d54523fe-6ae4-4d9f-b19b-dd1625667e42 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:16.388626 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.469070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:16.473655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:16.476886 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.8017731 Nov 24 14:01:16.479625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:16.484589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:16.503358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:16.615509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.10 (c304fcb7-303a-4d94-ac20-b8fab9ee80a9/fd0bbe78-0313-4109-a6b9-752f149c51ea/efbb740c-867d-470b-843c-4c3f1cab73b1) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:16.661930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-62c6f5d9-5244-479f-8130-a6238d8276d8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:16.686102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:16.693370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:16.705907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:16.706177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:16.718208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] Sync routers for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:16.723331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:16.731382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:16.732456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:16.761957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.772475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83cd3554-bbc5-4c64-99a0-d93dcb53de2e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:16.825917 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.829963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:16.834803 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.6391618 Nov 24 14:01:16.844188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:16.844758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.845056 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Transition to ACTIVE for port object d670b4ec-57fe-4eaa-abac-c1f52d488a15 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:16.845195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:16.856184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42586) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:16.859065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=0033b20f-e38f-4165-87c0-a822bd77c119,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:16.864812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-62c6f5d9-5244-479f-8130-a6238d8276d8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:16.865140 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:16.866903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:16.870071 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-62c6f5d9-5244-479f-8130-a6238d8276d8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4007 time: 0.9560242 Nov 24 14:01:16.872689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:16.876839 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8c7f8f9a-bd7d-4ce7-a827-1ee49ba2af67 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:16.892872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42590) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:16.970887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:16.971561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b433f38b-63d4-4675-a4f3-4e26e2ed7501 None None] The sync data for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:16.987959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-security--389521512', 'description': 'tempest-security-description-920217130'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:17.031405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32fa787f-2217-4daf-bd49-bb14cfaccac4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:17.032730 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8cdf25f-d7b4-45e0-bff6-451d3d16d3e8 None None] Pushing event updated for resources: {'Port': ['ID=d670b4ec-57fe-4eaa-abac-c1f52d488a15,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:17.037272 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8cdf25f-d7b4-45e0-bff6-451d3d16d3e8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:17.081050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.ipam_backend_mixin [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing IP validity checks on allocation pools {{(pid=83526) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 14:01:17.081602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.ipam_backend_mixin [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83526) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 14:01:17.210555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.217544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 32fa787f-2217-4daf-bd49-bb14cfaccac4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:17.299650 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Attempting to bind port d670b4ec-57fe-4eaa-abac-c1f52d488a15 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:17.300058 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Attempting to bind port d670b4ec-57fe-4eaa-abac-c1f52d488a15 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:17.300457 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Attempting to bind port d670b4ec-57fe-4eaa-abac-c1f52d488a15 on network 89cc7986-be93-42b0-bf08-7a1aa46579f1 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:17.306284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:17.313446 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:17.314009 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Checking segment: {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:17.314547 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.315745 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Bound using segment: {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:17.316401 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Bound port: d670b4ec-57fe-4eaa-abac-c1f52d488a15, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '97494fb6-9264-45f5-bf41-b9ed212d15c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:17.316790 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.336796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object efbb740c-867d-470b-843c-4c3f1cab73b1 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:17.349805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] 10.222.0.70 "PUT /v2.0/routers/0cae4fcd-f667-49b0-8c04-a43cca4a8dc1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 11.5358131 Nov 24 14:01:17.351032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42594) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:17.356730 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] Sync routers for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:17.430643 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:17.431512 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:17.548647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.558942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-712aac09-f33d-4b9e-81cb-c2b4fc28fa49 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:17.583353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.654126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.660947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efbd6f89-5614-460a-b25f-9d2d00f42a1f None None] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:17.670358 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] For port d670b4ec-57fe-4eaa-abac-c1f52d488a15, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:17.694910 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] For port d670b4ec-57fe-4eaa-abac-c1f52d488a15, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d670b4ec-57fe-4eaa-abac-c1f52d488a15,segment=NetworkSegment(97494fb6-9264-45f5-bf41-b9ed212d15c9),segment_id=97494fb6-9264-45f5-bf41-b9ed212d15c9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:17.702861 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.712919 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fc643b-8f42-476e-8057-d171ad53b391 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:17.770026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:17.786140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:17.787390 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8cdf25f-d7b4-45e0-bff6-451d3d16d3e8 None None] Pushing event updated for resources: {'Port': ['ID=d670b4ec-57fe-4eaa-abac-c1f52d488a15,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:17.795900 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8cdf25f-d7b4-45e0-bff6-451d3d16d3e8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:17.800607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.803693 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:17.808142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:17.820622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Provisioning for port 32fa787f-2217-4daf-bd49-bb14cfaccac4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:17.826996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.839197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Provisioning complete for port 32fa787f-2217-4daf-bd49-bb14cfaccac4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:17.839578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:17.874431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Checking segment: {'id': '8740ccea-2a85-4f45-b26d-bc316f9062f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:17.874950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network hostable DHCP agents. Network: 7884b3d9-4301-4a6d-ac64-582469e84aee, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:17.892541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=a49a47fe-f19e-475c-ad56-3f8e8ea346bd,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:17.910494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:17.917110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.156s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:18.039971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.051634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.062680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.078132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:18.078961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.084197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fdea23c6-e874-4dbb-aa07-fb9b77ebf1cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:18.112688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.118164 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "PUT /v2.0/security-groups/7aa1d0ef-2a96-4f37-872e-e4fd41e24180 HTTP/1.1" status: 200 len: 1610 time: 1.1347425 Nov 24 14:01:18.120252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:18.142127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=efbb740c-867d-470b-843c-4c3f1cab73b1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:18.145807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Network 7884b3d9-4301-4a6d-ac64-582469e84aee is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:18.150931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:18.153536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.183392 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:18.185170 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:18.196807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7aa1d0ef-2a96-4f37-872e-e4fd41e24180,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:18.225652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.252280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:18.283034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-583652e5-9114-425a-abe6-703c7f091c01 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.298239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] For port 32fa787f-2217-4daf-bd49-bb14cfaccac4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32fa787f-2217-4daf-bd49-bb14cfaccac4,segment=NetworkSegment(26ddebb3-0e4d-48c6-a017-be48f7130c3b),segment_id=26ddebb3-0e4d-48c6-a017-be48f7130c3b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:18.307738 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 3.5003843 Nov 24 14:01:18.310057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.315026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8627cbac-80d4-4bab-a810-6df839a858dc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:18.330889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42602) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:18.361400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': 'c304fcb7-303a-4d94-ac20-b8fab9ee80a9', 'name': 'tempest-PortsTestJSON-862550463', 'fixed_ips': [{'subnet_id': 'fd0bbe78-0313-4109-a6b9-752f149c51ea', 'ip_address': '172.20.0.9'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:18.400815 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:18.499489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Pushing event updated for resources: {'Port': ['ID=32fa787f-2217-4daf-bd49-bb14cfaccac4,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:18.506743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:18.527205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7884b3d9-4301-4a6d-ac64-582469e84aee) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:18.537885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46980b8a-c979-4d44-9eb1-9953c190f9a6 None None] Network 7884b3d9-4301-4a6d-ac64-582469e84aee requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:18.551072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:18.551666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.612719 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 3.1890728 Nov 24 14:01:18.621775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42606) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:18.628318 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-194f09a4-a53a-4959-a1c0-afc0c54fd8e6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups/7aa1d0ef-2a96-4f37-872e-e4fd41e24180 HTTP/1.1" status: 200 len: 1610 time: 0.4889727 Nov 24 14:01:18.632075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42610) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:18.636001 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T14:01:11Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:18.637725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:18.660961 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] Checking router: 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:18.771179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:18.786257 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] Routers {'0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:18.787289 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:18.791336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:18.807501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:18.811458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-175ade84-5a32-4374-836f-92030f4eaf7e None None] Provisioning for port efbb740c-867d-470b-843c-4c3f1cab73b1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:18.815219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:18.828749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-175ade84-5a32-4374-836f-92030f4eaf7e None None] Provisioning complete for port efbb740c-867d-470b-843c-4c3f1cab73b1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:18.829310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-175ade84-5a32-4374-836f-92030f4eaf7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.863870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:18.869383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.879014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7884b3d9-4301-4a6d-ac64-582469e84aee', 'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee', 'tenant_id': '5e936793ca53421b93b3d4209ca77990', 'fixed_ips': [{'subnet_id': 'a49a47fe-f19e-475c-ad56-3f8e8ea346bd'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:18.881913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.884440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:18.933884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:01:18.981288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.003445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32fa787f-2217-4daf-bd49-bb14cfaccac4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:19.065613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.084993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-175ade84-5a32-4374-836f-92030f4eaf7e None None] Port efbb740c-867d-470b-843c-4c3f1cab73b1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:19.125039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Deleting port 82103695-e509-4b3b-acea-f6a9415b56f1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:19.125415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.197323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-175ade84-5a32-4374-836f-92030f4eaf7e None None] Provisioning complete for port 32fa787f-2217-4daf-bd49-bb14cfaccac4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:19.197698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-175ade84-5a32-4374-836f-92030f4eaf7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.241408 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] Set router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:19.293626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Allocated IP 172.20.0.3 (7884b3d9-4301-4a6d-ac64-582469e84aee/a49a47fe-f19e-475c-ad56-3f8e8ea346bd/205930a5-057c-489e-8264-b728974e552c) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:19.348703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 32fa787f-2217-4daf-bd49-bb14cfaccac4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:19.349090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.377324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.387083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f6ff51d1-4b1f-4de5-8e26-5433b8145309 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:19.421475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7aa1d0ef-2a96-4f37-872e-e4fd41e24180,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:19.424725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:19.472610 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:12Z', 'revision_number': 3, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:17Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:19.494223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.495711 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/7aa1d0ef-2a96-4f37-872e-e4fd41e24180 HTTP/1.1" status: 204 len: 168 time: 0.8620114 Nov 24 14:01:19.506418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42614) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:19.518765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.530435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d8b07e99-9933-4665-8635-3a452876fccf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:19.597810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.9 (c304fcb7-303a-4d94-ac20-b8fab9ee80a9/fd0bbe78-0313-4109-a6b9-752f149c51ea/c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:19.598906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=6b036948-8a00-453f-b2c4-56c46a11b1af,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:19.611364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:19.619874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8100982'] for subnet, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.651952 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-583652e5-9114-425a-abe6-703c7f091c01 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 24 14:01:19.655722 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-583652e5-9114-425a-abe6-703c7f091c01 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae HTTP/1.1" status: 409 len: 329 time: 2.7904201 Nov 24 14:01:19.658613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:19.706324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] For port 82103695-e509-4b3b-acea-f6a9415b56f1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=82103695-e509-4b3b-acea-f6a9415b56f1,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:19.706776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.714863 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5416fc7-651e-489d-9123-b415a99efc8e None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:12Z', 'revision_number': 3, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:17Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:19.738527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 42b1bdf4-68b9-47df-8d46-bae330c84cdb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:19.825327 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T14:01:11Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:19.834939 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3649857d-46b6-4862-a58b-b927ee6cd35b None None] The sync data for ids ['0cae4fcd-f667-49b0-8c04-a43cca4a8dc1'] in dv-neutron-818151-2-hyperv is: [{'id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'name': 'tempest-ServerActionsTestJSON-665950053-router', 'tenant_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147'}], 'enable_snat': True}, 'gw_port_id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T13:54:59Z', 'updated_at': '2021-11-24T14:01:11Z', 'revision_number': 5, 'project_id': 'a6e6213b81eb4772a787ef2b41ed785b', 'gw_port': {'id': '82103695-e509-4b3b-acea-f6a9415b56f1', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:58:e9:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0cae4fcd-f667-49b0-8c04-a43cca4a8dc1', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.147', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T13:55:00Z', 'updated_at': '2021-11-24T13:55:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:19.838732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3444b584-5de9-4805-b682-fb2cdb2b08a6 None None] Provisioning complete for port efbb740c-867d-470b-843c-4c3f1cab73b1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:19.843022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3444b584-5de9-4805-b682-fb2cdb2b08a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.879018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Calling delete_port for 82103695-e509-4b3b-acea-f6a9415b56f1 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:19.912230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.946306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Transition to ACTIVE for port object 205930a5-057c-489e-8264-b728974e552c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:19.968199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3444b584-5de9-4805-b682-fb2cdb2b08a6 None None] Port efbb740c-867d-470b-843c-4c3f1cab73b1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:19.979139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Transition to ACTIVE for port object 205930a5-057c-489e-8264-b728974e552c will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:19.988628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:19.993174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-56f4674f-6365-4185-8692-6807af25ce7e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:19.999955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:20.000365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:20.045636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f501d772-89c8-40dd-9aa5-85f78452db24 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:20.089712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:20.104739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] Sync routers for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:20.121354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f501d772-89c8-40dd-9aa5-85f78452db24 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:20.123123 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f501d772-89c8-40dd-9aa5-85f78452db24 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.6157393 Nov 24 14:01:20.126129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42622) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:20.128932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:20.137502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Network 7884b3d9-4301-4a6d-ac64-582469e84aee is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:20.138672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Pushing event updated for resources: {'Port': ['ID=205930a5-057c-489e-8264-b728974e552c,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:20.147141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:20.148468 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/42b1bdf4-68b9-47df-8d46-bae330c84cdb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.6767941 Nov 24 14:01:20.149239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42626) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:20.149473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:20.150053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:20.150731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:20.169996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-50fbc0a8-c4da-49e8-8ad9-55b4ce173b08 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] delete failed (client error): The resource could not be found. Nov 24 14:01:20.175241 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-50fbc0a8-c4da-49e8-8ad9-55b4ce173b08 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/7aa1d0ef-2a96-4f37-872e-e4fd41e24180 HTTP/1.1" status: 404 len: 347 time: 0.0437200 Nov 24 14:01:20.175241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42630) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:20.184310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--2132544246'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:20.191233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:20.225035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.238966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:20.245174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:20.248463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:20.267393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-88788afe-9303-4726-b8d9-1dc7ac92c440 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:20.269609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e52fba5e-7e7b-40d1-aaae-072690d9ed22 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:20.270290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:20.270879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.277611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d089c3-5d5a-49c8-afe9-0ace04fe7d42 None None] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:20.340501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:20.401597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Pushing event deleted for resources: {'Port': ['ID=82103695-e509-4b3b-acea-f6a9415b56f1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:20.405074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:20.413396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-88788afe-9303-4726-b8d9-1dc7ac92c440 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:20.418339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-88788afe-9303-4726-b8d9-1dc7ac92c440 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=42b1bdf4-68b9-47df-8d46-bae330c84cdb HTTP/1.1" status: 200 len: 205 time: 0.2639797 Nov 24 14:01:20.457427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42634) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:20.510569 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 4.0296431 Nov 24 14:01:20.560424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Attempting to bind port 205930a5-057c-489e-8264-b728974e552c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:20.563385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Attempting to bind port 205930a5-057c-489e-8264-b728974e552c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '8740ccea-2a85-4f45-b26d-bc316f9062f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:20.563905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Attempting to bind port 205930a5-057c-489e-8264-b728974e552c on network 7884b3d9-4301-4a6d-ac64-582469e84aee {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:20.568235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] Routers {'42b1bdf4-68b9-47df-8d46-bae330c84cdb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:20.568985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:20.591462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42638) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:20.623323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8771276033028', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-7895437'] for subnet, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.637767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4dc5fbf7-3b93-40e7-abe3-4dc2f8563093 tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:20.666661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:20.667318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4981901f-e128-4cd7-9461-8e9cb2593cfe None None] The sync data for ids ['42b1bdf4-68b9-47df-8d46-bae330c84cdb'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:20.677652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:20.678148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Checking segment: {'id': '8740ccea-2a85-4f45-b26d-bc316f9062f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:20.678664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.679153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Bound using segment: {'id': '8740ccea-2a85-4f45-b26d-bc316f9062f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:20.680003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Bound port: 205930a5-057c-489e-8264-b728974e552c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8740ccea-2a85-4f45-b26d-bc316f9062f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '7884b3d9-4301-4a6d-ac64-582469e84aee'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:20.680707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.712677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:20.713272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.718146 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "PUT /v2.0/subnets/a49a47fe-f19e-475c-ad56-3f8e8ea346bd HTTP/1.1" status: 200 len: 877 time: 2.0875819 Nov 24 14:01:20.721527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42642) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:20.745743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event updated for resources: {'Subnet': ['ID=a49a47fe-f19e-475c-ad56-3f8e8ea346bd,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:20.752575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:20.752750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.854024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] For port 205930a5-057c-489e-8264-b728974e552c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:20.864689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] For port 205930a5-057c-489e-8264-b728974e552c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=205930a5-057c-489e-8264-b728974e552c,segment=NetworkSegment(8740ccea-2a85-4f45-b26d-bc316f9062f0),segment_id=8740ccea-2a85-4f45-b26d-bc316f9062f0)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:20.870910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.887509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-971fbc9a-1f15-468f-8696-b23ffa6422aa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:20.894413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.928972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:20.931035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:20.955891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.048116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Pushing event updated for resources: {'Port': ['ID=205930a5-057c-489e-8264-b728974e552c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:21.058246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:21.199356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d670b4ec-57fe-4eaa-abac-c1f52d488a15 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:21.230848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.252811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port 205930a5-057c-489e-8264-b728974e552c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:21.253145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.268162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Allocated IP 172.22.0.2 (2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37/6b036948-8a00-453f-b2c4-56c46a11b1af/3beaa343-1d37-4d86-abb6-f2b05fd43e29) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:21.308845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.385353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d670b4ec-57fe-4eaa-abac-c1f52d488a15 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:21.401638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d670b4ec-57fe-4eaa-abac-c1f52d488a15 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:21.404047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.510485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:21.542348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.607268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:21.610616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:21.677807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:21.696243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:21.786402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] For port 205930a5-057c-489e-8264-b728974e552c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=205930a5-057c-489e-8264-b728974e552c,segment=NetworkSegment(8740ccea-2a85-4f45-b26d-bc316f9062f0),segment_id=8740ccea-2a85-4f45-b26d-bc316f9062f0)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:21.787439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.815626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.855124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.872126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Transition to ACTIVE for port object 3beaa343-1d37-4d86-abb6-f2b05fd43e29 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:21.879712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d670b4ec-57fe-4eaa-abac-c1f52d488a15, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d670b4ec-57fe-4eaa-abac-c1f52d488a15,segment=NetworkSegment(97494fb6-9264-45f5-bf41-b9ed212d15c9),segment_id=97494fb6-9264-45f5-bf41-b9ed212d15c9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:21.884925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.890212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:21.935235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Calling delete_port for 205930a5-057c-489e-8264-b728974e552c owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:21.942321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7cb017e9-125d-45ba-8dd7-703fb83b1b7e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:21.985622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:21.994177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Transition to ACTIVE for port object 3beaa343-1d37-4d86-abb6-f2b05fd43e29 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:21.994177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 7cb017e9-125d-45ba-8dd7-703fb83b1b7e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:21.994177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7cb017e9-125d-45ba-8dd7-703fb83b1b7e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:22.017311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.045507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:22.048461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:22.050841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:22.053266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d670b4ec-57fe-4eaa-abac-c1f52d488a15,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.069732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.072410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.039s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:22.083936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.088060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.170911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a4cf3bc-736f-4b24-8396-ab8147a0e221 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:22.216856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Pushing event updated for resources: {'Port': ['ID=3beaa343-1d37-4d86-abb6-f2b05fd43e29,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.219700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.262880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Attempting to bind port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:22.264095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Attempting to bind port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:22.265710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Attempting to bind port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 on network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:22.271659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.277028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:22.277288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f1ef6f0c-e59d-4da3-8767-2d4920963c63 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:22.277676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Checking segment: {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:22.278229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.278912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Bound using segment: {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:22.279532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Bound port: 3beaa343-1d37-4d86-abb6-f2b05fd43e29, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:22.280068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.352737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Port': ['ID=205930a5-057c-489e-8264-b728974e552c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.381864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.407432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] For port 3beaa343-1d37-4d86-abb6-f2b05fd43e29, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:22.410694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] For port 3beaa343-1d37-4d86-abb6-f2b05fd43e29, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3beaa343-1d37-4d86-abb6-f2b05fd43e29,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:22.420130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.421214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:22.429746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:22.479252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No DVR routers for this DVR port 205930a5-057c-489e-8264-b728974e552c on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:22.492105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.498565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:22.501299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:22.561874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-528aa210-9da2-40cb-93ad-7b224d6b633b None None] Network 7884b3d9-4301-4a6d-ac64-582469e84aee requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:22.563013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.581262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.602949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-218902c7-b147-41d8-98f0-4096cf3cb461 None None] Could not find standard attr ID for object 205930a5-057c-489e-8264-b728974e552c. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:01:22.622948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.630466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.635097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.464s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.638915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4d092eeb-3942-482d-af85-84bffc837bba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:22.652326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:22.653004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.689509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.693120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.693492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:01:22.693759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Pushing event updated for resources: {'Port': ['ID=3beaa343-1d37-4d86-abb6-f2b05fd43e29,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.696678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port b1495035-c1d4-4947-8317-7f30cb9130fb {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:22.697080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.704736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.751908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.756167 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] 10.222.0.70 "DELETE /v2.0/routers/0cae4fcd-f667-49b0-8c04-a43cca4a8dc1 HTTP/1.1" status: 204 len: 168 time: 5.3974791 Nov 24 14:01:22.759299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42646) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:22.764587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=848c9e5b-521c-4516-ae46-198fdc6db1cd,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.770571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.891942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:22.898951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-147f2764-6e89-4bbf-8bc4-6a5ac0517c7b tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:22.941490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0881c96f-f3a6-40ef-93ce-a8c4c1e9a8cb None None] Provisioning for port c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:22.943607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=a49a47fe-f19e-475c-ad56-3f8e8ea346bd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:22.951219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:22.956117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0881c96f-f3a6-40ef-93ce-a8c4c1e9a8cb None None] Provisioning complete for port c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:22.956837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0881c96f-f3a6-40ef-93ce-a8c4c1e9a8cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.006828 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 4.6715367 Nov 24 14:01:23.008402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.013441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 2.8369551 Nov 24 14:01:23.018245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42650) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:23.018645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42652) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:23.085470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.086993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router 42b1bdf4-68b9-47df-8d46-bae330c84cdb {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:01:23.099737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-0881c96f-f3a6-40ef-93ce-a8c4c1e9a8cb None None] Port c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:23.102344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d670b4ec-57fe-4eaa-abac-c1f52d488a15 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:23.113341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Deleting subnet d04c57a1-6813-42f8-932e-ab9506091c4e {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:23.190420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.220912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '848c9e5b-521c-4516-ae46-198fdc6db1cd', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:23.234820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d670b4ec-57fe-4eaa-abac-c1f52d488a15 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:23.238662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.328224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4463581d-9c0d-4a65-8dd5-387e706eea34 None None] Network 7884b3d9-4301-4a6d-ac64-582469e84aee requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:23.355502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:23.379584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.388876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:23.399798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:23.407139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.416604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.422087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8e4e6a04-5757-40ae-8442-e42b482ae5d8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/42b1bdf4-68b9-47df-8d46-bae330c84cdb HTTP/1.1" status: 204 len: 168 time: 2.9268041 Nov 24 14:01:23.423493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42658) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:23.439164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:23.490192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.505676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7884b3d9-4301-4a6d-ac64-582469e84aee']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:23.580692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Calling delete_port for b1495035-c1d4-4947-8317-7f30cb9130fb owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:23.627405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8740ccea-2a85-4f45-b26d-bc316f9062f0') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:23.627710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8740ccea-2a85-4f45-b26d-bc316f9062f0') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:23.648602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.656903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.703779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.739689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 897 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:23.740111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.751641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet eab0d0fe-90d2-4c39-b7fb-965833a7b41a {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:23.755892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba686236-12e0-458c-b296-b7250edf466a None None] DHCP port deletion for 7884b3d9-4301-4a6d-ac64-582469e84aee request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:23.757005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:23.766407 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:23.800445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.802777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2931e32e-9891-4663-9f2f-3b84d69d8bdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:23.803474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2931e32e-9891-4663-9f2f-3b84d69d8bdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:23.868951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.916690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.951389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d7ea9a-5f5f-41ca-a965-5487817560c9 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:23.966024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.970035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:23.973704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2931e32e-9891-4663-9f2f-3b84d69d8bdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:23.974875 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2931e32e-9891-4663-9f2f-3b84d69d8bdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 923 time: 0.9552879 Nov 24 14:01:23.982872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42662) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:23.983697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=7884b3d9-4301-4a6d-ac64-582469e84aee,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:24.022929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:24.026743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.051226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-de78602d-eee0-48c9-9a37-e35199647568 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:24.087580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.093477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c9701b3e-9d95-45e2-b029-16c16b8a1668 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:24.117739 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/7884b3d9-4301-4a6d-ac64-582469e84aee HTTP/1.1" status: 204 len: 168 time: 3.3919079 Nov 24 14:01:24.121650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=34cce9fb-a15e-4410-a7e8-0b1661ebbcf0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:24.126400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42666) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.129097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:24.155079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d04c57a1-6813-42f8-932e-ab9506091c4e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:24.157606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:24.161788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a978826-2015-4915-a18a-80b46b43e5d5 None None] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:24.162353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.172950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.176486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.180675 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 1.1564622 Nov 24 14:01:24.189995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42670) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.190979 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca5a71f7-97c2-4520-a7b9-5955d5bc4900 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:24.191413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ca5a71f7-97c2-4520-a7b9-5955d5bc4900 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:24.195644 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ca5a71f7-97c2-4520-a7b9-5955d5bc4900 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/a49a47fe-f19e-475c-ad56-3f8e8ea346bd HTTP/1.1" status: 404 len: 337 time: 0.0655365 Nov 24 14:01:24.197760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42672) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.208894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.249198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-450fec15-dba5-4783-88f3-59dd806a9cfe None None] Network 7c23cefd-d4e1-4241-a3d2-42622a5131e3 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:24.250577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.254658 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-85bf2512-f826-48c9-8f67-65d8db89b957 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:24.255092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-85bf2512-f826-48c9-8f67-65d8db89b957 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:24.259099 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-85bf2512-f826-48c9-8f67-65d8db89b957 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/7884b3d9-4301-4a6d-ac64-582469e84aee HTTP/1.1" status: 404 len: 339 time: 0.0561740 Nov 24 14:01:24.259099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:24.324234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42678) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.378287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.383228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Port': ['ID=b1495035-c1d4-4947-8317-7f30cb9130fb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:24.389275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:24.394308 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-87dec4c5-9798-4027-9c2d-03a3f6c119e6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:24.394751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-87dec4c5-9798-4027-9c2d-03a3f6c119e6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:24.399950 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-87dec4c5-9798-4027-9c2d-03a3f6c119e6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/3cbec4cd-2564-4892-84de-e26f8cb2c4dd HTTP/1.1" status: 404 len: 337 time: 0.0657136 Nov 24 14:01:24.400140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.406325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-40604520-7139-4857-b855-9592f94c5abd None None] Provisioning for port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:24.433333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42682) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.440633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9050f0c9-8201-421b-8731-beb9041c8c91 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:24.443716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9af5f3c8-2837-4542-a093-05cddb8d86e2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:24.444664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9050f0c9-8201-421b-8731-beb9041c8c91 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:24.449416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9050f0c9-8201-421b-8731-beb9041c8c91 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:24.451106 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9050f0c9-8201-421b-8731-beb9041c8c91 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2379 time: 0.4653621 Nov 24 14:01:24.476070 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] 10.222.0.70 "DELETE /v2.0/subnets/d04c57a1-6813-42f8-932e-ab9506091c4e HTTP/1.1" status: 204 len: 168 time: 1.7130890 Nov 24 14:01:24.477390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42686) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.477853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42688) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.494260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.583144 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c65ee28-e90d-4043-87d9-99807127af23 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:24.583494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c65ee28-e90d-4043-87d9-99807127af23 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:24.587939 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2c65ee28-e90d-4043-87d9-99807127af23 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/a453ffa9-1409-4817-9300-dbd08ded9f28 HTTP/1.1" status: 404 len: 339 time: 0.1328695 Nov 24 14:01:24.634350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42694) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.664900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.674539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=eab0d0fe-90d2-4c39-b7fb-965833a7b41a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:24.683501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:24.697902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.705680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49d46652-3043-44d3-80ee-822c61296435 None None] Network ac1bda5c-7660-4f44-aab3-2ae0cf38a180 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:24.766401 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/eab0d0fe-90d2-4c39-b7fb-965833a7b41a HTTP/1.1" status: 204 len: 168 time: 1.3197062 Nov 24 14:01:24.772450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:24.772790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.786623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42698) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.795954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.799902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] DHCP port deletion for 7c23cefd-d4e1-4241-a3d2-42622a5131e3 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:24.821908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Deleting port 56c8174f-1729-44dc-ac74-e921f21a7c80 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:24.822383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.859745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:24.881804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=34cce9fb-a15e-4410-a7e8-0b1661ebbcf0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:24.884927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:24.890975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.897875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:24.903139 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/34cce9fb-a15e-4410-a7e8-0b1661ebbcf0 HTTP/1.1" status: 204 len: 168 time: 0.7054522 Nov 24 14:01:24.911835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42702) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:24.932759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.060086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3beaa343-1d37-4d86-abb6-f2b05fd43e29 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:25.076459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Deleting port 56c8174f-1729-44dc-ac74-e921f21a7c80 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:25.076795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.341210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:25.363560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:25.363560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.437107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7b5139b9-59c9-40a6-ab3a-c250b48a24ca tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:25.442312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] For port 56c8174f-1729-44dc-ac74-e921f21a7c80, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=56c8174f-1729-44dc-ac74-e921f21a7c80,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:25.443524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.483739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.503828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet 472eec3c-b375-4ea9-b4df-ba09d7003ada {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:25.518516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.572042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] DHCP port deletion for ac1bda5c-7660-4f44-aab3-2ae0cf38a180 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:25.581886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Calling delete_port for 56c8174f-1729-44dc-ac74-e921f21a7c80 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:25.596757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.22.0.1 (2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37/6b036948-8a00-453f-b2c4-56c46a11b1af/565160e6-a40f-40ee-a7d7-7f75b51fee2a) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:25.599792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.621852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['23e1cf3f-a2a8-43ac-b801-d1e45af52b39']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:25.624485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Deleting port e6c679e7-cb66-4c24-83e7-2c4a45ce410c {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:25.624861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.629199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7b5139b9-59c9-40a6-ab3a-c250b48a24ca tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:25.634527 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7b5139b9-59c9-40a6-ab3a-c250b48a24ca tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.7174554 Nov 24 14:01:25.647681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42706) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:25.651673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8be7cdb7-682c-496d-9cc8-74db27af9557') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:25.652062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8be7cdb7-682c-496d-9cc8-74db27af9557') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:25.739747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:25.761816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.771723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.797810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.799715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] For port 56c8174f-1729-44dc-ac74-e921f21a7c80, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=56c8174f-1729-44dc-ac74-e921f21a7c80,segment=NetworkSegment(294894e1-7345-4c10-ab6b-ce6e04e017bb),segment_id=294894e1-7345-4c10-ab6b-ce6e04e017bb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:25.800089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.813444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.822046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:25.847143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.866821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 856 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:25.867950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:25.887711 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:25.902475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Pushing event deleted for resources: {'Port': ['ID=56c8174f-1729-44dc-ac74-e921f21a7c80,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:25.908537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:25.984783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] No DVR routers for this DVR port 56c8174f-1729-44dc-ac74-e921f21a7c80 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:26.012051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Calling delete_port for 56c8174f-1729-44dc-ac74-e921f21a7c80 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:26.031205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] For port e6c679e7-cb66-4c24-83e7-2c4a45ce410c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,segment=NetworkSegment(4c66be1f-461b-43bb-83ba-3741548a7f5b),segment_id=4c66be1f-461b-43bb-83ba-3741548a7f5b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:26.031608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.042582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 3beaa343-1d37-4d86-abb6-f2b05fd43e29, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3beaa343-1d37-4d86-abb6-f2b05fd43e29,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:26.145049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.159553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.161857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.168993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Calling delete_port for e6c679e7-cb66-4c24-83e7-2c4a45ce410c owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:26.173929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.192452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.200719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0bafafc4-bf37-48bf-95bf-c3a279f3804c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.221036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=23e1cf3f-a2a8-43ac-b801-d1e45af52b39,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.223038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.224994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.241400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 565160e6-a40f-40ee-a7d7-7f75b51fee2a will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:26.263114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.264844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.275215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.282196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.286010 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/23e1cf3f-a2a8-43ac-b801-d1e45af52b39 HTTP/1.1" status: 204 len: 168 time: 1.6467519 Nov 24 14:01:26.290221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42710) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.303070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 56c8174f-1729-44dc-ac74-e921f21a7c80 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:26.337005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=3beaa343-1d37-4d86-abb6-f2b05fd43e29,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.340141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.342947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Router d8199beb-49b1-48d9-ab92-543c1469b3ae has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:26.352123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.355368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 56c8174f-1729-44dc-ac74-e921f21a7c80 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:26.355368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 56c8174f-1729-44dc-ac74-e921f21a7c80 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:26.355368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 82103695-e509-4b3b-acea-f6a9415b56f1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:26.358751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.364004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.367661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-521aa8c5-393e-44c3-a0b4-a469fd9ea98e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.013s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.368461 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-075da544-528d-4e16-8336-dbb0be0732b7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:26.368897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-075da544-528d-4e16-8336-dbb0be0732b7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:26.372817 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-075da544-528d-4e16-8336-dbb0be0732b7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/bc156b09-3e50-468f-8987-fbed0a846862 HTTP/1.1" status: 404 len: 337 time: 0.0747049 Nov 24 14:01:26.381313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42714) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.388362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.397280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd1019d0-fc2a-45a4-9a56-d9d9bed6f6cb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.427167 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-1acdb710-9733-4e60-94c2-62e15092d3e5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:26.427913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1acdb710-9733-4e60-94c2-62e15092d3e5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:26.432671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 82103695-e509-4b3b-acea-f6a9415b56f1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:26.433641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 82103695-e509-4b3b-acea-f6a9415b56f1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:26.433641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 205930a5-057c-489e-8264-b728974e552c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:26.457025 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1acdb710-9733-4e60-94c2-62e15092d3e5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/2f2fc36e-ec38-47c5-8ed2-43bdeb6d3a9e HTTP/1.1" status: 404 len: 339 time: 0.0689380 Nov 24 14:01:26.468395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Pushing event deleted for resources: {'Port': ['ID=e6c679e7-cb66-4c24-83e7-2c4a45ce410c,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.477574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.478393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42718) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.480216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 205930a5-057c-489e-8264-b728974e552c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:26.480671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 205930a5-057c-489e-8264-b728974e552c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:26.485233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] No DVR routers for this DVR port e6c679e7-cb66-4c24-83e7-2c4a45ce410c on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:26.520758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.525590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.527947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.531331 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/848c9e5b-521c-4516-ae46-198fdc6db1cd HTTP/1.1" status: 204 len: 168 time: 0.8798037 Nov 24 14:01:26.536901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-770ef9a0-252b-45bb-877f-9aba49d2a788 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.557625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:26.557957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:26.558332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42722) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.608605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:26.609793 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2926a20-f42e-408c-b708-7f2dcbc611f1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:26.610223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c2926a20-f42e-408c-b708-7f2dcbc611f1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:26.621139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:26.623547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:26.770707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=472eec3c-b375-4ea9-b4df-ba09d7003ada,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.776137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.776635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.213s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:26.798542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10d405fd-9b42-480b-ae82-1db8a7973727 None None] Network 12ac07b8-6349-4c6e-9bc5-fabd3af1869b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:26.801826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=848c9e5b-521c-4516-ae46-198fdc6db1cd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.809644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.812111 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/472eec3c-b375-4ea9-b4df-ba09d7003ada HTTP/1.1" status: 204 len: 168 time: 2.0241790 Nov 24 14:01:26.813235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.816301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42726) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.825869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=565160e6-a40f-40ee-a7d7-7f75b51fee2a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:26.828769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.461s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:26.853571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:26.861140 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2003515 Nov 24 14:01:26.867313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:26.869367 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b HTTP/1.1" status: 204 len: 168 time: 2.3800211 Nov 24 14:01:26.874829 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] Sync routers for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:26.885481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42730) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.885815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42732) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.891987 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c2926a20-f42e-408c-b708-7f2dcbc611f1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/c65e22f1-d7f8-4a53-bcd7-9220155510be HTTP/1.1" status: 404 len: 337 time: 0.3772287 Nov 24 14:01:26.906373 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:26.907013 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:26.916068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42734) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:26.960649 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-49037655-f09c-4b00-a650-f1cad14020c5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:26.962101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-49037655-f09c-4b00-a650-f1cad14020c5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:26.964095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-49037655-f09c-4b00-a650-f1cad14020c5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/c9646eb3-12b1-40d9-86ec-59f349fd38a8 HTTP/1.1" status: 404 len: 339 time: 0.0463092 Nov 24 14:01:26.974932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42742) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.022378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.027151 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-5dce8fd8-2401-47e1-985e-70e2d0e768bf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.027924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5dce8fd8-2401-47e1-985e-70e2d0e768bf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.028205 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.029958 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5dce8fd8-2401-47e1-985e-70e2d0e768bf tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/6d3bf52e-bf10-43f6-b456-a077f6467a3c HTTP/1.1" status: 404 len: 337 time: 0.0539153 Nov 24 14:01:27.033230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42746) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.051654 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] Routers {'d8199beb-49b1-48d9-ab92-543c1469b3ae'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:27.052666 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['d8199beb-49b1-48d9-ab92-543c1469b3ae'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.061353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3beaa343-1d37-4d86-abb6-f2b05fd43e29 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:27.062688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Deleting port 56c8174f-1729-44dc-ac74-e921f21a7c80 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:27.063160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.093560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-05c47334-c7d5-4a0e-8e24-b4c38d726432 None None] Provisioning for port 565160e6-a40f-40ee-a7d7-7f75b51fee2a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:27.097600 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-1bd0afa6-0696-4527-8398-708d6039667f tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] show failed (client error): The resource could not be found. Nov 24 14:01:27.098648 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1bd0afa6-0696-4527-8398-708d6039667f tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "GET /v2.0/routers/tempest-non_exist_router-814960032 HTTP/1.1" status: 404 len: 334 time: 0.2042968 Nov 24 14:01:27.107175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42750) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.108969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.111799 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-97d1e0e6-57db-4f58-824f-ff63a6fd1382 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:01:27.112455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-97d1e0e6-57db-4f58-824f-ff63a6fd1382 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:27.116264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-395ff297-6284-475a-b743-88d00bff5059 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Request body: {'router': {'name': 'new_name'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:27.134958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-05c47334-c7d5-4a0e-8e24-b4c38d726432 None None] Provisioning complete for port 565160e6-a40f-40ee-a7d7-7f75b51fee2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:27.135375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-05c47334-c7d5-4a0e-8e24-b4c38d726432 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.152473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5559a77b-a6de-49b2-9160-8c022b506551 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:27.170378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] The port '56c8174f-1729-44dc-ac74-e921f21a7c80' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:27.178620 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-c28e1d2d-14d3-48b6-8d3b-6d32d8d469c6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.179247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c28e1d2d-14d3-48b6-8d3b-6d32d8d469c6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.184068 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c28e1d2d-14d3-48b6-8d3b-6d32d8d469c6 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/e02fdfbf-28ce-40b3-b0c3-6edd5fa4aef8 HTTP/1.1" status: 404 len: 339 time: 0.1466599 Nov 24 14:01:27.205275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42754) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.211136 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.212249 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90db16b4-c749-4583-aa42-c49a2613bd50 None None] The sync data for ids ['d8199beb-49b1-48d9-ab92-543c1469b3ae'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:27.262539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-05c47334-c7d5-4a0e-8e24-b4c38d726432 None None] Port 565160e6-a40f-40ee-a7d7-7f75b51fee2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:27.263239 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-395ff297-6284-475a-b743-88d00bff5059 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] update failed (client error): The resource could not be found. Nov 24 14:01:27.271287 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-395ff297-6284-475a-b743-88d00bff5059 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "PUT /v2.0/routers/tempest-non_exist_router-807676101 HTTP/1.1" status: 404 len: 334 time: 0.1597700 Nov 24 14:01:27.272390 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8348e94-f55e-415b-b4bf-804d17ba709d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.273545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a8348e94-f55e-415b-b4bf-804d17ba709d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.277555 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a8348e94-f55e-415b-b4bf-804d17ba709d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/ddd83803-7b14-4e33-b4c4-0512401f5709 HTTP/1.1" status: 404 len: 337 time: 0.0612378 Nov 24 14:01:27.277555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42758) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.281764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42760) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.291834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:27.292025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.306951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-97d1e0e6-57db-4f58-824f-ff63a6fd1382 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:27.312207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97d1e0e6-57db-4f58-824f-ff63a6fd1382 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/c2a3f8ad-79e8-47f3-a7b7-b50c60a6067b HTTP/1.1" status: 404 len: 333 time: 0.4159682 Nov 24 14:01:27.315981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42764) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.319158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5559a77b-a6de-49b2-9160-8c022b506551 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:27.323300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5559a77b-a6de-49b2-9160-8c022b506551 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.7541187 Nov 24 14:01:27.361144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42770) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.416790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] DHCP port deletion for 12ac07b8-6349-4c6e-9bc5-fabd3af1869b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:27.422910 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-d72dbde1-8ab1-4fc5-a77b-e7f308662b0f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.423344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d72dbde1-8ab1-4fc5-a77b-e7f308662b0f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.427450 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d72dbde1-8ab1-4fc5-a77b-e7f308662b0f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/ceb040a6-705b-4e6e-b930-4b7d3a909566 HTTP/1.1" status: 404 len: 339 time: 0.1092768 Nov 24 14:01:27.427604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Deleting port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:27.428824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.430926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.438116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42772) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.465388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--1387417389'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:27.485618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:27.496149 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-13e9ad27-b078-49e7-bc6e-3d4004c04544 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.496902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-13e9ad27-b078-49e7-bc6e-3d4004c04544 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.500844 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-13e9ad27-b078-49e7-bc6e-3d4004c04544 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/dcb0dcf2-a541-4ec4-8885-885eae25818f HTTP/1.1" status: 404 len: 337 time: 0.0593095 Nov 24 14:01:27.502941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.510321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42778) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.516968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac1bda5c-7660-4f44-aab3-2ae0cf38a180']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.546112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:27.559425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e6c679e7-cb66-4c24-83e7-2c4a45ce410c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:27.569394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7c23cefd-d4e1-4241-a3d2-42622a5131e3']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.577361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4c66be1f-461b-43bb-83ba-3741548a7f5b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.577698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4c66be1f-461b-43bb-83ba-3741548a7f5b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.589847 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-27599613-3298-4ed9-bea2-4172236d75d1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.590714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-27599613-3298-4ed9-bea2-4172236d75d1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.595100 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-27599613-3298-4ed9-bea2-4172236d75d1 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/4862f14a-b211-4e69-a305-563ddb9c83b6 HTTP/1.1" status: 404 len: 339 time: 0.0812032 Nov 24 14:01:27.597546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42782) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.601182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.604852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port efbb740c-867d-470b-843c-4c3f1cab73b1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:27.605208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.617310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: e6c679e7-cb66-4c24-83e7-2c4a45ce410c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:27.617672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e6c679e7-cb66-4c24-83e7-2c4a45ce410c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:27.629550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.643143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '294894e1-7345-4c10-ab6b-ce6e04e017bb') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.643434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '294894e1-7345-4c10-ab6b-ce6e04e017bb') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:27.674195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.690708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 876 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:27.692204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.692357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.702620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] For port 7dd4260c-a909-499b-9ce0-53e7b7e24a95, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7dd4260c-a909-499b-9ce0-53e7b7e24a95,segment=NetworkSegment(d8281e69-477b-4a55-86eb-2b602d615a01),segment_id=d8281e69-477b-4a55-86eb-2b602d615a01)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:27.703034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:27.706480 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:27.718374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.735706 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-fc7ca072-d313-477b-84b6-3dbc08fa0a47 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.736170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fc7ca072-d313-477b-84b6-3dbc08fa0a47 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.740258 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc7ca072-d313-477b-84b6-3dbc08fa0a47 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/af2d8161-0b36-44d8-96df-feaefffa2bed HTTP/1.1" status: 404 len: 337 time: 0.1374414 Nov 24 14:01:27.766499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42786) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.804101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.815600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting subnet 4643d209-20e3-4c62-b658-3a4fb8fffd9d {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:27.819232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.836041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Calling delete_port for 7dd4260c-a909-499b-9ce0-53e7b7e24a95 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:27.853968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.858865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-76adbcae-f1b9-47f3-8953-f5d8fba2e1b8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:27.863505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Releasing vlan 877 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:27.863937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.875912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.878818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-e6f6d5a3-18c3-4f7a-8b03-88ee38daed79 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.879251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e6f6d5a3-18c3-4f7a-8b03-88ee38daed79 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6f6d5a3-18c3-4f7a-8b03-88ee38daed79 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/6a7e96cb-2fbf-4fda-aece-9ac15aaa5ce1 HTTP/1.1" status: 404 len: 339 time: 0.1083694 Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:27.883981 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:27.886785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42790) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.920128 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/ac1bda5c-7660-4f44-aab3-2ae0cf38a180 HTTP/1.1" status: 204 len: 168 time: 1.1025708 Nov 24 14:01:27.923953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.928407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b29e7760-835c-49a7-9880-6f5307f4f85c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:27.930266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=ac1bda5c-7660-4f44-aab3-2ae0cf38a180,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:27.937574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42794) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.942079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:27.943394 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-85bdda5b-8bdd-4769-856f-993ce1cadacb tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:27.943854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-85bdda5b-8bdd-4769-856f-993ce1cadacb tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:27.948744 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-85bdda5b-8bdd-4769-856f-993ce1cadacb tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/637530f1-644e-4238-9f71-60707f9324d0 HTTP/1.1" status: 404 len: 337 time: 0.0597131 Nov 24 14:01:27.965667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42798) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:27.967884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:27.970153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Pushing event deleted for resources: {'Port': ['ID=7dd4260c-a909-499b-9ce0-53e7b7e24a95,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:27.974084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:27.977545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] No DVR routers for this DVR port 7dd4260c-a909-499b-9ce0-53e7b7e24a95 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:28.049704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:28.104811 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a2ca472-4a99-4edf-bdc5-eb20f72188f0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:28.104811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0a2ca472-4a99-4edf-bdc5-eb20f72188f0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:28.106431 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a2ca472-4a99-4edf-bdc5-eb20f72188f0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/464ab7ec-0ada-4110-aabf-1ad2e7c9eac0 HTTP/1.1" status: 404 len: 339 time: 0.1003766 Nov 24 14:01:28.117878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42802) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:28.159435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.194658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:28.217947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-e1e7a9af-1d92-41e5-8b86-c4fd1ceacb1d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:28.218376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e1e7a9af-1d92-41e5-8b86-c4fd1ceacb1d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:28.222739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.280661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.294751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:28.308026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.310078 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] 10.222.0.70 "DELETE /v2.0/networks/7c23cefd-d4e1-4241-a3d2-42622a5131e3 HTTP/1.1" status: 204 len: 168 time: 3.8191686 Nov 24 14:01:28.318398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e1e7a9af-1d92-41e5-8b86-c4fd1ceacb1d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/54140a24-8764-4f1d-8830-56abd9ff4083 HTTP/1.1" status: 404 len: 337 time: 0.1917543 Nov 24 14:01:28.322751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42808) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:28.368501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Pushing event deleted for resources: {'Network': ['ID=7c23cefd-d4e1-4241-a3d2-42622a5131e3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:28.371006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.391166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:28.393167 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-180f1886-2c72-4b19-94d9-2fe7f43ae7be tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] DELETE failed (client error): The resource could not be found. Nov 24 14:01:28.393625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-180f1886-2c72-4b19-94d9-2fe7f43ae7be tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:01:28.395498 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-180f1886-2c72-4b19-94d9-2fe7f43ae7be tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/159a661c-7f67-47cf-9bcb-c79d0ff7d5c7 HTTP/1.1" status: 404 len: 339 time: 0.0590601 Nov 24 14:01:28.415553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42812) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:28.453475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.587522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42816) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:28.597968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12ac07b8-6349-4c6e-9bc5-fabd3af1869b']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:28.641167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.649593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd8281e69-477b-4a55-86eb-2b602d615a01') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:28.649883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd8281e69-477b-4a55-86eb-2b602d615a01') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:28.656177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-63edf64f-c3e7-498b-b1b0-317b6320e589 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:28.706889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.738859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Subnet': ['ID=4643d209-20e3-4c62-b658-3a4fb8fffd9d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:28.753549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:28.754789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.764455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for efbb740c-867d-470b-843c-4c3f1cab73b1 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:28.767815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2ab4352-0028-4fe2-843d-f34cd74f87e2 None None] Network 41c18b2a-c344-4766-be36-277eaa48676e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:28.772111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.775168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.798321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.815582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e0f03cb6-07de-4e6a-8332-b8dcf40a9d61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:28.839985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/subnets/4643d209-20e3-4c62-b658-3a4fb8fffd9d HTTP/1.1" status: 204 len: 168 time: 1.5593269 Nov 24 14:01:28.843194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 853 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:28.843585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.859020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42820) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:28.860374 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2a75d9c1-34d1-4b72-9137-fb713b5754fb admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=a6e6213b81eb4772a787ef2b41ed785b&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2716322 Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:28.861320 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:28.863258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42822) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:28.957460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=205d2964-2bec-43bb-8bff-4c6ad4a6b121,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:28.966954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7dd4260c-a909-499b-9ce0-53e7b7e24a95 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:28.982086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:28.988346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting subnet 54f3d445-a1ce-4f48-818a-bed6a59f09f3 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:28.990172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.006900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.014477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.016328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 7dd4260c-a909-499b-9ce0-53e7b7e24a95 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:29.016682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7dd4260c-a909-499b-9ce0-53e7b7e24a95 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:29.027715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.044124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=12ac07b8-6349-4c6e-9bc5-fabd3af1869b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.054019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.057225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.058045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/12ac07b8-6349-4c6e-9bc5-fabd3af1869b HTTP/1.1" status: 204 len: 168 time: 1.1195040 Nov 24 14:01:29.061280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42828) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:29.064340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 1.6119297 Nov 24 14:01:29.069409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42830) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:29.077240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '205d2964-2bec-43bb-8bff-4c6ad4a6b121', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:29.088320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-499230079'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:29.096208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:29.100497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:29.106220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.136268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] DHCP port deletion for 41c18b2a-c344-4766-be36-277eaa48676e request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:29.137379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:29.140426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:29.142941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:29.143569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Deleting port d95da42e-dd93-436a-beb3-128304f0125e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:29.144215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.150801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:29.162063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:29.166129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:29.171431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.190401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.197479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:29.200898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.208188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.234953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.245302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88d05002-2c5f-4f4f-845d-cf8b572e4cdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.281811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.311905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.319728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.322982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port d95da42e-dd93-436a-beb3-128304f0125e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:29.323494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.331802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 853} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:29.358437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.359026 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment 5fa2f941-93f1-45b3-aee0-e54e672c7fce of type vlan for network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc Nov 24 14:01:29.409753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.418391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.424156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.430754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e4a966ca-5454-46a9-bcf3-29ed987696c6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.431102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] For port d95da42e-dd93-436a-beb3-128304f0125e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d95da42e-dd93-436a-beb3-128304f0125e,segment=NetworkSegment(9260e382-62db-4293-9abc-4bdf45c4d4c2),segment_id=9260e382-62db-4293-9abc-4bdf45c4d4c2)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:29.431513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.447436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.481893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6530a3a0-c2c8-452c-8cc1-7fe0c72b5bd5,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.487253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.496742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.499151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.501398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.042s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.543073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.545396 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/subnets/54f3d445-a1ce-4f48-818a-bed6a59f09f3 HTTP/1.1" status: 204 len: 168 time: 1.1285484 Nov 24 14:01:29.546663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Subnet': ['ID=54f3d445-a1ce-4f48-818a-bed6a59f09f3,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.552707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42836) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:29.556425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.557680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.559052 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.4967036 Nov 24 14:01:29.565376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c85de229-d22d-48a0-a1a0-3a34cb7e3893 None None] Network 6f950245-e4b2-4735-849a-ee586a874fa7 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:29.574262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42840) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:29.578072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.582124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:29.582910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.589455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Calling delete_port for d95da42e-dd93-436a-beb3-128304f0125e owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:29.592079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83224eb2-3b94-474f-a52c-78ca9b3bb459 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.609558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=565160e6-a40f-40ee-a7d7-7f75b51fee2a,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.634898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.390s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.639093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '205d2964-2bec-43bb-8bff-4c6ad4a6b121', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:29.655524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b5e6ede-63c0-4b6e-a8f0-aee56a7ebf56 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.291s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.727165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:29.773094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:29.779048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=efbb740c-867d-470b-843c-4c3f1cab73b1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.789764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:29.796421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.810423 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.7392187 Nov 24 14:01:29.828819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42844) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:29.841142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:29.861725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=2d6ca335-7357-4cd4-849a-d0dc71f3eedc,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.868622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.874835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ed84909f-4a7a-476c-ac6f-2f01b9893c4d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:29.879468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.287s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.917881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:29.921093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.927014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Pushing event deleted for resources: {'Port': ['ID=d95da42e-dd93-436a-beb3-128304f0125e,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:29.929998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:29.938311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:29.945489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:29.964481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] No DVR routers for this DVR port d95da42e-dd93-436a-beb3-128304f0125e on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:29.973581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port d327ff90-a67e-4f45-bb97-210f52dde0af {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:29.973992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.009461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.040368 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/efbb740c-867d-470b-843c-4c3f1cab73b1 HTTP/1.1" status: 204 len: 168 time: 2.7226114 Nov 24 14:01:30.040714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:30.041654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.044157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.045820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/a39799c9-29bb-4c79-a47b-c7cce485cff2 HTTP/1.1" status: 204 len: 168 time: 1.1645207 Nov 24 14:01:30.055914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42848) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:30.078789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3e9e1f18-7e3f-4433-8f88-46b28fe8a9b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:30.090614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] For port d95da42e-dd93-436a-beb3-128304f0125e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d95da42e-dd93-436a-beb3-128304f0125e,segment=NetworkSegment(9260e382-62db-4293-9abc-4bdf45c4d4c2),segment_id=9260e382-62db-4293-9abc-4bdf45c4d4c2)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:30.090975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.110424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:30.118565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:30.120340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:30.121428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a39799c9-29bb-4c79-a47b-c7cce485cff2,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:30.126869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:30.165556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] DHCP port deletion for 6f950245-e4b2-4735-849a-ee586a874fa7 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:30.178054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Deleting port d327ff90-a67e-4f45-bb97-210f52dde0af {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:30.178492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.193784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:30.196562 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-203cefd5-bb6b-41b9-9051-890411d3bf08 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:01:30.197814 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-203cefd5-bb6b-41b9-9051-890411d3bf08 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/efbb740c-867d-470b-843c-4c3f1cab73b1 HTTP/1.1" status: 404 len: 333 time: 0.1386511 Nov 24 14:01:30.212441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42854) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:30.279846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:30.529199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] For port d327ff90-a67e-4f45-bb97-210f52dde0af, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d327ff90-a67e-4f45-bb97-210f52dde0af,segment=NetworkSegment(9ec604a5-fcfa-4738-9bf3-f895431479d4),segment_id=9ec604a5-fcfa-4738-9bf3-f895431479d4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:30.529797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.635502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Calling delete_port for d95da42e-dd93-436a-beb3-128304f0125e owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:30.662199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Calling delete_port for d327ff90-a67e-4f45-bb97-210f52dde0af owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:30.688235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] For port d327ff90-a67e-4f45-bb97-210f52dde0af, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d327ff90-a67e-4f45-bb97-210f52dde0af,segment=NetworkSegment(9ec604a5-fcfa-4738-9bf3-f895431479d4),segment_id=9ec604a5-fcfa-4738-9bf3-f895431479d4)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:30.688603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.698384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.708095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.629s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:30.712806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:30.713124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:30.768343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.771220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.776958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d4f01e41-5c8a-4795-929d-2c525c7116fb None None] Provisioning complete for port 565160e6-a40f-40ee-a7d7-7f75b51fee2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:30.777556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d4f01e41-5c8a-4795-929d-2c525c7116fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.802776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:30.835686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.853265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Pushing event deleted for resources: {'Port': ['ID=d327ff90-a67e-4f45-bb97-210f52dde0af,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:30.862623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:30.878245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] No DVR routers for this DVR port d327ff90-a67e-4f45-bb97-210f52dde0af on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:30.900501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d4f01e41-5c8a-4795-929d-2c525c7116fb None None] Port 565160e6-a40f-40ee-a7d7-7f75b51fee2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:30.935804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-200cec3a-16e5-4c0e-af65-8431105d9c3a tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:30.961000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:30.965229 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 1.3571944 Nov 24 14:01:30.966017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2fc89ca6-21d4-49bc-a27d-cb6c4c50671f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:30.967660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42870) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:30.971713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d95da42e-dd93-436a-beb3-128304f0125e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:30.974277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '205d2964-2bec-43bb-8bff-4c6ad4a6b121', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:30.979398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:30.982501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Calling delete_port for d327ff90-a67e-4f45-bb97-210f52dde0af owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:30.987959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:31.004313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:31.009689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:31.016552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d95da42e-dd93-436a-beb3-128304f0125e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:31.017156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d95da42e-dd93-436a-beb3-128304f0125e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:31.017766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d327ff90-a67e-4f45-bb97-210f52dde0af no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:31.024608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:31.049784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.062206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d327ff90-a67e-4f45-bb97-210f52dde0af {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:31.063278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d327ff90-a67e-4f45-bb97-210f52dde0af not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:31.077476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:31.141201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet fd0bbe78-0313-4109-a6b9-752f149c51ea {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:31.145721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.196758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:31.197078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:31.246716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.268502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.269637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port d95da42e-dd93-436a-beb3-128304f0125e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:31.270168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.318274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.333099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:31.377561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.381809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] The port 'd95da42e-dd93-436a-beb3-128304f0125e' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:31.387721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ebe626a-5252-49b8-b1dd-dada97b2d296 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:31.392422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=13299ddd-3565-4554-8ccf-400d7552a335,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:31.420314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:31.444410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.463275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.467331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.4978495 Nov 24 14:01:31.467987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42882) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:31.512793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=c0cc5abe-3445-4c29-81ec-0d6912e36933,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:31.519595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:31.536169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '205d2964-2bec-43bb-8bff-4c6ad4a6b121', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:31.537968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': '5fa2f941-93f1-45b3-aee0-e54e672c7fce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:31.538330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: 2d6ca335-7357-4cd4-849a-d0dc71f3eedc, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:31.548872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:31.552314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.568370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.573595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-07816a20-3aa9-4e66-8769-2c2c9efa1e10 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:31.573786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:31.579542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:31.597878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:31.602878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41c18b2a-c344-4766-be36-277eaa48676e']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:31.607632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=fd0bbe78-0313-4109-a6b9-752f149c51ea,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:31.612187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:31.612661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:31.624390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.626436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9260e382-62db-4293-9abc-4bdf45c4d4c2') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:31.626888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9260e382-62db-4293-9abc-4bdf45c4d4c2') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:31.628867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 2d6ca335-7357-4cd4-849a-d0dc71f3eedc) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:31.637578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:31.637798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a76f07e2-47c0-456a-bb3c-724eb9202421 None None] Network c304fcb7-303a-4d94-ac20-b8fab9ee80a9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:31.638112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.643932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.645330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/fd0bbe78-0313-4109-a6b9-752f149c51ea HTTP/1.1" status: 204 len: 168 time: 1.4282699 Nov 24 14:01:31.650998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42888) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:31.665435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5e8a498-9e92-484c-a44d-41608adf1f97 None None] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:31.675136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.685630 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.8525324 Nov 24 14:01:31.686254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.686421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42892) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:31.693076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:31.706313 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.0894446 Nov 24 14:01:31.711460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42896) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:31.716469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:31.723898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Releasing vlan 898 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:31.724323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:31.739800 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:31.742117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Deleting port d327ff90-a67e-4f45-bb97-210f52dde0af {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:31.742117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.750733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'network': {'name': 'tempest-RoutersTest-69902518'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:31.759990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:31.786705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-502087084', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:31.801054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:31.819346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:network and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:31.838869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:31.849550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:31.850846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:router and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:31.861232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:31.868802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.869052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] The port 'd327ff90-a67e-4f45-bb97-210f52dde0af' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:31.874719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:31.876485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:31.878094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.888429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:31.902871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.910282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:31.911494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:31.911647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.936669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Network': ['ID=41c18b2a-c344-4766-be36-277eaa48676e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:31.939899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.944293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:31.950701 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/networks/41c18b2a-c344-4766-be36-277eaa48676e HTTP/1.1" status: 204 len: 168 time: 3.0887506 Nov 24 14:01:31.952987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.953630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42904) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:31.954452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.955372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:31.956947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:31.985963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 869} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:31.990454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ab7a0699-21d2-40e8-95c3-465feee2045f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:31.996140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:32.004488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.005142 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added segment 86dd6433-6836-4bbb-978c-aeeea1efb3ac of type vlan for network 48c8de96-81d8-4340-92ca-511033c5e21b Nov 24 14:01:32.010304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 32fa787f-2217-4daf-bd49-bb14cfaccac4 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:32.010647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.013120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.017507 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.5456305 Nov 24 14:01:32.019807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42908) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:32.029058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '205d2964-2bec-43bb-8bff-4c6ad4a6b121', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:32.045159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:32.053036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:32.056833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.061588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:32.071786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:32.106362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.132357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.137176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:32.138164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.147706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70595d53-72e3-453c-a139-14460201a27d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:32.148647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.204462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f950245-e4b2-4735-849a-ee586a874fa7']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:32.257595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.275961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9ec604a5-fcfa-4738-9bf3-f895431479d4') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:32.276255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9ec604a5-fcfa-4738-9bf3-f895431479d4') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:32.311582 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 764 time: 0.5902007 Nov 24 14:01:32.312463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42916) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:32.330560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'subnet': {'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:32.360535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Network': ['ID=48c8de96-81d8-4340-92ca-511033c5e21b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:32.380382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 48c8de96-81d8-4340-92ca-511033c5e21b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:32.420100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:32.448089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:32.467441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.475839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:32.479886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.480918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:subnet and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:32.484828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:32.487522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-038ca006-9db3-415b-a93d-6b391546c36f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:32.505856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f90237b3-9634-41a9-92cd-b6a14b037c0b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:32.508365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:32.512414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:32.518928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.531894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Made reservation on behalf of 9d96b9002ef84a209d8d0c821d7c7a49 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:32.552579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.557753 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 714 time: 0.5349133 Nov 24 14:01:32.558394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42924) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:32.588659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.591405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.598718 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:01:32.641881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Releasing vlan 864 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:32.642574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.688140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-2d6ca335-7357-4cd4-849a-d0dc71f3eedc', 'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': 'c0cc5abe-3445-4c29-81ec-0d6912e36933'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:32.688974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:32.723006 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:32.799953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.809572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.852256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting subnet 317499df-5667-4a3c-99c5-f2725d135ed1 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:32.864247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.865721 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cde2ad35-f6e3-4518-b171-e8d1f20d569f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 1.1785769 Nov 24 14:01:32.867445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.912206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42930) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:32.912818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42932) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:32.919255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] DHCP port deletion for c304fcb7-303a-4d94-ac20-b8fab9ee80a9 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:32.933158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'port': {'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc', 'name': 'tempest-RoutersIpV6Test-892219697'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:32.975919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:32.997928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Deleting port 32fa787f-2217-4daf-bd49-bb14cfaccac4 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:32.998770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.002730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port 32fa787f-2217-4daf-bd49-bb14cfaccac4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32fa787f-2217-4daf-bd49-bb14cfaccac4,segment=NetworkSegment(26ddebb3-0e4d-48c6-a017-be48f7130c3b),segment_id=26ddebb3-0e4d-48c6-a017-be48f7130c3b)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:33.003089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.017279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:33.018947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.033172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32fa787f-2217-4daf-bd49-bb14cfaccac4 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:33.083418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.083635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.090608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-953cfc1e-9f1b-4d33-ae00-a4701e47ac28 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:33.109809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Pushing event deleted for resources: {'Network': ['ID=6f950245-e4b2-4735-849a-ee586a874fa7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:33.115132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.122680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.169297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.173149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/f90237b3-9634-41a9-92cd-b6a14b037c0b HTTP/1.1" status: 204 len: 168 time: 0.6115639 Nov 24 14:01:33.173771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42940) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:33.194479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:33.209137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Subnet': ['ID=3a3161f1-f54e-4c17-a06c-81d3d72d02bc,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:33.217977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:33.218539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3326ca7d-9be9-486d-bc15-fbd25dec3104 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:33.236569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f90237b3-9634-41a9-92cd-b6a14b037c0b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:33.239266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:33.255303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Checking segment: {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:33.255556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network hostable DHCP agents. Network: 48c8de96-81d8-4340-92ca-511033c5e21b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:33.261837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 32fa787f-2217-4daf-bd49-bb14cfaccac4 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:33.267617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Allocated IP 2001:db8::2 (2d6ca335-7357-4cd4-849a-d0dc71f3eedc/c0cc5abe-3445-4c29-81ec-0d6912e36933/fe975861-a5c1-41a9-9595-eb37739662b2) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:33.281948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3ab4b6e2-a209-43c2-b775-93b98b25f0a4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:33.308114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 48c8de96-81d8-4340-92ca-511033c5e21b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:33.311687 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] 10.222.0.70 "DELETE /v2.0/networks/6f950245-e4b2-4735-849a-ee586a874fa7 HTTP/1.1" status: 204 len: 168 time: 3.7577114 Nov 24 14:01:33.320633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3ab4b6e2-a209-43c2-b775-93b98b25f0a4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:33.321253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-2126361136', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:33.324770 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3ab4b6e2-a209-43c2-b775-93b98b25f0a4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5171 time: 0.1435423 Nov 24 14:01:33.324923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42948) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:33.340284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:33.364072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.370878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Usage tracker for resource:port and tenant:a6b69cf2eb3c43e1a4828d02afdba36b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:33.376068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.382520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:33.394425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 48c8de96-81d8-4340-92ca-511033c5e21b) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:33.403801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:33.404481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.407179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:33.434448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.437442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-22320d6e-2b95-4144-a4d8-3dc411ce5086 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:33.442379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:33.442603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c302e3e-a489-46a5-b7d9-d8c669724dff None None] Network 48c8de96-81d8-4340-92ca-511033c5e21b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:33.454549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.454549 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/ab7a0699-21d2-40e8-95c3-465feee2045f HTTP/1.1" status: 204 len: 168 time: 0.1258390 Nov 24 14:01:33.455818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42952) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:33.463467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Made reservation on behalf of a6b69cf2eb3c43e1a4828d02afdba36b for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:33.463629 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b5df9591-d4e6-474a-98aa-930681dde55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1464038 Nov 24 14:01:33.465906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.466928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=ab7a0699-21d2-40e8-95c3-465feee2045f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:33.469112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42956) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:33.473235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:33.490370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:33.501692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.510583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:33.547807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c5d7c364-aaa4-439a-ab15-cd0ca1fd59f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.549498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.577833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=32fa787f-2217-4daf-bd49-bb14cfaccac4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:33.581645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.613051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:33.628647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:33.631845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.635344 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No ports have port_id starting with 32fa787f-2217-4daf-bd49-bb14cfaccac4 Nov 24 14:01:33.687218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port 32fa787f-2217-4daf-bd49-bb14cfaccac4 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:33.736445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:33.759426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-446e1b73-277b-4d49-a5a4-ef2da21007b2 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:33.765382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] device_id is not set on port c6143ffc-917c-44a6-9d1c-010a3c74ceda yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:01:33.792781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.815271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Usage tracker for resource:security_group_rule and tenant:a6b69cf2eb3c43e1a4828d02afdba36b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:33.816433 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42962) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:33.823148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:33.850971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:33.969880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:33.981176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f169ca4-61ce-4e8f-bd4e-51cf743e5295 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:34.013121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.021304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-446e1b73-277b-4d49-a5a4-ef2da21007b2 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:34.023097 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-446e1b73-277b-4d49-a5a4-ef2da21007b2 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4683 time: 0.5663037 Nov 24 14:01:34.028889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] For port 32fa787f-2217-4daf-bd49-bb14cfaccac4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32fa787f-2217-4daf-bd49-bb14cfaccac4,segment=NetworkSegment(26ddebb3-0e4d-48c6-a017-be48f7130c3b),segment_id=26ddebb3-0e4d-48c6-a017-be48f7130c3b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:34.029382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.046065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-48c8de96-81d8-4340-92ca-511033c5e21b', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:34.047037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.056654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42968) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:34.082709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Subnet': ['ID=317499df-5667-4a3c-99c5-f2725d135ed1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:34.103232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:34.114912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.119159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c304fcb7-303a-4d94-ac20-b8fab9ee80a9']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:34.174596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '26ddebb3-0e4d-48c6-a017-be48f7130c3b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:34.174998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '26ddebb3-0e4d-48c6-a017-be48f7130c3b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:34.214247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.223711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.236101 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/subnets/317499df-5667-4a3c-99c5-f2725d135ed1 HTTP/1.1" status: 204 len: 168 time: 2.2768340 Nov 24 14:01:34.243515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42972) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:34.250173 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9528f886-5848-49ef-af97-47f0285d2774 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=5e936793ca53421b93b3d4209ca77990&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4312496 Nov 24 14:01:34.252968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42976) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:34.259516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.278289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b374354a-38d5-44e2-af5a-00fdd4d2544f None None] Network 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:34.303039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.303683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.329232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 887 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:34.329628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:34.346976 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:34.383464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Calling delete_port for 32fa787f-2217-4daf-bd49-bb14cfaccac4 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:34.540451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.566459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.571666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-20062d51-6a7f-414a-abe1-c739456f57cb tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:34.573290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:27Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:28Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:34.578019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.599862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] device_id is not set on port 90653ee4-88f8-42df-ab69-c1d6bc60687d yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:01:34.622093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.645188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:34.645560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Updating router 8b1794c5-dde1-4c7a-a979-ba268c818d76 port 565160e6-a40f-40ee-a7d7-7f75b51fee2a binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:01:34.648166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.684919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.706088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.711629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Transition to ACTIVE for port object fe975861-a5c1-41a9-9595-eb37739662b2 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:34.751565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f99102a-8914-4a07-893f-494cb07103dc,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:34.764498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:34.768758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ed9ac161-5806-4149-b833-db7156557b0e tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.127s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:34.779354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:34.779354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:34.781624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.782743 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/13299ddd-3565-4554-8ccf-400d7552a335 HTTP/1.1" status: 204 len: 168 time: 0.7159719 Nov 24 14:01:34.784157 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/c304fcb7-303a-4d94-ac20-b8fab9ee80a9 HTTP/1.1" status: 204 len: 168 time: 3.1325357 Nov 24 14:01:34.793310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42980) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:34.793670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 42982) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:34.794112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.794409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=13299ddd-3565-4554-8ccf-400d7552a335,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:34.807735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:34.814677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.823379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6fb35c5a-20ac-499e-acd6-51d4db28cb67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.152s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:34.831042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Transition to ACTIVE for port object fe975861-a5c1-41a9-9595-eb37739662b2 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:34.842518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-453700236'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:34.855525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.861677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-99859f0b-9442-4a1a-99ec-31f039cd9c52 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:34.888468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.893963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-07916fdf-e850-47ef-863c-542366441a55 tempest-QuotasNegativeTest-1722161082 tempest-QuotasNegativeTest-1722161082-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:34.908808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85221422-5477-44d6-a70e-46a24d5cc781,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:34.914506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:34.920821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:34.924464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/85221422-5477-44d6-a70e-46a24d5cc781 HTTP/1.1" status: 204 len: 168 time: 0.6662569 Nov 24 14:01:34.924618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:34.929506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=c304fcb7-303a-4d94-ac20-b8fab9ee80a9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:34.941641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Allocated IP 172.23.0.2 (48c8de96-81d8-4340-92ca-511033c5e21b/3a3161f1-f54e-4c17-a06c-81d3d72d02bc/59f099ea-edaa-47c6-9472-ad4e5b8e7df3) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:34.953583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:network and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:34.956630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:34.957441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:34.988548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:35.022073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:35.027929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting subnet 926b5b49-d1e0-4718-b7d3-197256880fc2 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:35.040992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.057275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:35.059992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:35.067194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Pushing event updated for resources: {'Port': ['ID=fe975861-a5c1-41a9-9595-eb37739662b2,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:35.072362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:35.074229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:35.075318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.103307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Allocated IP 172.26.4.124 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/90653ee4-88f8-42df-ab69-c1d6bc60687d) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:35.132144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8::d2 (2d6ca335-7357-4cd4-849a-d0dc71f3eedc/c0cc5abe-3445-4c29-81ec-0d6912e36933/c6143ffc-917c-44a6-9d1c-010a3c74ceda) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:35.146728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f4c0fd96-6d2d-4fb8-ae05-8a163b6b2636 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:35.186471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] DHCP port deletion for 782f26dd-d3ff-4e1a-8ad4-5783128b14d5 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:35.195293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.226708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Deleting port 4b2646de-ed4e-43ae-acc9-d946a1160cdd {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:35.227147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.257857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f4c0fd96-6d2d-4fb8-ae05-8a163b6b2636 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:35.259405 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f4c0fd96-6d2d-4fb8-ae05-8a163b6b2636 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4195 time: 0.4629765 Nov 24 14:01:35.265688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 42992) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.268853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 888} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:35.288249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Deleting port 32fa787f-2217-4daf-bd49-bb14cfaccac4 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:35.289194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.348626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.360144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.360144 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Added segment 2a6a9ab1-78e5-483b-b76f-70ee8ab79399 of type vlan for network 94e09b73-af5f-4ffd-8880-d599c21331b6 Nov 24 14:01:35.366735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.406265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.409378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-68aa16d7-6d79-4552-84af-0439729e1880 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:35.428448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2fc89ca6-21d4-49bc-a27d-cb6c4c50671f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:35.448215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:35.454865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fa45a7ab-d617-4c49-b6e2-d87408fb5800 None None] The port '32fa787f-2217-4daf-bd49-bb14cfaccac4' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:35.459222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.462125 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/2fc89ca6-21d4-49bc-a27d-cb6c4c50671f HTTP/1.1" status: 204 len: 168 time: 0.1949329 Nov 24 14:01:35.464933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43002) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.529141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0e312663-d13f-4110-b70e-11eb5ba0a6aa tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:35.556555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.557189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0e312663-d13f-4110-b70e-11eb5ba0a6aa tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:35.560292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0e312663-d13f-4110-b70e-11eb5ba0a6aa tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3707 time: 0.0938978 Nov 24 14:01:35.562457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43008) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.607152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.611902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.624547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Attempting to bind port fe975861-a5c1-41a9-9595-eb37739662b2 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:35.625266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Attempting to bind port fe975861-a5c1-41a9-9595-eb37739662b2 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5fa2f941-93f1-45b3-aee0-e54e672c7fce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:35.625585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.626179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Attempting to bind port fe975861-a5c1-41a9-9595-eb37739662b2 on network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:35.669101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.669435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:35.669816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Checking segment: {'id': '5fa2f941-93f1-45b3-aee0-e54e672c7fce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:35.670226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.671102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Bound using segment: {'id': '5fa2f941-93f1-45b3-aee0-e54e672c7fce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:35.671588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Bound port: fe975861-a5c1-41a9-9595-eb37739662b2, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5fa2f941-93f1-45b3-aee0-e54e672c7fce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '2d6ca335-7357-4cd4-849a-d0dc71f3eedc'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:35.672027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.673548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c7e618ad-23d7-4580-8416-b35172f81d99 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:35.694137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=6530a3a0-c2c8-452c-8cc1-7fe0c72b5bd5,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:35.704908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:35.731276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.733394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.736654 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/6530a3a0-c2c8-452c-8cc1-7fe0c72b5bd5 HTTP/1.1" status: 204 len: 168 time: 0.1729589 Nov 24 14:01:35.739285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43014) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.751626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.755614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:35.756394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.766608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ec21284e-e809-4627-9eb3-c7447bd6a153 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:35.801916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.831011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2b1bb617-5b2e-4b46-adfe-1d1c6de9d3a3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:35.844186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:01:35.857087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2b1bb617-5b2e-4b46-adfe-1d1c6de9d3a3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:35.858511 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2b1bb617-5b2e-4b46-adfe-1d1c6de9d3a3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.1171367 Nov 24 14:01:35.864211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43020) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.911822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.916905 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 1.1188481 Nov 24 14:01:35.918275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object c6143ffc-917c-44a6-9d1c-010a3c74ceda will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:35.919879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43024) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.921248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Network': ['ID=94e09b73-af5f-4ffd-8880-d599c21331b6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:35.937150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:35.937823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-958675b0-83ed-4a4c-b32f-e40fdcba28da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:35.938462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:35.978919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:35.981006 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/subnets/926b5b49-d1e0-4718-b7d3-197256880fc2 HTTP/1.1" status: 204 len: 168 time: 1.7340631 Nov 24 14:01:35.982322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Subnet': ['ID=926b5b49-d1e0-4718-b7d3-197256880fc2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:35.985137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43030) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:35.987897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:36.013541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.032339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a11d6a67-784e-441d-a0de-c69c21f9ad63 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:36.057086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.070531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Transition to ACTIVE for port object 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:36.074560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.092418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Transition to ACTIVE for port object 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:36.135330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e661339-f842-4e46-afb0-d837b2d5d968 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.153446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43034) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:36.156558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.165291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:36.173021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:36.177616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:36.186598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2df2851-d224-4efd-b818-d9279ee73af6 None None] Network e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:36.188770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:36.199214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:36.199385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Pushing event updated for resources: {'Port': ['ID=90653ee4-88f8-42df-ab69-c1d6bc60687d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:36.203509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.205091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:36.215903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:36.216688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:36.220566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6fb8a091-d684-41d3-86c5-b9164653f80c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:36.243105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Allocated IP 172.23.0.1 (48c8de96-81d8-4340-92ca-511033c5e21b/3a3161f1-f54e-4c17-a06c-81d3d72d02bc/314c298c-ccb9-4a3c-8b8d-6f21750f666e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:36.252148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.254197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:36.280022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.299743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e05f6c2b-b76c-4a17-9c60-f52c9cd47c67 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:36.307194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port 4b2646de-ed4e-43ae-acc9-d946a1160cdd {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:36.307531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.342763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:36.343640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:36.354355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.381180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-583022f8-f5a0-4133-8cba-ad3422bb12e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:36.419928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=205d2964-2bec-43bb-8bff-4c6ad4a6b121,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:36.429517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:36.501137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:36.503285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=c6143ffc-917c-44a6-9d1c-010a3c74ceda,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:36.513179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c81dcd37-2db6-43f5-9310-35d2acd944f2 tempest-DvrRoutersNegativeTest-53800133 tempest-DvrRoutersNegativeTest-53800133-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-192737190', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:36.515499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.policy [None req-c81dcd37-2db6-43f5-9310-35d2acd944f2 tempest-DvrRoutersNegativeTest-53800133 tempest-DvrRoutersNegativeTest-53800133-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=83525) log_rule_list /opt/stack/neutron/neutron/policy.py:411}} Nov 24 14:01:36.515975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.policy [None req-c81dcd37-2db6-43f5-9310-35d2acd944f2 tempest-DvrRoutersNegativeTest-53800133 tempest-DvrRoutersNegativeTest-53800133-project] Failed policy check for 'create_router' {{(pid=83525) enforce /opt/stack/neutron/neutron/policy.py:482}} Nov 24 14:01:36.516323 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-c81dcd37-2db6-43f5-9310-35d2acd944f2 tempest-DvrRoutersNegativeTest-53800133 tempest-DvrRoutersNegativeTest-53800133-project] create failed (client error): Access was denied to this resource. Nov 24 14:01:36.525211 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c81dcd37-2db6-43f5-9310-35d2acd944f2 tempest-DvrRoutersNegativeTest-53800133 tempest-DvrRoutersNegativeTest-53800133-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.3610046 Nov 24 14:01:36.525211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:36.525211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:36.525211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.529369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.309s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:36.543852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Pushing event updated for resources: {'Port': ['ID=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:36.556910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:36.598166 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 927 time: 3.6829717 Nov 24 14:01:36.609046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43044) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:36.628860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.650630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Transition to ACTIVE for port object 314c298c-ccb9-4a3c-8b8d-6f21750f666e will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:36.670119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Attributes excluded by policy engine: ['network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:36.671277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.677192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.678462 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/205d2964-2bec-43bb-8bff-4c6ad4a6b121 HTTP/1.1" status: 204 len: 168 time: 0.8130951 Nov 24 14:01:36.682001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:36.688525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Network 48c8de96-81d8-4340-92ca-511033c5e21b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:36.690375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.702694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] For port fe975861-a5c1-41a9-9595-eb37739662b2, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:36.717759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:36.725058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:36.729962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-44b5f5a9-0070-4122-94dd-618951e0623f tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:36.767413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.768714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.774173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] For port fe975861-a5c1-41a9-9595-eb37739662b2, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=fe975861-a5c1-41a9-9595-eb37739662b2,segment=NetworkSegment(5fa2f941-93f1-45b3-aee0-e54e672c7fce),segment_id=5fa2f941-93f1-45b3-aee0-e54e672c7fce)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:36.782608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] For port 4b2646de-ed4e-43ae-acc9-d946a1160cdd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b2646de-ed4e-43ae-acc9-d946a1160cdd,segment=NetworkSegment(540ab5bb-29ab-454c-be59-755229bb8240),segment_id=540ab5bb-29ab-454c-be59-755229bb8240)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:36.783429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.807473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.828946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-91fc7fee-3943-4a72-a4d8-87cba2b19c9d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:36.843890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-53aef8aa-3266-4b38-a62f-436f9b227993 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:36.889967 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 3.9730592 Nov 24 14:01:36.890781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43054) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:36.891746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Transition to ACTIVE for port object 565160e6-a40f-40ee-a7d7-7f75b51fee2a will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:36.917436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.124'}]}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:36.937195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 48c8de96-81d8-4340-92ca-511033c5e21b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:36.946218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:36.957118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:36.966836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:36.982778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:36.994060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Usage tracker for resource:router and tenant:a6b69cf2eb3c43e1a4828d02afdba36b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:37.000439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] For port 4b2646de-ed4e-43ae-acc9-d946a1160cdd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b2646de-ed4e-43ae-acc9-d946a1160cdd,segment=NetworkSegment(540ab5bb-29ab-454c-be59-755229bb8240),segment_id=540ab5bb-29ab-454c-be59-755229bb8240)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:37.001008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.010423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:37.014396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43058) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:37.045745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Calling delete_port for 4b2646de-ed4e-43ae-acc9-d946a1160cdd owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:37.047668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-91fc7fee-3943-4a72-a4d8-87cba2b19c9d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:37.053001 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-91fc7fee-3943-4a72-a4d8-87cba2b19c9d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.3659873 Nov 24 14:01:37.053001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=314c298c-ccb9-4a3c-8b8d-6f21750f666e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:37.056544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:37.061252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.332s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:37.073996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--1824812843'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:37.083042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:37.086012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b2646de-ed4e-43ae-acc9-d946a1160cdd no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:37.088836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.103086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:37.126452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.130381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.212852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Attempting to bind port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:37.213196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Attempting to bind port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:37.213652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Attempting to bind port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 on network 48c8de96-81d8-4340-92ca-511033c5e21b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:37.267963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:37.294693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:37.306055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:37.316091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.317398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Pushing event updated for resources: {'Port': ['ID=fe975861-a5c1-41a9-9595-eb37739662b2,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:37.319120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Calling delete_port for 4b2646de-ed4e-43ae-acc9-d946a1160cdd owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:37.335448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.492s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:37.336322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:37.336626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Checking segment: {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:37.337299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.337688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Bound using segment: {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:37.338177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Bound port: 59f099ea-edaa-47c6-9472-ad4e5b8e7df3, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:37.338561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.347649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-308c2a41-f50f-4fff-8370-4446f1c60f77 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.207s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:37.360466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:37.415175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.416489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:37.428798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b7bb6a56-dbc8-4d1a-b87e-154519c5f570 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:37.451023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.478967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.538295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port 4b2646de-ed4e-43ae-acc9-d946a1160cdd update to DOWN by agent not found {{(pid=83527) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2088}} Nov 24 14:01:37.574608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] DHCP port deletion for e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:37.589120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.590398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.611624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd774570-637d-4b64-b016-957a05e14f8b None None] Pushing event updated for resources: {'Port': ['ID=565160e6-a40f-40ee-a7d7-7f75b51fee2a,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:37.612894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=944b5593-554a-4563-a4d2-4e2cb4ed7a40,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:37.630025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd774570-637d-4b64-b016-957a05e14f8b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:37.631955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:37.633037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.141s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:37.633511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:37.646121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:37.692634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Deleting port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:37.693015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.724764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Usage tracker for resource:security_group_rule and tenant:edc84daa42ea41bdb5243f16372ddaa4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:37.734630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] No DVR routers for this DVR port 4b2646de-ed4e-43ae-acc9-d946a1160cdd on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:37.743174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:37.747437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.777381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Pushing event deleted for resources: {'Port': ['ID=4b2646de-ed4e-43ae-acc9-d946a1160cdd,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:37.817331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:37.882022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.453s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:37.893524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:37.928980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] For port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:37.938064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] For port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:37.952544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.956109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:37.962978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-84125f38-2933-40cd-9d08-af25349c09a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:38.029059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Attempting to bind port 565160e6-a40f-40ee-a7d7-7f75b51fee2a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:38.029649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Attempting to bind port 565160e6-a40f-40ee-a7d7-7f75b51fee2a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:38.030186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Attempting to bind port 565160e6-a40f-40ee-a7d7-7f75b51fee2a on network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:38.090232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:38.091480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Checking segment: {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:38.092070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.092629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Bound using segment: {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:38.093270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Bound port: 565160e6-a40f-40ee-a7d7-7f75b51fee2a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8e40795f-cd8f-4b38-9f6f-a81082879b19', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:38.093841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.134303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.145074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port 4b2646de-ed4e-43ae-acc9-d946a1160cdd {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:38.145453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.171057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Pushing event updated for resources: {'Port': ['ID=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:38.196801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.204214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-266150fd-86fe-4d48-bd1d-a4ded75b4620 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:38.223810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:38.247298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Checking segment: {'id': '2a6a9ab1-78e5-483b-b76f-70ee8ab79399', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:38.247517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network hostable DHCP agents. Network: 94e09b73-af5f-4ffd-8880-d599c21331b6, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:38.283727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] For port 0ad2af51-d7ae-4e48-8f37-10145e30fae9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0ad2af51-d7ae-4e48-8f37-10145e30fae9,segment=NetworkSegment(a488562a-2b1f-489f-9b06-8fff41be8d8d),segment_id=a488562a-2b1f-489f-9b06-8fff41be8d8d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:38.288957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.307229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d96aba74-b1ad-4259-8b96-846a782bb08f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:38.316310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:38.323332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.337169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.341097 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 1.2762113 Nov 24 14:01:38.348816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43068) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:38.352633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.384851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': 'd96aba74-b1ad-4259-8b96-846a782bb08f', 'direction': 'ingress', 'protocol': 17}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:38.391988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:38.397011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:38.400427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15f1e8ef-b595-474f-af83-eddc53357626 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:38.433369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:38.442251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:38.456584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Calling delete_port for 0ad2af51-d7ae-4e48-8f37-10145e30fae9 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:38.461192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] The port '4b2646de-ed4e-43ae-acc9-d946a1160cdd' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:38.466988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.469776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:38.489148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 94e09b73-af5f-4ffd-8880-d599c21331b6) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:38.497446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] For port 565160e6-a40f-40ee-a7d7-7f75b51fee2a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:38.511042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5229189a-8926-4304-bb4a-a2311beb0112 None None] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:38.536011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:38.542117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.545974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] For port 565160e6-a40f-40ee-a7d7-7f75b51fee2a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=565160e6-a40f-40ee-a7d7-7f75b51fee2a,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:38.552235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.563062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event updated for resources: {'Port': ['ID=314c298c-ccb9-4a3c-8b8d-6f21750f666e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:38.569009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.580470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c4da6702-a147-49d3-9e82-a8072462321f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:38.587300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:38.589059 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.6680534 Nov 24 14:01:38.590030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.597236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.607354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43072) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:38.623689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-592333163', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:38.646081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:38.676908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:router and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:38.685255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:38.700238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.728262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:38.745568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a6b973ce-5454-4235-bb29-a0f0d3e8291d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:38.791647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:38.797194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:38.839323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a86bf1e4-e0d6-464d-b115-be0e218cb646,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:38.843010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:38.849558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.849797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.850598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:38.989427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['782f26dd-d3ff-4e1a-8ad4-5783128b14d5']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:39.018976 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=edc84daa42ea41bdb5243f16372ddaa4&name=default HTTP/1.1" status: 200 len: 2647 time: 2.0002789 Nov 24 14:01:39.023578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43076) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:39.031598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '540ab5bb-29ab-454c-be59-755229bb8240') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:39.031749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.032362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '540ab5bb-29ab-454c-be59-755229bb8240') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:39.074432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Network 48c8de96-81d8-4340-92ca-511033c5e21b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:39.078136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.078732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:39.100414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.146608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.169991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fe975861-a5c1-41a9-9595-eb37739662b2 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:39.216978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.234048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] No DVR routers for this DVR port 0ad2af51-d7ae-4e48-8f37-10145e30fae9 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:39.258659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd774570-637d-4b64-b016-957a05e14f8b None None] Pushing event updated for resources: {'Port': ['ID=565160e6-a40f-40ee-a7d7-7f75b51fee2a,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:39.278251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd774570-637d-4b64-b016-957a05e14f8b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.698s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:39.280492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.113s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:39.306731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.313373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.323958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:39.334272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Pushing event deleted for resources: {'Port': ['ID=0ad2af51-d7ae-4e48-8f37-10145e30fae9,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:39.340918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-352d0b7e-0da2-4765-ad87-4469625f6973 None None] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:39.356170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:39.360758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=962bf752-1944-4068-aae2-fc9e914e1a51,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:39.375170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:39.399717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Releasing vlan 860 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:39.399969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:39.420586 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:39.426443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.436933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.441751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 709 time: 1.0882308 Nov 24 14:01:39.446816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43080) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:39.456536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:39.475147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.476777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-219fba73-0f86-4f7d-9d56-88a00b9da0bd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 701 time: 0.8681951 Nov 24 14:01:39.532471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43084) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:39.549569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port fe975861-a5c1-41a9-9595-eb37739662b2 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:39.555597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6', 'name': 'tempest-PortsTestJSON-1156776505'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:39.560473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:39.700278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.738811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.762908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7368747-36c7-4737-81e4-f811b9716531 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:39.782946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.816033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Network': ['ID=782f26dd-d3ff-4e1a-8ad4-5783128b14d5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:39.820546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:39.827136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-94e09b73-af5f-4ffd-8880-d599c21331b6', 'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': '944b5593-554a-4563-a4d2-4e2cb4ed7a40'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:39.828069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.830797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:port and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:39.832060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:39.840523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:39.858731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:39.876954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:39.883166 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/networks/782f26dd-d3ff-4e1a-8ad4-5783128b14d5 HTTP/1.1" status: 204 len: 168 time: 3.8968062 Nov 24 14:01:39.889250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43088) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:39.895348 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:39.927685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.005035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.031468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.039797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:40.043334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.048382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4aa0069e-a3e6-4713-99f0-0e64409e49fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:40.068144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.073293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.099657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0ad2af51-d7ae-4e48-8f37-10145e30fae9 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:40.111430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.119415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a86bf1e4-e0d6-464d-b115-be0e218cb646,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:40.124145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:40.126581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.129320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.135327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e20dad64-8700-4a61-9296-db4d4e37e818 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:40.138466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Provisioning for port fe975861-a5c1-41a9-9595-eb37739662b2 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:40.152505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 8f652f09-586b-467b-b15b-f2126ef6c70c yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:01:40.177546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.178676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/a86bf1e4-e0d6-464d-b115-be0e218cb646 HTTP/1.1" status: 204 len: 168 time: 1.1520939 Nov 24 14:01:40.211301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 0ad2af51-d7ae-4e48-8f37-10145e30fae9 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:01:40.212537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0ad2af51-d7ae-4e48-8f37-10145e30fae9 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:01:40.221082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccfc5451-4d22-4709-b1ad-230dd0876205 None None] Network 48c8de96-81d8-4340-92ca-511033c5e21b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:40.232968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:40.258990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Provisioning complete for port fe975861-a5c1-41a9-9595-eb37739662b2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:40.259657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.325299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=c6143ffc-917c-44a6-9d1c-010a3c74ceda,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:40.344301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:40.496154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.696911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.712604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.777485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:37Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:37Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:38Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:40.790114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cea32132-16e0-4139-a161-ae1e8b64cae7 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:37Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:37Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:38Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:40.792830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] For port fe975861-a5c1-41a9-9595-eb37739662b2, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=fe975861-a5c1-41a9-9595-eb37739662b2,segment=NetworkSegment(5fa2f941-93f1-45b3-aee0-e54e672c7fce),segment_id=5fa2f941-93f1-45b3-aee0-e54e672c7fce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:40.802967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:40.811802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:40.826573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1eeca897-1cd6-433a-8a70-20b2918dc80b tempest-FloatingIPTestJSON-2019691514 tempest-FloatingIPTestJSON-2019691514-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:40.908136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.2 (94e09b73-af5f-4ffd-8880-d599c21331b6/944b5593-554a-4563-a4d2-4e2cb4ed7a40/8f652f09-586b-467b-b15b-f2126ef6c70c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:40.946527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.008968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Pushing event updated for resources: {'Port': ['ID=fe975861-a5c1-41a9-9595-eb37739662b2,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:41.012455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:41.015678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Provisioning for port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:41.026838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Provisioning complete for port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:41.026838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.051996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d96aba74-b1ad-4259-8b96-846a782bb08f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:41.056808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:41.103186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e653b4d3-8e0f-4ce9-894d-0a81384d4bc1']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:41.190007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a488562a-2b1f-489f-9b06-8fff41be8d8d') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:41.190301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a488562a-2b1f-489f-9b06-8fff41be8d8d') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:41.270728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.271928 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/d96aba74-b1ad-4259-8b96-846a782bb08f HTTP/1.1" status: 204 len: 168 time: 1.8210051 Nov 24 14:01:41.282413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.286183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43106) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:41.304559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.307497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.312257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Releasing vlan 866 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:41.312838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.392782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] For port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:41.417891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.420354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:41.497426 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:41.559361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Pushing event updated for resources: {'Port': ['ID=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:41.562576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:41.600486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Provisioning complete for port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:41.600996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.715715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.731355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c59227e8-7693-495c-9757-b8584e756836 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:41.783322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.898416 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/networks/e653b4d3-8e0f-4ce9-894d-0a81384d4bc1 HTTP/1.1" status: 204 len: 168 time: 1.9973571 Nov 24 14:01:41.899701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Network': ['ID=e653b4d3-8e0f-4ce9-894d-0a81384d4bc1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:41.907073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43114) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:41.910497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e7e85e8-427f-4c91-a975-a81c274bc41e tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:41.926301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:41.984802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Provisioning for port c6143ffc-917c-44a6-9d1c-010a3c74ceda completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:41.996481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Provisioning complete for port c6143ffc-917c-44a6-9d1c-010a3c74ceda triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:41.997044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.093486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Port c6143ffc-917c-44a6-9d1c-010a3c74ceda cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:42.114122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Provisioning for port 314c298c-ccb9-4a3c-8b8d-6f21750f666e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:42.122089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Provisioning complete for port 314c298c-ccb9-4a3c-8b8d-6f21750f666e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:42.122796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.161616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.206153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:42.230453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3ba7d84b-4db1-47cd-b110-93a827014f08 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:42.231999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.7613361 Nov 24 14:01:42.235270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.235529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43122) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:42.251273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.271138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:42.273426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Port 314c298c-ccb9-4a3c-8b8d-6f21750f666e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:42.276646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3ba7d84b-4db1-47cd-b110-93a827014f08 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:42.277976 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3ba7d84b-4db1-47cd-b110-93a827014f08 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.9703617 Nov 24 14:01:42.301350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43126) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:42.307659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Provisioning complete for port fe975861-a5c1-41a9-9595-eb37739662b2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:42.311134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-727ff72b-1ed7-479c-acd4-079106effb73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.373816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--1014669632'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:42.395444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.396352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Fanout notify agent at l3_agent the message router_deleted on router db2b14d1-674d-4af6-8de5-071d4a07b1b4 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:01:42.401916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:42.448379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:42.457575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.516878 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] create failed (client error): There was a conflict when trying to complete your request. Nov 24 14:01:42.518140 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-158dd314-b895-4f2d-9d96-4a9aad583648 tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 409 len: 372 time: 5.6134663 Nov 24 14:01:42.525017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43132) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:42.531537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object 8f652f09-586b-467b-b15b-f2126ef6c70c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:42.576366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.714498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.730077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ce723162-5f3c-4193-a1f6-c0354a76ac44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:42.781549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Deleting port 90653ee4-88f8-42df-ab69-c1d6bc60687d {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:42.781900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.818702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=8f652f09-586b-467b-b15b-f2126ef6c70c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:42.823694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:42.830953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2e24d6a2-531c-4a58-a511-00221afc6463 None None] Provisioning complete for port 314c298c-ccb9-4a3c-8b8d-6f21750f666e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:42.831453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e24d6a2-531c-4a58-a511-00221afc6463 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.848823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:42.870003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:42.876133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:42.903747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2e24d6a2-531c-4a58-a511-00221afc6463 None None] Port 314c298c-ccb9-4a3c-8b8d-6f21750f666e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:42.908066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting subnet 07399c12-b132-41cc-ba04-9605a6e3af74 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:42.920265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-45b09f13-0442-4704-948a-d797c60e73d1 {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:42.920890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:42.922205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2e24d6a2-531c-4a58-a511-00221afc6463 None None] Provisioning complete for port c6143ffc-917c-44a6-9d1c-010a3c74ceda triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:42.922799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e24d6a2-531c-4a58-a511-00221afc6463 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:42.927788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:43.002166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2e24d6a2-531c-4a58-a511-00221afc6463 None None] Port c6143ffc-917c-44a6-9d1c-010a3c74ceda cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:43.033048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.098155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fe975861-a5c1-41a9-9595-eb37739662b2 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:43.110061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:43.115306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:43.118372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:43.185215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.185653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port fe975861-a5c1-41a9-9595-eb37739662b2 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:43.186412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.357382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:43.418834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.419511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.428542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-42ace81f-cdc6-4414-96a8-530aceb401d5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:43.430492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.489555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.524200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:43.524927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.563661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.588985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.626005 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 4.0854850 Nov 24 14:01:43.627307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=c6143ffc-917c-44a6-9d1c-010a3c74ceda,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:43.630939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:43.632620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43150) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:43.637679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a5923760-8dfe-4337-9dbf-1e8d85a9ed7b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:43.652122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Allocated IP 172.20.0.3 (94e09b73-af5f-4ffd-8880-d599c21331b6/944b5593-554a-4563-a4d2-4e2cb4ed7a40/9e21f54c-a16d-4daf-8826-66b340468a32) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:43.712967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.717245 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 1.3675387 Nov 24 14:01:43.744032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43154) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:43.760152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--1317809763'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:43.770799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:43.771451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.814767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.817875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:43.825339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:43.848362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:43.904353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.917279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Transition to ACTIVE for port object 9e21f54c-a16d-4daf-8826-66b340468a32 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:43.920700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.942037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Transition to ACTIVE for port object 9e21f54c-a16d-4daf-8826-66b340468a32 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:43.946211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:43.947550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.953613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:43.959229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added routes are [{'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:113}} Nov 24 14:01:43.963854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c8c7908f-4fc3-499b-b947-796ec4170a35 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:44.014003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Subnet': ['ID=07399c12-b132-41cc-ba04-9605a6e3af74,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:44.014271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.021455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:44.021589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:44.047029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.050164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Removed routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:121}} Nov 24 14:01:44.050550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.060990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:44.067014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b10688b-457d-4c44-880f-d5e13ea0f3ff None None] Network 81e8d49c-689b-4cea-8ae7-3a55b0bb002d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:44.067689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:44.071633 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/subnets/07399c12-b132-41cc-ba04-9605a6e3af74 HTTP/1.1" status: 204 len: 168 time: 2.1631355 Nov 24 14:01:44.076852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Calling delete_port for 90653ee4-88f8-42df-ab69-c1d6bc60687d owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:44.110684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2aaa0c78-22ed-42dc-b85c-5d2eeb61822f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:44.113401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.476s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:44.122594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43162) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:44.131649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:44.196516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:44.248060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:44.259644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:44.274607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Pushing event updated for resources: {'Port': ['ID=9e21f54c-a16d-4daf-8826-66b340468a32,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:44.285389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:44.309208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:44.316528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:44.317077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 565160e6-a40f-40ee-a7d7-7f75b51fee2a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:44.321763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:44.345945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.359364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.365485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-924dbb3d-9d64-4adc-967a-cce06728cb89 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:44.405812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dad596d8-73ce-46f7-a7f9-6eb6f66f903d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:44.408663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:44.525953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.546764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.561953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.8152041 Nov 24 14:01:44.564123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43166) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:44.605740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Attempting to bind port 9e21f54c-a16d-4daf-8826-66b340468a32 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:44.606264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Attempting to bind port 9e21f54c-a16d-4daf-8826-66b340468a32 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '2a6a9ab1-78e5-483b-b76f-70ee8ab79399', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:44.606483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Attempting to bind port 9e21f54c-a16d-4daf-8826-66b340468a32 on network 94e09b73-af5f-4ffd-8880-d599c21331b6 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:44.623716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:44.624154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Checking segment: {'id': '2a6a9ab1-78e5-483b-b76f-70ee8ab79399', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:44.624517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.624911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Bound using segment: {'id': '2a6a9ab1-78e5-483b-b76f-70ee8ab79399', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:44.625385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Bound port: 9e21f54c-a16d-4daf-8826-66b340468a32, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2a6a9ab1-78e5-483b-b76f-70ee8ab79399', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 888, 'network_id': '94e09b73-af5f-4ffd-8880-d599c21331b6'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:44.625767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.661401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 565160e6-a40f-40ee-a7d7-7f75b51fee2a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:44.667613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43168) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:44.675911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '2aaa0c78-22ed-42dc-b85c-5d2eeb61822f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': 'dad596d8-73ce-46f7-a7f9-6eb6f66f903d', 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:44.686185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1304184443', 'description': 'tempest-secgroup-smoke-1304184443 description', 'project_id': '84c43153da724ce38453763656256a35'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:44.694509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:44.698647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port f2b0ead3-eede-48e5-b87d-8e28157c8010 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:44.698994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.700458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:44.704797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 565160e6-a40f-40ee-a7d7-7f75b51fee2a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:44.705177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.707915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:44.711443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:44.714228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:44.729530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:44.734474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:44.749587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:44.763404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.768922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.787688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.817192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-658425a3-040e-46b4-b8f3-ce3caff4d92d None None] Provisioning complete for port c6143ffc-917c-44a6-9d1c-010a3c74ceda triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:44.817595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-658425a3-040e-46b4-b8f3-ce3caff4d92d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.850004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] For port 9e21f54c-a16d-4daf-8826-66b340468a32, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:44.862494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.878358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:44.887402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] DHCP port deletion for 81e8d49c-689b-4cea-8ae7-3a55b0bb002d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:44.905319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Deleting port f2b0ead3-eede-48e5-b87d-8e28157c8010 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:44.905688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.010059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-658425a3-040e-46b4-b8f3-ce3caff4d92d None None] Port c6143ffc-917c-44a6-9d1c-010a3c74ceda cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:45.016764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:45.027699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:45.031834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:45.033175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.041817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:45.108944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.114500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 565160e6-a40f-40ee-a7d7-7f75b51fee2a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=565160e6-a40f-40ee-a7d7-7f75b51fee2a,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:45.126735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.133548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.139859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.144289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3bd476e1-bc89-431a-8161-55d79347bfd0 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.178491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:45.180202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d70b662-3c4e-43c3-bf40-0daf18945764,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.182774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.259169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] For port 9e21f54c-a16d-4daf-8826-66b340468a32, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9e21f54c-a16d-4daf-8826-66b340468a32,segment=NetworkSegment(2a6a9ab1-78e5-483b-b76f-70ee8ab79399),segment_id=2a6a9ab1-78e5-483b-b76f-70ee8ab79399)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:45.268717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f2b0ead3-eede-48e5-b87d-8e28157c8010 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:01:45.276025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.279059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.315795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.337496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] For port f2b0ead3-eede-48e5-b87d-8e28157c8010, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f2b0ead3-eede-48e5-b87d-8e28157c8010,segment=NetworkSegment(ea05a458-89e1-4c48-9ed4-3800bfecbaa1),segment_id=ea05a458-89e1-4c48-9ed4-3800bfecbaa1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:45.337898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.357776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.361861 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 740 time: 0.7046125 Nov 24 14:01:45.363310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=565160e6-a40f-40ee-a7d7-7f75b51fee2a,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.366019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43174) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:45.390408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8122c6a5-8aff-4319-8038-994425007d20 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.418413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.420225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd774570-637d-4b64-b016-957a05e14f8b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.095s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.435027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.445879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d91c1ebf-8196-41a0-8aca-293721df3d3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.462529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Pushing event deleted for resources: {'Port': ['ID=90653ee4-88f8-42df-ab69-c1d6bc60687d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.471286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.474000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] For port f2b0ead3-eede-48e5-b87d-8e28157c8010, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f2b0ead3-eede-48e5-b87d-8e28157c8010,segment=NetworkSegment(ea05a458-89e1-4c48-9ed4-3800bfecbaa1),segment_id=ea05a458-89e1-4c48-9ed4-3800bfecbaa1)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:45.474547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.510114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.512033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Calling delete_port for f2b0ead3-eede-48e5-b87d-8e28157c8010 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:45.521138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8073cc13-6934-4ef9-81fc-4e1f399f968c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.527183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:45.531133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.544532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.549253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:45.557416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:45.568079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:45.613899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.629256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4396dd26-97cf-4547-844d-fbcc8f61c9d0 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.660663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Pushing event updated for resources: {'Port': ['ID=9e21f54c-a16d-4daf-8826-66b340468a32,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.668026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Calling delete_port for f2b0ead3-eede-48e5-b87d-8e28157c8010 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:45.671984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.677462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.706767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.711066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-324b519a-cb4b-448a-83a6-ee33a8cfea01 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:45.784381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Pushing event deleted for resources: {'Port': ['ID=f2b0ead3-eede-48e5-b87d-8e28157c8010,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.790562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.793694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] No DVR routers for this DVR port f2b0ead3-eede-48e5-b87d-8e28157c8010 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:01:45.825249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=7d70b662-3c4e-43c3-bf40-0daf18945764,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:45.829346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:45.868921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.871543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:45.873444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.874632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/7d70b662-3c4e-43c3-bf40-0daf18945764 HTTP/1.1" status: 204 len: 168 time: 0.5073640 Nov 24 14:01:45.879409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.880657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9205179f-6173-4e54-9590-6ebcc4c3f793 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 934 time: 3.6397851 Nov 24 14:01:45.881485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43178) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:45.884434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43180) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:45.896920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.900844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:45.923999 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] 10.222.0.70 "DELETE /v2.0/ports/90653ee4-88f8-42df-ab69-c1d6bc60687d HTTP/1.1" status: 204 len: 168 time: 3.3977804 Nov 24 14:01:45.987872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:01:45.988197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:01:45.989442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-185343db-029a-4958-ad02-e836e514c5e2 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:46.044629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.120689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.121740 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 1.4540558 Nov 24 14:01:46.126556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43188) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:46.128869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c515eff7-1452-46c0-9ddd-403a3742014c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:46.139391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:46.154348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group_rule': {'security_group_id': 'c515eff7-1452-46c0-9ddd-403a3742014c', 'project_id': '84c43153da724ce38453763656256a35', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:46.173644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router a5d3c148-c0d8-42cc-8713-772f9e9b7f4e is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:01:46.176043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:46.184259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f1e49e46-4917-4caa-b4a7-463b63faf4d8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:46.186234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:46.197861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:46.217103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f1e49e46-4917-4caa-b4a7-463b63faf4d8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:46.219818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f1e49e46-4917-4caa-b4a7-463b63faf4d8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4195 time: 0.3356090 Nov 24 14:01:46.223557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43192) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:46.277430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:46.279914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2b33edef-3a52-410b-8980-3c5602f70470 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 934 time: 0.3940103 Nov 24 14:01:46.283294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43198) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:46.290043 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:46.297873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'routes': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:46.316088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:46.316786 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:46.427426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43202) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:46.477026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.478070 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:46.504439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.567461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.573006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-82b4ca86-f832-4cd2-aa82-34dc4b51fd8b tempest-AllowedAddressPairTestJSON-1959114942 tempest-AllowedAddressPairTestJSON-1959114942-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:46.607433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dad596d8-73ce-46f7-a7f9-6eb6f66f903d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:46.623258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:46.640678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.644542 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/dad596d8-73ce-46f7-a7f9-6eb6f66f903d HTTP/1.1" status: 204 len: 168 time: 0.4106476 Nov 24 14:01:46.644790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43208) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:46.686833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Deleting port f2b0ead3-eede-48e5-b87d-8e28157c8010 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:46.687313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.722210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.750564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.800684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] The port 'f2b0ead3-eede-48e5-b87d-8e28157c8010' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:01:46.852069 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:43Z', 'revision_number': 6, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:37Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:46.856948 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:46.857512 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Updating router 8b1794c5-dde1-4c7a-a979-ba268c818d76 port 314c298c-ccb9-4a3c-8b8d-6f21750f666e binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:01:46.915609 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:46.919731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a9c1df83-63df-40f0-a815-5d8a7bb9b922 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:46.946635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:46.951675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Usage tracker for resource:security_group_rule and tenant:7a99f7f7833d430a9ecec21a27eca034 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:46.954951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:46.962842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:47.045732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.071657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.083935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.119564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b9de8bd9-1695-42fa-956f-dcbf17bd6b21 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:47.125136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8d45150-ac13-4d9d-ba2d-7620a3172863 None None] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:47.159902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a9c1df83-63df-40f0-a815-5d8a7bb9b922 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:47.162937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['81e8d49c-689b-4cea-8ae7-3a55b0bb002d']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.164854 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a9c1df83-63df-40f0-a815-5d8a7bb9b922 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4007 time: 0.5189714 Nov 24 14:01:47.165758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43212) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:47.170580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=498d8306-8b76-4930-a94e-d2262c8d3e61,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:47.179585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:47.188297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.188787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ea05a458-89e1-4c48-9ed4-3800bfecbaa1') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.211488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.236985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:47.287166 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=7a99f7f7833d430a9ecec21a27eca034&name=default HTTP/1.1" status: 200 len: 2647 time: 0.8529918 Nov 24 14:01:47.292841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43216) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:47.293756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] Sync routers for ids ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:47.302165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.326133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.resource_extend [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:01:47.334669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.343793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.349406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-302c3e26-9234-46ba-bc18-77810d3f3331 None None] Provisioning for port 9e21f54c-a16d-4daf-8826-66b340468a32 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:47.356823 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/a5d3c148-c0d8-42cc-8713-772f9e9b7f4e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.7412798 Nov 24 14:01:47.369757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Releasing vlan 885 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:01:47.370311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.386437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43220) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:47.388332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.390726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:01:47.403709 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:01:47.407944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] Routers {'a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:47.415663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.419691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25ca7431-e825-49c0-9b79-739db1c9be9f,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:47.435748 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.462952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.485045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:47.488008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:47.505054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.510285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e21f54c-a16d-4daf-8826-66b340468a32 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:47.551112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.573671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.645150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.664735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] Routers {'a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:47.665414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.682498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.686541 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 1.5480676 Nov 24 14:01:47.686949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43224) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:47.693209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group_rule': {'security_group_id': 'c515eff7-1452-46c0-9ddd-403a3742014c', 'project_id': '84c43153da724ce38453763656256a35', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:47.699192 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Transition to ACTIVE for port object 314c298c-ccb9-4a3c-8b8d-6f21750f666e will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:47.702524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:47.707212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=8f652f09-586b-467b-b15b-f2126ef6c70c,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:47.709296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:47.713908 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.719015 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:47.720525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.720658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.726292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:47.728084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7774ded6-3b81-4a8c-a415-aa2e901e19c1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:47.728964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7774ded6-3b81-4a8c-a415-aa2e901e19c1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:47.730214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de23c728-65a5-46be-95d5-845457da8eab tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:47.731719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:47.743518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-70eef274-76e4-4fb9-a0e8-522a156f9ce8 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:47.749762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:47.766497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.773561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2aaa0c78-22ed-42dc-b85c-5d2eeb61822f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:47.777911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:113}} Nov 24 14:01:47.778246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Removed routes are [{'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:121}} Nov 24 14:01:47.784581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:47.802400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.841617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Pushing event deleted for resources: {'Network': ['ID=81e8d49c-689b-4cea-8ae7-3a55b0bb002d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:47.858573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.870168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/networks/81e8d49c-689b-4cea-8ae7-3a55b0bb002d HTTP/1.1" status: 204 len: 168 time: 3.7360342 Nov 24 14:01:47.870725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:47.871153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7d0f341-b2ca-4193-a3ba-86ebe0ab7777 None None] The sync data for ids ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:47.885219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.889161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43228) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:47.889161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:47.891125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43230) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:47.895734 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c39d95d-bc09-4cd8-bc1f-8f5c8759dfed None None] Pushing event updated for resources: {'Port': ['ID=314c298c-ccb9-4a3c-8b8d-6f21750f666e,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:47.896024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/2aaa0c78-22ed-42dc-b85c-5d2eeb61822f HTTP/1.1" status: 204 len: 168 time: 0.7216704 Nov 24 14:01:47.900162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 9e21f54c-a16d-4daf-8826-66b340468a32 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:47.901445 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0c39d95d-bc09-4cd8-bc1f-8f5c8759dfed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:47.905637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7774ded6-3b81-4a8c-a415-aa2e901e19c1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:47.909451 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7774ded6-3b81-4a8c-a415-aa2e901e19c1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports/c6143ffc-917c-44a6-9d1c-010a3c74ceda HTTP/1.1" status: 200 len: 982 time: 0.5023720 Nov 24 14:01:47.910673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9e21f54c-a16d-4daf-8826-66b340468a32 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:47.911066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.957045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:47.966530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43236) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:48.074639 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Attempting to bind port 314c298c-ccb9-4a3c-8b8d-6f21750f666e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:48.075039 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Attempting to bind port 314c298c-ccb9-4a3c-8b8d-6f21750f666e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:48.077701 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Attempting to bind port 314c298c-ccb9-4a3c-8b8d-6f21750f666e on network 48c8de96-81d8-4340-92ca-511033c5e21b {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:48.096130 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:48.096786 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Checking segment: {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:48.097354 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.097903 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Bound using segment: {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:48.098526 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Bound port: 314c298c-ccb9-4a3c-8b8d-6f21750f666e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '86dd6433-6836-4bbb-978c-aeeea1efb3ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:48.099080 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.108150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.119340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.123023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3521a12b-d4b6-4b6c-88fa-9c2138e825cc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Synchronizing usage tracker for tenant:b8414925e97644acb99608415dc5b4ae on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:48.181289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 9e21f54c-a16d-4daf-8826-66b340468a32, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9e21f54c-a16d-4daf-8826-66b340468a32,segment=NetworkSegment(2a6a9ab1-78e5-483b-b76f-70ee8ab79399),segment_id=2a6a9ab1-78e5-483b-b76f-70ee8ab79399)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:48.190846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.191703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 565160e6-a40f-40ee-a7d7-7f75b51fee2a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:48.238262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:48.268806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.279884 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] For port 314c298c-ccb9-4a3c-8b8d-6f21750f666e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:48.280931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.283452 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] For port 314c298c-ccb9-4a3c-8b8d-6f21750f666e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=314c298c-ccb9-4a3c-8b8d-6f21750f666e,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:48.291842 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.295888 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6c99024-1a29-44d9-a409-c77a22027df5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:48.343172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:48.390612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.396255 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.7044270 Nov 24 14:01:48.397363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43240) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:48.414179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=143f89fc-e006-4c45-beeb-a8ae852a50cd,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:48.424657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:48.431061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group_rule': {'security_group_id': 'c515eff7-1452-46c0-9ddd-403a3742014c', 'project_id': '84c43153da724ce38453763656256a35', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:48.439094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:48.447873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:48.452034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:48.452309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3521a12b-d4b6-4b6c-88fa-9c2138e825cc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Unset dirty status for tenant:b8414925e97644acb99608415dc5b4ae on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:48.456436 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3521a12b-d4b6-4b6c-88fa-9c2138e825cc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "GET /v2.0/ports?device_id=d8199beb-49b1-48d9-ab92-543c1469b3ae HTTP/1.1" status: 200 len: 205 time: 0.5664032 Nov 24 14:01:48.459578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:48.463682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43244) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:48.467227 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:48.468800 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:48.526656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e910333e-6151-49b8-9265-5f5cfcbbd43a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:48.536826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=9e21f54c-a16d-4daf-8826-66b340468a32,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:48.541170 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c39d95d-bc09-4cd8-bc1f-8f5c8759dfed None None] Pushing event updated for resources: {'Port': ['ID=314c298c-ccb9-4a3c-8b8d-6f21750f666e,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:48.545735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:48.573399 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0c39d95d-bc09-4cd8-bc1f-8f5c8759dfed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:48.577121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 565160e6-a40f-40ee-a7d7-7f75b51fee2a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:48.577575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.727844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9de682ef-f23a-43bd-aa0e-c1f7c58cc3ae None None] Provisioning complete for port 9e21f54c-a16d-4daf-8826-66b340468a32 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:48.728226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9de682ef-f23a-43bd-aa0e-c1f7c58cc3ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.807653 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:48.834499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.852530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-faef9564-ecb1-4a18-b356-00e55f9618a0 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:48.926528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.951459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=498d8306-8b76-4930-a94e-d2262c8d3e61,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:48.968347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:48.972663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:48.975972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e910333e-6151-49b8-9265-5f5cfcbbd43a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:48.985885 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e910333e-6151-49b8-9265-5f5cfcbbd43a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 1.0871923 Nov 24 14:01:48.987808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43248) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:49.001396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--5984344'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:49.013823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:49.016465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.018027 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/498d8306-8b76-4930-a94e-d2262c8d3e61 HTTP/1.1" status: 204 len: 168 time: 1.7211604 Nov 24 14:01:49.028083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9de682ef-f23a-43bd-aa0e-c1f7c58cc3ae None None] Provisioning for port 8f652f09-586b-467b-b15b-f2126ef6c70c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:49.033350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9de682ef-f23a-43bd-aa0e-c1f7c58cc3ae None None] Provisioning complete for port 8f652f09-586b-467b-b15b-f2126ef6c70c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:49.033677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9de682ef-f23a-43bd-aa0e-c1f7c58cc3ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.063300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.065838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:49.119121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.125506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.148838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.157409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9de682ef-f23a-43bd-aa0e-c1f7c58cc3ae None None] Port 8f652f09-586b-467b-b15b-f2126ef6c70c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:49.309808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-31cb0753-dfbe-4c80-91da-fcda95a3a25b None None] Provisioning complete for port 8f652f09-586b-467b-b15b-f2126ef6c70c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:49.310718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-31cb0753-dfbe-4c80-91da-fcda95a3a25b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.352424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.361593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 314c298c-ccb9-4a3c-8b8d-6f21750f666e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:49.381600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.400971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:49.403235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:49.440200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:49.450105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-31cb0753-dfbe-4c80-91da-fcda95a3a25b None None] Port 8f652f09-586b-467b-b15b-f2126ef6c70c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:49.458965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:49.471645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37c2d45a-27c8-460a-a1cf-9c2b7d5f8e86,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:49.481971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:49.483792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 314c298c-ccb9-4a3c-8b8d-6f21750f666e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:49.486334 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:47Z', 'revision_number': 7, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:48Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:49.489885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:49.490574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 314c298c-ccb9-4a3c-8b8d-6f21750f666e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:49.491127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.533598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.535214 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 1.1131666 Nov 24 14:01:49.540437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43256) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:49.552713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group_rule': {'security_group_id': 'c515eff7-1452-46c0-9ddd-403a3742014c', 'project_id': '84c43153da724ce38453763656256a35', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:49.562537 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e1b3d8-1b43-4e8f-ab98-e3b1419428c9 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:47Z', 'revision_number': 7, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:48Z', 'revision_number': 4, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:49.579790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:49.588535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:49.612150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:49.633664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:49.650574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.658815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.682242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.689495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:49.690768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:49.705435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 314c298c-ccb9-4a3c-8b8d-6f21750f666e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=314c298c-ccb9-4a3c-8b8d-6f21750f666e,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:49.714873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.716226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e21f54c-a16d-4daf-8826-66b340468a32 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:49.734669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43260) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:49.744184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.754174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:49.777789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=36131f2b-fe8c-4ab9-ba40-d6cacde4c092,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:49.787300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:49.794857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.795323 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1575 time: 0.8052559 Nov 24 14:01:49.800730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43264) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:49.817439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '36131f2b-fe8c-4ab9-ba40-d6cacde4c092', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:49.832942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:49.848518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=314c298c-ccb9-4a3c-8b8d-6f21750f666e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:49.852683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:49.865619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9e21f54c-a16d-4daf-8826-66b340468a32 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:49.865984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.903402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:49.915064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:49.935827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:49.986211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:50.004818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd4af45a-e32a-4c5c-a617-25527c89bfb7 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=a6b69cf2eb3c43e1a4828d02afdba36b&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2690449 Nov 24 14:01:50.007742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43268) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.039570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.040457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.052142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.067285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:50.111422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fe541abc-d058-4d89-93de-15ea6af4b56b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:50.121498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:50.134060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.135230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.5894325 Nov 24 14:01:50.140380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43272) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.149295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group_rule': {'security_group_id': 'c515eff7-1452-46c0-9ddd-403a3742014c', 'project_id': '84c43153da724ce38453763656256a35', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:50.164642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:50.172066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.173192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:50.177237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:50.181380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.187123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:50.191741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:50.204797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:50.229648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=390dd17e-a403-4a95-a28a-e54b1edfd2fb,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:50.232302 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Project 84c43153da724ce38453763656256a35 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:01:50.238289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.239185 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ed6a5c87-400b-4b0d-ac8c-387a8e924e9b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 700 time: 3.9550474 Nov 24 14:01:50.242508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:50.244386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43276) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.246871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.310316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.311474 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 717 time: 0.5098073 Nov 24 14:01:50.322229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43280) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.345753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.381278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.412296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.449603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.466747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.500909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.507795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.519164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c42e9b55-9e9c-45ee-b74f-45eeae7af993 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:50.526354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.527176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.553762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8854bdbb-7559-4fec-8853-8adf0061e9e7,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:50.561850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:50.567443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.033s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:50.579631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.580148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Fanout notify agent at l3_agent the message router_deleted on router d8199beb-49b1-48d9-ab92-543c1469b3ae {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:01:50.582864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.587389 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/390dd17e-a403-4a95-a28a-e54b1edfd2fb HTTP/1.1" status: 204 len: 168 time: 0.2607789 Nov 24 14:01:50.587389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=390dd17e-a403-4a95-a28a-e54b1edfd2fb,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:50.589329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43284) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.591311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:50.593810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.597470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.4536073 Nov 24 14:01:50.604453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43288) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.625004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'security_group_rule': {'security_group_id': 'c515eff7-1452-46c0-9ddd-403a3742014c', 'project_id': '84c43153da724ce38453763656256a35', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:50.635423 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c431db4d-6889-4362-8205-8550c55505ee tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 700 time: 0.3898556 Nov 24 14:01:50.642173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43292) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.779692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.780361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6d791d69-b3b8-4dbc-9e1f-cd453228227b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:50.780700 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-375d1432-1fc3-4e90-9512-6f0daf84acd2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] 10.222.0.70 "DELETE /v2.0/routers/d8199beb-49b1-48d9-ab92-543c1469b3ae HTTP/1.1" status: 204 len: 168 time: 2.3148434 Nov 24 14:01:50.786282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:50.811041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6d791d69-b3b8-4dbc-9e1f-cd453228227b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:50.815039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6d791d69-b3b8-4dbc-9e1f-cd453228227b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.2198868 Nov 24 14:01:50.815661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43298) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:50.819751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:security_group_rule and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:50.832126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:50.858217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:50.917438 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Project 84c43153da724ce38453763656256a35 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:01:50.938478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.948966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:50.968999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7df59e6-aef3-4725-9a28-04d13f8fc7f4 tempest-TagsExtTest-1654993363 tempest-TagsExtTest-1654993363-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:51.004360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.008822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f99102a-8914-4a07-893f-494cb07103dc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:51.012885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:51.028789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.063484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:51.097500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.115086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.116776 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/1f99102a-8914-4a07-893f-494cb07103dc HTTP/1.1" status: 204 len: 168 time: 1.1074941 Nov 24 14:01:51.194157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.223115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43306) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:51.256027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.278879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=8f652f09-586b-467b-b15b-f2126ef6c70c,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:51.315000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.322076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7521b924-89dc-4fa4-ab20-d4cc82a81039 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:51.337638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 314c298c-ccb9-4a3c-8b8d-6f21750f666e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:51.341598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:51.362246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.384246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=36131f2b-fe8c-4ab9-ba40-d6cacde4c092,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:51.386671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:51.431168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.432959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.437513 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:51.462396 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:51.467065 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:51.480275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-824606b5-43cd-41ee-96d8-34d862629921 tempest-ServersTestManualDisk-958774854 tempest-ServersTestManualDisk-958774854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:51.510789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.582790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 314c298c-ccb9-4a3c-8b8d-6f21750f666e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:51.583291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.656019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.657130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/36131f2b-fe8c-4ab9-ba40-d6cacde4c092 HTTP/1.1" status: 204 len: 168 time: 0.8405547 Nov 24 14:01:51.666770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43320) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:51.768266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-539d6a14-6642-4f46-9d6f-21ff6565c4b5 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=b8414925e97644acb99608415dc5b4ae&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5439000 Nov 24 14:01:51.772035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43326) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:51.803481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-dd821c1c-5663-462a-a1ca-3583dbe58c90 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:51.807636 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:51.812361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=518715c3-777e-4064-aa19-6a2600ad2429,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:51.863984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-dd821c1c-5663-462a-a1ca-3583dbe58c90 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:51.865218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dd821c1c-5663-462a-a1ca-3583dbe58c90 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.1970820 Nov 24 14:01:51.871636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43330) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:51.880700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group': {'name': 'tempest-secgroup--2045800662'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:51.897209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.417s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:51.900730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:51.905997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:51.929739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:51.942334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:51.954890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:52.000963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.005276 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 1.3968995 Nov 24 14:01:52.012606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.023534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43336) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:52.044636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.057807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'network': {'name': 'tempest-network-smoke--1119239227', 'project_id': '84c43153da724ce38453763656256a35', 'port_security_enabled': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:52.125014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:52.151132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:network and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:52.170419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:52.264657 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:47Z', 'revision_number': 7, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:49Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:52.266102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:52.269371 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:52.284563 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:52.285398 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:52.309882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-844cec7c-a158-4f8f-8432-ce98647c1a6d None None] Provisioning complete for port 8f652f09-586b-467b-b15b-f2126ef6c70c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:52.310178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-844cec7c-a158-4f8f-8432-ce98647c1a6d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.336377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:52.361397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43344) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:52.363461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:52.383203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:52.385860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Made reservation on behalf of 84c43153da724ce38453763656256a35 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:52.388878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.410564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:52.428208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-844cec7c-a158-4f8f-8432-ce98647c1a6d None None] Port 8f652f09-586b-467b-b15b-f2126ef6c70c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:01:52.479625 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:52.487575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 882} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:52.490747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.498756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b74ca2d7-bfac-45c8-b0b2-07f58561d373 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:52.534731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ab9fb15-a0cb-4dd2-85fa-639b44fe09ea,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:52.540417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.540695 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Added segment 43da5e1a-72d2-4cde-9863-2082fd9e5bbc of type vlan for network b86c842d-e3f1-4cfd-957a-f6a0ed42384a Nov 24 14:01:52.542080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:52.620537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.646023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.654377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.659217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-189a13e8-2608-4291-a545-1bb846d20b24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:52.661676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port c6143ffc-917c-44a6-9d1c-010a3c74ceda {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:52.662051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.677849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-109350660'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:52.696200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:52.713400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:network and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:52.729407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:52.744843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:52.759304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.765878 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/9ab9fb15-a0cb-4dd2-85fa-639b44fe09ea HTTP/1.1" status: 204 len: 168 time: 0.9783454 Nov 24 14:01:52.765878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.765878 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.8897350 Nov 24 14:01:52.765878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5d768612-8720-461d-ae94-14fd949d47b3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:52.774184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43352) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:52.779219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:52.834402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '5d768612-8720-461d-ae94-14fd949d47b3', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:52.836864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:52.841158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.850570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:52.866849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.868068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:52.873056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:52.888455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.895009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:52.895613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:52.899898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:52.905342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Router 4ad4d030-8357-4cea-a47e-a7167f08e7ff is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:01:52.930617 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:47Z', 'revision_number': 7, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:49Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:52.937451 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-401b8ce8-5c03-4d98-9f57-709614db2fa8 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:47Z', 'revision_number': 7, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '314c298c-ccb9-4a3c-8b8d-6f21750f666e', 'name': '', 'network_id': '48c8de96-81d8-4340-92ca-511033c5e21b', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:ef:0c:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:34Z', 'updated_at': '2021-11-24T14:01:49Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '3a3161f1-f54e-4c17-a06c-81d3d72d02bc', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:52.951289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0fd14727-51b9-4a54-a956-a08a07c59b3e tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:53.071078 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 1.0322502 Nov 24 14:01:53.077514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43356) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:53.087670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Network': ['ID=b86c842d-e3f1-4cfd-957a-f6a0ed42384a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:53.088400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.091335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:53.099121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'admin_state_up': True, 'project_id': '84c43153da724ce38453763656256a35', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:53.106059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:53.108701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:53.113646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:security_group_rule and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:53.119521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.120229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:53.131927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:53.159559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:53.249646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.281174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for c6143ffc-917c-44a6-9d1c-010a3c74ceda owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:53.311290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.311931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:router and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:53.318145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:53.319066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-69c8ae66-5cef-440f-8ef6-f6cf3d4ee948 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:53.342134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:53.362591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 858} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:01:53.364728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 314c298c-ccb9-4a3c-8b8d-6f21750f666e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:53.365062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.400003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8b4e42b4-db5a-4a5f-9874-be2a0c39e3c9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:53.411476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:53.418861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.419245 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Added segment 9bb1c113-5cd8-4f33-a63f-dbdb934a70f4 of type vlan for network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 Nov 24 14:01:53.489961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.490855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.527553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.530610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.539512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.554455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:53.583671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=859ce8da-b3c0-464a-b2f5-35ef48b5c537,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:53.592015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:53.604574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.607509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.611888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:53.612473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.632674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.633923 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-08aacc17-a540-4c73-a877-2799c4926a35 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.8112078 Nov 24 14:01:53.638463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43360) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:53.731446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6d7ae345-943d-4d94-a76e-aa76a9e19636 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:53.765855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 314c298c-ccb9-4a3c-8b8d-6f21750f666e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=314c298c-ccb9-4a3c-8b8d-6f21750f666e,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:53.766220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.773805 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cbe6d693-e9cd-43f2-9b5b-dae5cd6ee083 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules/859ce8da-b3c0-464a-b2f5-35ef48b5c537 HTTP/1.1" status: 200 len: 705 time: 0.1324091 Nov 24 14:01:53.825686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43364) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:53.860259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:53.872619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] Sync routers for ids ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:53.874032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.881764 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/routers/4ad4d030-8357-4cea-a47e-a7167f08e7ff/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.2349577 Nov 24 14:01:53.883533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:53.886118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] Routers {'4ad4d030-8357-4cea-a47e-a7167f08e7ff'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:53.886781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:53.889500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b9045637-8963-49d7-b4f8-2dbe6daed4a9 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:53.926793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:53.946734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:53.958186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] Routers {'4ad4d030-8357-4cea-a47e-a7167f08e7ff'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:53.958812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:53.976828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=c6143ffc-917c-44a6-9d1c-010a3c74ceda,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:53.980261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 1.6134429 Nov 24 14:01:53.980818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43372) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:53.986930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:53.991974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 314c298c-ccb9-4a3c-8b8d-6f21750f666e owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:54.024125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:54.024805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0d7a9df-9a49-45b2-9b62-ed53e379b4fb None None] The sync data for ids ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:54.031268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:54.049718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Network': ['ID=60454f28-a3b3-4176-9b9d-ec6e6f5c9527,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:54.056712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.325s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:54.063444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:01:54.206235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-346af784-933e-4127-ac0c-233e600fd6e3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:54.240542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:54.249455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:54.253546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:54.261091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:54.269510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-346af784-933e-4127-ac0c-233e600fd6e3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:54.270890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-346af784-933e-4127-ac0c-233e600fd6e3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3707 time: 0.4415221 Nov 24 14:01:54.273853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c661df55-67f6-48ea-ab4c-a0c3ac15021d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:54.275188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c661df55-67f6-48ea-ab4c-a0c3ac15021d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:54.275909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43376) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:54.304331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.305667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:54.311107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c661df55-67f6-48ea-ab4c-a0c3ac15021d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:54.312287 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c661df55-67f6-48ea-ab4c-a0c3ac15021d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports?device_id=4ad4d030-8357-4cea-a47e-a7167f08e7ff HTTP/1.1" status: 200 len: 982 time: 0.4242930 Nov 24 14:01:54.315535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43380) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:54.443424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.462937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.493766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.500898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-398b9a91-0b2d-4d73-a858-f0b94578c775 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:54.535703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.581396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=314c298c-ccb9-4a3c-8b8d-6f21750f666e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:54.589106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:54.590401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.635640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70f1a9a5-a39d-43a5-9131-0e592dd5d0c1 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:54.708441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=859ce8da-b3c0-464a-b2f5-35ef48b5c537,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:54.725249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:54.791300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.794772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/859ce8da-b3c0-464a-b2f5-35ef48b5c537 HTTP/1.1" status: 204 len: 168 time: 0.5156195 Nov 24 14:01:54.796203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43384) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:54.928079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:54.967777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.041019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-47dcc54e-64e4-498b-8487-2fe5dc0491a3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:55.097919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.102553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0d2c1cc-c4f1-4e94-aa21-1578f34f8a58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:55.130713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-47dcc54e-64e4-498b-8487-2fe5dc0491a3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:55.132638 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-47dcc54e-64e4-498b-8487-2fe5dc0491a3 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.3339579 Nov 24 14:01:55.137665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43388) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:55.150409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '5d768612-8720-461d-ae94-14fd949d47b3', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:55.190659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=ce5e5071-d58f-4320-b342-412ff32bd3d5,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:55.196232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:55.216648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:55.225336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.232514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:55.232870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network hostable DHCP agents. Network: 60454f28-a3b3-4176-9b9d-ec6e6f5c9527, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:01:55.302948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:55.400804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router a5d3c148-c0d8-42cc-8713-772f9e9b7f4e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:55.408490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.436904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Allocated IP 172.26.4.69 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/1b50cf83-69a4-4ab1-92e7-dc836a173eb9) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:55.504126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:01:55.519082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 60454f28-a3b3-4176-9b9d-ec6e6f5c9527) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:55.525764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:55.526698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.530271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc46beeb-d85f-40a9-8a42-22b6adf68f05 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:55.588509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.5697646 Nov 24 14:01:55.592341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43392) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:55.599893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'name': 'tempest-NetworksTestDHCPv6-438695918'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:55.750894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.770899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.779381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:55.787598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3e98b919-9136-4cae-adec-50067069cb62 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:55.797268 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] Sync routers for ids ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:55.810123 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] Routers {'a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:55.810997 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:55.857104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=79fa83a7-117f-4d5b-8057-f85e36d6a041,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:55.868622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:55.872410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.875787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'ce5e5071-d58f-4320-b342-412ff32bd3d5'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:01:55.876732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.883505 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:55.887497 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/a5d3c148-c0d8-42cc-8713-772f9e9b7f4e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.8721223 Nov 24 14:01:55.891056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43396) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:55.898452 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] Routers {'a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:55.899369 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:55.900375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:55.902508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:55.906058 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.7628202 Nov 24 14:01:55.906208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:55.907401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43400) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:55.907565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:55.912943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:55.958020 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e48adb15-fc27-4fff-95ce-d110eb36ba37 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules/79fa83a7-117f-4d5b-8057-f85e36d6a041 HTTP/1.1" status: 200 len: 705 time: 0.0471339 Nov 24 14:01:55.959257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43404) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:55.976791 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:55.977479 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b06d8796-7021-4c53-b557-5ea441e2947b None None] The sync data for ids ['a5d3c148-c0d8-42cc-8713-772f9e9b7f4e'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:55.980845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:01:55.983986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.104825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/ce5e5071-d58f-4320-b342-412ff32bd3d5/de629d91-faf2-4128-8910-f274dac8e2f8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:56.142385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port f8403a41-5b46-40ba-907d-af0947d9ee77 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:01:56.149780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.160701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:56.231742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:56.241994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:56.250119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:56.293954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Port': ['ID=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:56.302019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:56.315156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-064e1227-0abd-4e0b-a943-da54c7fe2dec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:56.401948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-064e1227-0abd-4e0b-a943-da54c7fe2dec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:56.403255 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-064e1227-0abd-4e0b-a943-da54c7fe2dec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3707 time: 0.4423244 Nov 24 14:01:56.409894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43408) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:56.411366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.426518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Transition to ACTIVE for port object de629d91-faf2-4128-8910-f274dac8e2f8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:56.449822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Transition to ACTIVE for port object de629d91-faf2-4128-8910-f274dac8e2f8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:56.457753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.464275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-090a22fb-aeb7-4e53-99a0-12aed3c20629 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:56.483665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.530128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:56.533568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:56.536041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Pushing event updated for resources: {'Port': ['ID=de629d91-faf2-4128-8910-f274dac8e2f8,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:56.536193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.537593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:56.540523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:56.595485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.602754 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-cfb7897a-45a2-4a00-bff9-d318b9bf93f3 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] remove_router_interface failed (client error): The resource could not be found. Nov 24 14:01:56.606451 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cfb7897a-45a2-4a00-bff9-d318b9bf93f3 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/a5d3c148-c0d8-42cc-8713-772f9e9b7f4e/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.7118518 Nov 24 14:01:56.610775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43412) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:56.635699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::1ff (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/ce5e5071-d58f-4320-b342-412ff32bd3d5/f8403a41-5b46-40ba-907d-af0947d9ee77) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:01:56.636424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Attempting to bind port de629d91-faf2-4128-8910-f274dac8e2f8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:01:56.636854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Attempting to bind port de629d91-faf2-4128-8910-f274dac8e2f8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:01:56.637481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Attempting to bind port de629d91-faf2-4128-8910-f274dac8e2f8 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:01:56.646355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:01:56.646700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:01:56.647061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.648122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:01:56.648693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Bound port: de629d91-faf2-4128-8910-f274dac8e2f8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:01:56.649085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.654174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:01:56.660160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4f2f5cdb-311b-4073-a823-93f86fcb9bd1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:56.673437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.675996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-178a0e0b-4e66-42a9-b5eb-cf61cd10ec13 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:56.706292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4f2f5cdb-311b-4073-a823-93f86fcb9bd1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:56.710692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=79fa83a7-117f-4d5b-8057-f85e36d6a041,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:56.710867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4f2f5cdb-311b-4073-a823-93f86fcb9bd1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=a5d3c148-c0d8-42cc-8713-772f9e9b7f4e HTTP/1.1" status: 200 len: 205 time: 0.0956054 Nov 24 14:01:56.710867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43416) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:56.722756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:56.758864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] For port de629d91-faf2-4128-8910-f274dac8e2f8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:01:56.763599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] For port de629d91-faf2-4128-8910-f274dac8e2f8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=de629d91-faf2-4128-8910-f274dac8e2f8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:01:56.768680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.782889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dfc023c2-b0f7-43d4-a4c1-ecbbda7f3cf0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:56.876792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.877543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:56.894083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Pushing event updated for resources: {'Port': ['ID=de629d91-faf2-4128-8910-f274dac8e2f8,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:56.904080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:56.919932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.080370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.083617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/79fa83a7-117f-4d5b-8057-f85e36d6a041 HTTP/1.1" status: 204 len: 168 time: 0.6696203 Nov 24 14:01:57.100300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43420) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:57.230855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:57.242893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5995634 Nov 24 14:01:57.244957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43424) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:57.245352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:57.248684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.267441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:57.268978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:57.339428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object f8403a41-5b46-40ba-907d-af0947d9ee77 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:01:57.367228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device de629d91-faf2-4128-8910-f274dac8e2f8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:01:57.489289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet 3a3161f1-f54e-4c17-a06c-81d3d72d02bc {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:57.492798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.524841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:57.548871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.584101 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f794e60a-6862-4cd0-9f61-f9bf2f51ef5d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.4685497 Nov 24 14:01:57.586083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43428) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:57.591788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port de629d91-faf2-4128-8910-f274dac8e2f8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:57.598442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Request body: {'security_group_rule': {'security_group_id': '5d768612-8720-461d-ae94-14fd949d47b3', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:01:57.604228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:01:57.608851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Usage tracker for resource:security_group_rule and tenant:117b224ee8b0426ba33dec676871e05e is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:01:57.612908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:01:57.618412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:01:57.643578 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Project 117b224ee8b0426ba33dec676871e05e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:01:57.660329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.671268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 8f652f09-586b-467b-b15b-f2126ef6c70c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:57.671614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.697998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.711391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13d36036-1ae1-4fbc-a926-96617d361199 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:57.786566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=f8403a41-5b46-40ba-907d-af0947d9ee77,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:57.791125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:57.850310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:01:57.855623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:01:57.858070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:01:57.862383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:57.863090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.868104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.869713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.878276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.911377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.914564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:54Z', 'revision_number': 8, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:57.915485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.922091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:01:57.934780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:57.935562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:57.947233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-594c2eff-01b8-424a-aa43-b7f37f6fd3b4 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:57.964881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=14b9036d-e6ce-428a-8864-7323076c6391,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:57.967700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:57.968444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:57.972546 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.3800526 Nov 24 14:01:57.973917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43432) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.005798 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 2.4099357 Nov 24 14:01:58.011624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43436) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.024385 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1623b492-9f36-43ff-a97a-3382093d33fd tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules/14b9036d-e6ce-428a-8864-7323076c6391 HTTP/1.1" status: 200 len: 711 time: 0.0468409 Nov 24 14:01:58.026016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43440) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.101861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.108399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.108899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-591694f5-3c6b-431f-a1eb-aa4b8860b05a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:58.109374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router a5d3c148-c0d8-42cc-8713-772f9e9b7f4e {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:01:58.123220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.186270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6815add1-c8d7-4c69-a121-91eb3712b714 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:58.190433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6815add1-c8d7-4c69-a121-91eb3712b714 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:01:58.191225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6815add1-c8d7-4c69-a121-91eb3712b714 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:58.196190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=3a3161f1-f54e-4c17-a06c-81d3d72d02bc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:58.198315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:58.201658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.212467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.213783 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-552d544e-1870-4f51-8d86-bcc4aea4d8c7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/a5d3c148-c0d8-42cc-8713-772f9e9b7f4e HTTP/1.1" status: 204 len: 168 time: 1.5025179 Nov 24 14:01:58.215714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc0a62bf-9414-4aed-905b-83d6a46e2037 None None] Network 48c8de96-81d8-4340-92ca-511033c5e21b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:58.220002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/3a3161f1-f54e-4c17-a06c-81d3d72d02bc HTTP/1.1" status: 204 len: 168 time: 0.9671025 Nov 24 14:01:58.220883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43444) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.221386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43446) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.244524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:58.300603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 8f652f09-586b-467b-b15b-f2126ef6c70c owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:58.345801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e3ca1c4-4c1d-4992-b39a-5a828a1e9909 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:01:58.355973 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-89561cee-89ea-4f3c-83cb-a01600528617 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3713 time: 0.3272600 Nov 24 14:01:58.362645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43452) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.419797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.445307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.455606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6815add1-c8d7-4c69-a121-91eb3712b714 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:58.455952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Router 95732bbb-def1-43f3-a30c-c41d29c85119 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:01:58.459151 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6815add1-c8d7-4c69-a121-91eb3712b714 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1668 time: 0.4429855 Nov 24 14:01:58.459297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.460588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43456) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.563545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.568846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cfb8bbd7-59d7-43a0-a6f3-53b689eae492 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:58.572978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:58.573514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.586873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=14b9036d-e6ce-428a-8864-7323076c6391,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:58.594431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:58.602556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Provisioning for port de629d91-faf2-4128-8910-f274dac8e2f8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:01:58.628544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.632235 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/14b9036d-e6ce-428a-8864-7323076c6391 HTTP/1.1" status: 204 len: 168 time: 0.2658782 Nov 24 14:01:58.635133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43460) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:58.645331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Provisioning complete for port de629d91-faf2-4128-8910-f274dac8e2f8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:01:58.645793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.731470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.737169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port f8403a41-5b46-40ba-907d-af0947d9ee77 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:58.737699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:58.742096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-74d6c2e2-00ad-4c65-8137-29c4a05a2eea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:58.790081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=8f652f09-586b-467b-b15b-f2126ef6c70c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:58.793669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:59.011621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ac4feee3-25aa-41bf-88ad-327ca60e1e7d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Synchronizing usage tracker for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:01:59.016229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet c0cc5abe-3445-4c29-81ec-0d6912e36933 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:01:59.032482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.044188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:01:59.060109 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Sync routers for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:01:59.080429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.084467 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:01:59.086025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.087537 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 6.0040698 Nov 24 14:01:59.087834 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:59.091480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43464) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:59.126282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.192857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] For port de629d91-faf2-4128-8910-f274dac8e2f8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=de629d91-faf2-4128-8910-f274dac8e2f8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:59.212351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.214592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:01:59.315256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] DHCP port deletion for 48c8de96-81d8-4340-92ca-511033c5e21b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:01:59.371294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Deleting port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:01:59.373286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.394232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ac4feee3-25aa-41bf-88ad-327ca60e1e7d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Unset dirty status for tenant:117b224ee8b0426ba33dec676871e05e on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:01:59.395663 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ac4feee3-25aa-41bf-88ad-327ca60e1e7d tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.7458079 Nov 24 14:01:59.405097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43470) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:59.414557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.505673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:59.506085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.535779 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:01:59.556786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:54Z', 'revision_number': 8, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:01:59.568438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-002e1348-545b-4c1a-9f06-20497803d5ca None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:01:54Z', 'revision_number': 8, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '565160e6-a40f-40ee-a7d7-7f75b51fee2a', 'name': '', 'network_id': '2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:4d:a8:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:24Z', 'updated_at': '2021-11-24T14:01:45Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '6b036948-8a00-453f-b2c4-56c46a11b1af', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:01:59.604730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Pushing event updated for resources: {'Port': ['ID=de629d91-faf2-4128-8910-f274dac8e2f8,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:01:59.618807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.404s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:01:59.641166 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a3f79b5d-9a9a-44d2-ac07-5332787eb275 tempest-TestNetworkAdvancedServerOps-544673990 tempest-TestNetworkAdvancedServerOps-544673990-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=84c43153da724ce38453763656256a35&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.5484657 Nov 24 14:01:59.645417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43474) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:01:59.720512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.746543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] For port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,segment=NetworkSegment(86dd6433-6836-4bbb-978c-aeeea1efb3ac),segment_id=86dd6433-6836-4bbb-978c-aeeea1efb3ac)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:01:59.747197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:01:59.800628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:59.918878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Calling delete_port for 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:01:59.985741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for f8403a41-5b46-40ba-907d-af0947d9ee77 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:00.070276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8602a874-d993-4805-adb6-1320944c5498 None None] Provisioning for port f8403a41-5b46-40ba-907d-af0947d9ee77 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:00.109560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cdea06e-4990-40b3-8e74-145b25f28995 tempest-TestNetworkAdvancedServerOps-544673990 tempest-TestNetworkAdvancedServerOps-544673990-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:00.113833 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7cdea06e-4990-40b3-8e74-145b25f28995 tempest-TestNetworkAdvancedServerOps-544673990 tempest-TestNetworkAdvancedServerOps-544673990-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.4647250 Nov 24 14:02:00.118411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43478) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:00.126956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8602a874-d993-4805-adb6-1320944c5498 None None] Provisioning complete for port f8403a41-5b46-40ba-907d-af0947d9ee77 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:00.127278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8602a874-d993-4805-adb6-1320944c5498 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.157471 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:01:56Z', 'revision_number': 3, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:01:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.176765 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Checking router: 95732bbb-def1-43f3-a30c-c41d29c85119 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:00.177123 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Updating router 95732bbb-def1-43f3-a30c-c41d29c85119 port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:02:00.197352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.205390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e0aa0d7-8e76-4438-b5f6-47c425345328 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:00.231637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8602a874-d993-4805-adb6-1320944c5498 None None] Port f8403a41-5b46-40ba-907d-af0947d9ee77 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:00.249248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:00.249618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:00.252050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8602a874-d993-4805-adb6-1320944c5498 None None] Provisioning complete for port de629d91-faf2-4128-8910-f274dac8e2f8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:00.252550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8602a874-d993-4805-adb6-1320944c5498 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.256830 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e889e2b1-4e52-47a1-8ea0-d14d95c0e8f6 tempest-TestNetworkAdvancedServerOps-544673990 tempest-TestNetworkAdvancedServerOps-544673990-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1369987 Nov 24 14:02:00.263553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43482) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:00.270409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2073217156', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'project_id': '84c43153da724ce38453763656256a35', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:00.274287 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.315930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.365528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=59f099ea-edaa-47c6-9472-ad4e5b8e7df3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:00.367431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Router 4ad4d030-8357-4cea-a47e-a7167f08e7ff has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:00.369110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.414927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:00.454751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No DVR routers for this DVR port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:00.455985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:00.512916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.516492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:subnet and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:00.520338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:00.545342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:00.548567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b25c0965-19c2-4fe5-aca8-93d8ac7fc58d None None] Provisioning complete for port f8403a41-5b46-40ba-907d-af0947d9ee77 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:00.548885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b25c0965-19c2-4fe5-aca8-93d8ac7fc58d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.560097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.581586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:00.586310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Made reservation on behalf of 84c43153da724ce38453763656256a35 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:00.594488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b25c0965-19c2-4fe5-aca8-93d8ac7fc58d None None] Port f8403a41-5b46-40ba-907d-af0947d9ee77 was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 14:02:00.596021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] Sync routers for ids ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:00.608973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] Routers {'4ad4d030-8357-4cea-a47e-a7167f08e7ff'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:00.609680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.619863 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/routers/4ad4d030-8357-4cea-a47e-a7167f08e7ff/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3028789 Nov 24 14:02:00.626303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43486) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:00.630230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:00.670311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.682610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] Routers {'4ad4d030-8357-4cea-a47e-a7167f08e7ff'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:00.682811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.706882 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.712388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=f8403a41-5b46-40ba-907d-af0947d9ee77,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:00.715989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.731027 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Transition to ACTIVE for port object 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:00.731515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:00.735001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.739091 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.749554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b96ee542-f60c-444b-ad9b-34f29cbe2e53 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:00.750570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Deleting port 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:00.750962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.755127 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:00.775654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.785066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.785494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36a9b0e6-a7e4-406e-9013-e894254aebbe None None] The sync data for ids ['4ad4d030-8357-4cea-a47e-a7167f08e7ff'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:00.841510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6a50ec41-269b-4c70-840f-b5b283bfdead None None] The port '59f099ea-edaa-47c6-9472-ad4e5b8e7df3' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:00.854761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48c8de96-81d8-4340-92ca-511033c5e21b']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.862166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=c0cc5abe-3445-4c29-81ec-0d6912e36933,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:00.863749 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa77086c-f1ca-4b10-b605-773a49f232c5 None None] Pushing event updated for resources: {'Port': ['ID=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:00.867795 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-fa77086c-f1ca-4b10-b605-773a49f232c5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:00.877360 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Attempting to bind port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:00.877831 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Attempting to bind port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:00.878297 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Attempting to bind port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:00.886173 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:00.886596 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:00.887347 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.887614 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:00.888322 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Bound port: 1b50cf83-69a4-4ab1-92e7-dc836a173eb9, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:00.888859 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.892510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:00.896646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '86dd6433-6836-4bbb-978c-aeeea1efb3ac') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.896933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '86dd6433-6836-4bbb-978c-aeeea1efb3ac') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:00.905550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.927540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.931225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.932484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "DELETE /v2.0/security-groups/5d768612-8720-461d-ae94-14fd949d47b3 HTTP/1.1" status: 204 len: 168 time: 1.5218503 Nov 24 14:02:00.933827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.935960 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/c0cc5abe-3445-4c29-81ec-0d6912e36933 HTTP/1.1" status: 204 len: 168 time: 2.7086020 Nov 24 14:02:00.939657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c809596-c573-4271-9969-4aee6a499034 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:00.942059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2daccbb4-c700-4e8a-bb11-29816736ee1f None None] Network 2d6ca335-7357-4cd4-849a-d0dc71f3eedc requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:00.952765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43490) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:00.953101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43492) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:00.970297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/f8403a41-5b46-40ba-907d-af0947d9ee77 HTTP/1.1" status: 204 len: 168 time: 2.5039301 Nov 24 14:02:00.970297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:00.982308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43494) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:00.985513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d768612-8720-461d-ae94-14fd949d47b3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:00.989862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:00.997713 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] For port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:00.998803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.001711 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] For port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:01.009208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 869 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:01.009749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.018046 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:01.027690 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:01.030270 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-ba10501c-b399-46a8-8915-8f50ceb59627 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:01.198340 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa77086c-f1ca-4b10-b605-773a49f232c5 None None] Pushing event updated for resources: {'Port': ['ID=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:01.201824 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-fa77086c-f1ca-4b10-b605-773a49f232c5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:01.202372 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:01.202993 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:01.267029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.270974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8caea98e-a28b-4c7d-b4b9-d794636ff25b tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:01.279890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device de629d91-faf2-4128-8910-f274dac8e2f8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:01.304199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.330111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=48c8de96-81d8-4340-92ca-511033c5e21b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:01.333054 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/48c8de96-81d8-4340-92ca-511033c5e21b HTTP/1.1" status: 204 len: 168 time: 3.1077976 Nov 24 14:02:01.334320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:01.337343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43502) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:01.415906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port de629d91-faf2-4128-8910-f274dac8e2f8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:01.416279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.482633 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:01.523024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] DHCP port deletion for 2d6ca335-7357-4cd4-849a-d0dc71f3eedc request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:01.525783 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f6635850-445a-4aab-bb98-d4fe8392cf75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:02:01.526298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f6635850-445a-4aab-bb98-d4fe8392cf75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:01.536984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Deleting port fe975861-a5c1-41a9-9595-eb37739662b2 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:01.537365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.590227 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-323f0fd4-f858-4190-b68a-53b25a22143f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.6215682 Nov 24 14:02:01.603857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43506) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:01.684750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.693755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f6635850-445a-4aab-bb98-d4fe8392cf75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:01.695476 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f6635850-445a-4aab-bb98-d4fe8392cf75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/8f652f09-586b-467b-b15b-f2126ef6c70c HTTP/1.1" status: 404 len: 333 time: 1.0667994 Nov 24 14:02:01.700391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 314c298c-ccb9-4a3c-8b8d-6f21750f666e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:01.707632 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a88e1d09-5955-4420-8a5f-b825aac016cd tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0883663 Nov 24 14:02:01.716042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a720417e-9a3a-44df-96e0-f708c29dd313 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:01.738596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 314c298c-ccb9-4a3c-8b8d-6f21750f666e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:01.738992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 314c298c-ccb9-4a3c-8b8d-6f21750f666e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:01.739352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:01.742734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43510) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:01.883813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] For port fe975861-a5c1-41a9-9595-eb37739662b2, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=fe975861-a5c1-41a9-9595-eb37739662b2,segment=NetworkSegment(5fa2f941-93f1-45b3-aee0-e54e672c7fce),segment_id=5fa2f941-93f1-45b3-aee0-e54e672c7fce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:01.884714 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-82598667-df67-48a5-9c24-ddf87233896f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:01:56Z', 'revision_number': 3, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:01.885217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.889253 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82598667-df67-48a5-9c24-ddf87233896f None None] The sync data for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv is: [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:01:56Z', 'revision_number': 3, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:01.891180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.900534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:01.917897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:01.918387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 59f099ea-edaa-47c6-9472-ad4e5b8e7df3 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:02.009156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b680b861-f71c-454c-804f-4837f2f21016 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:02.010512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b680b861-f71c-454c-804f-4837f2f21016 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:02.014512 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b680b861-f71c-454c-804f-4837f2f21016 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 1.0285375 Nov 24 14:02:02.018093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43518) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:02.070320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Calling delete_port for fe975861-a5c1-41a9-9595-eb37739662b2 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:02.123188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port fe975861-a5c1-41a9-9595-eb37739662b2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:02.123842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.152272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Checking segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:02.152847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network hostable DHCP agents. Network: b86c842d-e3f1-4cfd-957a-f6a0ed42384a, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:02:02.157423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43522) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:02.172313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.189998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d777a437-1436-4bab-97a2-9c6dcc3ae763 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:02.205009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Subnet': ['ID=4811f107-9786-45c2-af5e-030f9856728b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:02.223509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.519s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:02.308465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Pushing event deleted for resources: {'Port': ['ID=fe975861-a5c1-41a9-9595-eb37739662b2,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:02.310705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.311399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:02.314067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] No DVR routers for this DVR port fe975861-a5c1-41a9-9595-eb37739662b2 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:02.496273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] The port 'fe975861-a5c1-41a9-9595-eb37739662b2' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:02.637747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:02:02.695530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 565160e6-a40f-40ee-a7d7-7f75b51fee2a {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:02.695986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.711871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet ce5e5071-d58f-4320-b342-412ff32bd3d5 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:02.730574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.772545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, b86c842d-e3f1-4cfd-957a-f6a0ed42384a) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:02.778127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.781816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81ebe569-da78-4e04-a19d-2ed67a956f6b None None] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:02.847134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:02.847724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:02.863334 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ffaec19a-8472-4e6f-815c-667cd46fb74c admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=117b224ee8b0426ba33dec676871e05e&name=default HTTP/1.1" status: 200 len: 2647 time: 0.6953359 Nov 24 14:02:02.881987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43528) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:02.982289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d6ca335-7357-4cd4-849a-d0dc71f3eedc']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:02.993653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.000239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.009283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 565160e6-a40f-40ee-a7d7-7f75b51fee2a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=565160e6-a40f-40ee-a7d7-7f75b51fee2a,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:03.009638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.078836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:03.080203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.156604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 565160e6-a40f-40ee-a7d7-7f75b51fee2a owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:03.242594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 2.9776993 Nov 24 14:02:03.244954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5fa2f941-93f1-45b3-aee0-e54e672c7fce') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:03.245429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5fa2f941-93f1-45b3-aee0-e54e672c7fce') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:03.261908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43532) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:03.312037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Allocated IP 172.20.0.2 (b86c842d-e3f1-4cfd-957a-f6a0ed42384a/4811f107-9786-45c2-af5e-030f9856728b/5c147714-fdcd-4949-8147-807e126b1eed) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:03.354301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a80f278-8947-42e7-8630-142c8558b550 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.362592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:03.370958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.403487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.447124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.450848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.476154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.476442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 853 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:03.476638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.481944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5387226-9ec9-4b60-b891-7f94473278b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:03.492413 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:03.500797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.502265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1eac635a-978a-4288-83b2-a6a08203543c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:03.528457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.528831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.529253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.529570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.529935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.530321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.530733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.531094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.531554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.531923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.532311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:03.535461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:03.544364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.546813 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/1eac635a-978a-4288-83b2-a6a08203543c HTTP/1.1" status: 204 len: 168 time: 0.6620920 Nov 24 14:02:03.561384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.568720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:03.574534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:03.574868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.620452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.642567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.649991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7566d87b-ed88-4b50-82cb-602ab512ef26 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:03.709693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=565160e6-a40f-40ee-a7d7-7f75b51fee2a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:03.717893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:03.728697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.753905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.758543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ed07daeb-5413-4367-95bb-a2e733d4b398 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:03.784588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:03.800147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.810291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.814620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:03.815384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=2d6ca335-7357-4cd4-849a-d0dc71f3eedc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:03.825842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:03.851178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.851178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Fanout notify agent at l3_agent the message router_deleted on router 4ad4d030-8357-4cea-a47e-a7167f08e7ff {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:02:03.856182 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/2d6ca335-7357-4cd4-849a-d0dc71f3eedc HTTP/1.1" status: 204 len: 168 time: 2.8861372 Nov 24 14:02:03.867007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43538) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:03.891142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-210850448'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:03.903565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.904760 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-85796097-b7b9-4983-a347-080a74d93321 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/routers/4ad4d030-8357-4cea-a47e-a7167f08e7ff HTTP/1.1" status: 204 len: 168 time: 2.1496379 Nov 24 14:02:03.905983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:03.910854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43542) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:03.914895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:03.918954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.929584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:03.931222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:03.957532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fe975861-a5c1-41a9-9595-eb37739662b2 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:03.986621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-33a32ac6-77a0-4c93-b727-b3d3c06f1ae7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:04.024977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: fe975861-a5c1-41a9-9595-eb37739662b2 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:04.025290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device fe975861-a5c1-41a9-9595-eb37739662b2 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:04.041142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Transition to ACTIVE for port object 5c147714-fdcd-4949-8147-807e126b1eed will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:04.041877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:04.078452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:04.081304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Transition to ACTIVE for port object 5c147714-fdcd-4949-8147-807e126b1eed will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:04.085021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:04.085021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-474bc7b9-e68e-40d6-8562-a74dbf8259ef None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:04.088866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.092001 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/ce5e5071-d58f-4320-b342-412ff32bd3d5 HTTP/1.1" status: 204 len: 168 time: 2.0548828 Nov 24 14:02:04.093225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=ce5e5071-d58f-4320-b342-412ff32bd3d5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:04.096574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:04.097293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43546) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:04.113385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.119003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e9e7e0b9-bb09-4db9-98f5-835bc47b15b5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:04.176615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.195216 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8503967c-6d04-45b4-9199-e1ad29f17757 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0846500 Nov 24 14:02:04.200285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:04.203392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.224328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43550) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:04.236503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 857} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:02:04.247044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.247528 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment f89121ae-03fc-4730-b2df-7bfaed6f63c1 of type vlan for network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 Nov 24 14:02:04.263746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:04.302857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:04.303902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Pushing event updated for resources: {'Port': ['ID=5c147714-fdcd-4949-8147-807e126b1eed,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:04.309699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:04.311998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:04.341028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:04.453933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Attempting to bind port 5c147714-fdcd-4949-8147-807e126b1eed on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:04.454311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Attempting to bind port 5c147714-fdcd-4949-8147-807e126b1eed by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:04.454681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Attempting to bind port 5c147714-fdcd-4949-8147-807e126b1eed on network b86c842d-e3f1-4cfd-957a-f6a0ed42384a {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:04.466853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.468170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:04.468623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Checking segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:04.469099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.469554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Bound using segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:04.470265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Bound port: 5c147714-fdcd-4949-8147-807e126b1eed, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:04.470542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.563120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:04.572063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Deleting port de629d91-faf2-4128-8910-f274dac8e2f8 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:04.572527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.614694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] For port 5c147714-fdcd-4949-8147-807e126b1eed, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:04.625026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:04.633933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] For port 5c147714-fdcd-4949-8147-807e126b1eed, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5c147714-fdcd-4949-8147-807e126b1eed,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:04.637592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:04.643689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:04.668827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet 944b5593-554a-4563-a4d2-4e2cb4ed7a40 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:04.671196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.675173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:04.680612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7b126289-2dc3-4789-a8bb-f17e02b5dffe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:04.681649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.711894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.716509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:04.717160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:04.738565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-96057add-52db-4754-9680-d77b5ecc6a69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:04.742504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:04.846651 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.9637816 Nov 24 14:02:04.861100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43554) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:04.872000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:04.923949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Pushing event updated for resources: {'Port': ['ID=5c147714-fdcd-4949-8147-807e126b1eed,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:04.931479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:04.937277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] For port de629d91-faf2-4128-8910-f274dac8e2f8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=de629d91-faf2-4128-8910-f274dac8e2f8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:04.937727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.070464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:05.074318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.075564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Calling delete_port for de629d91-faf2-4128-8910-f274dac8e2f8 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:05.100818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.140774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:05.141032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:05.147037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:05.152175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:05.159774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:05.162205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.162684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.163276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.164300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.164508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.164958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.165334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.165868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.166202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.166623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.167089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:05.177957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.178712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.440s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:05.185426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:05.206524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6bdde153-a9ff-4e07-98f2-d2bf36c5d52b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.003s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:05.211166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:05.222610 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:05.247774 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9086385 Nov 24 14:02:05.248703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43558) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:05.250856 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:05.251657 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:01:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:05.314381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:02:05.401580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] No DVR routers for this DVR port de629d91-faf2-4128-8910-f274dac8e2f8 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:05.403679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Pushing event deleted for resources: {'Port': ['ID=de629d91-faf2-4128-8910-f274dac8e2f8,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:05.438209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:05.465195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.509033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.533783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:05.559825 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:05.704944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:05.705769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.756175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.786759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8e4f7d63-df7a-4c6a-9ade-31f4bb75c230 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:05.792004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet 6b036948-8a00-453f-b2c4-56c46a11b1af {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:05.795157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.800106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6641100e-7dfa-4b94-b647-8ca8b8fdb7a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.839490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:05.846697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=944b5593-554a-4563-a4d2-4e2cb4ed7a40,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:05.863471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:05.873943 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/944b5593-554a-4563-a4d2-4e2cb4ed7a40 HTTP/1.1" status: 204 len: 168 time: 1.9617355 Nov 24 14:02:05.877107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43562) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:05.922186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97d98382-8a7a-4c62-8571-cdbce5a59ed7 None None] Network 94e09b73-af5f-4ffd-8880-d599c21331b6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:05.945512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.014010 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 9, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:06.018171 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:06.026661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.037150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc617bc0-4d34-454f-acc2-3c431ae420dd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:06.038828 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:06.039581 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:06.095083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:06.099524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:06.108823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.121069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:06.121668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.149596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=477fd692-0f29-400a-8c35-e3498d58acb9,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:06.155369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device de629d91-faf2-4128-8910-f274dac8e2f8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:06.159171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:06.167480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 9e21f54c-a16d-4daf-8826-66b340468a32 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:06.167480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.169346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.9189439 Nov 24 14:02:06.172304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43566) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:06.182223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'name': 'tempest-NetworksTestDHCPv6-2095154049'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:06.191687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: de629d91-faf2-4128-8910-f274dac8e2f8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:06.192057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device de629d91-faf2-4128-8910-f274dac8e2f8 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:06.193526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eeb84127-170d-4b76-b478-d8ea193a20ce None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:06.252026 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:06.463569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:06.468223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:06.471396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:06.478393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:06.498513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:06.506024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.520377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port 9e21f54c-a16d-4daf-8826-66b340468a32, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9e21f54c-a16d-4daf-8826-66b340468a32,segment=NetworkSegment(2a6a9ab1-78e5-483b-b76f-70ee8ab79399),segment_id=2a6a9ab1-78e5-483b-b76f-70ee8ab79399)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:06.520976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.586986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82314cbf-1d80-44d2-b2e2-08cbb3799fc6 None None] DHCP port deletion for 94e09b73-af5f-4ffd-8880-d599c21331b6 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:06.593301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-82314cbf-1d80-44d2-b2e2-08cbb3799fc6 None None] Deleting port 9e21f54c-a16d-4daf-8826-66b340468a32 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:06.593683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82314cbf-1d80-44d2-b2e2-08cbb3799fc6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.609735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port bf2021ff-ac29-417c-8e8e-e39e46729d3d yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:06.618632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '477fd692-0f29-400a-8c35-e3498d58acb9'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:06.619555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.660500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 9e21f54c-a16d-4daf-8826-66b340468a32 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:06.773752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.783142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66a427a2-fa88-449f-a099-c7c64e119c76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:06.799413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.848138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/477fd692-0f29-400a-8c35-e3498d58acb9/d92a204b-7bd6-4599-9870-0a0b9a27a185) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:06.867959 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 9, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:06.876508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.876693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=9e21f54c-a16d-4daf-8826-66b340468a32,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:06.883174 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d7145f-96c3-4377-a93c-b1b0e110fff1 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 9, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'd670b4ec-57fe-4eaa-abac-c1f52d488a15', 'name': '', 'network_id': '89cc7986-be93-42b0-bf08-7a1aa46579f1', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:34:7b:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:09Z', 'updated_at': '2021-11-24T14:01:21Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '680006ef-4d94-41e1-9d14-3fbf3d869aee', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:06.893623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:06.898356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:06.908607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b788fdc2-de9e-40b1-843e-e903839d80c9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:06.917766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-82314cbf-1d80-44d2-b2e2-08cbb3799fc6 None None] The port '9e21f54c-a16d-4daf-8826-66b340468a32' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:06.982243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port 9e21f54c-a16d-4daf-8826-66b340468a32 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:06.996423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1d0445b-fb64-4c0d-a70c-fa37f456c01b None None] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:07.058632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=b0c0b927-55d5-4214-8f61-2ab7cfdd60b9,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:07.065809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:07.069586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.182624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3677d7f7-d078-4e0f-ba30-d90da10887df None None] Provisioning for port 5c147714-fdcd-4949-8147-807e126b1eed completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:07.264211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Allocated IP 172.20.0.1 (b86c842d-e3f1-4cfd-957a-f6a0ed42384a/4811f107-9786-45c2-af5e-030f9856728b/a3b13ddf-9d2b-4cd3-a527-e52062b6c671) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:07.364564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.434910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': 'f89121ae-03fc-4730-b2df-7bfaed6f63c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:07.435271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:02:07.449390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['94e09b73-af5f-4ffd-8880-d599c21331b6']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:07.455249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.469291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2a6a9ab1-78e5-483b-b76f-70ee8ab79399') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:07.469681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2a6a9ab1-78e5-483b-b76f-70ee8ab79399') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:07.477607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Transition to ACTIVE for port object d92a204b-7bd6-4599-9870-0a0b9a27a185 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:07.488937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5c147714-fdcd-4949-8147-807e126b1eed up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:07.489808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.509483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.514764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4e4a772-5d7a-4c65-aab1-8f1007d7709d tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:07.544600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.560557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Transition to ACTIVE for port object d92a204b-7bd6-4599-9870-0a0b9a27a185 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:07.562058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 888 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:07.562542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:07.581151 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:07.583515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=6b036948-8a00-453f-b2c4-56c46a11b1af,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:07.583598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.592475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:07.596172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:02:07.596339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f6fb30f6-4807-4ed7-ab06-2a3be65a0d52 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:07.630191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dea5cc4-8328-4b13-bd1e-8d727645da7d None None] Network 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:07.659936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.686406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:07.691685 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/6b036948-8a00-453f-b2c4-56c46a11b1af HTTP/1.1" status: 204 len: 168 time: 2.3926258 Nov 24 14:02:07.692968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:07.693549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.695851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43570) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:07.714973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.718282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7299da2d-4349-4cc5-8e28-d5ae96066292 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:07.733457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.739389 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/94e09b73-af5f-4ffd-8880-d599c21331b6 HTTP/1.1" status: 204 len: 168 time: 1.8588459 Nov 24 14:02:07.740316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43574) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:07.749194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.8847196 Nov 24 14:02:07.751325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43578) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:07.761963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73ffb030-70e2-452f-86c6-c96237f0368b None None] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:07.762178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.776202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-334836714', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:07.784809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:07.788612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=94e09b73-af5f-4ffd-8880-d599c21331b6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:07.797792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:07.800603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:07.814788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:07.828589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f10ed4a-92de-48ce-9844-79f1da57e737 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:07.829159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0f10ed4a-92de-48ce-9844-79f1da57e737 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:07.844250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:07.849887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0f10ed4a-92de-48ce-9844-79f1da57e737 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:07.852679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0f10ed4a-92de-48ce-9844-79f1da57e737 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/7f566d0c-ccf2-483a-820a-d1541294c9d2 HTTP/1.1" status: 200 len: 840 time: 0.1077034 Nov 24 14:02:07.856778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43582) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:07.869681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Pushing event updated for resources: {'Port': ['ID=d92a204b-7bd6-4599-9870-0a0b9a27a185,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:07.873963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:router and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:07.893677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:07.904495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::3b5 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/477fd692-0f29-400a-8c35-e3498d58acb9/bf2021ff-ac29-417c-8e8e-e39e46729d3d) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:07.906728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:07.908992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Transition to ACTIVE for port object a3b13ddf-9d2b-4cd3-a527-e52062b6c671 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:07.952918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.963709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.964811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:07.965860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3da484c8-94f1-47ad-97ea-eb9aa11c8d32 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/7f566d0c-ccf2-483a-820a-d1541294c9d2?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.1068470 Nov 24 14:02:07.966548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43586) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:07.973197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:08.031688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:08.031688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.071781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 5c147714-fdcd-4949-8147-807e126b1eed completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:08.087509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.087888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.088226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.088559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.088890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.089228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.090319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.090654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.091130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.091460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.091813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:02:08.095865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:08.099557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:08.103060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:08.104936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.109052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:08.114199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fcb66b8d-52a1-4b13-ac7b-ac59e9104882 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:08.122153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:08.135092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.539s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:08.141393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5c147714-fdcd-4949-8147-807e126b1eed triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:08.141779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.175745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Attempting to bind port d92a204b-7bd6-4599-9870-0a0b9a27a185 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:08.176136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Attempting to bind port d92a204b-7bd6-4599-9870-0a0b9a27a185 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:08.176718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Attempting to bind port d92a204b-7bd6-4599-9870-0a0b9a27a185 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:08.207517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.231614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.266249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:08.266853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:08.267017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.267608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:08.268271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Bound port: d92a204b-7bd6-4599-9870-0a0b9a27a185, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:08.268836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.305856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:08.318821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:08.322087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:08.359375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4eb53322-a5f2-4c20-ae92-35ce01db540c None None] Provisioning complete for port 5c147714-fdcd-4949-8147-807e126b1eed triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:08.359815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4eb53322-a5f2-4c20-ae92-35ce01db540c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.409569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Port': ['ID=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:08.412642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:08.460025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.467576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5', 'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': 'b0c0b927-55d5-4214-8f61-2ab7cfdd60b9'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:08.468432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.526399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.532815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e84ed3cb-a48f-4e0b-bba1-3f96709e7e44 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:08.536395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.538397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.626010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:08.627786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.629626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:08.634315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:08.635253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.640134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] DHCP port deletion for 2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:08.655496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=cacaa952-e652-4a93-8b4d-0ea336698c5d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:08.662253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] For port d92a204b-7bd6-4599-9870-0a0b9a27a185, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:08.667656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:08.668233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] For port d92a204b-7bd6-4599-9870-0a0b9a27a185, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92a204b-7bd6-4599-9870-0a0b9a27a185,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:08.675862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4400d823-483d-4638-ba25-c5d10a7e6811 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:08.682021 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7114828 Nov 24 14:02:08.682305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43592) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:08.690102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'security_group': {'name': 'tempest-secgroup-559382682'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:08.700002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:08.704301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:08.706223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.708523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:08.711385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.719126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:08.720563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Deleting port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:08.720563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.730803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.732096 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bb9a406d-2705-4dae-807a-dbd78aeb2fa2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.9773531 Nov 24 14:02:08.735553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43596) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:08.740050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object bf2021ff-ac29-417c-8e8e-e39e46729d3d will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:08.742676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 3beaa343-1d37-4d86-abb6-f2b05fd43e29, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3beaa343-1d37-4d86-abb6-f2b05fd43e29,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:08.743032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.761875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d2e550a5-2b6a-4b5b-8779-c87872a297c9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:08.809398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.885127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 3beaa343-1d37-4d86-abb6-f2b05fd43e29 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:08.918209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:08.918714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:08.979625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group_rule and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:08.988719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:09.050271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:09.173699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.184846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:09.216314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 5c147714-fdcd-4949-8147-807e126b1eed, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5c147714-fdcd-4949-8147-807e126b1eed,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:09.244132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.250415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Pushing event updated for resources: {'Port': ['ID=d92a204b-7bd6-4599-9870-0a0b9a27a185,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:09.271222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.509s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:09.272629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.275000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4eb53322-a5f2-4c20-ae92-35ce01db540c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.337159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:09.415981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.447975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:09.454170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.461107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=5c147714-fdcd-4949-8147-807e126b1eed,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:09.464665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d196b22-1dff-484d-8d13-74a1857ea50d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:09.515070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e21f54c-a16d-4daf-8826-66b340468a32 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:09.553991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9342536f-752d-402e-b02b-2879d8571f6d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:09.565352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:09.567554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.572703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 0.8888576 Nov 24 14:02:09.573821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:09.576826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43604) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:09.599285 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:02:09.610425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'security_group': {'name': 'tempest-secgroup-1958155069'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:09.614166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 9e21f54c-a16d-4daf-8826-66b340468a32 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:09.614523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e21f54c-a16d-4daf-8826-66b340468a32 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:09.614947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 565160e6-a40f-40ee-a7d7-7f75b51fee2a no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:09.619118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:09.626102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.636034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:09.640516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:09.651049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:09.702197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:09.706935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:09.712564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:09.713126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.730176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=bf2021ff-ac29-417c-8e8e-e39e46729d3d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:09.739531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.556s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:09.743389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.323s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:09.743546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 565160e6-a40f-40ee-a7d7-7f75b51fee2a {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:09.743732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 565160e6-a40f-40ee-a7d7-7f75b51fee2a not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:09.752358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Allocated IP 2001:db8::2 (727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5/b0c0b927-55d5-4214-8f61-2ab7cfdd60b9/9bd51090-2ab8-4eb5-93bf-ad47ecbe8832) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:09.782014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-4eb53322-a5f2-4c20-ae92-35ce01db540c None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:09.782382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-4eb53322-a5f2-4c20-ae92-35ce01db540c None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:09.801411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] For port 3beaa343-1d37-4d86-abb6-f2b05fd43e29, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3beaa343-1d37-4d86-abb6-f2b05fd43e29,segment=NetworkSegment(8e40795f-cd8f-4b38-9f6f-a81082879b19),segment_id=8e40795f-cd8f-4b38-9f6f-a81082879b19)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:09.801821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:09.807678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No DVR routers for this DVR port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:09.813117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=3beaa343-1d37-4d86-abb6-f2b05fd43e29,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:09.846719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:09.894247 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 3.7184987 Nov 24 14:02:09.905160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43610) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:09.935019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.044931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.052708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5c147714-fdcd-4949-8147-807e126b1eed up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:10.077481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:10.079142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:10.087576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group_rule and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:10.093689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:10.099840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:10.104830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Calling delete_port for 3beaa343-1d37-4d86-abb6-f2b05fd43e29 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:10.106199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8e40795f-cd8f-4b38-9f6f-a81082879b19') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:10.106199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8e40795f-cd8f-4b38-9f6f-a81082879b19') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:10.129066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.134437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.145375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.173318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:10.173543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.186274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.230076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:10.253289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.257877 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.6765308 Nov 24 14:02:10.263142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43614) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:10.276525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'SecurityGroup': ['ID=abd8e4f8-c237-434d-afc5-836a0f650b4f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:10.278115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:10.279885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:10.284225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:10.294228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.305393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1624446480', 'security_groups': ['abd8e4f8-c237-434d-afc5-836a0f650b4f'], 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'cacaa952-e652-4a93-8b4d-0ea336698c5d'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:10.338584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 884 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:10.338983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:10.353853 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:10.385935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca350710-63c6-44c0-bf68-78ace2e81f79 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:10.390247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca350710-63c6-44c0-bf68-78ace2e81f79 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:10.391594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ca350710-63c6-44c0-bf68-78ace2e81f79 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:10.446052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'tenant_id': '74f54ee2a8574df893d540b53d0009fe', 'fixed_ips': [{'subnet_id': 'cacaa952-e652-4a93-8b4d-0ea336698c5d'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:10.447023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.468644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Port': ['ID=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:10.473468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.476913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5c147714-fdcd-4949-8147-807e126b1eed triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:10.477076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:10.477310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.523025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Transition to ACTIVE for port object 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:10.527618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.602039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Transition to ACTIVE for port object 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:10.610118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ca350710-63c6-44c0-bf68-78ace2e81f79 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:10.611439 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ca350710-63c6-44c0-bf68-78ace2e81f79 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1669 time: 0.7051950 Nov 24 14:02:10.616329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43618) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:10.620808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.624804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.632730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fd774570-637d-4b64-b016-957a05e14f8b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:10.638776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eff168c3-2a0d-4b04-8d59-bdf4c8c03fa1 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:10.654376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.720124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:10.738611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:10.742285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:10.750585 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/2d2b9732-6a89-4dcb-afc9-7e1e72fb1e37 HTTP/1.1" status: 204 len: 168 time: 3.0473430 Nov 24 14:02:10.750795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43622) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:10.767972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:10.773859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-377275ef-b478-49e0-bfd6-eec609d943b6 None None] Provisioning for port d92a204b-7bd6-4599-9870-0a0b9a27a185 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:10.808431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:10.817158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:10.817897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Deleting port 3beaa343-1d37-4d86-abb6-f2b05fd43e29 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:10.818134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:10.842760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Pushing event updated for resources: {'Port': ['ID=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:10.857072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:10.865130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:10.871121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:10.894994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:10.899678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:10.924577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Allocated IP 172.20.0.2 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/cacaa952-e652-4a93-8b4d-0ea336698c5d/8ea226c9-4123-480e-83ad-f3cfa95ed36e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:10.932525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-be86a431-4ba0-46dc-b554-c5f2159ebbe5 None None] The port '3beaa343-1d37-4d86-abb6-f2b05fd43e29' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:10.984951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92a204b-7bd6-4599-9870-0a0b9a27a185 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:10.993225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port bf2021ff-ac29-417c-8e8e-e39e46729d3d {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:10.993572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.030882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8::1 (727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5/b0c0b927-55d5-4214-8f61-2ab7cfdd60b9/2b6af2f1-6217-4976-9c67-84ea790081df) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:11.196450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-377275ef-b478-49e0-bfd6-eec609d943b6 None None] Provisioning for port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:11.211786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.236317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port 89e658eb-cad2-4369-a55e-aebd839dbcf5 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:11.330702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Attempting to bind port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:11.331333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Attempting to bind port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'f89121ae-03fc-4730-b2df-7bfaed6f63c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:11.331438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Attempting to bind port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 on network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:11.342425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-377275ef-b478-49e0-bfd6-eec609d943b6 None None] Provisioning complete for port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:11.342738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-377275ef-b478-49e0-bfd6-eec609d943b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.408652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:11.409082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Checking segment: {'id': 'f89121ae-03fc-4730-b2df-7bfaed6f63c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:11.409448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.409853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Bound using segment: {'id': 'f89121ae-03fc-4730-b2df-7bfaed6f63c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:11.410361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Bound port: 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f89121ae-03fc-4730-b2df-7bfaed6f63c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:11.410762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.494511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-377275ef-b478-49e0-bfd6-eec609d943b6 None None] Port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:11.531487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d92a204b-7bd6-4599-9870-0a0b9a27a185 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:11.554602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.559497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d92a204b-7bd6-4599-9870-0a0b9a27a185 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:11.559497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.602859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.612617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.613042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Transition to ACTIVE for port object 8ea226c9-4123-480e-83ad-f3cfa95ed36e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:11.683078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Transition to ACTIVE for port object 8ea226c9-4123-480e-83ad-f3cfa95ed36e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:11.685661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] For port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:11.692092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] For port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,segment=NetworkSegment(f89121ae-03fc-4730-b2df-7bfaed6f63c1),segment_id=f89121ae-03fc-4730-b2df-7bfaed6f63c1)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:11.698623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.703952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:11.765726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Router 95732bbb-def1-43f3-a30c-c41d29c85119 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:11.766772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.770182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Provisioning for port bf2021ff-ac29-417c-8e8e-e39e46729d3d completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:11.784253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.5 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/cacaa952-e652-4a93-8b4d-0ea336698c5d/89e658eb-cad2-4369-a55e-aebd839dbcf5) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:11.801724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Provisioning complete for port bf2021ff-ac29-417c-8e8e-e39e46729d3d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:11.802100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.865474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for bf2021ff-ac29-417c-8e8e-e39e46729d3d owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:11.894021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:11.896600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:11.909091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:11.916807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 2b6af2f1-6217-4976-9c67-84ea790081df will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:11.919795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:11.924675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:11.927701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ad7747c0-f4f2-4ee1-8e86-288ac55a8a0b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.140s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:11.963937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:11.978046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Port bf2021ff-ac29-417c-8e8e-e39e46729d3d cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:12.043180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.055872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-94f0fc5c-2c24-4c64-888a-4d0f021806c0 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:12.111020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d92a204b-7bd6-4599-9870-0a0b9a27a185, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92a204b-7bd6-4599-9870-0a0b9a27a185,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:12.113429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Pushing event updated for resources: {'Port': ['ID=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:12.129304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:12.133039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Provisioning complete for port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:12.133979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.140282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.148862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.157095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.165969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e325f56b-04c1-4934-a236-dcb8ff843e43 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:12.178484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object 89e658eb-cad2-4369-a55e-aebd839dbcf5 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:12.206749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:12.230241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Attempting to bind port 8ea226c9-4123-480e-83ad-f3cfa95ed36e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:12.230622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Attempting to bind port 8ea226c9-4123-480e-83ad-f3cfa95ed36e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '1e68820c-505e-471b-8ec4-c754b46e3d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:12.230772 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "PUT /v2.0/routers/95732bbb-def1-43f3-a30c-c41d29c85119/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.9655879 Nov 24 14:02:12.230988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Attempting to bind port 8ea226c9-4123-480e-83ad-f3cfa95ed36e on network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:12.239366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.248057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-628ebc03-307a-4b32-b13e-be7050735713 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:12.281733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Sync routers for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:12.334136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fdbaaf6e-1237-47bd-a5c0-0f1c9157a2de None None] Port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:12.340774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:12.341148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Checking segment: {'id': '1e68820c-505e-471b-8ec4-c754b46e3d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:12.341555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.341944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Bound using segment: {'id': '1e68820c-505e-471b-8ec4-c754b46e3d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:12.342406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Bound port: 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1e68820c-505e-471b-8ec4-c754b46e3d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:12.342782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.351340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:12.355434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.355646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:12.357982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3beaa343-1d37-4d86-abb6-f2b05fd43e29 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:12.359156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:12.391939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=89e658eb-cad2-4369-a55e-aebd839dbcf5,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:12.395231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=2b6af2f1-6217-4976-9c67-84ea790081df,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:12.395956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:12.399540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:12.402336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:12.405164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-aa0958a6-d3ef-4fe8-8478-39eff5e459e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.013s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:12.455659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:12.469130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:12.471489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.472088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:12.472736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.479246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=bf2021ff-ac29-417c-8e8e-e39e46729d3d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:12.482503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:12.517519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d92a204b-7bd6-4599-9870-0a0b9a27a185,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:12.520275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 3beaa343-1d37-4d86-abb6-f2b05fd43e29 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:12.524239 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.2402411 Nov 24 14:02:12.527409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:12.528071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3beaa343-1d37-4d86-abb6-f2b05fd43e29 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:12.533088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.364s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:12.534739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:12.558606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.616657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/bf2021ff-ac29-417c-8e8e-e39e46729d3d HTTP/1.1" status: 204 len: 168 time: 1.9988556 Nov 24 14:02:12.621128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43634) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:12.622888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:12.627141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:12.764783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:12.777337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:12.790461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:12.800653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:12.824804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:12.828951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.865500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.878221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:12.889524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:12.893899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-561c03ca-a917-4943-bbe0-a7e6f60e272a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:12.895533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-561c03ca-a917-4943-bbe0-a7e6f60e272a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:12.896312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-561c03ca-a917-4943-bbe0-a7e6f60e272a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:12.942158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:12.960652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:12.969835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7a91ac7-7a49-4106-adb9-4d287065e9c1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:13.008799 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet cacaa952-e652-4a93-8b4d-0ea336698c5d (CIDR: 172.20.0.0/28) Nov 24 14:02:13.012565 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:02:13.013049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:13.034043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-561c03ca-a917-4943-bbe0-a7e6f60e272a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:13.035221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-561c03ca-a917-4943-bbe0-a7e6f60e272a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.4131057 Nov 24 14:02:13.038563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43644) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:13.042211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-d4d13377-63d5-4a08-8343-cea32277f16d tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Synchronizing usage tracker for tenant:84c43153da724ce38453763656256a35 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:13.088331 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-24ab01c6-0ba9-4abf-b8f4-d978dd42894e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5594065 Nov 24 14:02:13.091676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:13.094390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43648) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:13.101543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:13.206361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:13.225229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:13.245313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:13.252455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92a204b-7bd6-4599-9870-0a0b9a27a185 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:13.473375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-d4d13377-63d5-4a08-8343-cea32277f16d tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Unset dirty status for tenant:84c43153da724ce38453763656256a35 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:13.474463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d92a204b-7bd6-4599-9870-0a0b9a27a185 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:13.474955 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-d4d13377-63d5-4a08-8343-cea32277f16d tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1304184443&fields=id&tenant_id=84c43153da724ce38453763656256a35 HTTP/1.1" status: 200 len: 267 time: 0.6351514 Nov 24 14:02:13.476288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:13.478633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:13.495640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 477fd692-0f29-400a-8c35-e3498d58acb9 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:13.509983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:13.514126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:13.521343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:13.603178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:13.644985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:13.675075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:13.680056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:13.786819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:09Z', 'revision_number': 2, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:13.792604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Checking router: 95732bbb-def1-43f3-a30c-c41d29c85119 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:13.793385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Updating router 95732bbb-def1-43f3-a30c-c41d29c85119 port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:02:13.834124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0965d756-4e78-4479-9ab6-5b79698cb73f None None] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:14.018148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.065303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.109017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Provisioning for port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:14.117104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Provisioning complete for port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:14.117763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.226811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-0045c0eb-71fd-41a4-a03e-614d314d905c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:14.227596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-0045c0eb-71fd-41a4-a03e-614d314d905c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Synchronizing usage tracker for tenant:84c43153da724ce38453763656256a35 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:14.330137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.336029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-0045c0eb-71fd-41a4-a03e-614d314d905c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Unset dirty status for tenant:84c43153da724ce38453763656256a35 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:14.337870 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-0045c0eb-71fd-41a4-a03e-614d314d905c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 797 time: 0.8231828 Nov 24 14:02:14.342050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.342255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.343064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.346564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4e62f0b7-2893-4702-8aad-ce83dabc588c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:14.383348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:14.401097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.411976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=477fd692-0f29-400a-8c35-e3498d58acb9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:14.420093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:14.420609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cee52f3e-9227-4068-b28a-72266980a57b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.011s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:14.440759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8671ddb-fee0-4318-86a4-b5a881870d70 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:14.453794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.478191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:14.484569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:14.493284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:14.493872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.525806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=e7478ca1-ea35-4aea-b3dd-b676833cc73f,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:14.531858 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/477fd692-0f29-400a-8c35-e3498d58acb9 HTTP/1.1" status: 204 len: 168 time: 1.4899709 Nov 24 14:02:14.533011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:14.533693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43652) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:14.536856 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-8e445ce1-6b1e-405e-ac77-ce4f1e2ade33 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/quotas/84c43153da724ce38453763656256a35 HTTP/1.1" status: 200 len: 375 time: 0.1692612 Nov 24 14:02:14.552276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=2b6af2f1-6217-4976-9c67-84ea790081df,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:14.601991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:14.607225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.614385 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.5190394 Nov 24 14:02:14.656066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43656) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:14.673464 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c97b4abb-f80d-44ad-8323-e1b274898f80 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1377029 Nov 24 14:02:14.673959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d280560b-910a-4486-b1b8-b8debc593b88 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:14.678245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1380646784', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'e7478ca1-ea35-4aea-b3dd-b676833cc73f'}], 'security_groups': ['9342536f-752d-402e-b02b-2879d8571f6d']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:14.683151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43660) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:14.692194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:14.814756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8ea226c9-4123-480e-83ad-f3cfa95ed36e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:14.905671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:14.959217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:14.976984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:14.980900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:14.983471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:14.987369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:14.998538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] For port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,segment=NetworkSegment(f89121ae-03fc-4730-b2df-7bfaed6f63c1),segment_id=f89121ae-03fc-4730-b2df-7bfaed6f63c1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:15.001868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:15.039075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.045647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:15.076162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-8e1c8846-9de6-41cb-b587-4182ed6cf568 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5174174 Nov 24 14:02:15.097985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:15.280311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:15.311666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Pushing event updated for resources: {'Port': ['ID=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:15.317434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:15.372975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Provisioning for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:15.379183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:15.386164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:15.386808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.415307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Deleting port d92a204b-7bd6-4599-9870-0a0b9a27a185 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:15.415963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.453316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:02:15.572400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Delete allocated IP 172.20.0.5 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/cacaa952-e652-4a93-8b4d-0ea336698c5d) {{(pid=83525) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 14:02:15.585241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.18 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/e7478ca1-ea35-4aea-b3dd-b676833cc73f/89e658eb-cad2-4369-a55e-aebd839dbcf5) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:15.631550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.655048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-982583bc-6c8f-4881-a529-ab7688017ddc service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:02:15.661902 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-982583bc-6c8f-4881-a529-ab7688017ddc service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.1501811 Nov 24 14:02:15.671224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.735040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Transition to ACTIVE for port object a3b13ddf-9d2b-4cd3-a527-e52062b6c671 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:15.797968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.868461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.879174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] For port d92a204b-7bd6-4599-9870-0a0b9a27a185, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d92a204b-7bd6-4599-9870-0a0b9a27a185,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:15.879704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.888164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Ignored duplicate provisioning block setup for port 89e658eb-cad2-4369-a55e-aebd839dbcf5 by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} Nov 24 14:02:15.890486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port d670b4ec-57fe-4eaa-abac-c1f52d488a15 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:15.890840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.893772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.899843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e3f29543-2cb9-47a2-874f-8c520cc5c313 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:15.916712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:15.918084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:15.988421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-54d790ef-72f8-46de-a0f2-8138e001dc2c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:16.022731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.035717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=89e658eb-cad2-4369-a55e-aebd839dbcf5,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:16.042834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:16.069730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] In _notify_port_updated(), no bound segment for port 89e658eb-cad2-4369-a55e-aebd839dbcf5 on network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:02:16.073965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:16.074589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.076002 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/ports/89e658eb-cad2-4369-a55e-aebd839dbcf5 HTTP/1.1" status: 200 len: 921 time: 1.4154553 Nov 24 14:02:16.079338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43670) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:16.154745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 89e658eb-cad2-4369-a55e-aebd839dbcf5 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:16.155095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.223688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Calling delete_port for d92a204b-7bd6-4599-9870-0a0b9a27a185 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:16.290282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Update dhcp port {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'fixed_ips': [{'subnet_id': 'cacaa952-e652-4a93-8b4d-0ea336698c5d', 'ip_address': '172.20.0.2'}, {'subnet_id': 'e7478ca1-ea35-4aea-b3dd-b676833cc73f'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8ea226c9-4123-480e-83ad-f3cfa95ed36e'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:02:16.329683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-9498b1fa-8cb6-4ccc-998f-712e2659c830 service neutron] 10.222.0.70 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6658158 Nov 24 14:02:16.384137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052ce5ec-f136-4d1c-a331-606f7c225dce None None] Pushing event updated for resources: {'Port': ['ID=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:16.387565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-052ce5ec-f136-4d1c-a331-606f7c225dce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.399s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:16.395182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.264s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:16.460676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.499068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Provisioning complete for port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:16.500021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.581689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port d670b4ec-57fe-4eaa-abac-c1f52d488a15, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d670b4ec-57fe-4eaa-abac-c1f52d488a15,segment=NetworkSegment(97494fb6-9264-45f5-bf41-b9ed212d15c9),segment_id=97494fb6-9264-45f5-bf41-b9ed212d15c9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:16.582103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.604473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Attempting to bind port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:16.604473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Attempting to bind port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:16.604473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Attempting to bind port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 on network b86c842d-e3f1-4cfd-957a-f6a0ed42384a {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:16.606871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.614718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-5806e2f9-0aab-461e-93ac-fb30f1c9b517 service neutron] 10.222.0.70 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2832146 Nov 24 14:02:16.664997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:16.665536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Checking segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:16.666420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.667016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Bound using segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:16.667601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Bound port: a3b13ddf-9d2b-4cd3-a527-e52062b6c671, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:16.668104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.677168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.706215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 89e658eb-cad2-4369-a55e-aebd839dbcf5 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:16.731385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:16.734645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.340s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:16.735942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:16.805115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for d670b4ec-57fe-4eaa-abac-c1f52d488a15 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:16.813608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.129s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:16.892202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:16.899901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74af5401-f5e9-4890-bc49-59a928d50f14 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:16.965790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] No DVR routers for this DVR port d92a204b-7bd6-4599-9870-0a0b9a27a185 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:16.981093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Pushing event deleted for resources: {'Port': ['ID=d92a204b-7bd6-4599-9870-0a0b9a27a185,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:16.995148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:17.006857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:17.012786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:17.014908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=c9658e4c-8e13-4a45-84ed-b1f7129b80e1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:17.017492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:17.030865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-303b0a2f-85dc-497d-ba5b-1056a884037e req-022018b3-059c-4ea8-98ac-f9f0207663b3 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Synchronizing usage tracker for tenant:84c43153da724ce38453763656256a35 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:17.031031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:17.031584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.048487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.056032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-da789250-a86d-44f5-a7e6-356ec0b74d79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:17.078679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:02:17.096567 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 2.4104431 Nov 24 14:02:17.097430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a2f9fd1-81ad-4e9d-825a-c5ef779ae11d None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:17.100753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43682) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:17.112399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=89e658eb-cad2-4369-a55e-aebd839dbcf5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:17.114524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-303b0a2f-85dc-497d-ba5b-1056a884037e req-022018b3-059c-4ea8-98ac-f9f0207663b3 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Unset dirty status for tenant:84c43153da724ce38453763656256a35 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:17.116501 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-303b0a2f-85dc-497d-ba5b-1056a884037e req-022018b3-059c-4ea8-98ac-f9f0207663b3 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 210 time: 0.1999607 Nov 24 14:02:17.117633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:17.159366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'name': 'tempest-NetworksTestDHCPv6-244994798'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:17.252913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:17.253303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.268125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.280108 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/89e658eb-cad2-4369-a55e-aebd839dbcf5 HTTP/1.1" status: 204 len: 168 time: 1.1995826 Nov 24 14:02:17.282895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43690) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:17.342640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-5fa08753-8ade-49a6-b4db-a3f2b2ff1b77 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:02:17.343322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fa08753-8ade-49a6-b4db-a3f2b2ff1b77 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:17.369310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fa08753-8ade-49a6-b4db-a3f2b2ff1b77 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:17.371443 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5fa08753-8ade-49a6-b4db-a3f2b2ff1b77 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/89e658eb-cad2-4369-a55e-aebd839dbcf5 HTTP/1.1" status: 404 len: 333 time: 0.0875099 Nov 24 14:02:17.374134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43696) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:17.388959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.403467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1bb59835-109e-482f-9880-13f4d97aa6a3 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:17.436493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] For port a3b13ddf-9d2b-4cd3-a527-e52062b6c671, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:17.466295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=d670b4ec-57fe-4eaa-abac-c1f52d488a15,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:17.472777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:17.489346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.497066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] For port a3b13ddf-9d2b-4cd3-a527-e52062b6c671, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:17.530727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.536992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.555523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-052ce5ec-f136-4d1c-a331-606f7c225dce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:17.605532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.610554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61e2ff1d-b550-4d8d-a742-034b341d7406 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:17.627967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=abd8e4f8-c237-434d-afc5-836a0f650b4f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:17.642038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:17.651954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:17.652594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.657109 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/security-groups/abd8e4f8-c237-434d-afc5-836a0f650b4f HTTP/1.1" status: 204 len: 168 time: 0.2797544 Nov 24 14:02:17.657640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:17.658752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43702) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:17.660641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:17.668818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:17.721707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:17.722287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.726974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:17.731219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.761401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port ac884e28-67a7-4c9f-af27-85e451f61546 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:17.777197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Allocated IP 172.20.0.19 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/e7478ca1-ea35-4aea-b3dd-b676833cc73f/8ea226c9-4123-480e-83ad-f3cfa95ed36e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:17.788825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.841272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.844056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.899432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.904207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5077799-9b87-4fe4-a5e3-b110acd7a642 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:17.921187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9342536f-752d-402e-b02b-2879d8571f6d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:17.924222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:17.926451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:17.927555 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/security-groups/9342536f-752d-402e-b02b-2879d8571f6d HTTP/1.1" status: 204 len: 168 time: 0.2671998 Nov 24 14:02:17.931059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43706) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:18.007989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:18.067567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052ce5ec-f136-4d1c-a331-606f7c225dce None None] Pushing event updated for resources: {'Port': ['ID=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:18.070353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:18.070963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:18.101676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:18.113884 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] Sync routers for ids ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:18.138143 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] Routers {'62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:18.139073 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:18.141075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-052ce5ec-f136-4d1c-a331-606f7c225dce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.586s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:18.173528 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/62e1e4da-34fc-44d6-b3e7-c5f88e6b6277/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.4363029 Nov 24 14:02:18.177521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43712) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:18.184888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet cacaa952-e652-4a93-8b4d-0ea336698c5d {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:18.280504 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:18.288398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92a204b-7bd6-4599-9870-0a0b9a27a185 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:18.318115 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] Routers {'62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:18.320737 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:18.329851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'c9658e4c-8e13-4a45-84ed-b1f7129b80e1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:18.330980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:18.372819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50a539bd-8f9e-4273-857b-1982f4738a6f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:18.378407 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50a539bd-8f9e-4273-857b-1982f4738a6f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports/2b6af2f1-6217-4976-9c67-84ea790081df HTTP/1.1" status: 200 len: 911 time: 0.1962988 Nov 24 14:02:18.378603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d92a204b-7bd6-4599-9870-0a0b9a27a185 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:18.378603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d92a204b-7bd6-4599-9870-0a0b9a27a185 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:18.378761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43716) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:18.430911 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:18.431329 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01c46a7f-501c-4ae4-bbee-457d2aab373d None None] The sync data for ids ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:18.445564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::7c (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/c9658e4c-8e13-4a45-84ed-b1f7129b80e1/ac884e28-67a7-4c9f-af27-85e451f61546) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:18.504237 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d27f348-edda-47d9-9890-9c4666b43c08 req-34b1e1b7-9989-4a50-973a-fd8220590d83 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 210 time: 0.0503197 Nov 24 14:02:18.557002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:18.601180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Provisioning for port 2b6af2f1-6217-4976-9c67-84ea790081df completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:18.646273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Provisioning complete for port 2b6af2f1-6217-4976-9c67-84ea790081df triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:18.646660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:18.709060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Port 2b6af2f1-6217-4976-9c67-84ea790081df cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:18.760895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:18.775953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:18.830470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8ea226c9-4123-480e-83ad-f3cfa95ed36e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:18.869056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:18.924918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:02:18.951988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.018578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Transition to ACTIVE for port object 8ea226c9-4123-480e-83ad-f3cfa95ed36e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:19.025763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.045676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.060628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-e7df6a39-c2f0-4d10-8fc9-10090290419f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:19.062132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-e7df6a39-c2f0-4d10-8fc9-10090290419f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.47 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 797 time: 0.4516740 Nov 24 14:02:19.095239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object ac884e28-67a7-4c9f-af27-85e451f61546 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:19.158406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.169462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:19.231439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.278875 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-db3044f3-cbf3-4e7b-9e0b-3c9336a4dfe3 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=84c43153da724ce38453763656256a35 HTTP/1.1" status: 200 len: 380 time: 0.2008419 Nov 24 14:02:19.296764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'port': {'device_id': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'admin_state_up': True, 'tenant_id': '84c43153da724ce38453763656256a35', 'security_groups': ['c515eff7-1452-46c0-9ddd-403a3742014c']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:19.342773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.344441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf425943-c94c-46b3-a64b-13986afe865d None None] Provisioning complete for port 2b6af2f1-6217-4976-9c67-84ea790081df triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:19.344991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf425943-c94c-46b3-a64b-13986afe865d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.415150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.424923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2bec263-50bc-4808-9f13-b7de743508b5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:19.596690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:19.621673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:19.621925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:19.624424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:19.626103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.457s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:19.629305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:19.630104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.631139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf425943-c94c-46b3-a64b-13986afe865d None None] Port 2b6af2f1-6217-4976-9c67-84ea790081df cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:19.642803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/c9658e4c-8e13-4a45-84ed-b1f7129b80e1/a77ed0ed-4420-4324-a1a4-f249a1dd971f) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:19.708805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=ac884e28-67a7-4c9f-af27-85e451f61546,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:19.717384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:19.745922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.753564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a7e534e4-9538-4733-a26f-456b1b825e12 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:19.768894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:19.783918 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 2.6804047 Nov 24 14:02:19.785255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:19.789934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43728) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:19.794279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=cacaa952-e652-4a93-8b4d-0ea336698c5d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:19.803076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:19.855299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:17Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:19.861866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Made reservation on behalf of 84c43153da724ce38453763656256a35 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:19.863859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ccd352b-4fd1-41e8-85a1-bcb0ef8fe1da None None] The sync data for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv is: [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:17Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:19.865622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.877836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:19.898493 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7e5c2a50-e6c4-4e1c-a88a-b6d61a6bf34f req-e52333e9-7128-40a9-8c7b-e896ed58b714 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 210 time: 0.1480889 Nov 24 14:02:19.909673 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/cacaa952-e652-4a93-8b4d-0ea336698c5d HTTP/1.1" status: 204 len: 168 time: 1.9742851 Nov 24 14:02:19.910652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43732) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:19.946822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:20.015977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37ad1e3b-baa4-486f-a74f-d3182370a33c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:20.016703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-37ad1e3b-baa4-486f-a74f-d3182370a33c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:20.060482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.080860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Transition to ACTIVE for port object a77ed0ed-4420-4324-a1a4-f249a1dd971f will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:20.093316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:20.122569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Transition to ACTIVE for port object a77ed0ed-4420-4324-a1a4-f249a1dd971f will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:20.128582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-37ad1e3b-baa4-486f-a74f-d3182370a33c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:20.129767 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-37ad1e3b-baa4-486f-a74f-d3182370a33c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 928 time: 0.3388286 Nov 24 14:02:20.133394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43738) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:20.136966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.142658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9feb0514-589c-47d7-ab5e-657ac0093b53 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:20.224778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:20.234471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:20.259038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:20.313369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port ac884e28-67a7-4c9f-af27-85e451f61546 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:20.313635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.344965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Pushing event updated for resources: {'Port': ['ID=a77ed0ed-4420-4324-a1a4-f249a1dd971f,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:20.401150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:20.405787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:20.406583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:20.409819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:20.416869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:20.440502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Attempting to bind port a77ed0ed-4420-4324-a1a4-f249a1dd971f on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:20.441368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Attempting to bind port a77ed0ed-4420-4324-a1a4-f249a1dd971f by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:20.442076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Attempting to bind port a77ed0ed-4420-4324-a1a4-f249a1dd971f on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:20.450094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:20.450800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:20.451455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:20.451815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.452086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Allocated IP 172.20.0.6 (b86c842d-e3f1-4cfd-957a-f6a0ed42384a/4811f107-9786-45c2-af5e-030f9856728b/67fa1194-0c3d-4202-9709-065dd857e200) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:20.452710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:20.453378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Bound port: a77ed0ed-4420-4324-a1a4-f249a1dd971f, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:20.455210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.455855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.585253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] For port a77ed0ed-4420-4324-a1a4-f249a1dd971f, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:20.589207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] For port a77ed0ed-4420-4324-a1a4-f249a1dd971f, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a77ed0ed-4420-4324-a1a4-f249a1dd971f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:20.592923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d4c7a48-dd8d-4e1f-b81a-b5e5ab9c1df4 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:20.614471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.629182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:20.797059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 2b6af2f1-6217-4976-9c67-84ea790081df {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:20.798139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.807652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a3b13ddf-9d2b-4cd3-a527-e52062b6c671 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:20.857786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.861364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Provisioning for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:20.887708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Transition to ACTIVE for port object 67fa1194-0c3d-4202-9709-065dd857e200 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:20.888502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:20.888725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:20.916343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:20.932286 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 10.1815488 Nov 24 14:02:20.935228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43742) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:20.971183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:20.982906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.006706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Pushing event updated for resources: {'Port': ['ID=a77ed0ed-4420-4324-a1a4-f249a1dd971f,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:21.018677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.390s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:21.049764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.067165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72d50bd2-d576-450f-8fa9-61bae60da461 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:21.101689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:21.107385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:21.191050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:21.202049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:21.230752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:21.263327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:21.266386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for ac884e28-67a7-4c9f-af27-85e451f61546 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:21.272736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:21.609116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:21.609734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.650674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:21.662807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:21.663314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.664311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3713074 Nov 24 14:02:21.674708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05b46bd2-2ae1-4731-85ba-4ee8a5252413 req-ddde8d0a-2188-45e7-9aa4-f01209e23036 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:21.675390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-05b46bd2-2ae1-4731-85ba-4ee8a5252413 req-ddde8d0a-2188-45e7-9aa4-f01209e23036 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Synchronizing usage tracker for tenant:84c43153da724ce38453763656256a35 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:21.682246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Request body: {'port': {'device_id': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:21.692509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:21.715196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet 680006ef-4d94-41e1-9d14-3fbf3d869aee {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:21.733497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.777218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:21.777769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.789129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:21.808578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-05b46bd2-2ae1-4731-85ba-4ee8a5252413 req-ddde8d0a-2188-45e7-9aa4-f01209e23036 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Unset dirty status for tenant:84c43153da724ce38453763656256a35 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:21.809761 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05b46bd2-2ae1-4731-85ba-4ee8a5252413 req-ddde8d0a-2188-45e7-9aa4-f01209e23036 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 931 time: 0.6164041 Nov 24 14:02:21.811832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.012404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.031682 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05b46bd2-2ae1-4731-85ba-4ee8a5252413 req-fa55d3ab-ecb6-499d-8d32-e8eea0668a4a tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1789052 Nov 24 14:02:22.093700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 2b6af2f1-6217-4976-9c67-84ea790081df owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:22.112903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.187508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:22.206779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fcd4ebf6-7fed-4061-9ab5-bdfba7b6da98 None None] Could not find standard attr ID for object 89e658eb-cad2-4369-a55e-aebd839dbcf5. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:02:22.347928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.369689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d98a7c31-57ad-4199-aca9-ae057cb0fb2c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:22.375873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.421894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=ac884e28-67a7-4c9f-af27-85e451f61546,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:22.424984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:22.452899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.462194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6041acfa-2f55-4adf-b5ba-d19aa5ffc8a7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:22.476602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port a3b13ddf-9d2b-4cd3-a527-e52062b6c671, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:22.494527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.495498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8ea226c9-4123-480e-83ad-f3cfa95ed36e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:22.515358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.546877 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/ac884e28-67a7-4c9f-af27-85e451f61546 HTTP/1.1" status: 204 len: 168 time: 2.4120071 Nov 24 14:02:22.549312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43748) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:22.580736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0083ab97-f406-4370-8466-acfe389ae046 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:22.608439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.623231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-51ed877a-b9db-4b79-a831-9fbb99b14d3a tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:22.662211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:22.670834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:22.685855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=680006ef-4d94-41e1-9d14-3fbf3d869aee,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:22.703521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:17Z', 'revision_number': 10, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:22.710979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:22.711826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:22.717974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4637d10a-dded-40ec-be66-0fcbf749be93 None None] Provisioning for port 67fa1194-0c3d-4202-9709-065dd857e200 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:22.727145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4637d10a-dded-40ec-be66-0fcbf749be93 None None] Provisioning complete for port 67fa1194-0c3d-4202-9709-065dd857e200 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:22.727522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4637d10a-dded-40ec-be66-0fcbf749be93 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.791975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:22.794561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:22.832505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:22.836952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fac46d53-af80-44a7-aed9-6965da989665 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:22.838718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fac46d53-af80-44a7-aed9-6965da989665 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:22.839471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fac46d53-af80-44a7-aed9-6965da989665 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:22.840294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4637d10a-dded-40ec-be66-0fcbf749be93 None None] Port 67fa1194-0c3d-4202-9709-065dd857e200 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:22.841874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5411e26-9e1d-4521-9424-95cc14837e43 None None] Network 89cc7986-be93-42b0-bf08-7a1aa46579f1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:22.844584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:22.847502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:22.848108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.870537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.870778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 67fa1194-0c3d-4202-9709-065dd857e200 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:02:22.881850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.882770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c8369be3-e100-4925-8519-ff9e6c0cba6d tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:22.901639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:22.904533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Transition to ACTIVE for port object 67fa1194-0c3d-4202-9709-065dd857e200 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:22.906476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.906950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.916789 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/680006ef-4d94-41e1-9d14-3fbf3d869aee HTTP/1.1" status: 204 len: 168 time: 1.9800110 Nov 24 14:02:22.918565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:22.924161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43752) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:22.925172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f283e9d-0f5a-42be-b357-bdde430a6056 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:22.949839 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 3.0292432 Nov 24 14:02:22.952860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=2b6af2f1-6217-4976-9c67-84ea790081df,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:22.955366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:22.956142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43754) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:22.964226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'security_group': {'name': 'tempest-secgroup-849141720'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:23.004928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:23.008440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fac46d53-af80-44a7-aed9-6965da989665 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:23.012135 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fac46d53-af80-44a7-aed9-6965da989665 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.4593811 Nov 24 14:02:23.017466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43760) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:23.098037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:23.106755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:23.167408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:23.176687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:23.179866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:23.293649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.331373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57368027-1b1d-4b87-b2f8-623ce1d2838f None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:23.355328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:23.361681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group_rule and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:23.364642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:23.371604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:23.505902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:23.514730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.524586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.599s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:23.540423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.546355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e3b8e0fe-5e4b-4e2d-807a-347381569ef5 None None] Provisioning for port a77ed0ed-4420-4324-a1a4-f249a1dd971f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:23.614539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port a2af2a5c-8d84-4f05-9494-9efd65088629 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:23.614939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.676656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e3b8e0fe-5e4b-4e2d-807a-347381569ef5 None None] Could not find standard attr ID for object ac884e28-67a7-4c9f-af27-85e451f61546. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:02:23.746365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:23.790824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Attempting to bind port 67fa1194-0c3d-4202-9709-065dd857e200 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:23.791124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Attempting to bind port 67fa1194-0c3d-4202-9709-065dd857e200 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:23.791573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Attempting to bind port 67fa1194-0c3d-4202-9709-065dd857e200 on network b86c842d-e3f1-4cfd-957a-f6a0ed42384a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:23.868145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Port 67fa1194-0c3d-4202-9709-065dd857e200 on network b86c842d-e3f1-4cfd-957a-f6a0ed42384a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:02:23.868479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Attempting to bind port 67fa1194-0c3d-4202-9709-065dd857e200 on network b86c842d-e3f1-4cfd-957a-f6a0ed42384a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:23.877445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.899189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:23.900485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Checking segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:23.900888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Bound using segment: {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:23.901372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Bound port: 67fa1194-0c3d-4202-9709-065dd857e200, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '43da5e1a-72d2-4cde-9863-2082fd9e5bbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:23.901845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.902271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.915609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-502fd122-6d3a-4745-830d-50de754a25a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:23.930015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port a2af2a5c-8d84-4f05-9494-9efd65088629, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a2af2a5c-8d84-4f05-9494-9efd65088629,segment=NetworkSegment(97494fb6-9264-45f5-bf41-b9ed212d15c9),segment_id=97494fb6-9264-45f5-bf41-b9ed212d15c9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:23.930379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:23.950582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f415e16d-49f3-4429-aa36-243909259f09 req-f740d9fa-3a9c-436d-9b0d-63dfbc73ce93 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:23.957371 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f415e16d-49f3-4429-aa36-243909259f09 req-f740d9fa-3a9c-436d-9b0d-63dfbc73ce93 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 943 time: 0.6351409 Nov 24 14:02:23.980489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8630dedc-09fd-4687-97c2-c056b102b813,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:23.989983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet c9658e4c-8e13-4a45-84ed-b1f7129b80e1 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:23.993609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.036355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:24.042164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:24.042337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:24.158475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-748b4448-8c2d-4e93-8be8-f4cba67118c1 None None] DHCP port deletion for 89cc7986-be93-42b0-bf08-7a1aa46579f1 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:24.160087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7587cc2d-0197-4abd-ab31-a105946160dd None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:24.160466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7587cc2d-0197-4abd-ab31-a105946160dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.190728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.205009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for a2af2a5c-8d84-4f05-9494-9efd65088629 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:24.208084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a3b13ddf-9d2b-4cd3-a527-e52062b6c671 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:24.244481 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f415e16d-49f3-4429-aa36-243909259f09 req-e701b18b-c2fe-43fa-8fb0-7d4cd340f8dd tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2861657 Nov 24 14:02:24.246384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-748b4448-8c2d-4e93-8be8-f4cba67118c1 None None] Deleting port a2af2a5c-8d84-4f05-9494-9efd65088629 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:24.246990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-748b4448-8c2d-4e93-8be8-f4cba67118c1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.249372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.257439 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 1.2974975 Nov 24 14:02:24.261059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43766) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:24.265136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.283681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:24.307740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'security_group': {'name': 'tempest-secgroup-720140013'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:24.313902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:24.317739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:24.321503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:24.329054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:24.341481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.382009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No DVR routers for this DVR port a2af2a5c-8d84-4f05-9494-9efd65088629 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:24.383952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:24.394500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-748b4448-8c2d-4e93-8be8-f4cba67118c1 None None] The port 'a2af2a5c-8d84-4f05-9494-9efd65088629' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:24.398542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.400802 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] 10.222.0.47 "PUT /v2.0/ports/67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 1093 time: 2.7225196 Nov 24 14:02:24.409959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.449242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:02:24.585034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.301s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:24.585748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0f98385-4bd1-4fab-9be2-e4042f2b53e7 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.232s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:24.585919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:24.589778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.596455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:24.596952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.638819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group_rule and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:24.643732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:24.646713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:24.656037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:24.699001 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'status': 'completed', 'code': 200} Nov 24 14:02:24.730947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=a2af2a5c-8d84-4f05-9494-9efd65088629,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:24.736920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.745778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:24.750786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.775811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['89cc7986-be93-42b0-bf08-7a1aa46579f1']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:24.785817 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-da66070e-4125-405e-8f94-2d28c95e19f5 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1096 time: 0.3297346 Nov 24 14:02:24.792135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '97494fb6-9264-45f5-bf41-b9ed212d15c9') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:24.792461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '97494fb6-9264-45f5-bf41-b9ed212d15c9') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:24.795683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:17Z', 'revision_number': 10, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:24.817291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ceb3cdb-b34e-4f81-b896-7129e15f6250 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:24.818844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-680e1f0e-ff91-4fde-adfb-8088aaee39b3 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:17Z', 'revision_number': 10, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None, '_interfaces': [{'id': '3fb16aee-b0cc-4ee2-879b-e7b58265fce7', 'name': '', 'network_id': 'ed9fdeca-b2cd-4a96-bfea-16bfc7348534', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'mac_address': 'fa:16:3e:46:91:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:00:47Z', 'updated_at': '2021-11-24T14:01:05Z', 'revision_number': 5, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'subnets': [{'id': '4c338938-af44-4fa4-90ed-2e1169df03ce', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:24.823928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7587cc2d-0197-4abd-ab31-a105946160dd None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:24.824393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7587cc2d-0197-4abd-ab31-a105946160dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.850795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Update dhcp port {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'fixed_ips': [{'subnet_id': 'e7478ca1-ea35-4aea-b3dd-b676833cc73f', 'ip_address': '172.20.0.19'}, {'subnet_id': '2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8ea226c9-4123-480e-83ad-f3cfa95ed36e'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:02:24.870591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.901692 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-569aa64a-f3d1-4860-bbf5-a292a5a6f0cc service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 217 time: 0.1026971 Nov 24 14:02:24.905637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.917889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a77ed0ed-4420-4324-a1a4-f249a1dd971f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:24.925388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=c9658e4c-8e13-4a45-84ed-b1f7129b80e1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:24.932099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:24.953141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.954547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 878 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:24.955224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.971329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:24.971543 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:24.978762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee854871-b406-4438-a804-36de69cbdbab None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:24.985852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:24.991846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:25.004003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.004247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:25.013621 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/c9658e4c-8e13-4a45-84ed-b1f7129b80e1 HTTP/1.1" status: 204 len: 168 time: 1.9177907 Nov 24 14:02:25.017530 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/62e1e4da-34fc-44d6-b3e7-c5f88e6b6277/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.6376939 Nov 24 14:02:25.019046 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] Sync routers for ids ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:25.024957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43774) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.025294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43776) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.033065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7587cc2d-0197-4abd-ab31-a105946160dd None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:25.044360 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] Routers {'62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:25.046167 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:25.090503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-ba7de4d0-4454-40cf-8bea-ff018ae7f2a4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:25.092814 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-ba7de4d0-4454-40cf-8bea-ff018ae7f2a4 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 200 len: 835 time: 0.1838946 Nov 24 14:02:25.157389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.166011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b8fdd244-4609-4ba1-9dcd-2a804c05b17d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:25.166408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.176519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.182763 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 0.8851063 Nov 24 14:02:25.185282 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3dffd29d-451c-4ab4-aaca-9f01ff8dea27 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1588295 Nov 24 14:02:25.185825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43782) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.190134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43784) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.194212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'security_group': {'name': 'tempest-secgroup-984271169'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:25.196342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-002b0b3f-c2fc-4f57-bca5-31ed080d0bd7 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:25.205556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'SecurityGroup': ['ID=df98c181-4040-4196-84ff-02ea553d14f4,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:25.211173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:25.218073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/89cc7986-be93-42b0-bf08-7a1aa46579f1 HTTP/1.1" status: 204 len: 168 time: 2.2406952 Nov 24 14:02:25.218911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43790) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.229132 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:25.245585 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] Routers {'62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:25.246517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:25.331842 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:25.332704 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b8a9450-785f-4022-af9c-2632389ce12d None None] The sync data for ids ['62e1e4da-34fc-44d6-b3e7-c5f88e6b6277'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:25.338523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:25.373269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:25.377598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:25.387431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource security_group. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:25.389988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port a77ed0ed-4420-4324-a1a4-f249a1dd971f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:25.400874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b8fdd244-4609-4ba1-9dcd-2a804c05b17d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:25.403676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b8fdd244-4609-4ba1-9dcd-2a804c05b17d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 HTTP/1.1" status: 200 len: 205 time: 0.3757555 Nov 24 14:02:25.409290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.421669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a77ed0ed-4420-4324-a1a4-f249a1dd971f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:25.422187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.423608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43796) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.450229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=89cc7986-be93-42b0-bf08-7a1aa46579f1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:25.522977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.327s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:25.548152 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-5ecef337-ba33-4593-8a9c-f6ed09513333 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.4431572 Nov 24 14:02:25.582214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Allocated IP 172.20.0.2 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b/8ea226c9-4123-480e-83ad-f3cfa95ed36e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:25.647061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b90f8432-ba3a-4233-b6ea-3d75c2ad78b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:25.647837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b90f8432-ba3a-4233-b6ea-3d75c2ad78b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:25.664889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:25.681118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:security_group_rule and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:25.687113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b90f8432-ba3a-4233-b6ea-3d75c2ad78b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:25.690657 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b90f8432-ba3a-4233-b6ea-3d75c2ad78b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.4843450 Nov 24 14:02:25.691425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:25.694250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43800) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:25.732258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.750466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.807497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:25.826903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Deleting port a77ed0ed-4420-4324-a1a4-f249a1dd971f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:25.827304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.869782 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-5962fe6f-a8b6-4458-9328-c5c975c7e482 service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3115449 Nov 24 14:02:25.945576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:25.953814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port a77ed0ed-4420-4324-a1a4-f249a1dd971f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a77ed0ed-4420-4324-a1a4-f249a1dd971f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:25.967428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:25.972493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:26.010156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:26.047750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-acfe2cc0-4b5f-448e-ad85-62cc229fe3ee req-aec4cbe6-6851-420f-8425-d3a2280ac45a service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1716988 Nov 24 14:02:26.061084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.097634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c93e6d5d-c4f4-4aec-a2e0-14c9a185349e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:26.098380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c93e6d5d-c4f4-4aec-a2e0-14c9a185349e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:26.113821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aede6b9-b685-4ad8-8782-14917f6d779f req-f72d7a22-31c9-488d-8955-5e10d5bf1acc tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:26.122326 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7aede6b9-b685-4ad8-8782-14917f6d779f req-f72d7a22-31c9-488d-8955-5e10d5bf1acc tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 943 time: 0.6301575 Nov 24 14:02:26.144909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a2af2a5c-8d84-4f05-9494-9efd65088629 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:26.173217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:02:26.193785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=a77ed0ed-4420-4324-a1a4-f249a1dd971f,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:26.206518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: a2af2a5c-8d84-4f05-9494-9efd65088629 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:26.207060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a2af2a5c-8d84-4f05-9494-9efd65088629 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:26.207650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d670b4ec-57fe-4eaa-abac-c1f52d488a15 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:26.238593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:26.241439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.258614 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d670b4ec-57fe-4eaa-abac-c1f52d488a15 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:26.259230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d670b4ec-57fe-4eaa-abac-c1f52d488a15 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:26.259903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a77ed0ed-4420-4324-a1a4-f249a1dd971f no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:26.313046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Transition to ACTIVE for port object 8ea226c9-4123-480e-83ad-f3cfa95ed36e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:26.314706 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-0231a238-3f83-49b4-ad2a-fe856478adb9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1096 time: 0.1892657 Nov 24 14:02:26.316357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] For port a77ed0ed-4420-4324-a1a4-f249a1dd971f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a77ed0ed-4420-4324-a1a4-f249a1dd971f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:26.316770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.325723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.333203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.337932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c93e6d5d-c4f4-4aec-a2e0-14c9a185349e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:26.341586 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c93e6d5d-c4f4-4aec-a2e0-14c9a185349e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.6423156 Nov 24 14:02:26.342166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:26.346729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43804) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:26.347348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.422246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ce62e0fe-0596-48ea-910c-1424d9a6b05f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:26.472973 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7aede6b9-b685-4ad8-8782-14917f6d779f req-c9350436-20f8-4ebb-b791-e20ef767ab80 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3499036 Nov 24 14:02:26.480706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5d59b01e-3f31-4d9d-afec-638728ec8fe1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1234632 Nov 24 14:02:26.486387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43808) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:26.507113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Calling delete_port for a77ed0ed-4420-4324-a1a4-f249a1dd971f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:26.510981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-45e0b35d-deb4-40ed-a143-87354afa2e08 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:26.512588 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-45e0b35d-deb4-40ed-a143-87354afa2e08 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 898 time: 0.1907926 Nov 24 14:02:26.569772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:26.642789 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-1e2298d8-b9aa-4535-98ee-18f198c28882 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 217 time: 0.1221483 Nov 24 14:02:26.669310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.673170 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1576 time: 1.4817219 Nov 24 14:02:26.675793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:26.675969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b5b31b2e-ed1b-4f93-8bad-752e49b21f1d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:26.679213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:26.693041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:26.712812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.717184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43812) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:26.733862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:26.734363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:26.742404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-2071420923', 'security_groups': ['b5b31b2e-ed1b-4f93-8bad-752e49b21f1d'], 'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:26.743247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.752924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port a77ed0ed-4420-4324-a1a4-f249a1dd971f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a77ed0ed-4420-4324-a1a4-f249a1dd971f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:26.760029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.762536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5db01ecf-6380-408f-ab5b-6020aeff4759 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:26.772484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.790512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:26.820009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:26.832160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.832696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router 62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:02:26.841079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:26.844620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.868730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:26.869880 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-80c1b11e-bb38-476d-b451-775cbb4b0d17 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 HTTP/1.1" status: 204 len: 168 time: 1.4441590 Nov 24 14:02:26.876065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43816) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:26.876711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=a77ed0ed-4420-4324-a1a4-f249a1dd971f,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:26.879979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:27.038095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-138492fd-37c5-486a-966c-bccf3a12deaf service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:27.039577 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-138492fd-37c5-486a-966c-bccf3a12deaf service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 200 len: 835 time: 0.3884387 Nov 24 14:02:27.199443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:27.230812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet b0c0b927-55d5-4214-8f61-2ab7cfdd60b9 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:27.235023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Deleting port a77ed0ed-4420-4324-a1a4-f249a1dd971f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:27.235648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.243421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:27.244357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.278193 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-62d62feb-a821-4363-b2f4-ef6abe3ba4d9 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2265885 Nov 24 14:02:27.281141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:27.348981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.403917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.411058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:27.548915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.580886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] device_id is not set on port f8f15d9d-0555-40f7-a114-669e0b44c592 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:27.636539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] For port a77ed0ed-4420-4324-a1a4-f249a1dd971f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a77ed0ed-4420-4324-a1a4-f249a1dd971f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:27.637612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.670781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.723841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4827b8a3-a1f8-4d39-8936-9e19d0c4821f None None] Provisioning for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:27.732003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:27.758336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=94112229-d317-4154-8ac7-11540198b68c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:27.762840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:27.765184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:27.773967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:27.775204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.782654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.788891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4827b8a3-a1f8-4d39-8936-9e19d0c4821f None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:27.789439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4827b8a3-a1f8-4d39-8936-9e19d0c4821f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.796157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-30edb391-8f75-4c00-a1fa-a6c6a6db84bc tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:27.810702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.7 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b/f8f15d9d-0555-40f7-a114-669e0b44c592) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:27.845964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=b0c0b927-55d5-4214-8f61-2ab7cfdd60b9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:27.860847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:27.873222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:27.875095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/b0c0b927-55d5-4214-8f61-2ab7cfdd60b9 HTTP/1.1" status: 204 len: 168 time: 0.9980700 Nov 24 14:02:27.878032 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.3187242 Nov 24 14:02:27.878824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43822) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:27.881053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43824) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:27.888697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '94112229-d317-4154-8ac7-11540198b68c', 'ip_address': '2001:db8::a6:ea60:332b:583b'}], 'name': 'tempest-NetworksTestDHCPv6-995284536'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:27.905577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Calling delete_port for a77ed0ed-4420-4324-a1a4-f249a1dd971f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:27.941018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c478544c-6fc9-4b97-8977-faff3208ab56 None None] Network 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:28.023269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.035022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.085274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object f8f15d9d-0555-40f7-a114-669e0b44c592 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:28.107455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-43001e32-c127-402f-9ab0-4228af53f64b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:28.119296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.158738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:28.162041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:28.163118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.175574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8ea226c9-4123-480e-83ad-f3cfa95ed36e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:28.202176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.211265 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-b5f4d5d5-52ad-47ae-8358-98974041ffb2 service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9132237 Nov 24 14:02:28.221961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] No DVR routers for this DVR port a77ed0ed-4420-4324-a1a4-f249a1dd971f on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:28.236553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:28.249048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:28.256056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.260600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:28.260803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ee0911e-2648-41ae-80e7-fd0db0d678a4 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:28.298270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Pushing event deleted for resources: {'Port': ['ID=a77ed0ed-4420-4324-a1a4-f249a1dd971f,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:28.300757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:28.354948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port dde3bd15-c291-4a14-9254-ed586f2dce00 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:28.391361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=f8f15d9d-0555-40f7-a114-669e0b44c592,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:28.398843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:28.473133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2cdaba-7705-4a8a-8e11-7f2cbe9cb937 req-ebb909f7-2f95-43f7-8269-b66a84d1978b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:28.474534 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2c2cdaba-7705-4a8a-8e11-7f2cbe9cb937 req-ebb909f7-2f95-43f7-8269-b66a84d1978b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 943 time: 0.4424698 Nov 24 14:02:28.512114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:28.517341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:28.532985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:28.591834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,segment=NetworkSegment(f89121ae-03fc-4730-b2df-7bfaed6f63c1),segment_id=f89121ae-03fc-4730-b2df-7bfaed6f63c1)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:28.592311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.592681 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2c2cdaba-7705-4a8a-8e11-7f2cbe9cb937 req-1fcd88bb-015b-49ab-b2e0-05650a4cbd0e tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1071751 Nov 24 14:02:28.612499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:28.612888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.695945 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-beaef2e3-b695-4a74-aed4-f7f456c06d4d req-ce613b21-7965-45f3-ab42-2944007844aa service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3652320 Nov 24 14:02:28.702655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:28.703339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.755022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:28.755530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.759242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:28.791463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4827b8a3-a1f8-4d39-8936-9e19d0c4821f None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:28.791463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4827b8a3-a1f8-4d39-8936-9e19d0c4821f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.792560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.0688987 Nov 24 14:02:28.797400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43830) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:28.806104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:28.878038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '94112229-d317-4154-8ac7-11540198b68c'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:28.878879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.920268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4827b8a3-a1f8-4d39-8936-9e19d0c4821f None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:28.973037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 3fb16aee-b0cc-4ee2-879b-e7b58265fce7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,segment=NetworkSegment(78b0ca0d-865e-42f7-acb6-95fcbd295329),segment_id=78b0ca0d-865e-42f7-acb6-95fcbd295329)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:28.973407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:28.992950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-066da9e6-24c2-4bda-af2c-7fac5d7eeae0 None None] DHCP port deletion for 727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:29.002513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-066da9e6-24c2-4bda-af2c-7fac5d7eeae0 None None] Deleting port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:29.003497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-066da9e6-24c2-4bda-af2c-7fac5d7eeae0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.004195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::a6:ea60:332b:583b (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/94112229-d317-4154-8ac7-11540198b68c/dde3bd15-c291-4a14-9254-ed586f2dce00) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:29.033620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.043279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4b1216bf-b202-480b-a6dc-a61cab80d35a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:29.096979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-066da9e6-24c2-4bda-af2c-7fac5d7eeae0 None None] The port '9bd51090-2ab8-4eb5-93bf-ad47ecbe8832' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:29.120092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6c12e2ee-3f1f-4294-af1c-8b9c77afccfc None None] Provisioning for port f8f15d9d-0555-40f7-a114-669e0b44c592 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:29.122412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=9bd51090-2ab8-4eb5-93bf-ad47ecbe8832,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:29.129166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:29.130324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6c12e2ee-3f1f-4294-af1c-8b9c77afccfc None None] Provisioning complete for port f8f15d9d-0555-40f7-a114-669e0b44c592 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:29.130786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6c12e2ee-3f1f-4294-af1c-8b9c77afccfc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.137570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No DVR routers for this DVR port 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:29.147174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:29.181378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:29.185593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6c12e2ee-3f1f-4294-af1c-8b9c77afccfc None None] Port f8f15d9d-0555-40f7-a114-669e0b44c592 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:29.188721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6c12e2ee-3f1f-4294-af1c-8b9c77afccfc None None] Could not find standard attr ID for object 89e658eb-cad2-4369-a55e-aebd839dbcf5. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:02:29.188881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:29.218238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:29.232041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:29.367053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:29.415183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.419491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc07c0d3-0d67-4aca-9bcc-febf7e867af4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:29.466580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=3fb16aee-b0cc-4ee2-879b-e7b58265fce7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:29.470224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:29.540769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.649233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:29.695468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f89121ae-03fc-4730-b2df-7bfaed6f63c1') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:29.696085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f89121ae-03fc-4730-b2df-7bfaed6f63c1') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:29.738700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.785706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.796930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.816851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:02:29.823728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.834663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.902042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 857 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:29.902513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:29.925524 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:29.960230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object dde3bd15-c291-4a14-9254-ed586f2dce00 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:30.013256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:30.031392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '67fa1194-0c3d-4202-9709-065dd857e200', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'port_id': '67fa1194-0c3d-4202-9709-065dd857e200', 'mac_address': 'fa:16:3e:86:5a:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 882, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:02:30.094685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.106246 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b (CIDR: 172.20.0.0/28) Nov 24 14:02:30.108137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f40e374a-89f5-4fba-bfd5-3fed17872352 tempest-NetworksIpV6TestAttrs-823084170 tempest-NetworksIpV6TestAttrs-823084170-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:30.112292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.125087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.131991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 67fa1194-0c3d-4202-9709-065dd857e200 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:02:30.132788 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:02:30.133228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:30.150786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:30.155433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.158051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1984fdfa-2de4-4de7-b6a8-1d28dcf46ec8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:30.158192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:30.175668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:30.179193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.188239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a11c562-e5b8-4bf7-8464-6fb004c6d004 req-51602bdd-cfc3-4097-ac6d-3ef43f85a2cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:30.189820 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a11c562-e5b8-4bf7-8464-6fb004c6d004 req-51602bdd-cfc3-4097-ac6d-3ef43f85a2cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 943 time: 0.4440036 Nov 24 14:02:30.195089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:30.230897 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/727c9dc4-c786-4e7a-8f2e-2dbd30dda9a5 HTTP/1.1" status: 204 len: 168 time: 2.3485749 Nov 24 14:02:30.234869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43836) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:30.246655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-77320688', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:30.254813 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fa0625e8-ca37-45fa-9bfa-b519e0340efa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.4561701 Nov 24 14:02:30.261610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:30.266311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:router and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:30.267512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43840) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:30.270053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:30.276607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:30.279138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:30.281114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:30.285174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:30.293220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.294128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.353063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=dde3bd15-c291-4a14-9254-ed586f2dce00,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:30.382272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:30.382649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9bd51090-2ab8-4eb5-93bf-ad47ecbe8832 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:30.413060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:30.414765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:30.423135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:30.423486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:30.430006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:30.430878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:30.431077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/94112229-d317-4154-8ac7-11540198b68c/8b829699-8249-445a-aecf-465ed32e5399) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:30.434972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:30.435661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.456393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.464334 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 945 time: 2.5775666 Nov 24 14:02:30.464334 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a11c562-e5b8-4bf7-8464-6fb004c6d004 req-9316ea37-e80e-4fa2-bcae-15cc3231b2fe tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2253225 Nov 24 14:02:30.465182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43844) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:30.523096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:30.523869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:30.529068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:30.532738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:30.537715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['67fa1194-0c3d-4202-9709-065dd857e200'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:02:30.539856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:30.550149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:30.554308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.641705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:30.696691 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet e7478ca1-ea35-4aea-b3dd-b676833cc73f (CIDR: 172.20.0.16/28) Nov 24 14:02:30.700694 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:02:30.701129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:30.713098 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4891543 Nov 24 14:02:30.714339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43848) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:30.750804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:30.751083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:30.760155 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aaf04bea-409c-47a0-9319-bc8c407026c4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.4860203 Nov 24 14:02:30.760381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43852) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:30.767603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'subnet': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:30.811238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb763e79-f37d-4bc8-ad3f-281b46b6a7db tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:30.815412 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bb763e79-f37d-4bc8-ad3f-281b46b6a7db tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.3453918 Nov 24 14:02:30.815706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43856) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:30.847276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.898818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.910762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port dde3bd15-c291-4a14-9254-ed586f2dce00 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:30.911110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:30.933212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Transition to ACTIVE for port object 8b829699-8249-445a-aecf-465ed32e5399 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:30.949598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:31.018036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:31.031580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Usage tracker for resource:subnet and tenant:74f54ee2a8574df893d540b53d0009fe is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:31.036953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:31.045415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:31.049224 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting subnet 4c338938-af44-4fa4-90ed-2e1169df03ce {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:31.052120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.097354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Transition to ACTIVE for port object 8b829699-8249-445a-aecf-465ed32e5399 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:31.098945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:29Z', 'revision_number': 11, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:31.112361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.120505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:31.129007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.138293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8c72daf9-d2d3-4f41-9754-29dabcf2d291 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:31.196749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.276635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Pushing event updated for resources: {'Port': ['ID=8b829699-8249-445a-aecf-465ed32e5399,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:31.278892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.281775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.283265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2969e5c4-a218-4f13-ba6b-f1d2791d2139 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:31.289483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.291837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:31.293865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:31.294690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:31.312495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Made reservation on behalf of 74f54ee2a8574df893d540b53d0009fe for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:31.315988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.351290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Subnet': ['ID=4c338938-af44-4fa4-90ed-2e1169df03ce,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:31.356174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:31.364926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:31.369218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:31.372282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:31.375009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.413436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.468391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:31.475198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for dde3bd15-c291-4a14-9254-ed586f2dce00 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:31.558306 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/4c338938-af44-4fa4-90ed-2e1169df03ce HTTP/1.1" status: 204 len: 168 time: 0.8427799 Nov 24 14:02:31.566231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43862) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:31.633604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a2fe4f7-2e46-498a-8e1a-6dc9a2e6196d None None] Network ed9fdeca-b2cd-4a96-bfea-16bfc7348534 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:31.663168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:29Z', 'revision_number': 11, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:31.713584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.725837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Deleting port 076ab8d4-d3e1-4483-9297-704d0d112470 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:31.726082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.742809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d805c0a9-240f-4e9e-a1c5-71bc75c3c84f None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:29Z', 'revision_number': 11, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:31.808229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:31.810393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 172.26.4.146 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/d4dba1ff-00fe-4408-b32d-302960b6ff13) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:31.818303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e96ad084-a4ce-4b5d-90eb-151c6178b409 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:31.868829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=dde3bd15-c291-4a14-9254-ed586f2dce00,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:31.876535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:32.001741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] For port 076ab8d4-d3e1-4483-9297-704d0d112470, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=076ab8d4-d3e1-4483-9297-704d0d112470,segment=NetworkSegment(78b0ca0d-865e-42f7-acb6-95fcbd295329),segment_id=78b0ca0d-865e-42f7-acb6-95fcbd295329)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:32.002025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.002469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.011074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330f9a7d-0dd6-49b3-a84a-cf654b12013d req-1a05e9a5-1c96-4ed8-9bda-5da80b1bb328 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:32.012701 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-330f9a7d-0dd6-49b3-a84a-cf654b12013d req-1a05e9a5-1c96-4ed8-9bda-5da80b1bb328 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 944 time: 0.4027450 Nov 24 14:02:32.018905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Attempting to bind port 8b829699-8249-445a-aecf-465ed32e5399 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:32.019441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Attempting to bind port 8b829699-8249-445a-aecf-465ed32e5399 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:32.019441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Attempting to bind port 8b829699-8249-445a-aecf-465ed32e5399 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:32.033110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:32.033424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:32.033813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.034196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:32.034954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Bound port: 8b829699-8249-445a-aecf-465ed32e5399, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:32.035093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.082623 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/dde3bd15-c291-4a14-9254-ed586f2dce00 HTTP/1.1" status: 204 len: 168 time: 1.2634857 Nov 24 14:02:32.086670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43866) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:32.114302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:32.151176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Calling delete_port for 076ab8d4-d3e1-4483-9297-704d0d112470 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:32.151849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:32.151993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3fb16aee-b0cc-4ee2-879b-e7b58265fce7 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:32.193985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.198159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] For port 8b829699-8249-445a-aecf-465ed32e5399, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:32.199075 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-330f9a7d-0dd6-49b3-a84a-cf654b12013d req-7061ca53-7152-482f-a566-7c15c18f4703 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1785653 Nov 24 14:02:32.215012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] For port 8b829699-8249-445a-aecf-465ed32e5399, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b829699-8249-445a-aecf-465ed32e5399,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:32.216467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59385564-f980-46c9-9353-411c5309aeac tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:32.217799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59385564-f980-46c9-9353-411c5309aeac tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:32.218542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-59385564-f980-46c9-9353-411c5309aeac tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:32.226500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.230723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-099300ba-88dd-48be-a177-b5edbb0e929f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:32.257905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.264350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.264596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-98d7bb4f-8ca4-46a7-aee3-093a07a65df8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:32.270012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-49ba52ba-c228-4af9-9425-da4178b02cf4 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:32.322407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48ca33ea-28bc-48d2-9b94-9b97099a8996 None None] DHCP port deletion for ed9fdeca-b2cd-4a96-bfea-16bfc7348534 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:32.333010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.356348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:32.360775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:32.365253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Pushing event updated for resources: {'Port': ['ID=8b829699-8249-445a-aecf-465ed32e5399,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:32.369944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:32.370872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.379946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:32.383288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ebc1ae9-7ce9-4009-99e2-970bbe3570f3 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:32.387149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Subnet': ['ID=d6c0c184-31b6-4a38-8bfc-31bee5f7cc72,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:32.404392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:32.404392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17c84c92-ad34-4989-87cd-3b0a36ac541c tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.059s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:32.444245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No DVR routers for this DVR port 076ab8d4-d3e1-4483-9297-704d0d112470 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:32.462753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-59385564-f980-46c9-9353-411c5309aeac tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:32.467167 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-59385564-f980-46c9-9353-411c5309aeac tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.3715672 Nov 24 14:02:32.470180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43870) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:32.487128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Port': ['ID=076ab8d4-d3e1-4483-9297-704d0d112470,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:32.493804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:32.519959 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.7584381 Nov 24 14:02:32.524843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43874) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:32.534518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-165563823', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'd6c0c184-31b6-4a38-8bfc-31bee5f7cc72'}], 'security_groups': ['8630dedc-09fd-4687-97c2-c056b102b813', 'df98c181-4040-4196-84ff-02ea553d14f4']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:32.553988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:32.563729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:32.571626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:32.628485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=d4dba1ff-00fe-4408-b32d-302960b6ff13,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:32.640936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.377s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:32.696885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.795791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed9fdeca-b2cd-4a96-bfea-16bfc7348534']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:32.814915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78b0ca0d-865e-42f7-acb6-95fcbd295329') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:32.815216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78b0ca0d-865e-42f7-acb6-95fcbd295329') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:32.838122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.844517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.845505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Update dhcp port {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'fixed_ips': [{'subnet_id': 'e7478ca1-ea35-4aea-b3dd-b676833cc73f', 'ip_address': '172.20.0.19'}, {'subnet_id': '2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b', 'ip_address': '172.20.0.2'}, {'subnet_id': 'd6c0c184-31b6-4a38-8bfc-31bee5f7cc72'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8ea226c9-4123-480e-83ad-f3cfa95ed36e'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:02:32.853709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 94112229-d317-4154-8ac7-11540198b68c {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:32.860593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.901335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.908807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.917808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Releasing vlan 870 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:32.918039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.926584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:32.933257 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:33.020235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.020965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.066144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.074713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87379d38-6b00-4964-abbd-4e6be4a357c4 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:33.088966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.092959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.103929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Pushing event deleted for resources: {'Network': ['ID=ed9fdeca-b2cd-4a96-bfea-16bfc7348534,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:33.109239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:33.139875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Allocated IP 172.20.0.34 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/d6c0c184-31b6-4a38-8bfc-31bee5f7cc72/8ea226c9-4123-480e-83ad-f3cfa95ed36e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:33.150693 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/networks/ed9fdeca-b2cd-4a96-bfea-16bfc7348534 HTTP/1.1" status: 204 len: 168 time: 1.5831962 Nov 24 14:02:33.151430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43878) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:33.154763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4bc26178-8c3e-4837-8b05-514fab7c505d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.157945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'routes': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:33.328378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:33.369965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.392014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.394016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Transition to ACTIVE for port object 8ea226c9-4123-480e-83ad-f3cfa95ed36e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:33.398788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4947ea48-4af1-409c-974f-fd3832e5f7b6 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:33.399954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.403804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:33.444561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=94112229-d317-4154-8ac7-11540198b68c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:33.447695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:33.555267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:33.569238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.574689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:33.631368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.635344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-846b2b5e-71f0-4ad5-a2c9-1bf860c3c3c6 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:33.708115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/94112229-d317-4154-8ac7-11540198b68c HTTP/1.1" status: 204 len: 168 time: 1.2344823 Nov 24 14:02:33.708115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Added routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:113}} Nov 24 14:02:33.708115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Removed routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:121}} Nov 24 14:02:33.708115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:33.712136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43884) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:33.718720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2734bbc-b6d5-40ed-8f7b-be081ac35ad7 req-b12d7010-54bb-40db-abb1-f89831ab2d3b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:33.720344 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2734bbc-b6d5-40ed-8f7b-be081ac35ad7 req-b12d7010-54bb-40db-abb1-f89831ab2d3b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 944 time: 0.3231211 Nov 24 14:02:33.775021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fb736529-86f3-4804-92a0-9464c8697905 None None] Provisioning for port 8b829699-8249-445a-aecf-465ed32e5399 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:33.791702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-671f2671-ff43-400d-85ed-fe97428c4244 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0770319 Nov 24 14:02:33.796970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43888) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:33.813000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:33.857689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:33.860350 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2734bbc-b6d5-40ed-8f7b-be081ac35ad7 req-d6e29f63-7a7f-498d-b7ef-2a79c6657b00 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076312 Nov 24 14:02:33.981371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.34-df091a46-f699-4f73-aa2f-282990be97b6 {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:33.981660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:33.990736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:33.993913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 67fa1194-0c3d-4202-9709-065dd857e200 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:33.997185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:34.001336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 67fa1194-0c3d-4202-9709-065dd857e200 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:34.002132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.002534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:34.010843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:34.024354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:34.200674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.298381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:34.300469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8ea226c9-4123-480e-83ad-f3cfa95ed36e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:34.345636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.353433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Deleting port 8b829699-8249-445a-aecf-465ed32e5399 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:34.354538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.355026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.440316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.480318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.484634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dc46296e-63dc-4ced-ad53-ca8d237de383 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:34.509047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router a38fe41f-1d91-4edf-8039-9ef7af56c186 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:02:34.535044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router 8b1794c5-dde1-4c7a-a979-ba268c818d76 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:34.554433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:02:34.558872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Provisioning for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:34.580409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:34.612777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:34.623196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:34.627439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:34.627743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=3beec28a-ce17-48a9-9b76-a06666aba35b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:34.627883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.632576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:34.633050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.654122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:34.654665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.668446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:34.668975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.697199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.706281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.9073462 Nov 24 14:02:34.713056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-44de90f0-1cb6-4f35-9b2d-3499701c75e3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:34.716507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43896) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:34.724119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '3beec28a-ce17-48a9-9b76-a06666aba35b', 'ip_address': '2001:db8::b4f6:c58c:2baa:2855'}], 'name': 'tempest-NetworksTestDHCPv6-1978937432'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:34.837007 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'code': 200} Nov 24 14:02:34.884591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:34.897013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] For port 8b829699-8249-445a-aecf-465ed32e5399, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b829699-8249-445a-aecf-465ed32e5399,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:34.897013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:34.993673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:35.036494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:35.037538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:35.043370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:35.051048 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] Sync routers for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:35.054297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:35.086021 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:35.086984 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.095078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.099480 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-891dd79e-73ae-4485-98d3-dbb4b662c85e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 701 time: 1.9464388 Nov 24 14:02:35.108203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:35.110791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43904) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:35.114253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:35.117028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Calling delete_port for 8b829699-8249-445a-aecf-465ed32e5399 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:35.120243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.171078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cd7c41c7-75e5-45ab-848a-63ba7daa3c12 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:35.197258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 7f96edb0-5f88-4dc8-8586-3e3bb745d6ce yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:35.204323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cd7c41c7-75e5-45ab-848a-63ba7daa3c12 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:35.209971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cd7c41c7-75e5-45ab-848a-63ba7daa3c12 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 205 time: 0.0978870 Nov 24 14:02:35.226559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43908) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:35.247347 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:35.351627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.356755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:35.391934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Provisioning complete for port f8f15d9d-0555-40f7-a114-669e0b44c592 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:35.392556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.458647 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:29Z', 'revision_number': 11, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.464979 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] Checking router: 8b1794c5-dde1-4c7a-a979-ba268c818d76 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:35.465492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Port f8f15d9d-0555-40f7-a114-669e0b44c592 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:35.468002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 076ab8d4-d3e1-4483-9297-704d0d112470 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:35.477934 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] Routers {'8b1794c5-dde1-4c7a-a979-ba268c818d76'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:35.478809 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8b1794c5-dde1-4c7a-a979-ba268c818d76'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.491539 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-11493ec9-b446-4235-b271-62f6e3ea0e35 req-de2a5f7e-2e0b-4dcf-8867-3f30691fab6f service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1098 time: 0.4381809 Nov 24 14:02:35.518905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Pushing event deleted for resources: {'Port': ['ID=8b829699-8249-445a-aecf-465ed32e5399,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:35.529951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:35.530858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 076ab8d4-d3e1-4483-9297-704d0d112470 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:35.531279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 076ab8d4-d3e1-4483-9297-704d0d112470 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:35.535909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] No DVR routers for this DVR port 8b829699-8249-445a-aecf-465ed32e5399 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:35.539365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:35.553537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] Sync routers for ids ['a38fe41f-1d91-4edf-8039-9ef7af56c186'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:35.561613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::b4f6:c58c:2baa:2855 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/3beec28a-ce17-48a9-9b76-a06666aba35b/7f96edb0-5f88-4dc8-8586-3e3bb745d6ce) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:35.561834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff2b3ae6-d6a5-477a-9a19-70d7d6ced778 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:35.566520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.580391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:35.580807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.637774 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] Set router 8b1794c5-dde1-4c7a-a979-ba268c818d76 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:35.694081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] Routers {'a38fe41f-1d91-4edf-8039-9ef7af56c186'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:35.694728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a38fe41f-1d91-4edf-8039-9ef7af56c186'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.708417 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-11493ec9-b446-4235-b271-62f6e3ea0e35 req-9252af5e-936c-4421-babe-cfa333ee4dca service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2104192 Nov 24 14:02:35.712435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.717359 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 882 time: 5.4813380 Nov 24 14:02:35.718591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43912) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:35.766860 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:29Z', 'revision_number': 11, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.772122 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-913a2925-f185-44a0-aebd-e7418fa799d4 None None] The sync data for ids ['8b1794c5-dde1-4c7a-a979-ba268c818d76'] in dv-neutron-818151-2-hyperv is: [{'id': '8b1794c5-dde1-4c7a-a979-ba268c818d76', 'name': 'tempest-RoutersTest-router-1037898234', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:00:41Z', 'updated_at': '2021-11-24T14:02:29Z', 'revision_number': 11, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:35.778350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.821555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf13ed24-e340-4317-a3dc-1ebee589c890 None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:35.909932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] Routers {'a38fe41f-1d91-4edf-8039-9ef7af56c186'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:35.910582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a38fe41f-1d91-4edf-8039-9ef7af56c186'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:35.957135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:35.975946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 7f96edb0-5f88-4dc8-8586-3e3bb745d6ce will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:36.008393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e14a49c-d4bd-4ae4-a693-ce43a3c6edb9 req-a228dcf4-be8e-4310-a6ae-195d7acb2c65 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:36.009825 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9e14a49c-d4bd-4ae4-a693-ce43a3c6edb9 req-a228dcf4-be8e-4310-a6ae-195d7acb2c65 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.9296753 Nov 24 14:02:36.014268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.023514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20726ae6-a9fc-42f4-8e44-98a98aa233f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.043590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:36.044029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2264da2-0e28-4bd6-a74d-40d568ee1f7e None None] The sync data for ids ['a38fe41f-1d91-4edf-8039-9ef7af56c186'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:36.051009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3dd580ce-1627-47eb-8153-12fb1ba7072b tempest-FloatingIPNegativeTestJSON-43231581 tempest-FloatingIPNegativeTestJSON-43231581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:36.078261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b829699-8249-445a-aecf-465ed32e5399 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:36.135084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Delete allocated IP 172.20.0.7 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b) {{(pid=83525) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Nov 24 14:02:36.142946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8b829699-8249-445a-aecf-465ed32e5399 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:36.142946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b829699-8249-445a-aecf-465ed32e5399 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:36.146236 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9e14a49c-d4bd-4ae4-a693-ce43a3c6edb9 req-b7e4ec29-69c5-4419-be78-e6cc8d947225 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1201239 Nov 24 14:02:36.160748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:36.167331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:36.170787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=7f96edb0-5f88-4dc8-8586-3e3bb745d6ce,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:36.173280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:36.177349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:36.178036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.198270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Allocated IP 172.20.0.42 (8aeb6176-eff5-4042-baaa-de8b7dcc3ca1/d6c0c184-31b6-4a38-8bfc-31bee5f7cc72/f8f15d9d-0555-40f7-a114-669e0b44c592) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:36.200714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:36.210284 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.4924855 Nov 24 14:02:36.213575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43916) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:36.217116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '3beec28a-ce17-48a9-9b76-a06666aba35b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:36.217968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.400222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/3beec28a-ce17-48a9-9b76-a06666aba35b/21af9ac4-d5af-4e4c-832d-ac867157fca5) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:36.402360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.415009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.451949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.470998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af593090-884a-4494-b7a0-d9beec5e3fea tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:36.471398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Transition to ACTIVE for port object f8f15d9d-0555-40f7-a114-669e0b44c592 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:36.471836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-af593090-884a-4494-b7a0-d9beec5e3fea tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:36.476007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.484058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-db696533-3d94-417d-8b9e-a42fa0ece4ea tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:36.493973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.494192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router 8b1794c5-dde1-4c7a-a979-ba268c818d76 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:02:36.505241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-af593090-884a-4494-b7a0-d9beec5e3fea tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:36.507797 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-af593090-884a-4494-b7a0-d9beec5e3fea tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 946 time: 0.2925897 Nov 24 14:02:36.513109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43920) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:36.557794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.558774 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-14b0c506-b6df-4d6e-9eec-343522b9db40 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 204 len: 168 time: 1.3285019 Nov 24 14:02:36.568184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43924) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:36.570302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event updated for resources: {'Port': ['ID=f8f15d9d-0555-40f7-a114-669e0b44c592,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:36.573451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:36.574393 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c2e552e6-802e-4aa8-b418-9170ea8d14f4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/routers/a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 200 len: 883 time: 0.8529902 Nov 24 14:02:36.576678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43928) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:36.582497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1647094707', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:36.598279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:36.617154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Usage tracker for resource:router and tenant:9d96b9002ef84a209d8d0c821d7c7a49 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:36.627637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:36.639598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 7f96edb0-5f88-4dc8-8586-3e3bb745d6ce {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:36.639969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.667040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:36.684582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.700176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.700649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.701609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.713499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Transition to ACTIVE for port object 21af9ac4-d5af-4e4c-832d-ac867157fca5 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:36.739623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Transition to ACTIVE for port object 21af9ac4-d5af-4e4c-832d-ac867157fca5 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:36.748112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.752818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8ac7b888-7b4c-4522-b9ac-739c43f925a6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:36.776006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.780633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] In _notify_port_updated(), no bound segment for port f8f15d9d-0555-40f7-a114-669e0b44c592 on network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 {{(pid=83525) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:02:36.791468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:36.791468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.791468 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "PUT /v2.0/ports/f8f15d9d-0555-40f7-a114-669e0b44c592 HTTP/1.1" status: 200 len: 959 time: 4.2606373 Nov 24 14:02:36.792987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43932) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:36.828681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Pushing event updated for resources: {'Port': ['ID=21af9ac4-d5af-4e4c-832d-ac867157fca5,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:36.832002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:36.832879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:36.834759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:36.836677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:36.881552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.901882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port f8f15d9d-0555-40f7-a114-669e0b44c592 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:36.902262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.936539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.941019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cc1182cf-10b9-4d04-bf5c-f11c4b066739 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.3650055 Nov 24 14:02:36.942513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43936) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:36.946865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Attempting to bind port 21af9ac4-d5af-4e4c-832d-ac867157fca5 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:36.947061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.947899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Attempting to bind port 21af9ac4-d5af-4e4c-832d-ac867157fca5 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:36.947899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Attempting to bind port 21af9ac4-d5af-4e4c-832d-ac867157fca5 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:36.951450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Request body: {'router': {'admin_state_up': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:36.968118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:36.969053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:36.981367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:36.982209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:36.984194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Bound port: 21af9ac4-d5af-4e4c-832d-ac867157fca5, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:36.986737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.125773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 7f96edb0-5f88-4dc8-8586-3e3bb745d6ce owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:37.151369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] For port 21af9ac4-d5af-4e4c-832d-ac867157fca5, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:37.154830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] For port 21af9ac4-d5af-4e4c-832d-ac867157fca5, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=21af9ac4-d5af-4e4c-832d-ac867157fca5,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:37.161366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.183141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cf7ab1b6-88fe-453c-bfcc-f2d8bc2c03db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:37.307660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Pushing event updated for resources: {'Port': ['ID=21af9ac4-d5af-4e4c-832d-ac867157fca5,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:37.311741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:37.364060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9719262b-dee5-4a89-ad70-18d420287c25 None None] Provisioning for port f8f15d9d-0555-40f7-a114-669e0b44c592 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:37.373104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9719262b-dee5-4a89-ad70-18d420287c25 None None] Provisioning complete for port f8f15d9d-0555-40f7-a114-669e0b44c592 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:37.373728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9719262b-dee5-4a89-ad70-18d420287c25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.443731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9719262b-dee5-4a89-ad70-18d420287c25 None None] Port f8f15d9d-0555-40f7-a114-669e0b44c592 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:37.451230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.466240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:37.535539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=7f96edb0-5f88-4dc8-8586-3e3bb745d6ce,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:37.538063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:37.545675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6232d211-8df3-4514-97eb-3668b037d573 req-e0a44978-9ace-48ed-b953-2212f698f7a0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:37.547156 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6232d211-8df3-4514-97eb-3668b037d573 req-e0a44978-9ace-48ed-b953-2212f698f7a0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.1932790 Nov 24 14:02:37.608567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.626797 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/7f96edb0-5f88-4dc8-8586-3e3bb745d6ce HTTP/1.1" status: 204 len: 168 time: 1.1126652 Nov 24 14:02:37.634986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43942) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:37.694357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6232d211-8df3-4514-97eb-3668b037d573 req-afb09b88-87a8-47a3-a05f-8c8049e5d40d tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1164684 Nov 24 14:02:37.716217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049fd97f-2648-43c3-9149-23295a48dcf0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:37.717698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049fd97f-2648-43c3-9149-23295a48dcf0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:37.718454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-049fd97f-2648-43c3-9149-23295a48dcf0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:37.736789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-049fd97f-2648-43c3-9149-23295a48dcf0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:37.738550 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-049fd97f-2648-43c3-9149-23295a48dcf0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1014090 Nov 24 14:02:37.740932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43948) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:37.812953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 3beec28a-ce17-48a9-9b76-a06666aba35b {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:37.816780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.915223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.948268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.954516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:37.978086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-00a3701a-90ed-44e0-a94b-207f10c3d0cd tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:router {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:37.991421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.092239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.126721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 21af9ac4-d5af-4e4c-832d-ac867157fca5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:38.192729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.201152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe21f82b-05b5-41ef-a6a6-b6efea248a1f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:38.239419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 21af9ac4-d5af-4e4c-832d-ac867157fca5 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:38.247105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=3beec28a-ce17-48a9-9b76-a06666aba35b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:38.259111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:38.260950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for f8f15d9d-0555-40f7-a114-669e0b44c592 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:38.264273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.281788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/3beec28a-ce17-48a9-9b76-a06666aba35b HTTP/1.1" status: 204 len: 168 time: 0.5393372 Nov 24 14:02:38.284094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43952) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:38.335477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-00a3701a-90ed-44e0-a94b-207f10c3d0cd tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:router {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:38.340322 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-00a3701a-90ed-44e0-a94b-207f10c3d0cd tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 886 time: 1.7587123 Nov 24 14:02:38.345452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43956) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:38.356117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-77320688'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:38.365852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.370579 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97779459-c291-4652-8e6f-eaa9b55dd132 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0824761 Nov 24 14:02:38.370905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43960) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:38.376379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:38.396918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ce601fa-1cc9-4bdc-a72c-bba4b82f1590 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:38.426675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58566749-6c63-46a9-88d6-21b8ac0c3ab2 req-8479dd93-ed65-4609-9f00-1c9b77eea83e tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:38.429163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-58566749-6c63-46a9-88d6-21b8ac0c3ab2 req-8479dd93-ed65-4609-9f00-1c9b77eea83e tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.5871015 Nov 24 14:02:38.486956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Could not find standard attr ID for object 7f96edb0-5f88-4dc8-8586-3e3bb745d6ce. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:02:38.522405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:38.527454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:38.530703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:38.536296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Provisioning for port 21af9ac4-d5af-4e4c-832d-ac867157fca5 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:38.537243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:38.549008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:38.580016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Provisioning complete for port 21af9ac4-d5af-4e4c-832d-ac867157fca5 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:38.580395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.597130 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-58566749-6c63-46a9-88d6-21b8ac0c3ab2 req-bf4a4177-6a11-477c-b3e9-4a6b4a26b64c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1473827 Nov 24 14:02:38.640265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.642432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43964) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:38.653702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-745f2d56-5dfa-4583-a8bf-7945fad0ef0c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:38.725549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.733438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.762838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=f8f15d9d-0555-40f7-a114-669e0b44c592,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:38.768320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] For port 21af9ac4-d5af-4e4c-832d-ac867157fca5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=21af9ac4-d5af-4e4c-832d-ac867157fca5,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:38.770631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:38.773000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Router b979fd8a-97fa-4d10-9e55-a52323d33a71 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:02:38.776345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.778514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-74b84fa7-3f09-40d1-9008-84e435dbc1e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:38.822545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:38.837447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Deleting port 21af9ac4-d5af-4e4c-832d-ac867157fca5 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:38.838465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.878080 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b4ca00c4-5cae-4534-b1c4-f86d8bc199cd tempest-TestNetworkAdvancedServerOps-544673990 tempest-TestNetworkAdvancedServerOps-544673990-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1093 time: 0.2342134 Nov 24 14:02:38.882686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43968) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:38.892021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '67fa1194-0c3d-4202-9709-065dd857e200', 'tenant_id': '84c43153da724ce38453763656256a35', 'fixed_ip_address': '172.20.0.6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:38.901160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:38.908915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Usage tracker for resource:floatingip and tenant:84c43153da724ce38453763656256a35 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:38.913857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:38.923212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Pushing event updated for resources: {'Port': ['ID=21af9ac4-d5af-4e4c-832d-ac867157fca5,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:38.923507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:38.957602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:38.983326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:38.995258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.066445 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/f8f15d9d-0555-40f7-a114-669e0b44c592 HTTP/1.1" status: 204 len: 168 time: 2.2699661 Nov 24 14:02:39.078819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43972) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:39.144600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.148132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] For port 21af9ac4-d5af-4e4c-832d-ac867157fca5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=21af9ac4-d5af-4e4c-832d-ac867157fca5,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:39.148429 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-d8ba77b2-d6a5-4313-8fb2-59f1ae30de75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] GET failed (client error): The resource could not be found. Nov 24 14:02:39.148576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.148927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d8ba77b2-d6a5-4313-8fb2-59f1ae30de75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Synchronizing usage tracker for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:39.151304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b46d8891-3a7a-4516-8f99-5e230f8998e3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:39.171636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:39.179188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.180428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-95aadf12-09ce-46b1-aff8-2af038e3d459 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "PUT /v2.0/routers/b979fd8a-97fa-4d10-9e55-a52323d33a71 HTTP/1.1" status: 200 len: 694 time: 2.2373285 Nov 24 14:02:39.183715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43976) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:39.190479 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] Sync routers for ids ['b979fd8a-97fa-4d10-9e55-a52323d33a71'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:39.202837 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] Routers {'b979fd8a-97fa-4d10-9e55-a52323d33a71'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:39.203690 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b979fd8a-97fa-4d10-9e55-a52323d33a71'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:39.209905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:39.236751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d8ba77b2-d6a5-4313-8fb2-59f1ae30de75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Unset dirty status for tenant:74f54ee2a8574df893d540b53d0009fe on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:39.241757 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d8ba77b2-d6a5-4313-8fb2-59f1ae30de75 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports/f8f15d9d-0555-40f7-a114-669e0b44c592 HTTP/1.1" status: 404 len: 333 time: 0.1495974 Nov 24 14:02:39.242507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43980) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:39.280385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:39.288997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:39.289672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Calling delete_port for 21af9ac4-d5af-4e4c-832d-ac867157fca5 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:39.293016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:39.293578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.327778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:39.354034 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.9817867 Nov 24 14:02:39.360209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 43984) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:39.363240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.372533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09', 'ip_address': '2001:db8::a0b3:5a0f:1dd0:2e27'}], 'name': 'tempest-NetworksTestDHCPv6-799002574'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:39.391041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.398129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:39.456702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] No DVR routers for this DVR port 21af9ac4-d5af-4e4c-832d-ac867157fca5 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:39.461737 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] Set router b979fd8a-97fa-4d10-9e55-a52323d33a71 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:39.470236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Pushing event deleted for resources: {'Port': ['ID=21af9ac4-d5af-4e4c-832d-ac867157fca5,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:39.473109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:39.475424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5068c3c0-bd70-405d-aeed-01fa550f8731 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:39.618974 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b979fd8a-97fa-4d10-9e55-a52323d33a71', 'name': 'tempest-RoutersTest-router-1647094707', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:36Z', 'updated_at': '2021-11-24T14:02:37Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:39.627991 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] Checking router: b979fd8a-97fa-4d10-9e55-a52323d33a71 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:39.644902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] Routers {'b979fd8a-97fa-4d10-9e55-a52323d33a71'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:39.647418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b979fd8a-97fa-4d10-9e55-a52323d33a71'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:39.652803 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9853a229-ef0d-4681-b6e5-c24aad2a3bb0 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/routers/b979fd8a-97fa-4d10-9e55-a52323d33a71 HTTP/1.1" status: 200 len: 700 time: 0.4678209 Nov 24 14:02:39.658338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43988) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:39.665161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:39.674283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:39.678935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:39.690524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Allocated IP 172.26.4.20 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/ce065fe8-caba-462c-af0c-2aea33f0759e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:39.693844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:39.706344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:39.707846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.713714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.724393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1ff6e304-088d-4f91-8dde-ca3c8d183ce7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Synchronizing usage tracker for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:39.735276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:39.741082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.819978 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] Set router b979fd8a-97fa-4d10-9e55-a52323d33a71 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:39.822918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:39.825777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port c25f1efc-c87e-4115-8967-d51e4c113afc yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:39.840618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1ff6e304-088d-4f91-8dde-ca3c8d183ce7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Unset dirty status for tenant:9d96b9002ef84a209d8d0c821d7c7a49 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:39.844531 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1ff6e304-088d-4f91-8dde-ca3c8d183ce7 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=b979fd8a-97fa-4d10-9e55-a52323d33a71 HTTP/1.1" status: 200 len: 205 time: 0.1804724 Nov 24 14:02:39.848812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43992) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:39.946916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09/f85f9e54-729b-4439-b3e8-57bb67ae38d5) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:39.951885 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b979fd8a-97fa-4d10-9e55-a52323d33a71', 'name': 'tempest-RoutersTest-router-1647094707', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:36Z', 'updated_at': '2021-11-24T14:02:37Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:39.956994 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2425965c-f365-4d9d-bda7-6cad0ecbc56e None None] The sync data for ids ['b979fd8a-97fa-4d10-9e55-a52323d33a71'] in dv-neutron-818151-2-hyperv is: [{'id': 'b979fd8a-97fa-4d10-9e55-a52323d33a71', 'name': 'tempest-RoutersTest-router-1647094707', 'tenant_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:36Z', 'updated_at': '2021-11-24T14:02:37Z', 'revision_number': 2, 'project_id': '9d96b9002ef84a209d8d0c821d7c7a49', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:40.029686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.036461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f3779198-91cf-4921-98b2-64ecb53701e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:40.066350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5b31b2e-ed1b-4f93-8bad-752e49b21f1d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:40.073713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.132635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:40.137329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 21af9ac4-d5af-4e4c-832d-ac867157fca5 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:40.144113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.148681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.148991 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/security-groups/b5b31b2e-ed1b-4f93-8bad-752e49b21f1d HTTP/1.1" status: 204 len: 168 time: 0.9004579 Nov 24 14:02:40.150368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 43996) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:40.192281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 21af9ac4-d5af-4e4c-832d-ac867157fca5 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:40.192624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 21af9ac4-d5af-4e4c-832d-ac867157fca5 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:40.205446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.210467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-47bffa03-67f0-4f64-bf7b-fb61e78bfe85 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:40.280540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:40.283896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:40.288931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:40.302584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.318671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Transition to ACTIVE for port object f85f9e54-729b-4439-b3e8-57bb67ae38d5 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:40.338915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Port': ['ID=ce065fe8-caba-462c-af0c-2aea33f0759e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:40.344650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:40.356589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Transition to ACTIVE for port object f85f9e54-729b-4439-b3e8-57bb67ae38d5 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:40.368629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.372691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3b762da2-ae78-4a8a-b911-0ccd1ce3ec0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:40.443246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:40.446944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:40.448844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Pushing event updated for resources: {'Port': ['ID=f85f9e54-729b-4439-b3e8-57bb67ae38d5,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:40.450776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:40.454860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:40.540667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::a0b3:5a0f:1dd0:2e27 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09/c25f1efc-c87e-4115-8967-d51e4c113afc) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:40.543473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Attempting to bind port f85f9e54-729b-4439-b3e8-57bb67ae38d5 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:40.543911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Attempting to bind port f85f9e54-729b-4439-b3e8-57bb67ae38d5 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:40.544707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Attempting to bind port f85f9e54-729b-4439-b3e8-57bb67ae38d5 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:40.551408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:40.551807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:40.552212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.552643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:40.554384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Bound port: f85f9e54-729b-4439-b3e8-57bb67ae38d5, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:40.554774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.605093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.650810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] For port f85f9e54-729b-4439-b3e8-57bb67ae38d5, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:40.654668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] For port f85f9e54-729b-4439-b3e8-57bb67ae38d5, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f85f9e54-729b-4439-b3e8-57bb67ae38d5,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:40.659355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.663714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:40.762540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.762801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Pushing event updated for resources: {'Port': ['ID=f85f9e54-729b-4439-b3e8-57bb67ae38d5,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:40.767975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:40.775637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.806313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.811203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.837563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.937381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.940950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d71e9393-bdc7-434c-b476-5e6ad153aa32 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:40.961701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:40.996242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object c25f1efc-c87e-4115-8967-d51e4c113afc will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:41.049737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.059556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:41.131617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.132284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Fanout notify agent at l3_agent the message router_deleted on router b979fd8a-97fa-4d10-9e55-a52323d33a71 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:02:41.135751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=df98c181-4040-4196-84ff-02ea553d14f4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:41.147163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:41.162223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:41.171242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.172037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:41.175314 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/security-groups/df98c181-4040-4196-84ff-02ea553d14f4 HTTP/1.1" status: 204 len: 168 time: 0.9736378 Nov 24 14:02:41.175607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=c25f1efc-c87e-4115-8967-d51e4c113afc,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:41.176113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44000) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.185368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:41.191143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:41.196178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.231122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.232411 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3f0ee69d-6c3c-4401-bcc2-b267072914ff tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/b979fd8a-97fa-4d10-9e55-a52323d33a71 HTTP/1.1" status: 204 len: 168 time: 1.3796024 Nov 24 14:02:41.247329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44004) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.248323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:41.292156 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.9238758 Nov 24 14:02:41.295325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44008) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.303146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd1420cf-deab-4e18-87d8-d093f769424c tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=b979fd8a-97fa-4d10-9e55-a52323d33a71 HTTP/1.1" status: 200 len: 205 time: 0.0527582 Nov 24 14:02:41.304562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44012) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.336317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.378837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.422384 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-f18dce83-a9f9-4ac8-9601-8b856a8a7963 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:41.423412 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f18dce83-a9f9-4ac8-9601-8b856a8a7963 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/b979fd8a-97fa-4d10-9e55-a52323d33a71 HTTP/1.1" status: 404 len: 336 time: 0.0863073 Nov 24 14:02:41.429315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44016) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.433499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router a38fe41f-1d91-4edf-8039-9ef7af56c186 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:41.474602 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-e73bd4a4-aa8e-49ac-a3a5-bc974b0e0923 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:41.475039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e73bd4a4-aa8e-49ac-a3a5-bc974b0e0923 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:41.486017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.488567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.492562 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/security-groups/8630dedc-09fd-4687-97c2-c056b102b813 HTTP/1.1" status: 204 len: 168 time: 0.3140080 Nov 24 14:02:41.494410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44020) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.495575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3688e36a-a0f0-4ba6-808f-2e021163e970 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:41.542326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.548328 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e73bd4a4-aa8e-49ac-a3a5-bc974b0e0923 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/3a3161f1-f54e-4c17-a06c-81d3d72d02bc HTTP/1.1" status: 404 len: 337 time: 0.1178544 Nov 24 14:02:41.548988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44024) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.557157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8630dedc-09fd-4687-97c2-c056b102b813,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:41.566240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:41.633663 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-4fc81278-8d13-4379-acb2-b49017dcdcf3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:41.634098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4fc81278-8d13-4379-acb2-b49017dcdcf3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:41.638115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4fc81278-8d13-4379-acb2-b49017dcdcf3 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/6b036948-8a00-453f-b2c4-56c46a11b1af HTTP/1.1" status: 404 len: 337 time: 0.0836051 Nov 24 14:02:41.644268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-835cea56-16fa-4343-bacb-77b8bcd80627 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:41.646657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44028) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.648923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-835cea56-16fa-4343-bacb-77b8bcd80627 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:41.650059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-835cea56-16fa-4343-bacb-77b8bcd80627 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:41.679613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.701810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-9c20c649-a627-44a7-8c66-ee76dd0ec354 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:41.702251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9c20c649-a627-44a7-8c66-ee76dd0ec354 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:41.704097 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9c20c649-a627-44a7-8c66-ee76dd0ec354 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/680006ef-4d94-41e1-9d14-3fbf3d869aee HTTP/1.1" status: 404 len: 337 time: 0.0555358 Nov 24 14:02:41.707439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44032) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.708106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-835cea56-16fa-4343-bacb-77b8bcd80627 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:41.712149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-835cea56-16fa-4343-bacb-77b8bcd80627 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.4123950 Nov 24 14:02:41.719280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44036) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.799871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-e57b3acb-1e51-45b3-a5aa-baef13dd2bd2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:41.800202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e57b3acb-1e51-45b3-a5aa-baef13dd2bd2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:41.802030 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e57b3acb-1e51-45b3-a5aa-baef13dd2bd2 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/4c338938-af44-4fa4-90ed-2e1169df03ce HTTP/1.1" status: 404 len: 337 time: 0.0911455 Nov 24 14:02:41.805392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44040) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.854458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port c25f1efc-c87e-4115-8967-d51e4c113afc {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:41.854794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:41.862808 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5dc106f3-4911-4b83-ac98-1c756ebd60de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 200 len: 205 time: 0.0541332 Nov 24 14:02:41.867564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44044) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:41.949833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3dcb9c20-5171-4740-8a5d-863582598a3f None None] Provisioning for port f85f9e54-729b-4439-b3e8-57bb67ae38d5 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:42.012827 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-0c80a783-7cbb-43bf-b570-a82b9f73dd90 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:42.013863 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0c80a783-7cbb-43bf-b570-a82b9f73dd90 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/8b1794c5-dde1-4c7a-a979-ba268c818d76 HTTP/1.1" status: 404 len: 336 time: 0.1453800 Nov 24 14:02:42.018010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44048) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.071347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet 2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:42.084516 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-099c9ad0-be7e-4ba3-b2b1-31f5eb6c98d1 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=9914b2df-11c0-4062-9d63-2bc0e07c4c82 HTTP/1.1" status: 200 len: 205 time: 0.0618720 Nov 24 14:02:42.084516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.092337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44052) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.116683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f85f9e54-729b-4439-b3e8-57bb67ae38d5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:42.177527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.181870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-42fffcf4-c3f4-4f61-bc73-f0224c8c82a9 None None] Could not find standard attr ID for object dde3bd15-c291-4a14-9254-ed586f2dce00. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:02:42.212070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f85f9e54-729b-4439-b3e8-57bb67ae38d5 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:42.218272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f85f9e54-729b-4439-b3e8-57bb67ae38d5 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:42.218554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.237913 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-4c2802ab-0fa0-4f87-9a67-4ee85ce0aaf4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:42.242206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4c2802ab-0fa0-4f87-9a67-4ee85ce0aaf4 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/9914b2df-11c0-4062-9d63-2bc0e07c4c82 HTTP/1.1" status: 404 len: 336 time: 0.1438117 Nov 24 14:02:42.243417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44056) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.310155 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-5b54ef8b-8002-46f6-b19d-52cbba87d8de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:42.310497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5b54ef8b-8002-46f6-b19d-52cbba87d8de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:42.314501 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5b54ef8b-8002-46f6-b19d-52cbba87d8de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/e5c1ff5f-e903-4fb1-a5c7-688946c34c0c HTTP/1.1" status: 404 len: 337 time: 0.0674076 Nov 24 14:02:42.315502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44060) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.382758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.403431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.418048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f85f9e54-729b-4439-b3e8-57bb67ae38d5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f85f9e54-729b-4439-b3e8-57bb67ae38d5,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:42.424337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.428550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:42.475807 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-693e11ef-b509-4810-bff9-a8f1d5f93f68 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 200 len: 205 time: 0.1517713 Nov 24 14:02:42.476660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.485822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:42.514649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.522251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f85f9e54-729b-4439-b3e8-57bb67ae38d5,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:42.526288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:42.531184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] Sync routers for ids ['a38fe41f-1d91-4edf-8039-9ef7af56c186'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:42.532229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.535640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-27fb5776-ba9f-43dc-91c2-270576aa979f None None] Could not find standard attr ID for object 7f96edb0-5f88-4dc8-8586-3e3bb745d6ce. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:02:42.538618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.546784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8dbff96e-3d57-4e47-a5ca-68ac373ab86b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:42.549197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] Routers {'a38fe41f-1d91-4edf-8039-9ef7af56c186'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:42.550071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a38fe41f-1d91-4edf-8039-9ef7af56c186'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:42.593609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.598574 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a72ac0b0-fc43-4ae5-afbb-a60784059a80 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 200 len: 890 time: 4.2501118 Nov 24 14:02:42.603440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44068) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.609584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:42.644716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.661929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:42.675263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] Routers {'a38fe41f-1d91-4edf-8039-9ef7af56c186'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:42.676050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a38fe41f-1d91-4edf-8039-9ef7af56c186'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:42.703934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:42.707082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.710822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-87e70bc4-dbf8-4388-9c41-d197e692b292 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:42.714230 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b HTTP/1.1" status: 204 len: 168 time: 1.2101748 Nov 24 14:02:42.716308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44072) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.744523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:42.745039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff1b0d5f-0421-45de-9640-1cecc1db67dc None None] The sync data for ids ['a38fe41f-1d91-4edf-8039-9ef7af56c186'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:42.747012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for c25f1efc-c87e-4115-8967-d51e4c113afc owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:42.747486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d86ac46-b226-4690-8a3a-d5b6eb0aa03c None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:42.779657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-6da76f8c-b544-483a-afd9-777d2772d52b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:42.783006 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6da76f8c-b544-483a-afd9-777d2772d52b tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/24311646-1e87-4d0c-9d2d-92cc6b5057ed HTTP/1.1" status: 404 len: 336 time: 0.2576411 Nov 24 14:02:42.789409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44076) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.862382 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ef3f6a0b-5a7e-43ae-80ab-b51d627353ec tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 HTTP/1.1" status: 200 len: 205 time: 0.0714135 Nov 24 14:02:42.868744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44080) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:42.875125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet d6c0c184-31b6-4a38-8bfc-31bee5f7cc72 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:42.917419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event updated for resources: {'Port': ['ID=ce065fe8-caba-462c-af0c-2aea33f0759e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:42.950777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:42.978547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:43.010970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3a12a2f6-053a-4cb3-b5b0-fe5e39ffcd75 None None] Provisioning for port c25f1efc-c87e-4115-8967-d51e4c113afc completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:43.021421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.023138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3a12a2f6-053a-4cb3-b5b0-fe5e39ffcd75 None None] Provisioning complete for port c25f1efc-c87e-4115-8967-d51e4c113afc triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:43.023563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a12a2f6-053a-4cb3-b5b0-fe5e39ffcd75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.092825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.093726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3a12a2f6-053a-4cb3-b5b0-fe5e39ffcd75 None None] Port c25f1efc-c87e-4115-8967-d51e4c113afc cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:43.101026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60e2fb48-65aa-445b-8778-04a0b34a9aad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:43.155456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=c25f1efc-c87e-4115-8967-d51e4c113afc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:43.156133 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-40a691c4-a7a4-4f64-ac0e-31f2b7beea76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:43.157176 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-40a691c4-a7a4-4f64-ac0e-31f2b7beea76 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/d98b2ea8-f759-4b1e-a231-a4ef92eebbd1 HTTP/1.1" status: 404 len: 336 time: 0.2873533 Nov 24 14:02:43.164641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:43.167628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44084) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.248718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b0a67e0-096c-40ff-8f93-0284a33674de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:43.249151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3b0a67e0-096c-40ff-8f93-0284a33674de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:43.262883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.264665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.278206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3b0a67e0-096c-40ff-8f93-0284a33674de tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/cdfca3a5-73d9-41ca-b022-7f05a6bf09f7 HTTP/1.1" status: 404 len: 337 time: 0.1046898 Nov 24 14:02:43.281674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44088) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.325454 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/c25f1efc-c87e-4115-8967-d51e4c113afc HTTP/1.1" status: 204 len: 168 time: 1.5719359 Nov 24 14:02:43.326337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44092) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.355870 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dd89be64-1707-4227-8cd8-e9a7ca180ebe tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf HTTP/1.1" status: 200 len: 205 time: 0.0698891 Nov 24 14:02:43.356113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44096) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.455007 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-0695ef3b-6db1-4f50-931b-1737202144aa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:43.460265 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0695ef3b-6db1-4f50-931b-1737202144aa tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/e9eb3e33-7f0b-427b-8a9d-8e5a6436aebf HTTP/1.1" status: 404 len: 336 time: 0.0994270 Nov 24 14:02:43.460265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44100) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.488241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f627dec-4a05-44a3-ab6d-38fa25552875 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:43.489553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f627dec-4a05-44a3-ab6d-38fa25552875 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:43.490553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7f627dec-4a05-44a3-ab6d-38fa25552875 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:43.508045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-e61caba9-dd74-4078-a2e6-6961472cc55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:43.508500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e61caba9-dd74-4078-a2e6-6961472cc55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:43.510206 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e61caba9-dd74-4078-a2e6-6961472cc55d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/983c0237-d8a7-4fa1-9353-bb3decd0db62 HTTP/1.1" status: 404 len: 337 time: 0.0494175 Nov 24 14:02:43.518554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44104) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.522896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7f627dec-4a05-44a3-ab6d-38fa25552875 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:43.526971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7f627dec-4a05-44a3-ab6d-38fa25552875 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1950045 Nov 24 14:02:43.527571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44108) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.562652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.612696 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Floating IP 23e79b9e-c628-41f7-8df7-6750470f80dc associated. External IP: 172.26.4.20, port: 67fa1194-0c3d-4202-9709-065dd857e200. Nov 24 14:02:43.627032 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-16e15507-ae3a-4ff9-bb6e-310168f7552c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/routers/a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 200 len: 890 time: 1.0199263 Nov 24 14:02:43.633156 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3aabc1d1-287f-4678-8c84-c90c34db80fb tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "GET /v2.0/ports?device_id=8bae44ed-5a02-4b5c-8a01-82551153f917 HTTP/1.1" status: 200 len: 205 time: 0.1102314 Nov 24 14:02:43.633581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44112) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.634331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44114) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.772359 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-ea4cfc90-19aa-4e88-a64b-7c347eee1efd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] delete failed (client error): The resource could not be found. Nov 24 14:02:43.774506 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea4cfc90-19aa-4e88-a64b-7c347eee1efd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/routers/8bae44ed-5a02-4b5c-8a01-82551153f917 HTTP/1.1" status: 404 len: 336 time: 0.1368191 Nov 24 14:02:43.775845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-306d69ea-2f63-440e-8273-38a6565e8abf tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:43.782271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44120) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.856478 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-7ada7b35-0e2c-4513-9e43-66fb160b457d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:43.857045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7ada7b35-0e2c-4513-9e43-66fb160b457d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:43.872363 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7ada7b35-0e2c-4513-9e43-66fb160b457d tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/d84e48cc-8c0a-4880-b899-7d51994d9ca1 HTTP/1.1" status: 404 len: 337 time: 0.0850561 Nov 24 14:02:43.872638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.878975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44124) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.879709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-39f7fdea-f79f-4b8f-81d4-a9ebb255859f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:43.917761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-306d69ea-2f63-440e-8273-38a6565e8abf tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:43.918807 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-306d69ea-2f63-440e-8273-38a6565e8abf tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 200 len: 205 time: 0.2835448 Nov 24 14:02:43.924525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44128) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:43.934244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-64747f66-fd11-413f-844c-e9f09e8eba26 None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:43.934627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64747f66-fd11-413f-844c-e9f09e8eba26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.964683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=d6c0c184-31b6-4a38-8bfc-31bee5f7cc72,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:43.967146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:43.975201 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-61b1f916-12e0-4c46-bda0-6875e2244433 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:43.975981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-61b1f916-12e0-4c46-bda0-6875e2244433 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:43.978623 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-61b1f916-12e0-4c46-bda0-6875e2244433 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] 10.222.0.70 "DELETE /v2.0/subnets/92a67e43-85d9-4a70-a511-803d3c21308b HTTP/1.1" status: 404 len: 337 time: 0.0672984 Nov 24 14:02:43.982697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:43.984801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/d6c0c184-31b6-4a38-8bfc-31bee5f7cc72 HTTP/1.1" status: 204 len: 168 time: 1.2672367 Nov 24 14:02:43.993528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44134) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.028193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d0a024a-f450-4869-bd66-a97545881d5b None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:44.029656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:44.034494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.087588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a771cbf6-8090-4f00-9c06-a75b6018d435 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:44.088536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a771cbf6-8090-4f00-9c06-a75b6018d435 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:44.090307 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a771cbf6-8090-4f00-9c06-a75b6018d435 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/2ba7f3dc-8e6c-42f4-860c-5d8c69c4e16b HTTP/1.1" status: 404 len: 337 time: 0.0956168 Nov 24 14:02:44.096246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44138) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.126801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f85f9e54-729b-4439-b3e8-57bb67ae38d5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:44.173289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.202531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting subnet e7478ca1-ea35-4aea-b3dd-b676833cc73f {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:44.206008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.287912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.424112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f85f9e54-729b-4439-b3e8-57bb67ae38d5 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:44.424695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.435999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.439949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.509159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-64747f66-fd11-413f-844c-e9f09e8eba26 None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:44.509159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64747f66-fd11-413f-844c-e9f09e8eba26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.519248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44144) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.562239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.577203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-00d87e2a-4eca-4b80-b9af-6ffd391745c0 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:44.606465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-64747f66-fd11-413f-844c-e9f09e8eba26 None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:44.631476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Subnet': ['ID=e7478ca1-ea35-4aea-b3dd-b676833cc73f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:44.636817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.642944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.645812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:44.649187 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/e7478ca1-ea35-4aea-b3dd-b676833cc73f HTTP/1.1" status: 204 len: 168 time: 0.5518391 Nov 24 14:02:44.653167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44150) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.700842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.704949 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-72111660-205f-4753-ac59-d56a74568fdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:44.705449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-72111660-205f-4753-ac59-d56a74568fdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:44.707356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-72111660-205f-4753-ac59-d56a74568fdb tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/cacaa952-e652-4a93-8b4d-0ea336698c5d HTTP/1.1" status: 404 len: 337 time: 0.0530136 Nov 24 14:02:44.710070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44154) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.728457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1e52245-2aa0-4b93-85d2-d9d1ab20d06f tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:44.762454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:44.776150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a016be2-d473-4b2d-bff5-4e46700010cd None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:44.784362 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-55bd4586-7298-47ae-8336-698c7746a819 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "GET /v2.0/ports?device_id=4ad4d030-8357-4cea-a47e-a7167f08e7ff HTTP/1.1" status: 200 len: 205 time: 0.0722063 Nov 24 14:02:44.785248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44158) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.844477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:44.852636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:44.863568 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09 HTTP/1.1" status: 204 len: 168 time: 1.3306630 Nov 24 14:02:44.867269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44162) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.897005 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-1bdb7fde-e7c1-48bf-917a-85ce7749df16 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] delete failed (client error): The resource could not be found. Nov 24 14:02:44.898132 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1bdb7fde-e7c1-48bf-917a-85ce7749df16 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/routers/4ad4d030-8357-4cea-a47e-a7167f08e7ff HTTP/1.1" status: 404 len: 336 time: 0.1114831 Nov 24 14:02:44.901620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44166) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.950224 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ceb52433-6350-480c-8986-e2ba1fec9776 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:44.950659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ceb52433-6350-480c-8986-e2ba1fec9776 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:44.954702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ceb52433-6350-480c-8986-e2ba1fec9776 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/944b5593-554a-4563-a4d2-4e2cb4ed7a40 HTTP/1.1" status: 404 len: 337 time: 0.0497808 Nov 24 14:02:44.954974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-508af0de-fa28-496c-9837-e32c9ba68387 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0836306 Nov 24 14:02:44.956456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44170) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:44.961242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44172) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.019960 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d2c56a0-1c6d-499a-886c-0047bd5aa6c5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.020189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1d2c56a0-1c6d-499a-886c-0047bd5aa6c5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.027556 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d2c56a0-1c6d-499a-886c-0047bd5aa6c5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/fd0bbe78-0313-4109-a6b9-752f149c51ea HTTP/1.1" status: 404 len: 337 time: 0.0657761 Nov 24 14:02:45.027809 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bb9eacef-3d1a-44cf-afae-2e50a685a542 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=9d96b9002ef84a209d8d0c821d7c7a49&name=default HTTP/1.1" status: 200 len: 2647 time: 0.5052006 Nov 24 14:02:45.027809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44178) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.030594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44180) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.039600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-314947f4-c14f-4e8f-9706-57c84f960787 None None] Update dhcp port {'port': {'network_id': '8aeb6176-eff5-4042-baaa-de8b7dcc3ca1', 'fixed_ips': [{'subnet_id': 'e7478ca1-ea35-4aea-b3dd-b676833cc73f'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '8ea226c9-4123-480e-83ad-f3cfa95ed36e'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:02:45.070424 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-dfdfa5df-0536-4540-b988-c75b036f5ab8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.070856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-dfdfa5df-0536-4540-b988-c75b036f5ab8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.072524 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dfdfa5df-0536-4540-b988-c75b036f5ab8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/96eb2a88-9c78-4914-a466-b197ad9fdbb0 HTTP/1.1" status: 404 len: 337 time: 0.0440888 Nov 24 14:02:45.075138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44186) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.103859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-314947f4-c14f-4e8f-9706-57c84f960787 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.132833 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a08e7d5b-140b-4a4a-b2db-df84b1c6232c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.133540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a08e7d5b-140b-4a4a-b2db-df84b1c6232c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.136726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a08e7d5b-140b-4a4a-b2db-df84b1c6232c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/ed33b300-d2a1-43db-9034-2375609e0cb4 HTTP/1.1" status: 404 len: 333 time: 0.0590460 Nov 24 14:02:45.139969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44190) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.158472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Router 95732bbb-def1-43f3-a30c-c41d29c85119 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:02:45.243060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:45.253701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Deleting port f85f9e54-729b-4439-b3e8-57bb67ae38d5 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:45.254093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.266271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.306517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc5c821d-d488-4ebe-a9f1-778e31232329 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:45.307231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fc5c821d-d488-4ebe-a9f1-778e31232329 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:45.314872 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f4516da0-4f88-4b64-9729-94e485dc810a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.315298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f4516da0-4f88-4b64-9729-94e485dc810a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.316963 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f4516da0-4f88-4b64-9729-94e485dc810a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/069052fe-ffd3-4364-a970-a83ecc7ff028 HTTP/1.1" status: 404 len: 337 time: 0.1763444 Nov 24 14:02:45.320143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44194) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.327400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.373009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a0fffeb-c4c7-4a67-a4ab-0f92c299174a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.373521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1a0fffeb-c4c7-4a67-a4ab-0f92c299174a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.377613 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1a0fffeb-c4c7-4a67-a4ab-0f92c299174a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/1779010f-68b3-4ec7-a60a-89ab2050355b HTTP/1.1" status: 404 len: 337 time: 0.0528014 Nov 24 14:02:45.378421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44198) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.381590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fc5c821d-d488-4ebe-a9f1-778e31232329 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:45.385800 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fc5c821d-d488-4ebe-a9f1-778e31232329 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.4241333 Nov 24 14:02:45.390122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44202) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.404238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7515f251-c2a4-4aa2-8a4a-d36c863532e8 None None] Network 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:45.476074 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-30c9cb4f-c4ac-48dc-bc32-81e3bdac0177 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.476436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-30c9cb4f-c4ac-48dc-bc32-81e3bdac0177 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.480482 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-30c9cb4f-c4ac-48dc-bc32-81e3bdac0177 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/114b5268-2eaa-4442-aa58-76c7889f060b HTTP/1.1" status: 404 len: 333 time: 0.0985386 Nov 24 14:02:45.480659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44206) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.516537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.531743 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-1018b80a-9318-49fd-9b8a-6080910d5aaa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.532273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1018b80a-9318-49fd-9b8a-6080910d5aaa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.537485 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1018b80a-9318-49fd-9b8a-6080910d5aaa tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/18d22814-9c3e-48ab-8d48-53c0ae9706bd HTTP/1.1" status: 404 len: 337 time: 0.0526173 Nov 24 14:02:45.537707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44210) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.543641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port d4dba1ff-00fe-4408-b32d-302960b6ff13 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:45.544423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.581547 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ae1f77c6-f3aa-4d27-b0df-1cdf5eec3bc5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] DELETE failed (client error): The resource could not be found. Nov 24 14:02:45.581985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ae1f77c6-f3aa-4d27-b0df-1cdf5eec3bc5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:45.586278 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ae1f77c6-f3aa-4d27-b0df-1cdf5eec3bc5 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/subnets/d7f6341c-2aa7-458e-bb35-ce009d2902f2 HTTP/1.1" status: 404 len: 337 time: 0.0450091 Nov 24 14:02:45.586576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29c58230-e288-434e-ae3c-6392c840d799 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:45.587239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-29c58230-e288-434e-ae3c-6392c840d799 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:45.589900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44214) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.662518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-29c58230-e288-434e-ae3c-6392c840d799 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:45.666480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-29c58230-e288-434e-ae3c-6392c840d799 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2750263 Nov 24 14:02:45.669065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44218) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.675493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 7f566d0c-ccf2-483a-820a-d1541294c9d2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:45.675857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.695034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a8b143a9-fb24-4683-b66f-5bdeb09bde8c None None] Provisioning complete for port 8ea226c9-4123-480e-83ad-f3cfa95ed36e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:45.695415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a8b143a9-fb24-4683-b66f-5bdeb09bde8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.751772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-263f8eee-a727-4adc-a60e-f4e02dbf619c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0768938 Nov 24 14:02:45.752023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44222) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:45.759618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:45.775297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.789667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4a4900b-8680-4a95-99bc-8aafc4411326 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:45.812519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] For port f85f9e54-729b-4439-b3e8-57bb67ae38d5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f85f9e54-729b-4439-b3e8-57bb67ae38d5,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:45.812929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.829648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba40cbc5-78a1-4360-a259-ff96446c9c56,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:45.842534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:45.914088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.952687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:45.953791 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/ba40cbc5-78a1-4360-a259-ff96446c9c56 HTTP/1.1" status: 204 len: 168 time: 0.9213367 Nov 24 14:02:45.957045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Calling delete_port for f85f9e54-729b-4439-b3e8-57bb67ae38d5 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:46.019069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:46.048464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:46.064722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.065529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 7f566d0c-ccf2-483a-820a-d1541294c9d2 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:46.079626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:46.083311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.141953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.148979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:46.166572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:46.183247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8ea226c9-4123-480e-83ad-f3cfa95ed36e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:46.188855 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] Sync routers for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:46.205592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:46.206943 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:46.222243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] DHCP port deletion for 8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:46.240431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for d4dba1ff-00fe-4408-b32d-302960b6ff13 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:46.242584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Pushing event deleted for resources: {'Port': ['ID=f85f9e54-729b-4439-b3e8-57bb67ae38d5,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:46.247290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Deleting port 8ea226c9-4123-480e-83ad-f3cfa95ed36e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:46.247648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.247820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.253604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ccd2d36d-8413-4b58-9479-fa69ca78dfbf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:46.304553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a8b143a9-fb24-4683-b66f-5bdeb09bde8c None None] Provisioning complete for port 7f566d0c-ccf2-483a-820a-d1541294c9d2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:46.304941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a8b143a9-fb24-4683-b66f-5bdeb09bde8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.348807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=7f566d0c-ccf2-483a-820a-d1541294c9d2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:46.353605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:46.359224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:46.372757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.404645 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/ports/7f566d0c-ccf2-483a-820a-d1541294c9d2 HTTP/1.1" status: 204 len: 168 time: 0.8137157 Nov 24 14:02:46.407075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44230) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:46.419463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] No DVR routers for this DVR port f85f9e54-729b-4439-b3e8-57bb67ae38d5 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:46.421544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a8b143a9-fb24-4683-b66f-5bdeb09bde8c None None] Port 7f566d0c-ccf2-483a-820a-d1541294c9d2 was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 14:02:46.541696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.555708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 8ea226c9-4123-480e-83ad-f3cfa95ed36e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:46.556405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.563136 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:46.651623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.655819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.675262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:46.675957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.822893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.831388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c05b7c2-4e95-4287-837f-2dd58d0ef916 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:46.844790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:46.845710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.895181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=d4dba1ff-00fe-4408-b32d-302960b6ff13,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:46.904341 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 8.0203803 Nov 24 14:02:46.905616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:46.908104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:02:46.945812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:46.955263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Calling delete_port for 8ea226c9-4123-480e-83ad-f3cfa95ed36e owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:46.959355 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:02:46.987022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:46.988591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f85f9e54-729b-4439-b3e8-57bb67ae38d5 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:47.043204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 8ea226c9-4123-480e-83ad-f3cfa95ed36e owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:47.077396 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'status': 'completed', 'code': 200} Nov 24 14:02:47.080889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3a5311ab-3b38-4b37-a767-6f0f4d68c436 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:47.144551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f85f9e54-729b-4439-b3e8-57bb67ae38d5 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:47.147296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f85f9e54-729b-4439-b3e8-57bb67ae38d5 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:47.154173 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '23e79b9e-c628-41f7-8df7-6750470f80dc', 'tenant_id': '84c43153da724ce38453763656256a35', 'floating_ip_address': '172.26.4.20', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'port_id': '67fa1194-0c3d-4202-9709-065dd857e200', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'mac_address': 'fa:16:3e:86:5a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:02:40Z', 'updated_at': '2021-11-24T14:02:40Z', 'revision_number': 0, 'project_id': '84c43153da724ce38453763656256a35', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:22Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:47.159376 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] Checking router: 95732bbb-def1-43f3-a30c-c41d29c85119 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:02:47.174317 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:47.175122 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:47.192680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:47.193962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:47.219523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=11']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:47.230130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:47.256808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:47.257580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:47.389635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44252) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:47.402605 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:02:47.532435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1185011448-network', 'tenant_id': 'd8f8b834cdff4f678fb27b967b7aa48b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:47.539018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:47.544588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Usage tracker for resource:network and tenant:d8f8b834cdff4f678fb27b967b7aa48b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:47.549202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.560131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:47.567052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:47.569009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.581093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Made reservation on behalf of d8f8b834cdff4f678fb27b967b7aa48b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:47.584225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.597679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.633088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:47.637403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Usage tracker for resource:security_group_rule and tenant:d8f8b834cdff4f678fb27b967b7aa48b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:47.640474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:47.646915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:47.695537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Deleting port 8ea226c9-4123-480e-83ad-f3cfa95ed36e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:47.695899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.708010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.721556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-addc5377-e876-4a1b-8674-bc93c37c8857 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:47.761798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Deleting port 8ea226c9-4123-480e-83ad-f3cfa95ed36e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:47.762946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.763986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.837407 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '23e79b9e-c628-41f7-8df7-6750470f80dc', 'tenant_id': '84c43153da724ce38453763656256a35', 'floating_ip_address': '172.26.4.20', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'port_id': '67fa1194-0c3d-4202-9709-065dd857e200', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'mac_address': 'fa:16:3e:86:5a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:02:40Z', 'updated_at': '2021-11-24T14:02:40Z', 'revision_number': 0, 'project_id': '84c43153da724ce38453763656256a35', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:22Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:47.840212 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-c6c9fc88-6627-4dc3-a015-1a4957370898 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1098 time: 0.7479095 Nov 24 14:02:47.844306 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ce9d5f0-48d1-4e70-bff2-9780329d91d2 None None] The sync data for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv is: [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '23e79b9e-c628-41f7-8df7-6750470f80dc', 'tenant_id': '84c43153da724ce38453763656256a35', 'floating_ip_address': '172.26.4.20', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'port_id': '67fa1194-0c3d-4202-9709-065dd857e200', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'mac_address': 'fa:16:3e:86:5a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:02:40Z', 'updated_at': '2021-11-24T14:02:40Z', 'revision_number': 0, 'project_id': '84c43153da724ce38453763656256a35', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:22Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:47.903513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12b3e7e-2857-4786-98de-337dcee00ad3 req-ad7b689a-5777-4a5b-bf88-8c2a9a223abf tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:47.907377 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c12b3e7e-2857-4786-98de-337dcee00ad3 req-ad7b689a-5777-4a5b-bf88-8c2a9a223abf tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.7498994 Nov 24 14:02:47.914310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.929758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 851} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:02:47.934145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.940740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.941106 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Added segment 097f0e42-3015-4e27-9c16-edc8dbc9112d of type vlan for network 99ebbc60-aad0-4014-a19e-55e6165ad0ef Nov 24 14:02:47.941232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.972183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:47.974772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=6b444e4b-4b18-4009-bf57-a34612117a83,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:47.989813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6d4ffa63-db21-4537-82be-0ac0e0130456 tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:48.043483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.322s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:48.045937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:48.049773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f12eed9-2db6-4361-a8ad-5dc58a811270,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:48.056725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:48.072509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36282494-6bfa-4fa2-ba1a-2986954451a7 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:48.083128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:48.088800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.090218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:48.090977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.104205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:48.104612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.108662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:48.109460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.128956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ab8910c-1639-4f36-aea7-bc2f92313d64 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:48.145276 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c12b3e7e-2857-4786-98de-337dcee00ad3 req-35b96c77-6e53-4a8f-8155-71d1b42f2473 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1419723 Nov 24 14:02:48.153340 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7618065 Nov 24 14:02:48.154036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44258) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:48.203888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.204387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router a38fe41f-1d91-4edf-8039-9ef7af56c186 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:02:48.209370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44260) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:48.216126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.220467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 204 len: 168 time: 4.2917826 Nov 24 14:02:48.222332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44264) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:48.247734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Request body: {'subnet': {'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1185011448-subnet', 'tenant_id': 'd8f8b834cdff4f678fb27b967b7aa48b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:48.263605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:48.317246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5811a0b-0ff0-4b23-b83c-442b809a42a9 None None] New status for floating IP 23e79b9e-c628-41f7-8df7-6750470f80dc: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:02:48.335084 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.5820611 Nov 24 14:02:48.337602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Usage tracker for resource:subnet and tenant:d8f8b834cdff4f678fb27b967b7aa48b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:48.341970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c312f91e-1150-4348-8cc3-041319ff7b7a tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/floatingips/23e79b9e-c628-41f7-8df7-6750470f80dc HTTP/1.1" status: 200 len: 990 time: 0.1313558 Nov 24 14:02:48.345144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:48.345372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44270) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:48.349835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] For port 8ea226c9-4123-480e-83ad-f3cfa95ed36e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8ea226c9-4123-480e-83ad-f3cfa95ed36e,segment=NetworkSegment(1e68820c-505e-471b-8ec4-c754b46e3d28),segment_id=1e68820c-505e-471b-8ec4-c754b46e3d28)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:48.350160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.353330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-242528230'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:48.358995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:48.362788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:48.364505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Pushing event updated for resources: {'Network': ['ID=99ebbc60-aad0-4014-a19e-55e6165ad0ef,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:48.365632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:48.368775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:48.370910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:48.371446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:48.384361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '6b444e4b-4b18-4009-bf57-a34612117a83', 'ip_address': '2001:db8::b900:3131:585e:3ae'}], 'name': 'tempest-NetworksTestDHCPv6-1892394530'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:48.401495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-6903aab6-5ac9-41de-9bc3-7353576dd9ea service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:48.402892 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-6903aab6-5ac9-41de-9bc3-7353576dd9ea service neutron] 10.222.0.47 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 898 time: 0.4555228 Nov 24 14:02:48.407326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:48.410089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.444972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 99ebbc60-aad0-4014-a19e-55e6165ad0ef details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:02:48.488321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Calling delete_port for 8ea226c9-4123-480e-83ad-f3cfa95ed36e owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:48.529013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Made reservation on behalf of d8f8b834cdff4f678fb27b967b7aa48b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:48.530961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.537554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Calling delete_port for 8ea226c9-4123-480e-83ad-f3cfa95ed36e owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:48.598511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 899} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:02:48.633987 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-5ee46c88-09fe-4fd6-8a72-60134d9a6c1c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 998 time: 0.2139244 Nov 24 14:02:48.641364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.641707 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment dedfc71b-93e5-4054-a2b1-7c8907526c28 of type vlan for network c4645f89-6df9-4781-b4d9-dcff31f16cbe Nov 24 14:02:48.668754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.675297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d7a437b-1885-4229-81df-e7b738002c3c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:48.695551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:48.726366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:48.733992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Port': ['ID=8ea226c9-4123-480e-83ad-f3cfa95ed36e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:48.736397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:48.740286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.742047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] No DVR routers for this DVR port 8ea226c9-4123-480e-83ad-f3cfa95ed36e on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:48.749768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-5674900f-fba9-410b-8d16-9477d595288a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:48.751549 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-5674900f-fba9-410b-8d16-9477d595288a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 200 len: 835 time: 0.1084993 Nov 24 14:02:48.794533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:48.799341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.807254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '6b444e4b-4b18-4009-bf57-a34612117a83'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:48.808133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.854764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:02:48.855410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:02:48.856542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port f0547738-89f8-438b-9cce-bc8ab1aa5034 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:48.890718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.894568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:48.894996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.903137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1fec8115-fcd1-4492-8e38-7dc2f3f13a98 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:48.923423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:48.969428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8aeb6176-eff5-4042-baaa-de8b7dcc3ca1']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:49.001487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e68820c-505e-471b-8ec4-c754b46e3d28') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:49.001759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e68820c-505e-471b-8ec4-c754b46e3d28') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:49.017376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.028426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.035125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f9c6b8c4-f0a8-4571-9e2b-daa066233324 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:49.045277 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.7088912 Nov 24 14:02:49.053429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44274) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:49.058359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=c4645f89-6df9-4781-b4d9-dcff31f16cbe,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:49.064240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:49.067746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:49.085106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.105122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:02:49.105489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.106910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/6b444e4b-4b18-4009-bf57-a34612117a83/cdf5a8ab-0770-4771-a161-c8532e5b3625) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:49.113191 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-8057fa33-adfd-490a-b5c2-0eae0e31ec03 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.3543386 Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:02:49.121326 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:02:49.143938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=81ea79c9-beb6-43bc-8036-8717cf3b026f,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:49.147684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:49.208636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:02:49.242711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Checking segment: {'id': '097f0e42-3015-4e27-9c16-edc8dbc9112d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:49.243704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Network hostable DHCP agents. Network: 99ebbc60-aad0-4014-a19e-55e6165ad0ef, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:02:49.263610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.273216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4a7ca8b-93a9-4ea4-9322-541c657a011c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:49.291677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.315094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Pushing event deleted for resources: {'Network': ['ID=8aeb6176-eff5-4042-baaa-de8b7dcc3ca1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:49.327597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:49.335269 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] 10.222.0.70 "DELETE /v2.0/networks/8aeb6176-eff5-4042-baaa-de8b7dcc3ca1 HTTP/1.1" status: 204 len: 168 time: 2.9245458 Nov 24 14:02:49.340283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Network 99ebbc60-aad0-4014-a19e-55e6165ad0ef is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:02:49.349817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44280) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:49.378919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Deleting port 8ea226c9-4123-480e-83ad-f3cfa95ed36e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:49.379515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.432239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 99ebbc60-aad0-4014-a19e-55e6165ad0ef) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:49.456851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:49.457599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.507196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:49.507784 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2606328 Nov 24 14:02:49.514907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:49.526397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:49.536356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:49.542682 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-b12574bb-7229-48f2-a568-ec7905bcc381 service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4192550 Nov 24 14:02:49.549974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-099b33b0-6b68-42df-971f-735b3d39fb02 None None] Network 99ebbc60-aad0-4014-a19e-55e6165ad0ef requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:49.564946 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e73a8f05-d402-47db-b0bd-42afd641a439 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/floatingips/23e79b9e-c628-41f7-8df7-6750470f80dc HTTP/1.1" status: 200 len: 992 time: 0.2094669 Nov 24 14:02:49.580020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:49.669133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44290) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:49.702335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c4ca1a06-c099-4f95-8419-1a8c98d010f5 None None] The port '8ea226c9-4123-480e-83ad-f3cfa95ed36e' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:02:49.760284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.810537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.831341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Transition to ACTIVE for port object cdf5a8ab-0770-4771-a161-c8532e5b3625 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:49.880484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-babbcf26-8836-4c78-aa42-3b86c3082f2a req-ae12afb5-5710-4823-9c74-cbfc988c6b50 service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3283770 Nov 24 14:02:49.889159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bbd52832-777f-426d-87ae-9a5edea39144 None None] Network 99ebbc60-aad0-4014-a19e-55e6165ad0ef requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:49.966741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Transition to ACTIVE for port object cdf5a8ab-0770-4771-a161-c8532e5b3625 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:49.989031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:49.995699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:50.072493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.079708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-74243851-8163-42c4-96cf-3daa6e788af2 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:50.087448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Pushing event updated for resources: {'Port': ['ID=cdf5a8ab-0770-4771-a161-c8532e5b3625,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:50.094819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:50.106401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:50.108114 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-655e3e09-3d31-4681-bfa6-da54dfc0972a admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=74f54ee2a8574df893d540b53d0009fe&name=default HTTP/1.1" status: 200 len: 2647 time: 0.4376197 Nov 24 14:02:50.108839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44302) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:50.116939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:50.122368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:50.185288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.208472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=4bc554d1-6739-430f-b728-4d4a0b7a83a1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:50.225019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:50.225913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.261286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::b900:3131:585e:3ae (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/6b444e4b-4b18-4009-bf57-a34612117a83/f0547738-89f8-438b-9cce-bc8ab1aa5034) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:50.274119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': 'dedfc71b-93e5-4054-a2b1-7c8907526c28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:50.274484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: c4645f89-6df9-4781-b4d9-dcff31f16cbe, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:02:50.303386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.317062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f0361a87-74f8-4776-9808-71fab0107c06 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:50.319838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Attempting to bind port cdf5a8ab-0770-4771-a161-c8532e5b3625 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:50.320193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Attempting to bind port cdf5a8ab-0770-4771-a161-c8532e5b3625 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:50.320561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Attempting to bind port cdf5a8ab-0770-4771-a161-c8532e5b3625 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:50.328609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:50.328986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:50.329453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.329850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:50.330375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Bound port: cdf5a8ab-0770-4771-a161-c8532e5b3625, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:50.330751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.352199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b73c0956-253e-4714-8770-4861f0cc1ba6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:50.361724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:02:50.362693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:50.373928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.383624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/b73c0956-253e-4714-8770-4861f0cc1ba6 HTTP/1.1" status: 204 len: 168 time: 0.2737832 Nov 24 14:02:50.400539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, c4645f89-6df9-4781-b4d9-dcff31f16cbe) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:50.422852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3784c48f-975b-41e3-b567-884e5aab9d34 None None] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:50.423387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:50.423810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.514340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.4570851 Nov 24 14:02:50.517072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44314) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:50.530427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1419114965', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:50.536342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] For port cdf5a8ab-0770-4771-a161-c8532e5b3625, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:50.536932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:50.547132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:50.558526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] For port cdf5a8ab-0770-4771-a161-c8532e5b3625, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cdf5a8ab-0770-4771-a161-c8532e5b3625,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:50.574460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.579641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.580608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.587257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-592f7b64-89b4-4628-8658-f710f35293e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:50.629182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.644107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.657674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object f0547738-89f8-438b-9cce-bc8ab1aa5034 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:50.674176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.708370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.710682 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-01e711f5-d62d-43d7-afa7-2b6cb1b36662 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.1925473 Nov 24 14:02:50.713258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.713868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44320) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:50.719676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Pushing event updated for resources: {'Port': ['ID=cdf5a8ab-0770-4771-a161-c8532e5b3625,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:50.723508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:50.730839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:50.801401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:50.805457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:50.809903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:50.814030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:50.814712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.862382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=f0547738-89f8-438b-9cce-bc8ab1aa5034,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:50.866218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.5198536 Nov 24 14:02:50.867624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:50.869220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44330) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:50.871546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-c4645f89-6df9-4781-b4d9-dcff31f16cbe', 'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': '4bc554d1-6739-430f-b728-4d4a0b7a83a1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:50.876037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '6b444e4b-4b18-4009-bf57-a34612117a83', 'ip_address': '2001:db8::b900:3131:585e:3ae'}], 'name': 'tempest-NetworksTestDHCPv6-1205372428'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:50.879135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:50.900659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44334) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:50.908573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-1119150415-network', 'tenant_id': '7928240e87714d5b8136dff57f1deb6b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:50.921042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:50.936752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Usage tracker for resource:network and tenant:7928240e87714d5b8136dff57f1deb6b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:50.991451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:51.014299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:51.070519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Made reservation on behalf of 7928240e87714d5b8136dff57f1deb6b for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:51.075032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.127798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.163594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Allocated IP 2001:db8::2 (c4645f89-6df9-4781-b4d9-dcff31f16cbe/4bc554d1-6739-430f-b728-4d4a0b7a83a1/f4ca72d3-b513-4228-8e7d-0096cc69fc13) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:51.180910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:51.189425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:51.194383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:51.202143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:51.204557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:51.209002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Usage tracker for resource:security_group_rule and tenant:7928240e87714d5b8136dff57f1deb6b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:51.213955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:51.257620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:51.271580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:51.478381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.490498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Transition to ACTIVE for port object f4ca72d3-b513-4228-8e7d-0096cc69fc13 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:51.491096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.509877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.515345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Transition to ACTIVE for port object f4ca72d3-b513-4228-8e7d-0096cc69fc13 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:51.516046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.523710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 52085332-70ba-47e2-b1f8-38dcd31f5c03 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:51.526223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.532247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83bc1265-71b1-4ae4-bda1-74fa96ef15e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:51.621558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:51.625276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:51.628016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:51.660598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Pushing event updated for resources: {'Port': ['ID=f4ca72d3-b513-4228-8e7d-0096cc69fc13,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:51.664315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:51.718576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.814514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Attempting to bind port f4ca72d3-b513-4228-8e7d-0096cc69fc13 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:51.814898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Attempting to bind port f4ca72d3-b513-4228-8e7d-0096cc69fc13 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'dedfc71b-93e5-4054-a2b1-7c8907526c28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:51.815407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Attempting to bind port f4ca72d3-b513-4228-8e7d-0096cc69fc13 on network c4645f89-6df9-4781-b4d9-dcff31f16cbe {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:51.823711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:51.824141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Checking segment: {'id': 'dedfc71b-93e5-4054-a2b1-7c8907526c28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:51.824558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.825157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Bound using segment: {'id': 'dedfc71b-93e5-4054-a2b1-7c8907526c28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:51.825708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Bound port: f4ca72d3-b513-4228-8e7d-0096cc69fc13, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dedfc71b-93e5-4054-a2b1-7c8907526c28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 899, 'network_id': 'c4645f89-6df9-4781-b4d9-dcff31f16cbe'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:51.826103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.888104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-17dc9616-1d4d-47e4-9137-ee34eab9f359 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:51.909247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 891} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:02:51.924350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.924692 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Added segment 8b6c90f5-e312-477e-bda0-1f9d2b2a6111 of type vlan for network 95844fa5-55bb-4e49-a847-77b43b74f899 Nov 24 14:02:51.952904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] For port f4ca72d3-b513-4228-8e7d-0096cc69fc13, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:51.957047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] For port f4ca72d3-b513-4228-8e7d-0096cc69fc13, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f4ca72d3-b513-4228-8e7d-0096cc69fc13,segment=NetworkSegment(dedfc71b-93e5-4054-a2b1-7c8907526c28),segment_id=dedfc71b-93e5-4054-a2b1-7c8907526c28)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:51.960296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44348) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:51.963314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:51.979441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:51.986660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.045849 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): There was a conflict when trying to complete your request. Nov 24 14:02:52.048056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:52.087597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b17aa10-3ddb-48c1-a8fc-fdcd73db0a70,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:52.088976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Pushing event updated for resources: {'Port': ['ID=f4ca72d3-b513-4228-8e7d-0096cc69fc13,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:52.099821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:52.107318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:52.135167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.136351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:52.136816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.144651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f4da4505-3c10-4350-a0b6-92176d2239c9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:52.160475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cdf5a8ab-0770-4771-a161-c8532e5b3625 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:52.182025 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-755995f7-ae15-46c3-866d-38b752d4a8ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 409 len: 388 time: 1.3115628 Nov 24 14:02:52.185347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44354) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:52.255307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.3530884 Nov 24 14:02:52.267403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44358) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:52.282727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Request body: {'subnet': {'network_id': '95844fa5-55bb-4e49-a847-77b43b74f899', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-1119150415-subnet', 'tenant_id': '7928240e87714d5b8136dff57f1deb6b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:52.304830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Pushing event updated for resources: {'Network': ['ID=95844fa5-55bb-4e49-a847-77b43b74f899,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:52.310670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port cdf5a8ab-0770-4771-a161-c8532e5b3625 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:52.318435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:52.320094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 95844fa5-55bb-4e49-a847-77b43b74f899 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:02:52.321551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:52.324293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Usage tracker for resource:subnet and tenant:7928240e87714d5b8136dff57f1deb6b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:52.328397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:52.339449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:52.342539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--1462405648'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:52.356503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:52.361681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Made reservation on behalf of 7928240e87714d5b8136dff57f1deb6b for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:52.365975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.375671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:52.385294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:52.398938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:52.421048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.437583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8::1 (c4645f89-6df9-4781-b4d9-dcff31f16cbe/4bc554d1-6739-430f-b728-4d4a0b7a83a1/8c802b71-0e30-4f65-b7c4-544c462abe5a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:52.449950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.502806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Provisioning for port cdf5a8ab-0770-4771-a161-c8532e5b3625 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:52.517639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Provisioning complete for port cdf5a8ab-0770-4771-a161-c8532e5b3625 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:52.518015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.670552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f74ad2cf-3d3e-4f9a-b974-e6bf45fb88e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:52.674951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f74ad2cf-3d3e-4f9a-b974-e6bf45fb88e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:52.682064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44362) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:52.682318 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f74ad2cf-3d3e-4f9a-b974-e6bf45fb88e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.4952815 Nov 24 14:02:52.685093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.727073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] For port cdf5a8ab-0770-4771-a161-c8532e5b3625, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cdf5a8ab-0770-4771-a161-c8532e5b3625,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:52.733115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.735676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:52.737399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.747195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d6b73573-fdd5-401b-8996-76bda96397ef tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:52.764849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:52.780281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:52.785771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:52.796411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:52.820435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.825411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Pushing event updated for resources: {'Port': ['ID=cdf5a8ab-0770-4771-a161-c8532e5b3625,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:52.839363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:52.844626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 8c802b71-0e30-4f65-b7c4-544c462abe5a will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:52.854289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e12572d5-b975-4c19-86e4-11bfb71d8338,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:52.857423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:52.861935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-61a5c0ba-871c-40a3-a520-b10bdcdb0b21 None None] Provisioning for port f0547738-89f8-438b-9cce-bc8ab1aa5034 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:52.868468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-61a5c0ba-871c-40a3-a520-b10bdcdb0b21 None None] Provisioning complete for port f0547738-89f8-438b-9cce-bc8ab1aa5034 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:52.869022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-61a5c0ba-871c-40a3-a520-b10bdcdb0b21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.872147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port f0547738-89f8-438b-9cce-bc8ab1aa5034 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:52.872494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.911211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.921004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:52.925269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-61a5c0ba-871c-40a3-a520-b10bdcdb0b21 None None] Port f0547738-89f8-438b-9cce-bc8ab1aa5034 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:52.926140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-943dfb46-1355-456d-8975-083e9eedfc93 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:52.945802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Checking segment: {'id': '8b6c90f5-e312-477e-bda0-1f9d2b2a6111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 891, 'network_id': '95844fa5-55bb-4e49-a847-77b43b74f899'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:52.946387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Network hostable DHCP agents. Network: 95844fa5-55bb-4e49-a847-77b43b74f899, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:02:52.956411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.021204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:53.024703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:53.029091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=8c802b71-0e30-4f65-b7c4-544c462abe5a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:53.031517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:53.033295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:53.034192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:53.037024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e321a26d-4fb4-4a6d-8bb7-5558314fc3f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:53.044401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:53.049606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:53.050145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.050536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Network 95844fa5-55bb-4e49-a847-77b43b74f899 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:02:53.058867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:53.099451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a6efac8f-4106-4d1a-ba4e-0bb9fba0abcf,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:53.107693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:53.113220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 95844fa5-55bb-4e49-a847-77b43b74f899) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:53.122566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77a3ebb5-5567-4f29-86f6-09327325aae1 None None] Network 95844fa5-55bb-4e49-a847-77b43b74f899 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:53.144468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:53.145052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.192099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.198772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.9302568 Nov 24 14:02:53.212694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.219230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-31371203-6a0a-4be0-b964-1a52a0398926 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:53.224834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.237453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.366703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:53.388891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for f0547738-89f8-438b-9cce-bc8ab1aa5034 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:53.393570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.395400 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 1.4320784 Nov 24 14:02:53.399687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:53.400530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:53.520364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99ee915a-25af-4ff0-a4ce-ab428775701b None None] Network 95844fa5-55bb-4e49-a847-77b43b74f899 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:53.626739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.639638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6da4a86e-e798-4f8b-b6f5-320a6f42329d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:53.703049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=f0547738-89f8-438b-9cce-bc8ab1aa5034,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:53.706477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:53.758128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28bd6259-1058-49da-be85-63d9eb8bfd26 None None] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:53.765789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:53.784506 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/f0547738-89f8-438b-9cce-bc8ab1aa5034 HTTP/1.1" status: 204 len: 168 time: 1.1017344 Nov 24 14:02:53.788705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44378) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:53.845241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-06cc9582-f2ca-4664-831b-a53b0faf7685 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:53.947387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1c428de0-7e32-40bd-a868-fc016c6b3572 None None] Provisioning for port f4ca72d3-b513-4228-8e7d-0096cc69fc13 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:53.983429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f7fc8a3-e407-4f10-9380-ea5bdf42085a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:53.984829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f7fc8a3-e407-4f10-9380-ea5bdf42085a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:53.986316 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5f7fc8a3-e407-4f10-9380-ea5bdf42085a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1938770 Nov 24 14:02:53.989302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44386) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:53.991569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-06cc9582-f2ca-4664-831b-a53b0faf7685 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:53.992867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-06cc9582-f2ca-4664-831b-a53b0faf7685 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4007 time: 0.5887904 Nov 24 14:02:54.018178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44390) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:54.035076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-security--1994797761', 'description': 'tempest-security-description-173327394'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:54.110502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 6b444e4b-4b18-4009-bf57-a34612117a83 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:54.113807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.186591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.187656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.211875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cdf5a8ab-0770-4771-a161-c8532e5b3625 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:54.278335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-8cd1cf5a-ed33-4b11-a085-f6e1196ff105 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:54.279065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-8cd1cf5a-ed33-4b11-a085-f6e1196ff105 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Synchronizing usage tracker for tenant:d8f8b834cdff4f678fb27b967b7aa48b on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:54.318246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port cdf5a8ab-0770-4771-a161-c8532e5b3625 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:54.318963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.324037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.328802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.333158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.335881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.336463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.337105 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "PUT /v2.0/security-groups/6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1 HTTP/1.1" status: 200 len: 1611 time: 0.3179173 Nov 24 14:02:54.338189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7c2bed59-e0ca-456e-8187-0475bbd12f72 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:54.345697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44394) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:54.352396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-8cd1cf5a-ed33-4b11-a085-f6e1196ff105 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Unset dirty status for tenant:d8f8b834cdff4f678fb27b967b7aa48b on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:54.353520 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-8cd1cf5a-ed33-4b11-a085-f6e1196ff105 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/networks?id=99ebbc60-aad0-4014-a19e-55e6165ad0ef HTTP/1.1" status: 200 len: 812 time: 0.3739307 Nov 24 14:02:54.354094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.354906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.440210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.446399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:54.447017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-87d4876d-f271-4004-898e-13f6cee108c8 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:54.459709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:54.463785 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-c65fb543-9248-4a65-89ad-dc9061e11175 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/quotas/d8f8b834cdff4f678fb27b967b7aa48b HTTP/1.1" status: 200 len: 375 time: 0.0810285 Nov 24 14:02:54.464287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-180be296-0a89-4df6-8f98-70f87ce9896a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:54.484828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f4ca72d3-b513-4228-8e7d-0096cc69fc13 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:54.485099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=6b444e4b-4b18-4009-bf57-a34612117a83,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:54.490788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:54.506512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.520388 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/6b444e4b-4b18-4009-bf57-a34612117a83 HTTP/1.1" status: 204 len: 168 time: 0.5272593 Nov 24 14:02:54.521319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44398) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:54.570643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b34cf355-7a80-4985-b2b2-90df66f009de None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:54.609771 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-00b47bba-9586-4d04-902e-70c31a487a1b tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=d8f8b834cdff4f678fb27b967b7aa48b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1124485 Nov 24 14:02:54.614301 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e69ada95-441d-4a6a-ab74-468c53d7cbc0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups/6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1 HTTP/1.1" status: 200 len: 1611 time: 0.2649369 Nov 24 14:02:54.617212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44402) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:54.703837 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=8c802b71-0e30-4f65-b7c4-544c462abe5a,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:54.720372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:54.728190 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4c7a18f3-5cc8-4d86-b897-e2af0cb34502 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.2050731 Nov 24 14:02:54.728958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44408) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:54.735054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:54.809100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:54.824880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f4ca72d3-b513-4228-8e7d-0096cc69fc13 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:54.856439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:54.859180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:54.863869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:54.867443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:54.870337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f4ca72d3-b513-4228-8e7d-0096cc69fc13 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:54.870726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.874245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:54.886376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:54.890211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.899500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bbb91886-3a60-4a2c-8085-36d9de57e184 None None] Provisioning for port 8c802b71-0e30-4f65-b7c4-544c462abe5a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:02:54.920467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:54.923516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bbb91886-3a60-4a2c-8085-36d9de57e184 None None] Provisioning complete for port 8c802b71-0e30-4f65-b7c4-544c462abe5a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:54.923925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bbb91886-3a60-4a2c-8085-36d9de57e184 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.004446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-bbb91886-3a60-4a2c-8085-36d9de57e184 None None] Port 8c802b71-0e30-4f65-b7c4-544c462abe5a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:55.063222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.104365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.128050 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-b9fbd620-7098-45c6-9385-571c63d9d2db service neutron] 10.222.0.70 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4963160 Nov 24 14:02:55.156818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f4ca72d3-b513-4228-8e7d-0096cc69fc13, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f4ca72d3-b513-4228-8e7d-0096cc69fc13,segment=NetworkSegment(dedfc71b-93e5-4054-a2b1-7c8907526c28),segment_id=dedfc71b-93e5-4054-a2b1-7c8907526c28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:55.158783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6a7706c6-7424-464a-a741-2b001eccaee7 None None] Provisioning complete for port 8c802b71-0e30-4f65-b7c4-544c462abe5a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:55.159165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6a7706c6-7424-464a-a741-2b001eccaee7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.191061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.196137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.201354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1162ab0b-e593-42b1-8679-41f5bd44a65e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:55.202236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6d287a22-addb-4ba6-9cc5-cb025b170e5d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:55.242631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:02:55.260475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Deleting port cdf5a8ab-0770-4771-a161-c8532e5b3625 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:02:55.260887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.280727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:55.285331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:55.291730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:55.294481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.311964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=9a200a16-41b8-4533-8fbe-6c6901bb8703,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:55.315468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:55.325991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6a7706c6-7424-464a-a741-2b001eccaee7 None None] Port 8c802b71-0e30-4f65-b7c4-544c462abe5a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:55.346079 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6159222 Nov 24 14:02:55.349539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44412) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:55.357550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '9a200a16-41b8-4533-8fbe-6c6901bb8703', 'ip_address': '2001:db8:0:1::2'}], 'name': 'tempest-NetworksTestDHCPv6-2134501245'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:55.392124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f4ca72d3-b513-4228-8e7d-0096cc69fc13,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:55.400903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:55.500158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.506248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:55.511600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:55.511854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-baf30659-7539-4e7c-808b-1752961a4937 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:55.514801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:55.520724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:55.533322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-230fd5a5-e31f-4031-9065-841e64b39130 None None] Provisioning complete for port 8c802b71-0e30-4f65-b7c4-544c462abe5a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:55.533711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-230fd5a5-e31f-4031-9065-841e64b39130 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.535012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:55.544150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.556929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:55.565780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:55.570135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port a7fd02a0-6544-4f91-8533-9da34a860cdc yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:02:55.577083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.578190 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1 HTTP/1.1" status: 204 len: 168 time: 0.9582796 Nov 24 14:02:55.582368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44416) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:55.612298 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-51e9ba11-6289-4070-b24c-25aac2632cba service neutron] 10.222.0.70 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4756837 Nov 24 14:02:55.640468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-230fd5a5-e31f-4031-9065-841e64b39130 None None] Port 8c802b71-0e30-4f65-b7c4-544c462abe5a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:02:55.650032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] For port cdf5a8ab-0770-4771-a161-c8532e5b3625, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cdf5a8ab-0770-4771-a161-c8532e5b3625,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:02:55.650415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.669543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-31803eec-017e-4aae-9d96-3d1798736ea9 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:55.697457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-31803eec-017e-4aae-9d96-3d1798736ea9 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:55.698816 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-31803eec-017e-4aae-9d96-3d1798736ea9 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.1143074 Nov 24 14:02:55.703403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44420) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:55.725690 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-83b7da98-96c6-487a-bbce-7394bea9ee7f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] delete failed (client error): The resource could not be found. Nov 24 14:02:55.726737 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-83b7da98-96c6-487a-bbce-7394bea9ee7f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/6920bfe6-0481-4f23-8dc2-9fe8fdf67eb1 HTTP/1.1" status: 404 len: 347 time: 0.0223730 Nov 24 14:02:55.731396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44424) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:55.749477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--2036062017'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:55.750543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 78413ccb-dcd3-4839-aa79-4f283250f59b is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:02:55.760094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:55.778457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:55.787114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:02:55.787825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:02:55.793989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.820946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Calling delete_port for cdf5a8ab-0770-4771-a161-c8532e5b3625 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:02:55.856887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:55.860820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9ced8a63-6040-4177-8a7c-9e2aa043e744 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 0.5101323 Nov 24 14:02:55.863708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44432) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:55.867088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:55.870302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:55.929066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:55.950845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:55.956407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8b84c7e0-705e-4c47-9d87-0ab77c545a25 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:55.996175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:02:56.000082 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7c55bf8a-a396-49bb-a723-84107bf9c548 req-69457534-7b2e-4c69-b23d-a84908a0ea61 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 210 time: 0.0775654 Nov 24 14:02:56.004611 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/78413ccb-dcd3-4839-aa79-4f283250f59b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2892630 Nov 24 14:02:56.007656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44440) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.010349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Pushing event deleted for resources: {'Port': ['ID=cdf5a8ab-0770-4771-a161-c8532e5b3625,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:56.015227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:56.019648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] No DVR routers for this DVR port cdf5a8ab-0770-4771-a161-c8532e5b3625 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:02:56.022190 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] Sync routers for ids ['78413ccb-dcd3-4839-aa79-4f283250f59b'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:02:56.042861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b05be0ed-b871-4d84-9df5-8ae217dcc886 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:56.043470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-026ea092-6458-4273-b065-387090d310e9 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:56.043683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b05be0ed-b871-4d84-9df5-8ae217dcc886 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:56.077607 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] Routers {'78413ccb-dcd3-4839-aa79-4f283250f59b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:56.078271 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['78413ccb-dcd3-4839-aa79-4f283250f59b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:56.084758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b05be0ed-b871-4d84-9df5-8ae217dcc886 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:56.086365 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b05be0ed-b871-4d84-9df5-8ae217dcc886 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.2212341 Nov 24 14:02:56.098521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44444) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.151250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.160742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.171602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e98fce44-8d42-4de0-8c3f-bc1d1215a826 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:56.171985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f55bedc7-7ba5-4f7a-97e7-6f6124fa0594 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:56.172575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f55bedc7-7ba5-4f7a-97e7-6f6124fa0594 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:56.190996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f4ca72d3-b513-4228-8e7d-0096cc69fc13 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:02:56.203785 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:56.207506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f55bedc7-7ba5-4f7a-97e7-6f6124fa0594 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:56.209551 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f55bedc7-7ba5-4f7a-97e7-6f6124fa0594 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports/8c802b71-0e30-4f65-b7c4-544c462abe5a HTTP/1.1" status: 200 len: 911 time: 0.2008016 Nov 24 14:02:56.212531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44448) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.219955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '4bc554d1-6739-430f-b728-4d4a0b7a83a1'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:56.242300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d69617b-8459-4d75-aae3-6339871fbb98 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:56.243949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d69617b-8459-4d75-aae3-6339871fbb98 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:56.244915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0d69617b-8459-4d75-aae3-6339871fbb98 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:56.246320 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] Routers {'78413ccb-dcd3-4839-aa79-4f283250f59b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:02:56.247477 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['78413ccb-dcd3-4839-aa79-4f283250f59b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:56.250434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=12fb8c8a-8922-4cf4-8a5b-9cc5156bde28,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:56.255297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:56.256275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.257263 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.5248423 Nov 24 14:02:56.261490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44454) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.270209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '12fb8c8a-8922-4cf4-8a5b-9cc5156bde28', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:56.280130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:56.284927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:56.289880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:56.298948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:56.322467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.339606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0d69617b-8459-4d75-aae3-6339871fbb98 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:56.343864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44458) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.344020 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0d69617b-8459-4d75-aae3-6339871fbb98 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2444999 Nov 24 14:02:56.369489 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:02:56.369936 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24611c62-2fa9-4fb9-a7b2-7fa080059b98 None None] The sync data for ids ['78413ccb-dcd3-4839-aa79-4f283250f59b'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:02:56.423308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.429404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.432046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66bef3c4-3d0d-4521-8574-5969b0e80ddc tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:56.465319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f2bd060c-f497-487d-a195-ddf444e2253d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:56.470737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:56.489262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.492128 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2291274 Nov 24 14:02:56.495105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44462) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.539857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f4ca72d3-b513-4228-8e7d-0096cc69fc13 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:02:56.541505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.546363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.561916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.573385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82c901c4-189b-4c9f-8606-6a7558cd37f5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '9a200a16-41b8-4533-8fbe-6c6901bb8703'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:56.574211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82c901c4-189b-4c9f-8606-6a7558cd37f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.601275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.603523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2eaed393-e9f7-402f-b144-6501c4fce672 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:56.618924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.620361 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/f2bd060c-f497-487d-a195-ddf444e2253d HTTP/1.1" status: 204 len: 168 time: 0.1237288 Nov 24 14:02:56.622801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44466) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.625760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=f2bd060c-f497-487d-a195-ddf444e2253d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:56.655916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:56.677805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7d0b389c-35e4-4ba8-a7ac-c4bb0f14ba6e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:56.697107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7d0b389c-35e4-4ba8-a7ac-c4bb0f14ba6e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:56.699166 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7d0b389c-35e4-4ba8-a7ac-c4bb0f14ba6e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.0747595 Nov 24 14:02:56.701364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44470) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.708176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 9a200a16-41b8-4533-8fbe-6c6901bb8703 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:02:56.725102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.776208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.804702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.857231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.864046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.869179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:56.886007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=12fb8c8a-8922-4cf4-8a5b-9cc5156bde28,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:56.886748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cdf5a8ab-0770-4771-a161-c8532e5b3625 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:02:56.888508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:56.910616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.912204 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/12fb8c8a-8922-4cf4-8a5b-9cc5156bde28 HTTP/1.1" status: 204 len: 168 time: 0.2097435 Nov 24 14:02:56.914785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:56.923484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.938437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: cdf5a8ab-0770-4771-a161-c8532e5b3625 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:02:56.938437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cdf5a8ab-0770-4771-a161-c8532e5b3625 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:02:56.973176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6dc8dd0e-8653-480a-b52b-a844146ef0be tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:56.988070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6dc8dd0e-8653-480a-b52b-a844146ef0be tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:56.988263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:56.989441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6dc8dd0e-8653-480a-b52b-a844146ef0be tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0726030 Nov 24 14:02:56.996442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:57.002060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--750798975'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:57.009361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:57.019255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:57.028819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.066214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:57.070906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:57.074024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:57.079783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:57.148686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.154940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.160315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5cde687d-ce40-4a79-8353-a0c61952e4b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:57.298484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b21214cb-0c7b-4988-8a6d-8d032a101206,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:57.305804 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d4889a5e-e15f-4eae-b00f-2944babd2a2b req-3e939dac-8be0-4852-a2d3-7f009bf6cccf tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 210 time: 0.0548470 Nov 24 14:02:57.306918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:57.315438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.316771 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.3193660 Nov 24 14:02:57.320852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44484) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:57.327212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': 'b21214cb-0c7b-4988-8a6d-8d032a101206', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:57.331034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server [None req-82c901c4-189b-4c9f-8606-6a7558cd37f5 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9a200a16-41b8-4533-8fbe-6c6901bb8703: This subnet is being modified by another concurrent operation. Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 274, in create_dhcp_port Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 99, in _port_action Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 335, in create_port Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 685, in inner Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1423, in create_port Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1390, in _create_port_db Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1440, in create_port_db Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 669, in _ipam_get_subnets Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise exception Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9a200a16-41b8-4533-8fbe-6c6901bb8703: This subnet is being modified by another concurrent operation. Nov 24 14:02:57.337183 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Nov 24 14:02:57.352312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa62aa32-4d9c-48fc-9895-1db154278bf8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:57.353878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:57.363344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:57.363513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1366ef1e-e829-41d1-a77b-aa7b9f348b43 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:02:57.366196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:57.381926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:57.383792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=9a200a16-41b8-4533-8fbe-6c6901bb8703,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:57.387239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:57.399214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-3d6d5a3f-954c-45b8-8b4e-7a941ab6074a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:57.400681 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-3d6d5a3f-954c-45b8-8b4e-7a941ab6074a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.47 "GET /v2.0/networks?id=99ebbc60-aad0-4014-a19e-55e6165ad0ef HTTP/1.1" status: 200 len: 812 time: 0.2153223 Nov 24 14:02:57.415884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.443888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Request body: {'port': {'device_id': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef', 'admin_state_up': True, 'tenant_id': 'd8f8b834cdff4f678fb27b967b7aa48b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:57.494973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1366ef1e-e829-41d1-a77b-aa7b9f348b43 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:02:57.598458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.666955 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/9a200a16-41b8-4533-8fbe-6c6901bb8703 HTTP/1.1" status: 204 len: 168 time: 1.3212900 Nov 24 14:02:57.672565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44488) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:57.737440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.748239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.753008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-00676ff6-3704-4189-99dc-eb2a2bb3bfcb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:57.766940 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-29a162b0-5475-418d-84d0-e8e2c32476a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0896611 Nov 24 14:02:57.767182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44492) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:57.776800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:57.784593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e180a5b6-4af8-4ffb-9fba-8eb574dfbc46,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:57.791111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:57.792191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:57.800142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Usage tracker for resource:port and tenant:d8f8b834cdff4f678fb27b967b7aa48b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:57.804165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:57.807418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.808610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.4869711 Nov 24 14:02:57.811933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44496) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:57.814399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:57.819672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': 'b21214cb-0c7b-4988-8a6d-8d032a101206', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:57.828969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:57.835066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:57.838643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:57.841689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Made reservation on behalf of d8f8b834cdff4f678fb27b967b7aa48b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:57.844780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.860691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:57.931198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:57.976002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:57.989377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:57.994959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:58.004300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:58.043904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:02:58.047308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.061520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.065239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.071158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:58.094548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Allocated IP 172.20.0.4 (99ebbc60-aad0-4014-a19e-55e6165ad0ef/81ea79c9-beb6-43bc-8036-8717cf3b026f/5556426c-12cf-49da-8d89-bede94f2996e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:58.102375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0f843e3-a91c-479e-9741-883ea95990fd,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:58.107826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:58.123580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.124777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.3118525 Nov 24 14:02:58.135781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44500) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:58.145608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': 'b21214cb-0c7b-4988-8a6d-8d032a101206', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:58.162599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:58.164986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.174301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:58.179874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:58.180065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.184310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:58.184910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.188870 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/ports/8c802b71-0e30-4f65-b7c4-544c462abe5a HTTP/1.1" status: 200 len: 911 time: 1.9723425 Nov 24 14:02:58.188870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ac4136e7-632d-474b-8811-f7bb4d35f2cf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:58.191224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:58.210626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:58.265262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=8c802b71-0e30-4f65-b7c4-544c462abe5a,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:58.269651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:58.370691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.383243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11c8dae2-4125-468e-81e1-a0c95342f7e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:58.414370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.422595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:58.426198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:58.430388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:58.431326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.439068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecd60f2e-190a-4074-b6d8-dd085416f5cb None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:02:58.465325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=338204ce-3673-456a-a63b-f11102fb7365,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:58.469430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:58.480274 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7098053 Nov 24 14:02:58.480500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44510) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:58.486040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:58.494354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:58.498729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:router and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:58.502723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:58.509810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:58.522538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.524917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.529539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-38853ec5-edd0-41d1-b600-174746d24be6 req-da958fe7-aadb-44cf-8969-566753a8d6f5 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Synchronizing usage tracker for tenant:d8f8b834cdff4f678fb27b967b7aa48b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:02:58.545649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.567107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.568729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.592066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.593926 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7d6a371b-e839-4ead-84a0-09d5f5b58326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.1116917 Nov 24 14:02:58.596897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44514) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:58.611706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-38853ec5-edd0-41d1-b600-174746d24be6 req-da958fe7-aadb-44cf-8969-566753a8d6f5 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Unset dirty status for tenant:d8f8b834cdff4f678fb27b967b7aa48b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:02:58.612786 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-38853ec5-edd0-41d1-b600-174746d24be6 req-da958fe7-aadb-44cf-8969-566753a8d6f5 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 210 time: 0.1527109 Nov 24 14:02:58.615886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.629392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.632615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:58.669549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a81220ce-e330-4b0f-8f31-f3a9226a02c1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:58.677641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:58.689425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '338204ce-3673-456a-a63b-f11102fb7365'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:02:58.690541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.751067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.816720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52a348ad-7aae-46f0-b8f3-36ee0c751373 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:58.844936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:58.846110 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.7094088 Nov 24 14:02:58.857162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44518) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:58.868906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/338204ce-3673-456a-a63b-f11102fb7365/5a35b3e2-aca4-4b3b-a422-e31a78d3d103) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:58.873167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': 'b21214cb-0c7b-4988-8a6d-8d032a101206', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:58.882719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:58.888743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:58.892594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:58.901177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:58.908564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Network 99ebbc60-aad0-4014-a19e-55e6165ad0ef is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:58.910351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Pushing event updated for resources: {'Port': ['ID=5556426c-12cf-49da-8d89-bede94f2996e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:58.914956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:58.916809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:58.919456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:59.003316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:59.003953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.028525 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5927498 Nov 24 14:02:59.034081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.049420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.091326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Request body: {'port': {'device_id': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:59.094834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.105567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Transition to ACTIVE for port object 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:59.124776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Transition to ACTIVE for port object 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:02:59.133778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.137910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5237e447-cdf1-4216-8a33-c4c3a3eb5f5f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:59.202897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.211545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:02:59.212304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Pushing event updated for resources: {'Port': ['ID=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:59.215234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:02:59.217004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:59.217724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:02:59.305415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.322613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Attempting to bind port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:02:59.322613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Attempting to bind port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:02:59.323043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Attempting to bind port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:02:59.331236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:02:59.331653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:02:59.332181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.332554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:02:59.333787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Bound port: 5a35b3e2-aca4-4b3b-a422-e31a78d3d103, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:02:59.334199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.351705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.407318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.431275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] For port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:02:59.434887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] For port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:02:59.439965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.444871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:59.472870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b1afc485-0492-4040-97aa-a2fcba48585a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:02:59.506399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0d69bae-6b50-4aa7-be2f-803bd554c3c6,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:59.516200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Pushing event updated for resources: {'Port': ['ID=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:02:59.519816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:59.549797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:02:59.572163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.576726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.7137249 Nov 24 14:02:59.576914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44522) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:02:59.590307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': 'b21214cb-0c7b-4988-8a6d-8d032a101206', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:02:59.629493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:02:59.649487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:02:59.656852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:02:59.665433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:02:59.837748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::1 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/338204ce-3673-456a-a63b-f11102fb7365/063bd813-e11a-4146-9020-57206b70de03) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:02:59.852948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:02:59.996235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851329ff-b789-4355-9787-77512bd7fcce req-335f0eee-71ce-446d-b2e9-061545df1d55 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:02:59.997617 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-851329ff-b789-4355-9787-77512bd7fcce req-335f0eee-71ce-446d-b2e9-061545df1d55 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 931 time: 0.2008295 Nov 24 14:03:00.054116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.059126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-851329ff-b789-4355-9787-77512bd7fcce req-ee6255f5-eec8-4d4c-8f03-28d0c5ae5820 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Synchronizing usage tracker for tenant:d8f8b834cdff4f678fb27b967b7aa48b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:00.103579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.110430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-851329ff-b789-4355-9787-77512bd7fcce req-ee6255f5-eec8-4d4c-8f03-28d0c5ae5820 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Unset dirty status for tenant:d8f8b834cdff4f678fb27b967b7aa48b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:00.117899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.120275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-22d009c5-1859-45c7-923f-f7a3efaa515b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:00.122755 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-851329ff-b789-4355-9787-77512bd7fcce req-ee6255f5-eec8-4d4c-8f03-28d0c5ae5820 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1133738 Nov 24 14:03:00.126786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:00.141516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 063bd813-e11a-4146-9020-57206b70de03 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:00.166356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.169749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1344186b-3711-4cf2-9ab3-64efecccd9d7,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:00.171252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fd9768b9-7aae-4a9a-ac12-f454027add70 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:00.190995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:00.196339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5556426c-12cf-49da-8d89-bede94f2996e {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:03:00.208439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.227020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:00.228454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.229814 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 709 time: 0.6518133 Nov 24 14:03:00.233384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44528) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:00.278347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Transition to ACTIVE for port object 5556426c-12cf-49da-8d89-bede94f2996e will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:00.284672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.291511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f20f20e0-1e26-45fd-9800-cc7298daf5da tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:00.296552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=063bd813-e11a-4146-9020-57206b70de03,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:00.305794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:00.316056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:00.316899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:00.322389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:00.322918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.347254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.360555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.421950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.428755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:00.455021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Pushing event updated for resources: {'Port': ['ID=5556426c-12cf-49da-8d89-bede94f2996e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:00.456388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=1344186b-3711-4cf2-9ab3-64efecccd9d7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:00.458976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.461163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:00.476289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:00.523389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.524536 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/1344186b-3711-4cf2-9ab3-64efecccd9d7 HTTP/1.1" status: 204 len: 168 time: 0.2880077 Nov 24 14:03:00.527193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44532) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:00.650688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Attempting to bind port 5556426c-12cf-49da-8d89-bede94f2996e on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:00.651194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Attempting to bind port 5556426c-12cf-49da-8d89-bede94f2996e by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '097f0e42-3015-4e27-9c16-edc8dbc9112d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:00.651194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Attempting to bind port 5556426c-12cf-49da-8d89-bede94f2996e on network 99ebbc60-aad0-4014-a19e-55e6165ad0ef {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:00.673783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Port 5556426c-12cf-49da-8d89-bede94f2996e on network 99ebbc60-aad0-4014-a19e-55e6165ad0ef not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:03:00.674102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Attempting to bind port 5556426c-12cf-49da-8d89-bede94f2996e on network 99ebbc60-aad0-4014-a19e-55e6165ad0ef {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:00.691790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 2, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:00.692110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Checking segment: {'id': '097f0e42-3015-4e27-9c16-edc8dbc9112d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:00.692500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Bound using segment: {'id': '097f0e42-3015-4e27-9c16-edc8dbc9112d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:00.693535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Bound port: 5556426c-12cf-49da-8d89-bede94f2996e, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '097f0e42-3015-4e27-9c16-edc8dbc9112d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 851, 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:00.693886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.709295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 8c802b71-0e30-4f65-b7c4-544c462abe5a {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:00.709634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.731118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7ded09b4-aa88-4935-917e-206e5504442a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:00.738085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Provisioning for port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:00.746801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Provisioning complete for port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:00.747426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.789271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7ded09b4-aa88-4935-917e-206e5504442a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:00.790595 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7ded09b4-aa88-4935-917e-206e5504442a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5151 time: 0.2625165 Nov 24 14:03:00.795225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44536) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:00.890919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.904179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.916516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.941488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] For port 5556426c-12cf-49da-8d89-bede94f2996e, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:00.950519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] For port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:00.956906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.961717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3634708b-6039-4dc2-9685-6e71c0347d71 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:00.969339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] For port 5556426c-12cf-49da-8d89-bede94f2996e, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5556426c-12cf-49da-8d89-bede94f2996e,segment=NetworkSegment(097f0e42-3015-4e27-9c16-edc8dbc9112d),segment_id=097f0e42-3015-4e27-9c16-edc8dbc9112d)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:00.982439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:00.990058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fcfd355a-9fb0-4cad-85be-1a0cd60ceecc tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:01.011436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.018544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:01.026799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.034786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.040240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.041146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.048674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d0d69bae-6b50-4aa7-be2f-803bd554c3c6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:01.053737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:01.054457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:01.088956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Pushing event updated for resources: {'Port': ['ID=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:01.089824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.093263 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/d0d69bae-6b50-4aa7-be2f-803bd554c3c6 HTTP/1.1" status: 204 len: 168 time: 0.2945704 Nov 24 14:03:01.097921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:01.098296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44540) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:01.102033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b31c8c7-4549-4642-b703-10e3246af569 None None] Provisioning for port 063bd813-e11a-4146-9020-57206b70de03 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:01.108419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b31c8c7-4549-4642-b703-10e3246af569 None None] Provisioning complete for port 063bd813-e11a-4146-9020-57206b70de03 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:01.108913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b31c8c7-4549-4642-b703-10e3246af569 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.170305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5b31c8c7-4549-4642-b703-10e3246af569 None None] Port 063bd813-e11a-4146-9020-57206b70de03 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:01.191730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.193553 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] 10.222.0.47 "PUT /v2.0/ports/5556426c-12cf-49da-8d89-bede94f2996e HTTP/1.1" status: 200 len: 1093 time: 2.1116366 Nov 24 14:03:01.223042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'tag': '5556426c-12cf-49da-8d89-bede94f2996e'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:03:01.228687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=063bd813-e11a-4146-9020-57206b70de03,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:01.228875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Pushing event updated for resources: {'Port': ['ID=5556426c-12cf-49da-8d89-bede94f2996e,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:01.234753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:01.238610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 8c802b71-0e30-4f65-b7c4-544c462abe5a owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:01.269659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:01.297446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-24250bd5-e2ea-4c0b-ad3f-75286fd9e89d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:01.333413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:01.335885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:01.474094 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'tag': '5556426c-12cf-49da-8d89-bede94f2996e', 'status': 'completed', 'code': 200} Nov 24 14:03:01.535434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-24250bd5-e2ea-4c0b-ad3f-75286fd9e89d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:01.537499 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-24250bd5-e2ea-4c0b-ad3f-75286fd9e89d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4668 time: 0.4393492 Nov 24 14:03:01.541907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44548) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:01.597230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2a18dc95-728c-4357-b710-d27d1e679b46 None None] Provisioning complete for port 063bd813-e11a-4146-9020-57206b70de03 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:01.597608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2a18dc95-728c-4357-b710-d27d1e679b46 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.631235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a2910f-7f21-4877-a8a0-46bccc331fdd req-b34b0dfb-a97b-4945-897d-1e8f33e5e16b tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:01.633392 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10a2910f-7f21-4877-a8a0-46bccc331fdd req-b34b0dfb-a97b-4945-897d-1e8f33e5e16b tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 943 time: 0.3291454 Nov 24 14:03:01.636172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.650200 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-4ef90659-ccb7-4a14-9748-372026a87dd2 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d8f8b834cdff4f678fb27b967b7aa48b&device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 1096 time: 0.3792431 Nov 24 14:03:01.668407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2a18dc95-728c-4357-b710-d27d1e679b46 None None] Port 063bd813-e11a-4146-9020-57206b70de03 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:01.669954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.799693 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-6377067a-caae-4cc7-a599-c3dd839f7474 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5556426c-12cf-49da-8d89-bede94f2996e HTTP/1.1" status: 200 len: 217 time: 0.1211514 Nov 24 14:03:01.847967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:03:01.854421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.867201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-253ff110-b3d7-4e61-ad65-cb550613e3ec tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:01.881991 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10a2910f-7f21-4877-a8a0-46bccc331fdd req-1017162c-1a93-42e2-b7fc-3425d1025764 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2303157 Nov 24 14:03:01.892376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a81220ce-e330-4b0f-8f31-f3a9226a02c1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:01.906548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:01.921635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:01.925759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fa977a2-6751-4a83-a3ca-465a997bcc1d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:01.928000 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-9fa977a2-6751-4a83-a3ca-465a997bcc1d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=81ea79c9-beb6-43bc-8036-8717cf3b026f HTTP/1.1" status: 200 len: 852 time: 0.1173260 Nov 24 14:03:01.930613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-215a7fc9-cf3f-4f17-b0de-ae50cf66fa0e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:02.005971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.007001 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/a81220ce-e330-4b0f-8f31-f3a9226a02c1 HTTP/1.1" status: 204 len: 168 time: 0.4540696 Nov 24 14:03:02.010689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44552) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.019624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-f9e5b685-61a5-4a3c-a5e2-97d45f01c2d8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=99ebbc60-aad0-4014-a19e-55e6165ad0ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0583718 Nov 24 14:03:02.020447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=8c802b71-0e30-4f65-b7c4-544c462abe5a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:02.024143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:02.067687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:02.080898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Sync routers for ids ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:02.092799 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8e653e9e-1681-40ef-a65e-a12fed983519 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4185 time: 0.0785747 Nov 24 14:03:02.095726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "PUT /v2.0/routers/4e21ef91-d38d-4172-a98f-e6ab3fadcbcb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4972003 Nov 24 14:03:02.098580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44556) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.100260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.106667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Routers {'4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:02.107696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:02.182457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:02.183094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.204733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.224573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa020019-efcd-4f89-8e37-e7778214a567 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:02.225172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fa020019-efcd-4f89-8e37-e7778214a567 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:02.252131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fa020019-efcd-4f89-8e37-e7778214a567 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:02.256611 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fa020019-efcd-4f89-8e37-e7778214a567 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports/063bd813-e11a-4146-9020-57206b70de03 HTTP/1.1" status: 200 len: 911 time: 0.1507885 Nov 24 14:03:02.256611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.264343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44564) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.265054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:02.268792 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-58920c9f-7660-4add-89b3-a798e6879983 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2116294 Nov 24 14:03:02.328289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e0f843e3-a91c-479e-9741-883ea95990fd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:02.331536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:02.332409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.334837 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/e0f843e3-a91c-479e-9741-883ea95990fd HTTP/1.1" status: 204 len: 168 time: 0.2333682 Nov 24 14:03:02.337142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44568) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.436585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1cbedd24-b89d-4f21-ac09-fa0a6ea1f4b4 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:02.447004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.452463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c428cce0-2b7c-4395-a56d-adf327a62a4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:02.456810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c428cce0-2b7c-4395-a56d-adf327a62a4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:02.458908 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c428cce0-2b7c-4395-a56d-adf327a62a4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1860116 Nov 24 14:03:02.463811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44572) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.464677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Set router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:02.470646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1cbedd24-b89d-4f21-ac09-fa0a6ea1f4b4 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:02.474699 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1cbedd24-b89d-4f21-ac09-fa0a6ea1f4b4 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3702 time: 0.1310570 Nov 24 14:03:02.475268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44576) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.507795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.520098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.528832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:02.529221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.546990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.550241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:02.569281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e180a5b6-4af8-4ffb-9fba-8eb574dfbc46,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:02.572115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:02.578873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.582805 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/e180a5b6-4af8-4ffb-9fba-8eb574dfbc46 HTTP/1.1" status: 204 len: 168 time: 0.1062040 Nov 24 14:03:02.584002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44580) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.639064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2dabdcb3-3007-4bb6-af18-e355acb6666a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:02.659371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2dabdcb3-3007-4bb6-af18-e355acb6666a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:02.665150 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2dabdcb3-3007-4bb6-af18-e355acb6666a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.0790210 Nov 24 14:03:02.665396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44584) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.731602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.733652 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-768bd296-2c5b-4b87-b6f8-09bc840ef2a6 req-67410d8c-9789-4100-84ad-fe16c2981e52 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4565799 Nov 24 14:03:02.764738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.815830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.821548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5582c27b-5096-4271-a145-3cf2db93d426 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:02.848226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b21214cb-0c7b-4988-8a6d-8d032a101206,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:02.853032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:02.874238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:02.877973 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/b21214cb-0c7b-4988-8a6d-8d032a101206 HTTP/1.1" status: 204 len: 168 time: 0.2092133 Nov 24 14:03:02.878835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44588) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.926377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:58Z', 'updated_at': '2021-11-24T14:03:00Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None, '_interfaces': [{'id': '063bd813-e11a-4146-9020-57206b70de03', 'name': '', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'mac_address': 'fa:16:3e:b5:8f:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '338204ce-3673-456a-a63b-f11102fb7365', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:59Z', 'updated_at': '2021-11-24T14:03:00Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'subnets': [{'id': '338204ce-3673-456a-a63b-f11102fb7365', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:02.934199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Checking router: 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:02.934709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Updating router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb port 063bd813-e11a-4146-9020-57206b70de03 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:02.948533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f310b757-0caa-4c6a-ad60-d6b609130256 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:02.966341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f310b757-0caa-4c6a-ad60-d6b609130256 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:02.967635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f310b757-0caa-4c6a-ad60-d6b609130256 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0878477 Nov 24 14:03:02.974449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:02.979386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--1340839770'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:02.986516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:02.997809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:03.007854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.011282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.091956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:03.102499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:03.105856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:03.116038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:03.159937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7942dac0-fee8-4c1b-bec1-8ce751b9abee req-01647c85-9871-4a11-998b-88d2c2f47a1c tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:03.161929 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7942dac0-fee8-4c1b-bec1-8ce751b9abee req-01647c85-9871-4a11-998b-88d2c2f47a1c tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 943 time: 0.1157513 Nov 24 14:03:03.168046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e48b568-002c-4aed-9aac-b251f28bac57 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.266042 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7942dac0-fee8-4c1b-bec1-8ce751b9abee req-31728e3a-6d87-4f99-9489-4490f2f3b2c9 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761979 Nov 24 14:03:03.269860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.281603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.287400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a12ee77f-f089-4956-8e7d-333f584e8b9a tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:03.335926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1add8073-2f89-4878-9185-59b84064000c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:03.340299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:03.345909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.348330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.3750882 Nov 24 14:03:03.352260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:03.354322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-639ad8ec-480e-4b34-a81f-4e0472667447 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d8f8b834cdff4f678fb27b967b7aa48b&device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 1096 time: 0.4192934 Nov 24 14:03:03.360766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '1add8073-2f89-4878-9185-59b84064000c', 'direction': 'ingress', 'protocol': 17}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:03.367809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:03.372370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:03.375342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:03.382013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:03.400198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.432970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.446743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Transition to ACTIVE for port object 063bd813-e11a-4146-9020-57206b70de03 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:03.453637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 78413ccb-dcd3-4839-aa79-4f283250f59b has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:03.454916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.459266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:03.466440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.471694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.474528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:03.497753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=71c5534a-7bf7-426b-ae51-31edeb2975ce,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:03.500662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:03.530275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.532792 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-06f5ac3c-305a-4cf6-bb67-63aa310b085a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 709 time: 0.1784685 Nov 24 14:03:03.535284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44602) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:03.604842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a22a4db-fdc7-40ba-b822-f7d831fe429f None None] Pushing event updated for resources: {'Port': ['ID=063bd813-e11a-4146-9020-57206b70de03,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:03.607050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9a22a4db-fdc7-40ba-b822-f7d831fe429f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:03.625420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-ad9bca13-863b-4c14-888f-ae035a3198f8 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:03.627137 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-ad9bca13-863b-4c14-888f-ae035a3198f8 service neutron] 10.222.0.47 "GET /v2.0/networks?id=99ebbc60-aad0-4014-a19e-55e6165ad0ef HTTP/1.1" status: 200 len: 913 time: 0.2654448 Nov 24 14:03:03.627524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.637335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.664735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.727944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.735351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4062ab4d-66fd-4d61-b348-9186f55cae83 tempest-RoutersIpV6AdminTest-943645948 tempest-RoutersIpV6AdminTest-943645948-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:03.755982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1add8073-2f89-4878-9185-59b84064000c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:03.763161 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-adda7252-598b-41bc-a2c9-d737d2080713 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5556426c-12cf-49da-8d89-bede94f2996e HTTP/1.1" status: 200 len: 217 time: 0.0772471 Nov 24 14:03:03.767531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:03.779805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.781384 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/1add8073-2f89-4878-9185-59b84064000c HTTP/1.1" status: 204 len: 168 time: 0.2449305 Nov 24 14:03:03.783808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44606) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:03.787332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Attempting to bind port 063bd813-e11a-4146-9020-57206b70de03 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:03.787714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Attempting to bind port 063bd813-e11a-4146-9020-57206b70de03 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:03.788111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Attempting to bind port 063bd813-e11a-4146-9020-57206b70de03 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:03.799712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:03.800169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:03.800519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.800905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:03.801371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Bound port: 063bd813-e11a-4146-9020-57206b70de03, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:03.801745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.846942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-415b4535-207f-4b7d-90b4-7496711545a8 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:03.867527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-415b4535-207f-4b7d-90b4-7496711545a8 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:03.874198 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-415b4535-207f-4b7d-90b4-7496711545a8 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0858765 Nov 24 14:03:03.874786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44610) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:03.880969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--1446489238'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:03.888019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:03.892472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:03.894731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-ba9e0d5f-2740-434f-babc-1fdc9031cdff service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:03.896268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-ba9e0d5f-2740-434f-babc-1fdc9031cdff service neutron] 10.222.0.47 "GET /v2.0/subnets?id=81ea79c9-beb6-43bc-8036-8717cf3b026f HTTP/1.1" status: 200 len: 852 time: 0.1241395 Nov 24 14:03:03.900705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:03.903800 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/78413ccb-dcd3-4839-aa79-4f283250f59b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7093923 Nov 24 14:03:03.905017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44614) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:03.906361 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] Sync routers for ids ['78413ccb-dcd3-4839-aa79-4f283250f59b'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:03.909162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] For port 063bd813-e11a-4146-9020-57206b70de03, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:03.913416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] For port 063bd813-e11a-4146-9020-57206b70de03, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063bd813-e11a-4146-9020-57206b70de03,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:03.918292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.923497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] Routers {'78413ccb-dcd3-4839-aa79-4f283250f59b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:03.924142 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['78413ccb-dcd3-4839-aa79-4f283250f59b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:03.932773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:03.962768 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1214946f-cd57-4bd4-88e1-ef9057e77ad2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=78413ccb-dcd3-4839-aa79-4f283250f59b HTTP/1.1" status: 200 len: 205 time: 0.0564682 Nov 24 14:03:03.964480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:03.969972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44618) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:03.985073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-8b6ad5c9-cf4c-48f4-9b6c-58ee6c26c829 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=99ebbc60-aad0-4014-a19e-55e6165ad0ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0724111 Nov 24 14:03:03.990525 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:04.002016 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] Routers {'78413ccb-dcd3-4839-aa79-4f283250f59b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:04.002628 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['78413ccb-dcd3-4839-aa79-4f283250f59b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:04.021404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:04.031830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:04.035709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:04.042743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:04.046989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Routers {'4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:04.048462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:04.086856 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:04.087276 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ee8f435-06aa-4055-9856-acad77cbdb6d None None] The sync data for ids ['78413ccb-dcd3-4839-aa79-4f283250f59b'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:04.123742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.136983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.142142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d50c5ccf-ef6e-4bf3-b4ad-96b11d57c5bf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:04.189849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0bc16b6c-b6e7-436f-a76e-d431210ac6ee,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:04.207399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:04.219969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a22a4db-fdc7-40ba-b822-f7d831fe429f None None] Pushing event updated for resources: {'Port': ['ID=063bd813-e11a-4146-9020-57206b70de03,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:04.224523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9a22a4db-fdc7-40ba-b822-f7d831fe429f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:04.234820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.236791 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.3603137 Nov 24 14:03:04.239098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44622) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:04.249805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--1842323226'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:04.260430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:04.265270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] Set router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:04.267245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:04.272666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:04.281960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:04.321907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.377784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:04.383554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:04.387160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:04.394282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:04.412338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.460091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.464541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.468454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-88e9d665-95b9-4582-8482-1cdac18b59a1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:04.511726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=459c1dc9-58ca-46ef-bd29-32ead2e3eb0b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:04.516467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:04.524885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.529007 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.2847073 Nov 24 14:03:04.529355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:04.535216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '0bc16b6c-b6e7-436f-a76e-d431210ac6ee', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': '459c1dc9-58ca-46ef-bd29-32ead2e3eb0b', 'remote_ip_prefix': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:04.542024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:04.547399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:04.550195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:04.557233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:04.586336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.648407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-f75039c0-52d0-4232-8fc0-ffefc0acefd6 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5178401 Nov 24 14:03:04.673560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:58Z', 'updated_at': '2021-11-24T14:03:00Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None, '_interfaces': [{'id': '063bd813-e11a-4146-9020-57206b70de03', 'name': '', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'mac_address': 'fa:16:3e:b5:8f:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '338204ce-3673-456a-a63b-f11102fb7365', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:59Z', 'updated_at': '2021-11-24T14:03:03Z', 'revision_number': 4, 'project_id': '303f30b20dd547718e1105de03480ea7', 'subnets': [{'id': '338204ce-3673-456a-a63b-f11102fb7365', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:04.679253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97ee4e57-8066-4b2e-a003-fff0f196d0f1 None None] The sync data for ids ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'] in dv-neutron-818151-2-hyperv is: [{'id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:58Z', 'updated_at': '2021-11-24T14:03:00Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None, '_interfaces': [{'id': '063bd813-e11a-4146-9020-57206b70de03', 'name': '', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'mac_address': 'fa:16:3e:b5:8f:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '338204ce-3673-456a-a63b-f11102fb7365', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:59Z', 'updated_at': '2021-11-24T14:03:03Z', 'revision_number': 4, 'project_id': '303f30b20dd547718e1105de03480ea7', 'subnets': [{'id': '338204ce-3673-456a-a63b-f11102fb7365', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:04.785730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.791971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.794288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:04.816050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a62c4644-683e-4be6-b3a9-b342615c51df,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:04.821339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:04.833878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.838728 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 740 time: 0.3049326 Nov 24 14:03:04.839039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44632) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:04.888147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.898890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.932982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.936082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee80eda6-6a16-4b15-aa1e-202f57203918 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:04.955808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a62c4644-683e-4be6-b3a9-b342615c51df,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:04.965202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:04.966771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:04.969052 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/a62c4644-683e-4be6-b3a9-b342615c51df HTTP/1.1" status: 204 len: 168 time: 0.1288068 Nov 24 14:03:04.970032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44636) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.027163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5de94012-446d-4f49-8f87-53365e37838a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:05.044685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5de94012-446d-4f49-8f87-53365e37838a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:05.048792 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5de94012-446d-4f49-8f87-53365e37838a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4195 time: 0.0749509 Nov 24 14:03:05.048955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44640) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.076432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33053e36-b885-43f4-99fc-6c00f1126bc5 req-b622148e-08e4-4cd3-8099-4b924d0e0b5b tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:05.077965 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-33053e36-b885-43f4-99fc-6c00f1126bc5 req-b622148e-08e4-4cd3-8099-4b924d0e0b5b tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 943 time: 0.6028178 Nov 24 14:03:05.133405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.164155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.220845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.222317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.224587 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6df5839a-9fbd-4a61-8406-67fbdbe5f3bd req-2c4a782e-f3cb-45cc-939e-23f74d0c20f2 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5678520 Nov 24 14:03:05.238412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2d58a6ce-3dc1-40c2-be96-135337162376 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:05.240253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.260117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=459c1dc9-58ca-46ef-bd29-32ead2e3eb0b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:05.273258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.273767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.274241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.274819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.275251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.275730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.276313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.276788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.277214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.277672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.278136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:05.290437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.290832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:05.304865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.308291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/459c1dc9-58ca-46ef-bd29-32ead2e3eb0b HTTP/1.1" status: 204 len: 168 time: 0.2583225 Nov 24 14:03:05.311480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44644) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.378408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-33053e36-b885-43f4-99fc-6c00f1126bc5 req-e7443728-5b67-4288-a115-bd9e85535f1a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2824550 Nov 24 14:03:05.389540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fe5ae3a8-df97-49ed-aa23-77a8114a58a6 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:05.412071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fe5ae3a8-df97-49ed-aa23-77a8114a58a6 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:05.413478 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fe5ae3a8-df97-49ed-aa23-77a8114a58a6 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4007 time: 0.1010222 Nov 24 14:03:05.416520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44648) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.431962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.432708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router 78413ccb-dcd3-4839-aa79-4f283250f59b {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:03:05.452974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.454051 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-05ab7de4-cc39-4847-980d-fe5f90be07b6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/78413ccb-dcd3-4839-aa79-4f283250f59b HTTP/1.1" status: 204 len: 168 time: 1.4722252 Nov 24 14:03:05.456657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44652) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.489065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.516586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.564210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.570001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-375fb426-3229-469f-a7c1-bb35865d1883 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:05.586402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bc16b6c-b6e7-436f-a76e-d431210ac6ee,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:05.589928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:05.602289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.606346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/0bc16b6c-b6e7-436f-a76e-d431210ac6ee HTTP/1.1" status: 204 len: 168 time: 0.1888444 Nov 24 14:03:05.607049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44656) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.664157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-46f904b9-641e-44ba-be77-1587174906e7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:05.680177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-46f904b9-641e-44ba-be77-1587174906e7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:05.681304 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-46f904b9-641e-44ba-be77-1587174906e7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0732276 Nov 24 14:03:05.685638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44660) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.691604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--676970212'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:05.699981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:05.711517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:05.721652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-02a13176-7ba9-4447-80b7-f3e8e6f5a8f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.722514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.764027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:05.768321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:05.773034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:05.780198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:05.844800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.850392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.854644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fc692699-94e7-4840-826e-ecb4caade3b9 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:05.904019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3bb11dde-b9c0-4f16-8571-79ec7beada8c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:05.909054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:05.915530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.917253 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.2304688 Nov 24 14:03:05.920012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44664) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:05.925615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '3bb11dde-b9c0-4f16-8571-79ec7beada8c', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:05.932335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:05.936314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:05.939159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:05.940216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet 4bc554d1-6739-430f-b728-4d4a0b7a83a1 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:05.945064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.945558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:05.966888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5556426c-12cf-49da-8d89-bede94f2996e details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:03:05.967164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:05.977909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 063bd813-e11a-4146-9020-57206b70de03 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:05.978243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.043285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.048611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.050295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.053299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f3615bd-79c1-43a2-8e9d-52d72a189713 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:06.101754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03e230a3-4f17-4a24-98b9-e47570d6a4d3,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:06.104667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:06.108403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.111804 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 717 time: 0.1887884 Nov 24 14:03:06.113152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44668) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:06.166549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063bd813-e11a-4146-9020-57206b70de03 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:06.221886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5556426c-12cf-49da-8d89-bede94f2996e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5556426c-12cf-49da-8d89-bede94f2996e,segment=NetworkSegment(097f0e42-3015-4e27-9c16-edc8dbc9112d),segment_id=097f0e42-3015-4e27-9c16-edc8dbc9112d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:06.237126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.247870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '5556426c-12cf-49da-8d89-bede94f2996e', 'network_id': '99ebbc60-aad0-4014-a19e-55e6165ad0ef', 'port_id': '5556426c-12cf-49da-8d89-bede94f2996e', 'mac_address': 'fa:16:3e:1d:96:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 851, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '81ea79c9-beb6-43bc-8036-8717cf3b026f', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:03:06.254560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.309786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 063bd813-e11a-4146-9020-57206b70de03 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:06.311773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 063bd813-e11a-4146-9020-57206b70de03, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063bd813-e11a-4146-9020-57206b70de03,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:06.312140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.315225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.324263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.329357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 063bd813-e11a-4146-9020-57206b70de03 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:06.329734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.372393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5556426c-12cf-49da-8d89-bede94f2996e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:03:06.405936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5556426c-12cf-49da-8d89-bede94f2996e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5556426c-12cf-49da-8d89-bede94f2996e,segment=NetworkSegment(097f0e42-3015-4e27-9c16-edc8dbc9112d),segment_id=097f0e42-3015-4e27-9c16-edc8dbc9112d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:06.409780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.412011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc7bc0d3-fddd-4870-8527-3120d12c5814 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:06.418500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.421474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9a22a4db-fdc7-40ba-b822-f7d831fe429f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:06.491705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 063bd813-e11a-4146-9020-57206b70de03 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:06.520468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=03e230a3-4f17-4a24-98b9-e47570d6a4d3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:06.537806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.547945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=5556426c-12cf-49da-8d89-bede94f2996e,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:06.553593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:06.556437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.557535 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/03e230a3-4f17-4a24-98b9-e47570d6a4d3 HTTP/1.1" status: 204 len: 168 time: 0.4434488 Nov 24 14:03:06.564006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44674) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:06.567104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.568083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.568540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.568916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.569278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.569636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.569989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.570341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.570700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.571073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.571429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:06.582030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:06.590051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 063bd813-e11a-4146-9020-57206b70de03, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063bd813-e11a-4146-9020-57206b70de03,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:06.594391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.598986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e4b0b948-5395-4bb1-9384-640d7580d3fd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:06.637784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9456284b-5436-440b-9876-6fbd0bf91905 req-feaf94a2-6426-4fc2-a96d-839382192805 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:06.644009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.644222 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9456284b-5436-440b-9876-6fbd0bf91905 req-feaf94a2-6426-4fc2-a96d-839382192805 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 944 time: 0.1311719 Nov 24 14:03:06.653881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-117729e9-7da6-4f62-af5f-2833f161bb62 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:06.688414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.691027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=063bd813-e11a-4146-9020-57206b70de03,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:06.695740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:06.697035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=4bc554d1-6739-430f-b728-4d4a0b7a83a1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:06.700370 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9456284b-5436-440b-9876-6fbd0bf91905 req-c6270e97-4504-4800-ad98-e9fc3499f991 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554023 Nov 24 14:03:06.705700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:06.716615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c5deb6bb-033b-4f74-bce2-9925104082f8 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:06.720105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.721857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32071b69-cdea-41a7-baed-f78534292823 None None] Network c4645f89-6df9-4781-b4d9-dcff31f16cbe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:06.736686 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/4bc554d1-6739-430f-b728-4d4a0b7a83a1 HTTP/1.1" status: 204 len: 168 time: 1.2790692 Nov 24 14:03:06.740092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44678) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:06.778572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c5deb6bb-033b-4f74-bce2-9925104082f8 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:06.779731 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c5deb6bb-033b-4f74-bce2-9925104082f8 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.2147923 Nov 24 14:03:06.783153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44682) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:06.820433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['5556426c-12cf-49da-8d89-bede94f2996e'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:03:06.826292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:03:06.826614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:03:06.851725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.864301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.876867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port f4ca72d3-b513-4228-8e7d-0096cc69fc13 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:06.877481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.883707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.936953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.941964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c4e97538-ecb8-44a6-8aee-04012a7d681d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:06.957247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3bb11dde-b9c0-4f16-8571-79ec7beada8c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:06.961904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:06.974832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:06.975999 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/3bb11dde-b9c0-4f16-8571-79ec7beada8c HTTP/1.1" status: 204 len: 168 time: 0.1915603 Nov 24 14:03:06.978582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44686) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.041769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50600767-58f3-42bf-ae76-cc1e1007bd73 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:07.058792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50600767-58f3-42bf-ae76-cc1e1007bd73 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:07.063816 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50600767-58f3-42bf-ae76-cc1e1007bd73 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0805821 Nov 24 14:03:07.064616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44690) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.069984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group': {'name': 'tempest-secgroup--171819650'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:07.080617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:07.091875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:07.104156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.118422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port f4ca72d3-b513-4228-8e7d-0096cc69fc13, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f4ca72d3-b513-4228-8e7d-0096cc69fc13,segment=NetworkSegment(dedfc71b-93e5-4054-a2b1-7c8907526c28),segment_id=dedfc71b-93e5-4054-a2b1-7c8907526c28)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:07.118945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.143040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:07.147061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:07.150188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:07.157586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:07.199599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] DHCP port deletion for c4645f89-6df9-4781-b4d9-dcff31f16cbe request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:03:07.204027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Deleting port f4ca72d3-b513-4228-8e7d-0096cc69fc13 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:07.204602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.217739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.224062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.228191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9eb3ad7e-b2bb-40c0-847a-a5dc82665149 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:07.259227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2ac7ca56-9830-4fb7-8b68-5f2eafde314d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:07.259635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for f4ca72d3-b513-4228-8e7d-0096cc69fc13 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:07.266626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:07.291060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.293159 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.2277746 Nov 24 14:03:07.295800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44694) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.304244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '2ac7ca56-9830-4fb7-8b68-5f2eafde314d', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:07.311506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:07.315898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Usage tracker for resource:security_group_rule and tenant:8dac07a31711463c9b4f03734e56dddb is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:07.318921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:07.325240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:07.338462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 063bd813-e11a-4146-9020-57206b70de03 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:07.338803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.344085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.387778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.393820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2dde728-80d3-4697-b6a0-683f7a3e1e09 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:07.410485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.415071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.417245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e1ff7637-ef21-4822-9672-a57e3bdb642c tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:07.443072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] For port f4ca72d3-b513-4228-8e7d-0096cc69fc13, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f4ca72d3-b513-4228-8e7d-0096cc69fc13,segment=NetworkSegment(dedfc71b-93e5-4054-a2b1-7c8907526c28),segment_id=dedfc71b-93e5-4054-a2b1-7c8907526c28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:07.443572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.452439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.456208 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1566956 Nov 24 14:03:07.456208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=475885b5-94bc-47cf-b629-6d6f7964ddef,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:07.456412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44698) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.459867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:07.463842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=f4ca72d3-b513-4228-8e7d-0096cc69fc13,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:07.470391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:07.476440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No DVR routers for this DVR port f4ca72d3-b513-4228-8e7d-0096cc69fc13 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:07.484435 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-99ea22ec-5e91-411b-8c6f-9fcbd8f459c9 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules/475885b5-94bc-47cf-b629-6d6f7964ddef HTTP/1.1" status: 200 len: 705 time: 0.0245929 Nov 24 14:03:07.484674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44702) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.540037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f998392c-a376-4dae-9612-c33aa3f4b297 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:07.557973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f998392c-a376-4dae-9612-c33aa3f4b297 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:07.562388 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f998392c-a376-4dae-9612-c33aa3f4b297 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3707 time: 0.0738885 Nov 24 14:03:07.562984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44706) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.585644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Calling delete_port for f4ca72d3-b513-4228-8e7d-0096cc69fc13 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:07.595857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.607633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.636325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.644379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:07.658627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=475885b5-94bc-47cf-b629-6d6f7964ddef,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:07.661461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:07.664550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:03:07.665229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:03:07.667727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.671356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/475885b5-94bc-47cf-b629-6d6f7964ddef HTTP/1.1" status: 204 len: 168 time: 0.1051321 Nov 24 14:03:07.671718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44710) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.721882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fc6e4561-957a-42d7-8f97-182de7bfce37 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:07.741289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fc6e4561-957a-42d7-8f97-182de7bfce37 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:07.745270 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fc6e4561-957a-42d7-8f97-182de7bfce37 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.0698383 Nov 24 14:03:07.745743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44716) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.751330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '2ac7ca56-9830-4fb7-8b68-5f2eafde314d', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:07.757891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:07.768105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:07.787485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.799571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.851348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.855299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.857222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:07.879425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0eab5b71-8263-4fe0-a2b5-bdd6c08620e6,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:07.882611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:07.894748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.896742 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1500623 Nov 24 14:03:07.897534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c4645f89-6df9-4781-b4d9-dcff31f16cbe']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:07.899923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44720) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.906617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 063bd813-e11a-4146-9020-57206b70de03, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=063bd813-e11a-4146-9020-57206b70de03,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:07.906976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:07.921765 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8ae0b75c-27a4-440c-9bcf-6c58520394d7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules/0eab5b71-8263-4fe0-a2b5-bdd6c08620e6 HTTP/1.1" status: 200 len: 705 time: 0.0206885 Nov 24 14:03:07.924273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44724) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:07.971146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9ec5c823-8304-449a-a241-684e32d17a27 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:07.977184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dedfc71b-93e5-4054-a2b1-7c8907526c28') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:07.977501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dedfc71b-93e5-4054-a2b1-7c8907526c28') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:07.978932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5556426c-12cf-49da-8d89-bede94f2996e up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:07.987220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9ec5c823-8304-449a-a241-684e32d17a27 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:07.992120 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9ec5c823-8304-449a-a241-684e32d17a27 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3707 time: 0.0633163 Nov 24 14:03:07.992389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44728) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.025454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.041398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.047107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 063bd813-e11a-4146-9020-57206b70de03 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:08.058789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 5556426c-12cf-49da-8d89-bede94f2996e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:08.071495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 5556426c-12cf-49da-8d89-bede94f2996e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:08.072020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.075476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.077561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6dd69d98-ffde-4a4c-897b-3133eceed95a tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:08.101707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=0eab5b71-8263-4fe0-a2b5-bdd6c08620e6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:08.105290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:08.111221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.112433 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/0eab5b71-8263-4fe0-a2b5-bdd6c08620e6 HTTP/1.1" status: 204 len: 168 time: 0.1188667 Nov 24 14:03:08.116037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44732) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.117293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063bd813-e11a-4146-9020-57206b70de03 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:08.137725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.165630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5799818c-ebb3-4431-8765-c6356c6b79dc tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:08.166414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Deleting port f4ca72d3-b513-4228-8e7d-0096cc69fc13 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:08.166958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.169333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.183035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5799818c-ebb3-4431-8765-c6356c6b79dc tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:08.184511 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5799818c-ebb3-4431-8765-c6356c6b79dc tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.0669680 Nov 24 14:03:08.187214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44736) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.188369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 899 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:03:08.188771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.193512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Request body: {'security_group_rule': {'security_group_id': '2ac7ca56-9830-4fb7-8b68-5f2eafde314d', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:08.199750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:03:08.205129 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:03:08.214483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:08.236935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.278195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a318313a-3afe-43c4-8a4c-e6329827e986 None None] The port 'f4ca72d3-b513-4228-8e7d-0096cc69fc13' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:03:08.336728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.341644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.343737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:08.352493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.361438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6894d0-631e-4afe-9cb6-7898895e240b req-eef74207-ebb1-481c-b9ab-c11c45e67333 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:08.363183 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eb6894d0-631e-4afe-9cb6-7898895e240b req-eef74207-ebb1-481c-b9ab-c11c45e67333 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 944 time: 0.5204766 Nov 24 14:03:08.373185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=60f25d73-c9a5-4baf-bcce-0edbed1232a5,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:08.375878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:08.377844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d83fcb3e-be03-476a-8739-1dd09c1279e2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:08.390109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.391081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 063bd813-e11a-4146-9020-57206b70de03 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:08.391599 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2033360 Nov 24 14:03:08.394543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44740) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.394901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.415608 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2d66a127-a0f4-45a2-b952-18c6d7828fe7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules/60f25d73-c9a5-4baf-bcce-0edbed1232a5 HTTP/1.1" status: 200 len: 706 time: 0.0198700 Nov 24 14:03:08.423676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44744) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.437644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.439698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port 063bd813-e11a-4146-9020-57206b70de03 was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 14:03:08.443880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.446432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=063bd813-e11a-4146-9020-57206b70de03,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:08.450313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:08.465306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.476567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bbed9366-f456-451b-b944-73664577f065 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:08.481014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5556426c-12cf-49da-8d89-bede94f2996e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:03:08.498333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:08.500754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5556426c-12cf-49da-8d89-bede94f2996e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5556426c-12cf-49da-8d89-bede94f2996e,segment=NetworkSegment(097f0e42-3015-4e27-9c16-edc8dbc9112d),segment_id=097f0e42-3015-4e27-9c16-edc8dbc9112d)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:08.511355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.515600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2e01bbd4-49e0-4aa7-8947-ff6dd23ed655 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:08.516452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bbed9366-f456-451b-b944-73664577f065 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:08.528346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bbed9366-f456-451b-b944-73664577f065 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3708 time: 0.1077955 Nov 24 14:03:08.529270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44750) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.529397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.536960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=c4645f89-6df9-4781-b4d9-dcff31f16cbe,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:08.548855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:08.580291 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5556426c-12cf-49da-8d89-bede94f2996e', 'code': 200} Nov 24 14:03:08.584458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.590152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f4ca72d3-b513-4228-8e7d-0096cc69fc13 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:08.601466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.650107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f4ca72d3-b513-4228-8e7d-0096cc69fc13 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:08.650257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.650471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f4ca72d3-b513-4228-8e7d-0096cc69fc13 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:08.656448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:08.679726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=60f25d73-c9a5-4baf-bcce-0edbed1232a5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:08.683526 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eb6894d0-631e-4afe-9cb6-7898895e240b req-2c8c4bdb-4311-46e1-9076-77590360f8bc tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2753377 Nov 24 14:03:08.690828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:08.694441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/c4645f89-6df9-4781-b4d9-dcff31f16cbe HTTP/1.1" status: 204 len: 168 time: 1.9533606 Nov 24 14:03:08.699116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44754) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.707913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1671239507', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:08.715063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=5556426c-12cf-49da-8d89-bede94f2996e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:08.717192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:08.722371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.722892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:router and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:08.726636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:08.736113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:08.742533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.745743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.746171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.746718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.747370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.747533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.748155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.748687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.749033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.749359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.749686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.752856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.753186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:08.753608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.758243 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-group-rules/60f25d73-c9a5-4baf-bcce-0edbed1232a5 HTTP/1.1" status: 204 len: 168 time: 0.2238767 Nov 24 14:03:08.759535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44758) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.767884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:08.814382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0ce1638a-64dc-44bb-96f3-dfbd7fa21ca6 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:08.830498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.839235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0ce1638a-64dc-44bb-96f3-dfbd7fa21ca6 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group_rule {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:08.840524 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0ce1638a-64dc-44bb-96f3-dfbd7fa21ca6 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3219 time: 0.0811169 Nov 24 14:03:08.844213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44762) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.872825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.922556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.926062 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9bad711a-37a6-4a7e-aef7-1b2ec5ba45fc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.2232857 Nov 24 14:03:08.928714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44766) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:08.935877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-535677223'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:08.940921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:08.943957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:08.949942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:08.955325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:08.968750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.016174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.021413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d742cd59-38da-429b-8c26-79999fef65a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:09.024076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:09.036096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ac7ca56-9830-4fb7-8b68-5f2eafde314d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:09.045858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:09.051263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.053231 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "DELETE /v2.0/security-groups/2ac7ca56-9830-4fb7-8b68-5f2eafde314d HTTP/1.1" status: 204 len: 168 time: 0.2080379 Nov 24 14:03:09.055783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44770) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:09.111332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fc28aea-f366-4854-bc55-68a7b9d78a67 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Synchronizing usage tracker for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:09.129904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fc28aea-f366-4854-bc55-68a7b9d78a67 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Unset dirty status for tenant:8dac07a31711463c9b4f03734e56dddb on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:09.131496 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5fc28aea-f366-4854-bc55-68a7b9d78a67 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0746813 Nov 24 14:03:09.135982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44774) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:09.198107 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d9ff030f-64cb-4f19-8d74-34e18b59f7a2 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0603664 Nov 24 14:03:09.234695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:09.237579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.308162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4ecbf17-0c72-48dd-980e-3f44ccfc7cfa req-f7cb17c4-860f-489d-ae6b-e24c6ffb2523 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 1098 time: 0.4332218 Nov 24 14:03:09.402570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 853} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:03:09.433919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.434268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment 5a4f0363-fcd1-4d99-863b-a1c699da9e84 of type vlan for network fa522dda-607e-4bb3-af91-d3f819546827 Nov 24 14:03:09.454857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4ecbf17-0c72-48dd-980e-3f44ccfc7cfa req-cf127bb2-4680-46cb-851f-0226eadf544d service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1379385 Nov 24 14:03:09.474586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.485059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:09.502740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44782) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:09.564348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.568196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:09.568767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.579889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f757db34-4e48-4683-b8e1-87cf7b075d81 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:09.689215 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7495492f-db94-4b5d-9a94-a8243ec99ee3 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=8dac07a31711463c9b4f03734e56dddb&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1828604 Nov 24 14:03:09.689545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44788) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:09.742416 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.8125620 Nov 24 14:03:09.746194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44794) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:09.748513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=fa522dda-607e-4bb3-af91-d3f819546827,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:09.751559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:09.755030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.755206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:09.761867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network fa522dda-607e-4bb3-af91-d3f819546827 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:03:09.785632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.833768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:09.851952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:09.855565 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "PUT /v2.0/routers/4e21ef91-d38d-4172-a98f-e6ab3fadcbcb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3894529 Nov 24 14:03:09.855936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44798) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:09.856754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64642e24-0d8b-4c3f-89a6-f20f8d21a0bf tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:09.864640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] Sync routers for ids ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:09.892439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:09.897504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:09.900704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:09.907674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:09.912732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6efac8f-4106-4d1a-ba4e-0bb9fba0abcf,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:09.916771 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] Routers {'4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:09.917608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:09.921421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:09.927888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:09.994789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13dfc355-55fa-45dd-aec5-b63a267b90ba tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:09.996834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13dfc355-55fa-45dd-aec5-b63a267b90ba tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:09.996961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-13dfc355-55fa-45dd-aec5-b63a267b90ba tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:10.001705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.006795 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/a6efac8f-4106-4d1a-ba4e-0bb9fba0abcf HTTP/1.1" status: 204 len: 168 time: 0.3122685 Nov 24 14:03:10.050418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.061088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-13dfc355-55fa-45dd-aec5-b63a267b90ba tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:10.065629 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-13dfc355-55fa-45dd-aec5-b63a267b90ba tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.2019506 Nov 24 14:03:10.066411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44804) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:10.074825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4811cbd0-863e-49b7-b93a-d6fe34d59610 req-e9963446-b0a8-4099-bf3e-bae1445a1022 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:10.077088 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4811cbd0-863e-49b7-b93a-d6fe34d59610 req-e9963446-b0a8-4099-bf3e-bae1445a1022 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.1662459 Nov 24 14:03:10.088787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] Set router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:10.297135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:58Z', 'updated_at': '2021-11-24T14:03:08Z', 'revision_number': 3, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:10.302149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] Checking router: 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:10.315361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] Routers {'4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:10.316209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:10.336767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.343034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a3c64c57-932a-4a87-9315-1053544fbda6 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:10.387012 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4811cbd0-863e-49b7-b93a-d6fe34d59610 req-8ef17124-0e28-4ca3-aa2a-ea52021ad5bf tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2517612 Nov 24 14:03:10.426583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=ddef1ee6-c276-4b6d-b1ac-958e76e20b11,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:10.430434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:10.461880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] Set router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:10.465198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:10.465567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: fa522dda-607e-4bb3-af91-d3f819546827, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:03:10.478620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 338204ce-3673-456a-a63b-f11102fb7365 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:10.481988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.493386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network fa522dda-607e-4bb3-af91-d3f819546827 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:03:10.508610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, fa522dda-607e-4bb3-af91-d3f819546827) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:10.522762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:10.523358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.549982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8024137 Nov 24 14:03:10.553355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44814) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:10.554475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.569029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5932d006-53d5-4772-a459-7e51491e5b39 None None] Network fa522dda-607e-4bb3-af91-d3f819546827 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:10.593092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:58Z', 'updated_at': '2021-11-24T14:03:08Z', 'revision_number': 3, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:10.604362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6eb102-d901-4470-9ea7-437a0dc93aed None None] The sync data for ids ['4e21ef91-d38d-4172-a98f-e6ab3fadcbcb'] in dv-neutron-818151-2-hyperv is: [{'id': '4e21ef91-d38d-4172-a98f-e6ab3fadcbcb', 'name': 'tempest-NetworksTestDHCPv6-router-533495248', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:02:58Z', 'updated_at': '2021-11-24T14:03:08Z', 'revision_number': 3, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:10.693748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.872034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.876157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-daaeb422-76cb-4e0c-a38b-2fd7c880dfc9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:10.922548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-fa522dda-607e-4bb3-af91-d3f819546827', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:10.924693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.948230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=338204ce-3673-456a-a63b-f11102fb7365,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:10.951182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:10.962651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:10.986952 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/338204ce-3673-456a-a63b-f11102fb7365 HTTP/1.1" status: 204 len: 168 time: 0.9086401 Nov 24 14:03:10.989853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44824) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:11.022158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef2ace0f-64c1-4e10-8a38-fb0f390c21a7 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:11.264790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-04df8c82-f69c-4b34-9823-80daef0c3006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:11.288804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-04df8c82-f69c-4b34-9823-80daef0c3006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:11.290208 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-04df8c82-f69c-4b34-9823-80daef0c3006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 709 time: 0.2986710 Nov 24 14:03:11.292823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44834) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:11.382591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Allocated IP 2001:db8::2 (fa522dda-607e-4bb3-af91-d3f819546827/ddef1ee6-c276-4b6d-b1ac-958e76e20b11/5fe9a561-187e-4f27-b3c9-c2031208e0d5) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:11.453793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.461834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.596983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:03:11.636477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Deleting port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:11.636950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.757083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.780766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Transition to ACTIVE for port object 5fe9a561-187e-4f27-b3c9-c2031208e0d5 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:11.840970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Transition to ACTIVE for port object 5fe9a561-187e-4f27-b3c9-c2031208e0d5 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:11.894299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4276804a-5d0f-40ca-81de-46d0a5eb4f33 req-b2fac2f2-6ed2-4960-8e98-88c07fcc98af tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:11.896424 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4276804a-5d0f-40ca-81de-46d0a5eb4f33 req-b2fac2f2-6ed2-4960-8e98-88c07fcc98af tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.2236609 Nov 24 14:03:11.935701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.941499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.949020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.956571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] For port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:11.956964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.964955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:11.979351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:11.980181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Fanout notify agent at l3_agent the message router_deleted on router 4e21ef91-d38d-4172-a98f-e6ab3fadcbcb {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:03:12.007507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8::1 (fa522dda-607e-4bb3-af91-d3f819546827/ddef1ee6-c276-4b6d-b1ac-958e76e20b11/018b7562-3559-4086-8655-8c9a25f8b83b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:12.042515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.049421 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f85d54a7-61e7-4d70-be41-aa56eb59b326 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/routers/4e21ef91-d38d-4172-a98f-e6ab3fadcbcb HTTP/1.1" status: 204 len: 168 time: 0.7556467 Nov 24 14:03:12.050705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44850) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:12.061533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:12.092478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4276804a-5d0f-40ca-81de-46d0a5eb4f33 req-05664579-fde9-4605-afcb-5c1fa705cc2b tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1837304 Nov 24 14:03:12.285008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Calling delete_port for 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:12.313551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:12.315915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.318147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:12.321429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:12.327747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:12.334109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 018b7562-3559-4086-8655-8c9a25f8b83b will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:12.358674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:12.362160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.370058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:12.389356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:12.393519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.409361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.432709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Network fa522dda-607e-4bb3-af91-d3f819546827 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:12.437572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:12.439147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:12.439480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:12.439975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063bd813-e11a-4146-9020-57206b70de03 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:12.470545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:12.473422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=018b7562-3559-4086-8655-8c9a25f8b83b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:12.476278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] No DVR routers for this DVR port 5a35b3e2-aca4-4b3b-a422-e31a78d3d103 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:12.480003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:12.487285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Pushing event updated for resources: {'Port': ['ID=5fe9a561-187e-4f27-b3c9-c2031208e0d5,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:12.497249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.532s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:12.497865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-beb84ef6-5bae-4935-ba78-c8516da5954d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.064s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:12.502176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network fa522dda-607e-4bb3-af91-d3f819546827 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:12.505729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:12.512511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:12.513353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.528728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 063bd813-e11a-4146-9020-57206b70de03 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:12.528728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 063bd813-e11a-4146-9020-57206b70de03 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:12.571816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Pushing event deleted for resources: {'Port': ['ID=5a35b3e2-aca4-4b3b-a422-e31a78d3d103,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:12.577864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:12.627798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.640050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Attempting to bind port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:12.640560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Attempting to bind port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:12.640715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Attempting to bind port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 on network fa522dda-607e-4bb3-af91-d3f819546827 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:12.650768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:12.652317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Checking segment: {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:12.652902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.653167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Bound using segment: {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:12.653695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Bound port: 5fe9a561-187e-4f27-b3c9-c2031208e0d5, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:12.654175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.709055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44862) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:12.759176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] For port 5fe9a561-187e-4f27-b3c9-c2031208e0d5, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:12.765248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] For port 5fe9a561-187e-4f27-b3c9-c2031208e0d5, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5fe9a561-187e-4f27-b3c9-c2031208e0d5,segment=NetworkSegment(5a4f0363-fcd1-4d99-863b-a1c699da9e84),segment_id=5a4f0363-fcd1-4d99-863b-a1c699da9e84)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:12.773157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.780600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:12.825105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6089cb6b-65b5-4b2e-a4e8-4bfd8c84c103 req-eeb96470-a00b-4b60-9f50-c292c160a63a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:12.826817 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6089cb6b-65b5-4b2e-a4e8-4bfd8c84c103 req-eeb96470-a00b-4b60-9f50-c292c160a63a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.4889350 Nov 24 14:03:12.828586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.837472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2050a93-5622-452a-a96c-dd53978b6f4d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:12.892998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Pushing event updated for resources: {'Port': ['ID=5fe9a561-187e-4f27-b3c9-c2031208e0d5,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:12.896808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:12.948125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:12.957163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:12.969042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:12.969628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:12.970003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0250afbe-4199-4bae-aa73-a38a88d90335 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:12.979851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=e68f21f8-8124-451d-99a7-719e6649aeb4,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:12.988939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:13.008451 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6089cb6b-65b5-4b2e-a4e8-4bfd8c84c103 req-e4bc01f1-5dae-4a98-b845-5544c98b775a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1741970 Nov 24 14:03:13.037973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44868) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:13.039168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.9870002 Nov 24 14:03:13.042944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--1874322660', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:13.049357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:13.056117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:13.059539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:13.077051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:13.086261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:13.091675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:13.110747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:router and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:13.119799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:13.156143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:13.160921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.188981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:13.230658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.246469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.247398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.269285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.302199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'e68f21f8-8124-451d-99a7-719e6649aeb4'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:13.303221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.318242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:13.335749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:13.341450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:13.347664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.363939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:13.503379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/e68f21f8-8124-451d-99a7-719e6649aeb4/4832f4ab-6378-462d-8a74-3985955ea45a) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:13.530817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.532767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.536854 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a3b05803-346f-4492-8e93-be42dd272263 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.4961667 Nov 24 14:03:13.538365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44876) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:13.602565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.603407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.620166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-444ceda4-0ed4-4efb-ba57-2ab6df1b6ca2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:13.623951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25427940-4086-449e-9119-0b3e1ead024f req-896e9941-f093-4c7b-8c98-2ed7930af33f tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:13.625410 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-25427940-4086-449e-9119-0b3e1ead024f req-896e9941-f093-4c7b-8c98-2ed7930af33f tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.0914996 Nov 24 14:03:13.674132 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-25427940-4086-449e-9119-0b3e1ead024f req-314e01f4-d757-4c41-a591-13a176c4a4db tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420487 Nov 24 14:03:13.742675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.756757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Transition to ACTIVE for port object 4832f4ab-6378-462d-8a74-3985955ea45a will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:13.779872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Transition to ACTIVE for port object 4832f4ab-6378-462d-8a74-3985955ea45a will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:13.790896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:13.799452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:13.856279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=018b7562-3559-4086-8655-8c9a25f8b83b,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:13.859849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:13.871146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:13.874234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:13.884861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:13.897315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Pushing event updated for resources: {'Port': ['ID=4832f4ab-6378-462d-8a74-3985955ea45a,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:13.900690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:14.005358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Attempting to bind port 4832f4ab-6378-462d-8a74-3985955ea45a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:14.005991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Attempting to bind port 4832f4ab-6378-462d-8a74-3985955ea45a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:14.006101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Attempting to bind port 4832f4ab-6378-462d-8a74-3985955ea45a on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:14.013673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:14.014151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:14.014640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.015123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:14.015686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Bound port: 4832f4ab-6378-462d-8a74-3985955ea45a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:14.016163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.081549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.100343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.117348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0522014f-e98a-4d8b-a6bd-a4c22fc3f099 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:14.138305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] For port 4832f4ab-6378-462d-8a74-3985955ea45a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:14.141946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] For port 4832f4ab-6378-462d-8a74-3985955ea45a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4832f4ab-6378-462d-8a74-3985955ea45a,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:14.147102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.151575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e4f48fb9-83f6-4416-a948-d874c3304fcb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:14.171961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network fa522dda-607e-4bb3-af91-d3f819546827 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:14.178358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:14.180478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d2d9488f-e3f6-4eb6-8124-78344968d3de,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:14.185331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 875} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:03:14.219161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-980792d3-29bc-4383-8ef0-83bfc4455ad0 None None] Network fa522dda-607e-4bb3-af91-d3f819546827 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:14.346423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5fe9a561-187e-4f27-b3c9-c2031208e0d5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:14.361525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:14.495912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.496179 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment 09329ff1-fa04-43a6-bab2-843d53b31d28 of type vlan for network 1a509ac2-7dc4-4e91-864c-101a02b01959 Nov 24 14:03:14.519336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Pushing event updated for resources: {'Port': ['ID=4832f4ab-6378-462d-8a74-3985955ea45a,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:14.523580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.372s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:14.580626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Provisioning for port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:14.616460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:14.636651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Provisioning complete for port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:14.637127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.680349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:14.680832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.685353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.791627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.795994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:14.796704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.806484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:14.945016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:14.974494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.018415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] For port 5fe9a561-187e-4f27-b3c9-c2031208e0d5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5fe9a561-187e-4f27-b3c9-c2031208e0d5,segment=NetworkSegment(5a4f0363-fcd1-4d99-863b-a1c699da9e84),segment_id=5a4f0363-fcd1-4d99-863b-a1c699da9e84)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:15.026145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.028772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-052ce5ec-f136-4d1c-a331-606f7c225dce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:15.114033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 2.4010384 Nov 24 14:03:15.114930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44882) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:15.120474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-433416808', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:15.128440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:15.132966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:15.136365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:15.148800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:15.153443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:03:15.153803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:03:15.160414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Pushing event updated for resources: {'Port': ['ID=5fe9a561-187e-4f27-b3c9-c2031208e0d5,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:15.166596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=1a509ac2-7dc4-4e91-864c-101a02b01959,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:15.167390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:15.168631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.170226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.171842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.365s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:15.178364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.180504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:03:15.207584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.377725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a48d2e1d-18bf-4965-8952-01d932004edd None None] Provisioning for port 018b7562-3559-4086-8655-8c9a25f8b83b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:15.386141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a48d2e1d-18bf-4965-8952-01d932004edd None None] Provisioning complete for port 018b7562-3559-4086-8655-8c9a25f8b83b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:15.386934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a48d2e1d-18bf-4965-8952-01d932004edd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.430727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.460395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a48d2e1d-18bf-4965-8952-01d932004edd None None] Port 018b7562-3559-4086-8655-8c9a25f8b83b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:15.478641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a48d2e1d-18bf-4965-8952-01d932004edd None None] Provisioning complete for port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:15.479515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a48d2e1d-18bf-4965-8952-01d932004edd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.515341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd010d2e-f70b-4e57-9f84-3afb0b06a0b0 req-83b7c593-99d6-463f-ae9c-0f382b4d9d15 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:15.516881 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd010d2e-f70b-4e57-9f84-3afb0b06a0b0 req-83b7c593-99d6-463f-ae9c-0f382b4d9d15 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.5984440 Nov 24 14:03:15.652190 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd010d2e-f70b-4e57-9f84-3afb0b06a0b0 req-944e26a3-a556-4b79-b4f8-1a010fd63c00 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233160 Nov 24 14:03:15.701514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.748595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:15.784099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:03:15.787313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::1 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/e68f21f8-8124-451d-99a7-719e6649aeb4/1e3b7ee4-f2a8-453e-a9af-1575ce74da44) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:15.933743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0a454829-4f82-4b26-b87a-45a409d940d6 None None] Provisioning complete for port 018b7562-3559-4086-8655-8c9a25f8b83b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:15.933743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0a454829-4f82-4b26-b87a-45a409d940d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.009333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-0a454829-4f82-4b26-b87a-45a409d940d6 None None] Port 018b7562-3559-4086-8655-8c9a25f8b83b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:16.044708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.123 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/1d9688f8-d3ae-4b46-af07-c33aaa5101f5) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:16.142304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e0f27274-74a2-4c10-bcd0-d4abe8641232 None None] Provisioning complete for port 018b7562-3559-4086-8655-8c9a25f8b83b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:16.142926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e0f27274-74a2-4c10-bcd0-d4abe8641232 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.213770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e0f27274-74a2-4c10-bcd0-d4abe8641232 None None] Port 018b7562-3559-4086-8655-8c9a25f8b83b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:16.235503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e0f27274-74a2-4c10-bcd0-d4abe8641232 None None] Provisioning for port 4832f4ab-6378-462d-8a74-3985955ea45a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:16.246056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5fe9a561-187e-4f27-b3c9-c2031208e0d5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:16.252709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.269507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:16.302851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6108d35-aef8-4fc2-950d-fff4d9d2ea3a req-4cb2d56a-0ac9-48f7-b82e-352c591e6ad4 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:16.305972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.310164 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a6108d35-aef8-4fc2-950d-fff4d9d2ea3a req-4cb2d56a-0ac9-48f7-b82e-352c591e6ad4 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.1288767 Nov 24 14:03:16.315713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7995b847-7cc0-42e5-a4b4-7c44727024e1 tempest-ServerActionsTestJSON-1542257735 tempest-ServerActionsTestJSON-1542257735-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:16.362385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:16.362773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.380574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.389087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:16.390806 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a6108d35-aef8-4fc2-950d-fff4d9d2ea3a req-7328da76-484b-4a54-b4c4-a0caaa116c1e tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798326 Nov 24 14:03:16.404140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:16.410583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:16.411105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.421955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:16.427008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:16.436208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.441765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:16.479206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-6c999a1a-a358-490f-bd06-888f55f00753 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d8f8b834cdff4f678fb27b967b7aa48b&device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 1098 time: 0.2933581 Nov 24 14:03:16.519479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:16.520928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4832f4ab-6378-462d-8a74-3985955ea45a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:16.523596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:16.526322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:16.559169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:16.562519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:16.618209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:16.632675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4832f4ab-6378-462d-8a74-3985955ea45a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:16.638578 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:16.644776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4832f4ab-6378-462d-8a74-3985955ea45a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:16.645343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.655750 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:16.656652 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:16.711877 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1574018 Nov 24 14:03:16.717474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44894) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:16.728308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1921831868'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:16.734387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:16.741933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:16.743619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-bfb2a571-b9c6-44dc-941e-2a8d36c365a4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:16.745111 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-bfb2a571-b9c6-44dc-941e-2a8d36c365a4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=99ebbc60-aad0-4014-a19e-55e6165ad0ef HTTP/1.1" status: 200 len: 913 time: 0.2589376 Nov 24 14:03:16.745841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.746508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:16.753230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:16.778239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:16.781759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.816294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.835641 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-b19f65ed-0fa4-49ff-b51e-ed80ffdb1da8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5556426c-12cf-49da-8d89-bede94f2996e HTTP/1.1" status: 200 len: 217 time: 0.0795069 Nov 24 14:03:16.836273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-68472266-88eb-4822-948f-62c5289b9a9c None None] Provisioning for port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:16.845597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 859} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:03:16.846030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-68472266-88eb-4822-948f-62c5289b9a9c None None] Provisioning complete for port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:16.846552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-68472266-88eb-4822-948f-62c5289b9a9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.850071 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:16.858865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.859878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.867474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.867925 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment 790e0a33-d350-4c81-8cd4-d3aa67feae20 of type vlan for network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b Nov 24 14:03:16.919412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 4832f4ab-6378-462d-8a74-3985955ea45a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4832f4ab-6378-462d-8a74-3985955ea45a,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:16.926475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-7c4904da-edb8-41b9-9435-f648c89671d7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:16.932638 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-7c4904da-edb8-41b9-9435-f648c89671d7 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=81ea79c9-beb6-43bc-8036-8717cf3b026f HTTP/1.1" status: 200 len: 852 time: 0.0661356 Nov 24 14:03:16.938116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:16.943359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6d255ce3-0a4a-4aea-854e-028b73c0b4bc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:16.990016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-68472266-88eb-4822-948f-62c5289b9a9c None None] Port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:16.992582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.003299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-b38643f8-15cd-4b33-8455-2116af004ec0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=99ebbc60-aad0-4014-a19e-55e6165ad0ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0553925 Nov 24 14:03:17.032409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.036756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:17.037337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.045509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2bd4f77c-e045-4ff5-9533-17fa954e0d08 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:17.048726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=4832f4ab-6378-462d-8a74-3985955ea45a,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:17.062067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:17.231356 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:12Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:12Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:17.236277 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:17.236639 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Updating router 9447f30d-a2f1-408d-906a-0bcd23151ed7 port 018b7562-3559-4086-8655-8c9a25f8b83b binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:17.293491 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.356393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:17.359306 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.6407239 Nov 24 14:03:17.360123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:17.363209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44898) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:17.369934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:17.376159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:03:17.466365 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-ae96f97b-347b-4378-bdab-02b156c999d0 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4554591 Nov 24 14:03:17.480592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:17.484451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:17.487186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:17.493125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:17.511564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:17.638990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.651704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.753304 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.766226 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Transition to ACTIVE for port object 018b7562-3559-4086-8655-8c9a25f8b83b will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:17.777343 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.783400 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8cdf25f-d7b4-45e0-bff6-451d3d16d3e8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:17.789883 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3e7fbbf-bb01-421d-9b7a-f285fee0adb3 req-f55d5f91-f063-4ac1-92a9-0075d7ed534b service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3033643 Nov 24 14:03:17.811452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:03:17.832625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfc15ff-ba78-404e-b7c6-9d94f0969308 req-f509766e-dd33-4172-8e53-ddb202e149c4 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:17.834284 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dfc15ff-ba78-404e-b7c6-9d94f0969308 req-f509766e-dd33-4172-8e53-ddb202e149c4 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.2058806 Nov 24 14:03:17.839618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.861828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.863001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:17.877041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-65a8646b-1cf6-4359-952b-750ad2d48d4b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:17.985207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:17.989661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:18.022770 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Pushing event updated for resources: {'Port': ['ID=018b7562-3559-4086-8655-8c9a25f8b83b,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:18.038910 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.039259 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.039595 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.039952 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.040307 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.040608 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.040934 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.041250 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.041566 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.041881 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.042195 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:03:18.053459 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:18.073741 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Attempting to bind port 018b7562-3559-4086-8655-8c9a25f8b83b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:18.074260 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Attempting to bind port 018b7562-3559-4086-8655-8c9a25f8b83b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:18.074714 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Attempting to bind port 018b7562-3559-4086-8655-8c9a25f8b83b on network fa522dda-607e-4bb3-af91-d3f819546827 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:18.083400 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:18.092391 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dfc15ff-ba78-404e-b7c6-9d94f0969308 req-4dadcba6-70e0-4b78-b436-968ad1b7d797 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2502697 Nov 24 14:03:18.096869 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Checking segment: {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:18.097187 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.097588 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Bound using segment: {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:18.098088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Bound port: 018b7562-3559-4086-8655-8c9a25f8b83b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a4f0363-fcd1-4d99-863b-a1c699da9e84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:18.099203 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.118764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.125591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f4324280-3d35-4e80-ab62-ae27fb2f971d tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:18.148194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4832f4ab-6378-462d-8a74-3985955ea45a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:18.183830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:18.185750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:18.277745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=02987e09-a307-477d-8b4e-5a4c97ae1c9f,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:18.288019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:18.292581 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] For port 018b7562-3559-4086-8655-8c9a25f8b83b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:18.300063 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] For port 018b7562-3559-4086-8655-8c9a25f8b83b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=018b7562-3559-4086-8655-8c9a25f8b83b,segment=NetworkSegment(5a4f0363-fcd1-4d99-863b-a1c699da9e84),segment_id=5a4f0363-fcd1-4d99-863b-a1c699da9e84)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:18.301151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4832f4ab-6378-462d-8a74-3985955ea45a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:18.302791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.309836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:18.311791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:18.312324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:03:18.321408 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.331608 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0c39d95d-bc09-4cd8-bc1f-8f5c8759dfed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:18.357209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.359085 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 3.2430027 Nov 24 14:03:18.364230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44904) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:18.382854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:03:18.410135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:18.414570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:18.415361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.433769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:18.450977 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:18.451614 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:18.454725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:18.455606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:18.478430 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.1143222 Nov 24 14:03:18.481415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44912) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:18.636165 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:18.667194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3721b7e9-2165-4819-beb9-9affcbf4ed83 None None] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:18.718622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44916) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:18.720314 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ec528730-8b31-4e80-bb42-99125afe8a4d tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.3544052 Nov 24 14:03:18.856144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:03:18.922667 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Pushing event updated for resources: {'Port': ['ID=018b7562-3559-4086-8655-8c9a25f8b83b,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:18.927641 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.596s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:18.988283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1aec40e2-6a0e-496a-b47b-3d02c0fc7958 None None] Provisioning complete for port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:18.988665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1aec40e2-6a0e-496a-b47b-3d02c0fc7958 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:18.999004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20cd6265-1342-4749-abf5-8f25aea69d3f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:19.004007 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-20cd6265-1342-4749-abf5-8f25aea69d3f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2844129 Nov 24 14:03:19.005509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44920) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:19.023055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:19.061009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2ed45f98-090d-4a64-8af3-e6b1ed22dfe3 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0522001 Nov 24 14:03:19.061618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44924) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:19.070798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1313871961', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:19.138925 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:12Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:18Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:19.144669 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bb70ba1-05a1-47bf-865d-49b6a0824273 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:12Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:18Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:19.237204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:19.274647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1aec40e2-6a0e-496a-b47b-3d02c0fc7958 None None] Port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:19.276845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:19.289510 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Sync routers for ids ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:19.294646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "PUT /v2.0/routers/17f4c6c2-7440-4257-8a4e-2fe40c552fe2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.7552433 Nov 24 14:03:19.295845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44930) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:19.312368 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Routers {'17f4c6c2-7440-4257-8a4e-2fe40c552fe2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:19.314011 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:19.323812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:19.328520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:19.380056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-366b10e8-c69d-47b9-8574-3a792e762508 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:19.381343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-366b10e8-c69d-47b9-8574-3a792e762508 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:19.388856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:19.404527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-366b10e8-c69d-47b9-8574-3a792e762508 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:19.409292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-366b10e8-c69d-47b9-8574-3a792e762508 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports/1e3b7ee4-f2a8-453e-a9af-1575ce74da44 HTTP/1.1" status: 200 len: 911 time: 0.1118114 Nov 24 14:03:19.410446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44934) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:19.459537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:19.460507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:19.555860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3de85e9e-4731-444c-8a4c-aed0bd5a21cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:19.561919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3de85e9e-4731-444c-8a4c-aed0bd5a21cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:19.566333 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3de85e9e-4731-444c-8a4c-aed0bd5a21cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1510575 Nov 24 14:03:19.566496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44938) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:19.652932 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Set router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:19.665227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:19.824080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:19.828804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Allocated IP 2001:db8:1::2 (8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b/02987e09-a307-477d-8b4e-5a4c97ae1c9f/607ec195-0937-45ce-81e9-74522676e7b6) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:19.835399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:19.836131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Updating router 4c184764-fcb9-452b-b4f7-fde29787047c port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:19.855688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aada87e3-f3f0-41db-b9b5-689514a9a5d9 req-4682455c-bd14-48d2-a84c-4a94145b46d0 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:19.863972 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aada87e3-f3f0-41db-b9b5-689514a9a5d9 req-4682455c-bd14-48d2-a84c-4a94145b46d0 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.5365438 Nov 24 14:03:19.927788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:19.928783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.118343 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:13Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None, '_interfaces': [{'id': '1e3b7ee4-f2a8-453e-a9af-1575ce74da44', 'name': '', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'mac_address': 'fa:16:3e:33:14:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e68f21f8-8124-451d-99a7-719e6649aeb4', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:17Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'subnets': [{'id': 'e68f21f8-8124-451d-99a7-719e6649aeb4', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:20.125567 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Checking router: 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:20.125918 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Updating router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:20.172187 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aada87e3-f3f0-41db-b9b5-689514a9a5d9 req-840e5eba-43e0-498c-b32a-5f23336bc881 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3066006 Nov 24 14:03:20.231488 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.243063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 018b7562-3559-4086-8655-8c9a25f8b83b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:20.454893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.517467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.523546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6c439a10-d31b-4092-91fe-ee78acc16764 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:20.619452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=592f062e-f3d4-49e3-bd1d-81be732122e4,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:20.624419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:20.775409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.781880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:20.793263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: 1a509ac2-7dc4-4e91-864c-101a02b01959, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:03:20.800999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Transition to ACTIVE for port object 607ec195-0937-45ce-81e9-74522676e7b6 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:20.829082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Transition to ACTIVE for port object 607ec195-0937-45ce-81e9-74522676e7b6 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:20.855429 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.860653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.869191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:20.879847 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Transition to ACTIVE for port object 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:20.898915 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.903265 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:20.922835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.982014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 018b7562-3559-4086-8655-8c9a25f8b83b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:20.993132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 018b7562-3559-4086-8655-8c9a25f8b83b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:20.993513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:20.996486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:20.996887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.031123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:21.042074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:21.044842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:21.047258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Pushing event updated for resources: {'Port': ['ID=607ec195-0937-45ce-81e9-74522676e7b6,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:21.052341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:21.083365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.resource_extend [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 24 14:03:21.118736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:03:21.160361 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7149d3f1-24f0-40e9-b1f5-9c3e0e409ac3 None None] Pushing event updated for resources: {'Port': ['ID=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:21.163992 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7149d3f1-24f0-40e9-b1f5-9c3e0e409ac3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:21.180440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 1a509ac2-7dc4-4e91-864c-101a02b01959) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:21.199087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:21.199671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.206958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.270087 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Attempting to bind port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:21.270855 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Attempting to bind port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:21.271445 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Attempting to bind port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:21.283475 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:21.284025 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:21.284539 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.285039 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:21.287466 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Bound port: 1e3b7ee4-f2a8-453e-a9af-1575ce74da44, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:21.287971 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.303804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b84b3802-40d1-4ca4-b7e6-df25867ea7ec None None] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:21.320307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Transition to ACTIVE for port object 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:21.329468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-966d46c6-2e4b-4ff1-a19a-a3a23469a4a4 req-dc395583-0000-420f-8438-226ce35fc2ab tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:21.336684 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-966d46c6-2e4b-4ff1-a19a-a3a23469a4a4 req-dc395583-0000-420f-8438-226ce35fc2ab tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.4592505 Nov 24 14:03:21.389929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44, host dv-neutron-818151-2-hyperv, got binding levels [] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:21.389929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.402033 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 2.3382192 Nov 24 14:03:21.405334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44946) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:21.431060 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] For port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:21.436429 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] For port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:21.444541 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.449500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fc643b-8f42-476e-8057-d171ad53b391 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:21.477381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.490344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:21.536717 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7149d3f1-24f0-40e9-b1f5-9c3e0e409ac3 None None] Pushing event updated for resources: {'Port': ['ID=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:21.539973 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-966d46c6-2e4b-4ff1-a19a-a3a23469a4a4 req-3d023d48-bf86-4016-805d-cfe264f4be4c tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1983142 Nov 24 14:03:21.545941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Attempting to bind port 607ec195-0937-45ce-81e9-74522676e7b6 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:21.546575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Attempting to bind port 607ec195-0937-45ce-81e9-74522676e7b6 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:21.547154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Attempting to bind port 607ec195-0937-45ce-81e9-74522676e7b6 on network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:21.558378 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7149d3f1-24f0-40e9-b1f5-9c3e0e409ac3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:21.608669 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Routers {'17f4c6c2-7440-4257-8a4e-2fe40c552fe2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:21.609318 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:21.635659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:21.636177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Checking segment: {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:21.636651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.637104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Bound using segment: {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:21.637661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Bound port: 607ec195-0937-45ce-81e9-74522676e7b6, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:21.638335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.669564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:21.708970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8:1::1 (8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b/02987e09-a307-477d-8b4e-5a4c97ae1c9f/4b26afa3-9da7-4980-8671-1b407c238e25) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:21.869085 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] Set router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:21.873709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] For port 607ec195-0937-45ce-81e9-74522676e7b6, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:21.878062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] For port 607ec195-0937-45ce-81e9-74522676e7b6, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=607ec195-0937-45ce-81e9-74522676e7b6,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:21.882874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e57cb27-1e6f-4efb-8bd6-0431c9f2779f None None] Pushing event updated for resources: {'Port': ['ID=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:21.960316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:21.996324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3e57cb27-1e6f-4efb-8bd6-0431c9f2779f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.506s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:22.015448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.030581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.046576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d3a30c71-d4f4-4d77-9fb4-d920a6048238 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:22.065481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:03:22.065967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:03:22.070823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 4b26afa3-9da7-4980-8671-1b407c238e25 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:22.089902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Attempting to bind port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:22.090655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Attempting to bind port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:22.091202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Attempting to bind port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:22.104914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.111903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c7fc5414-8556-46c9-86d0-610bac01ebdc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:22.211526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Pushing event updated for resources: {'Port': ['ID=607ec195-0937-45ce-81e9-74522676e7b6,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:22.215510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:22.237253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 018b7562-3559-4086-8655-8c9a25f8b83b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=018b7562-3559-4086-8655-8c9a25f8b83b,segment=NetworkSegment(5a4f0363-fcd1-4d99-863b-a1c699da9e84),segment_id=5a4f0363-fcd1-4d99-863b-a1c699da9e84)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:22.244338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:22.244743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:22.245174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.245566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:22.246056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Bound port: 1d9688f8-d3ae-4b46-af07-c33aaa5101f5, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:22.246452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.284843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.296574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:22.363603 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:13Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None, '_interfaces': [{'id': '1e3b7ee4-f2a8-453e-a9af-1575ce74da44', 'name': '', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'mac_address': 'fa:16:3e:33:14:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e68f21f8-8124-451d-99a7-719e6649aeb4', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:21Z', 'revision_number': 4, 'project_id': '303f30b20dd547718e1105de03480ea7', 'subnets': [{'id': 'e68f21f8-8124-451d-99a7-719e6649aeb4', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:22.375816 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b39f068-e235-4505-9427-ac3c54a49369 None None] The sync data for ids ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'] in dv-neutron-818151-2-hyperv is: [{'id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:13Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 2, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None, '_interfaces': [{'id': '1e3b7ee4-f2a8-453e-a9af-1575ce74da44', 'name': '', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'mac_address': 'fa:16:3e:33:14:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e68f21f8-8124-451d-99a7-719e6649aeb4', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:21Z', 'revision_number': 4, 'project_id': '303f30b20dd547718e1105de03480ea7', 'subnets': [{'id': 'e68f21f8-8124-451d-99a7-719e6649aeb4', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:22.448122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=018b7562-3559-4086-8655-8c9a25f8b83b,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:22.460650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:22.484802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:22.494449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:22.503549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=4b26afa3-9da7-4980-8671-1b407c238e25,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:22.508099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:22.508632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.517128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.405s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:22.582071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:22.582425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.670999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-1a509ac2-7dc4-4e91-864c-101a02b01959', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:22.672199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.696358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.810029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] For port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:22.830848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] For port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:22.861636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:22.875812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:23.063098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e57cb27-1e6f-4efb-8bd6-0431c9f2779f None None] Pushing event updated for resources: {'Port': ['ID=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:23.065655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:23.066257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:23.174182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 1e3b7ee4-f2a8-453e-a9af-1575ce74da44, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:23.174809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:23.198716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-018492ff-733b-4bd1-8b9d-1375c18e19e6 req-b84f06af-e24d-46f7-9244-57cfe5101721 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:23.200253 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-018492ff-733b-4bd1-8b9d-1375c18e19e6 req-b84f06af-e24d-46f7-9244-57cfe5101721 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.4059756 Nov 24 14:03:23.361532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3e57cb27-1e6f-4efb-8bd6-0431c9f2779f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.486s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:23.376640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:23.383949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:23.384883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:23.388156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:23.398357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:23.406972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:23.439248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Allocated IP 172.20.0.2 (1a509ac2-7dc4-4e91-864c-101a02b01959/592f062e-f3d4-49e3-bd1d-81be732122e4/b67892e5-6903-4056-a39c-c16f1bdf953c) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:23.517913 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-018492ff-733b-4bd1-8b9d-1375c18e19e6 req-fb1d6189-f984-4136-b8d7-2f7f46963116 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3095746 Nov 24 14:03:23.602277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=4b26afa3-9da7-4980-8671-1b407c238e25,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:23.607187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:23.659249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:23.660949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:23.790571 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:03:23.891328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:23.897644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:23.971222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de87bd5c-1182-4046-b02c-e5037bf5df33 None None] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:24.012893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=1e3b7ee4-f2a8-453e-a9af-1575ce74da44,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:24.015339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:24.091511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:24.178002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.183705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-777b6fb6-a72b-4ce0-abc5-c5ad853f7957 None None] Provisioning for port 607ec195-0937-45ce-81e9-74522676e7b6 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:24.217354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Transition to ACTIVE for port object b67892e5-6903-4056-a39c-c16f1bdf953c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:24.300307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Transition to ACTIVE for port object b67892e5-6903-4056-a39c-c16f1bdf953c will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:24.319095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:24.334865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:24.337890 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8551071 Nov 24 14:03:24.341633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44958) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:24.348058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1791134842'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:24.357196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:24.360395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.361960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:24.368197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:24.374546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3e57cb27-1e6f-4efb-8bd6-0431c9f2779f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:24.377597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:24.394303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:24.399216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.458536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.469318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 857} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:03:24.478000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:24.482982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:24.499818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.499818 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment 760e440b-8386-4e18-b96a-54ed57dc5c0b of type vlan for network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 Nov 24 14:03:24.517797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:24.525227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:24.526103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:24.560016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.598566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.604676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:24.605602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.612111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-19666d27-4f1f-446a-ae49-6b134c5f10f1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:24.620801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 018b7562-3559-4086-8655-8c9a25f8b83b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:24.662128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:24.784521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95694f3f-d6b5-4683-8b1c-659996bde27d None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:16Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:24.802922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Pushing event updated for resources: {'Port': ['ID=b67892e5-6903-4056-a39c-c16f1bdf953c,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:24.822637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.448s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:24.826390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Attempting to bind port b67892e5-6903-4056-a39c-c16f1bdf953c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:24.826390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Attempting to bind port b67892e5-6903-4056-a39c-c16f1bdf953c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:24.826866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Attempting to bind port b67892e5-6903-4056-a39c-c16f1bdf953c on network 1a509ac2-7dc4-4e91-864c-101a02b01959 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:24.833716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efcd0967-9474-42f4-9587-6a9e722ad7aa req-c62f94db-9fe4-41db-a54c-e081ac7e46e2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:24.834949 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-efcd0967-9474-42f4-9587-6a9e722ad7aa req-c62f94db-9fe4-41db-a54c-e081ac7e46e2 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.8256600 Nov 24 14:03:24.849988 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-c122e7b5-3942-4d39-8da1-c2bc61eeec36 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d8f8b834cdff4f678fb27b967b7aa48b&device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 1098 time: 0.8329005 Nov 24 14:03:24.865594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:24.866174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Checking segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:24.866696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.867984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Bound using segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:24.868596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Bound port: b67892e5-6903-4056-a39c-c16f1bdf953c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:24.869086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.877872 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.5323179 Nov 24 14:03:24.879235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44962) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:24.893888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:24.904731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:24.943518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:25.027824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 018b7562-3559-4086-8655-8c9a25f8b83b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:25.028499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:25.031551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:25.035448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:25.040045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:25.047072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:25.056801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=73ccd08d-b5d4-43ae-bd73-1ed0580e6920,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:25.060416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.448s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:25.061968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:25.219939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:25.283955 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-efcd0967-9474-42f4-9587-6a9e722ad7aa req-e6f5a7a7-fa5f-466e-a30f-ef7d8e7de5b7 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4332972 Nov 24 14:03:25.450216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:03:25.469522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-fcf07879-f844-43a4-8ae9-03b83c2a351f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:25.471034 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-fcf07879-f844-43a4-8ae9-03b83c2a351f service neutron] 10.222.0.47 "GET /v2.0/networks?id=99ebbc60-aad0-4014-a19e-55e6165ad0ef HTTP/1.1" status: 200 len: 913 time: 0.6060033 Nov 24 14:03:25.574255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] For port b67892e5-6903-4056-a39c-c16f1bdf953c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:25.606746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:25.612818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e3fcc1dc-7afb-4e21-9c8e-5f8440852394 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:25.681465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] For port b67892e5-6903-4056-a39c-c16f1bdf953c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b67892e5-6903-4056-a39c-c16f1bdf953c,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:25.720934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:25.743962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:25.754280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=719afdec-c525-4346-b69e-a76bdf8a686f,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:25.769827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:25.771652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:25.772058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: 73ccd08d-b5d4-43ae-bd73-1ed0580e6920, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:03:25.795721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1a635028-b4dc-4f52-b1ca-53f289128aa9 None None] Provisioning for port 4b26afa3-9da7-4980-8671-1b407c238e25 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:25.819592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:03:25.836628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 73ccd08d-b5d4-43ae-bd73-1ed0580e6920) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:25.842538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:25.843120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:25.849997 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-d71b04b1-4f44-4a2e-a970-3dc6f5f8b438 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5556426c-12cf-49da-8d89-bede94f2996e HTTP/1.1" status: 200 len: 217 time: 0.2675092 Nov 24 14:03:25.852890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1a635028-b4dc-4f52-b1ca-53f289128aa9 None None] Provisioning complete for port 4b26afa3-9da7-4980-8671-1b407c238e25 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:25.853305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1a635028-b4dc-4f52-b1ca-53f289128aa9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:25.894442 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.0139339 Nov 24 14:03:25.895067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44966) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:25.953699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed076b30-cf8a-447a-8913-650d486f7dd1 None None] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:26.265965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (1a509ac2-7dc4-4e91-864c-101a02b01959/592f062e-f3d4-49e3-bd1d-81be732122e4/c00f8af4-02eb-44ba-975c-36393223efb1) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:26.269855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1a635028-b4dc-4f52-b1ca-53f289128aa9 None None] Port 4b26afa3-9da7-4980-8671-1b407c238e25 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:26.279328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Pushing event updated for resources: {'Port': ['ID=b67892e5-6903-4056-a39c-c16f1bdf953c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:26.283023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.539s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:26.287286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 607ec195-0937-45ce-81e9-74522676e7b6 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:26.293080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-82cc30c9-6369-4acf-b52a-0c7c81944511 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:26.294649 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-82cc30c9-6369-4acf-b52a-0c7c81944511 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=81ea79c9-beb6-43bc-8036-8717cf3b026f HTTP/1.1" status: 200 len: 852 time: 0.4368675 Nov 24 14:03:26.354759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:26.355911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.498105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 3, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:23Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:26.508886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.519720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:26.519720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Updating router 9447f30d-a2f1-408d-906a-0bcd23151ed7 port 4b26afa3-9da7-4980-8671-1b407c238e25 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:26.531833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object c00f8af4-02eb-44ba-975c-36393223efb1 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:26.607261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-6a47ca34-e50a-4094-af0a-74642c33ebb8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=99ebbc60-aad0-4014-a19e-55e6165ad0ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0672138 Nov 24 14:03:26.613293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:26.680660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442315db-b85e-4bdd-ae40-d29c4259fa6f req-828703bf-d224-4e55-b79a-b824566bc3fe tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:26.685104 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-442315db-b85e-4bdd-ae40-d29c4259fa6f req-828703bf-d224-4e55-b79a-b824566bc3fe tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.1410868 Nov 24 14:03:26.686822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.765627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 607ec195-0937-45ce-81e9-74522676e7b6 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:26.776806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-2862ffb7-08f2-43ac-b322-04f1c5486436 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1592278 Nov 24 14:03:26.790905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 607ec195-0937-45ce-81e9-74522676e7b6 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:26.791289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.813462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3f0562fd-5d28-4652-872e-bbd7160029c2 None None] Provisioning complete for port 4b26afa3-9da7-4980-8671-1b407c238e25 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:26.813754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3f0562fd-5d28-4652-872e-bbd7160029c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.839731 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-442315db-b85e-4bdd-ae40-d29c4259fa6f req-3e3e6566-b36c-463a-943d-3c1317d6934d tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1442716 Nov 24 14:03:26.868778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.874905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-986a2381-79f9-48f9-9a21-222f94ee97ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:26.925171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:26.946360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=c00f8af4-02eb-44ba-975c-36393223efb1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:26.983459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3f0562fd-5d28-4652-872e-bbd7160029c2 None None] Port 4b26afa3-9da7-4980-8671-1b407c238e25 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:26.985459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Allocated IP 2001:db8:2::2 (73ccd08d-b5d4-43ae-bd73-1ed0580e6920/719afdec-c525-4346-b69e-a76bdf8a686f/30e3e157-e213-4382-9978-63db425af94d) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:26.996759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:27.080841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:27.084597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:27.089656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:27.172501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:27.196298 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-879a7835-f817-463f-9041-fa45608ada18 None None] Sync routers for ids ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:27.234891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.254305 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] Routers {'17f4c6c2-7440-4257-8a4e-2fe40c552fe2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:27.260255 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:27.285185 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "PUT /v2.0/routers/17f4c6c2-7440-4257-8a4e-2fe40c552fe2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.7176294 Nov 24 14:03:27.288307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8cdcd8f-3fdf-4502-bdd9-7c51dd0b1f1a req-24b44e2b-3d83-482d-9b03-64e4bde14955 service neutron] 10.222.0.47 "GET /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4971416 Nov 24 14:03:27.289024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 44974) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:27.378415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.468193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.485744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb60b786-d880-4e0b-83ec-7bfd3c14b945 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:27.487096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb60b786-d880-4e0b-83ec-7bfd3c14b945 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:27.492050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44978) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:27.492243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bb60b786-d880-4e0b-83ec-7bfd3c14b945 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.2016425 Nov 24 14:03:27.598902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] Set router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:27.713998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.728091 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:13Z', 'updated_at': '2021-11-24T14:03:23Z', 'revision_number': 3, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:27.729044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Transition to ACTIVE for port object 30e3e157-e213-4382-9978-63db425af94d will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:27.731552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27d2a77e-7aa5-452f-850c-13bff2372e94 None None] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:27.732985 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-879a7835-f817-463f-9041-fa45608ada18 None None] Checking router: 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:27.744977 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] Routers {'17f4c6c2-7440-4257-8a4e-2fe40c552fe2'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:27.745589 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:27.765659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet e68f21f8-8124-451d-99a7-719e6649aeb4 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:27.768546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 607ec195-0937-45ce-81e9-74522676e7b6, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=607ec195-0937-45ce-81e9-74522676e7b6,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:27.769115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.829127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.838569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.845915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:27.860441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:27.931100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=607ec195-0937-45ce-81e9-74522676e7b6,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:27.937051 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] Set router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:27.940115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a27897fc-6f7d-4850-acc1-0832375c9431 None None] Provisioning for port b67892e5-6903-4056-a39c-c16f1bdf953c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:27.945893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Transition to ACTIVE for port object 30e3e157-e213-4382-9978-63db425af94d will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:27.948507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:27.979973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Transition to ACTIVE for port object 4b26afa3-9da7-4980-8671-1b407c238e25 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:28.002116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.003110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.018916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.049069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-599dbfa8-e8cd-46b4-a3b3-f4c641dadd00 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:28.086991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:28.096018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:28.125839 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-879a7835-f817-463f-9041-fa45608ada18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:13Z', 'updated_at': '2021-11-24T14:03:23Z', 'revision_number': 3, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:28.130728 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-879a7835-f817-463f-9041-fa45608ada18 None None] The sync data for ids ['17f4c6c2-7440-4257-8a4e-2fe40c552fe2'] in dv-neutron-818151-2-hyperv is: [{'id': '17f4c6c2-7440-4257-8a4e-2fe40c552fe2', 'name': 'tempest-NetworksTestDHCPv6-router-1160652677', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:13Z', 'updated_at': '2021-11-24T14:03:23Z', 'revision_number': 3, 'project_id': '303f30b20dd547718e1105de03480ea7', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:28.184869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:28.217501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.232538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-559062bb-a18e-4a6a-990b-67e9454ad457 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:28.249241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:28.285214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=e68f21f8-8124-451d-99a7-719e6649aeb4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:28.296930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:28.302492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.306050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8:2::1 (73ccd08d-b5d4-43ae-bd73-1ed0580e6920/719afdec-c525-4346-b69e-a76bdf8a686f/188270d0-aa74-4ce2-8132-d7380095ed80) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:28.332293 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/e68f21f8-8124-451d-99a7-719e6649aeb4 HTTP/1.1" status: 204 len: 168 time: 0.8390255 Nov 24 14:03:28.335955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44984) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:28.451001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93406ba4-ca6e-42c1-a743-521de1a31069 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:28.493681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffe4fac4-41b5-4e8d-bfff-4de0400f44ed None None] Pushing event updated for resources: {'Port': ['ID=4b26afa3-9da7-4980-8671-1b407c238e25,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:28.539279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.564990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.621855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:28.634954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7948b051-abc8-41f7-a9bf-da4f82ee4491 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:28.679334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.695635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7948b051-abc8-41f7-a9bf-da4f82ee4491 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:28.697140 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-0061f1f7-0ebb-4648-b3a8-5acc8a708942 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.7096615 Nov 24 14:03:28.700009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7948b051-abc8-41f7-a9bf-da4f82ee4491 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.3629794 Nov 24 14:03:28.703288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44988) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:28.737726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f9a1ff-114a-446d-8e93-b239c2234acc req-fadf1026-1673-4e7c-a86e-85bfd96d7ff1 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:28.739714 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c7f9a1ff-114a-446d-8e93-b239c2234acc req-fadf1026-1673-4e7c-a86e-85bfd96d7ff1 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.3419647 Nov 24 14:03:28.742627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=c00f8af4-02eb-44ba-975c-36393223efb1,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:28.745339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.750306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:28.795780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 188270d0-aa74-4ce2-8132-d7380095ed80 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:28.809937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Attempting to bind port 30e3e157-e213-4382-9978-63db425af94d on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:28.810288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Attempting to bind port 30e3e157-e213-4382-9978-63db425af94d by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:28.810587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Attempting to bind port 30e3e157-e213-4382-9978-63db425af94d on network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:28.900737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.916776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Pushing event updated for resources: {'Port': ['ID=30e3e157-e213-4382-9978-63db425af94d,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:28.919659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.871s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:28.920447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:28.920883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Checking segment: {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:28.921474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.921864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Bound using segment: {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:28.922339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Bound port: 30e3e157-e213-4382-9978-63db425af94d, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:28.922714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:28.952192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.874s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:28.952583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:28.953321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Attempting to bind port 4b26afa3-9da7-4980-8671-1b407c238e25 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:28.953689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Attempting to bind port 4b26afa3-9da7-4980-8671-1b407c238e25 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:28.954165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Attempting to bind port 4b26afa3-9da7-4980-8671-1b407c238e25 on network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:28.981231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c7f9a1ff-114a-446d-8e93-b239c2234acc req-933ba7d3-35bc-4f56-a758-1ff3779eaec6 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2319806 Nov 24 14:03:29.052500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:29.054460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:29.058846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-e39f0cb7-fc21-4216-9f37-d04216738229 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1098 time: 0.2668095 Nov 24 14:03:29.061128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:29.063313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.081722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3e4b804d-61a9-4673-95ef-67b55b8e85fd tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:29.104333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:29.104712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Checking segment: {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:29.105175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.105577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Bound using segment: {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:29.106070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Bound port: 4b26afa3-9da7-4980-8671-1b407c238e25, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '790e0a33-d350-4c81-8cd4-d3aa67feae20', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:29.106449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.121934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:29.122300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.295044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-319336be-de9b-445f-8460-affa1ec9495a None None] For port 30e3e157-e213-4382-9978-63db425af94d, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:29.299885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-319336be-de9b-445f-8460-affa1ec9495a None None] For port 30e3e157-e213-4382-9978-63db425af94d, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30e3e157-e213-4382-9978-63db425af94d,segment=NetworkSegment(760e440b-8386-4e18-b96a-54ed57dc5c0b),segment_id=760e440b-8386-4e18-b96a-54ed57dc5c0b)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:29.322892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:29.335569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:29.339061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=188270d0-aa74-4ce2-8132-d7380095ed80,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:29.342681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:29.343285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.345116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.350385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:29.362575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:29.376878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-40675d3b-c529-40f0-b2e7-f6deb22f0aef service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:29.378332 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-40675d3b-c529-40f0-b2e7-f6deb22f0aef service neutron] 10.222.0.47 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 898 time: 0.2611248 Nov 24 14:03:29.533711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] For port 4b26afa3-9da7-4980-8671-1b407c238e25, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:29.593404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] For port 4b26afa3-9da7-4980-8671-1b407c238e25, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b26afa3-9da7-4980-8671-1b407c238e25,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:29.608303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.621855 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-929d2c89-51ec-4947-93f5-8ddb859a7342 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 1000 time: 0.1797731 Nov 24 14:03:29.655367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Pushing event updated for resources: {'Port': ['ID=30e3e157-e213-4382-9978-63db425af94d,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:29.658638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:29.659489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.669194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.030s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:29.685759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.716671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:03:29.748650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Deleting port 4832f4ab-6378-462d-8a74-3985955ea45a {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:29.749028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.764241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.774220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.800467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:29.815539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:29.816559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b67892e5-6903-4056-a39c-c16f1bdf953c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:29.861750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-bcf34a77-5b69-4769-818f-aae2b54d415a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:29.863329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-bcf34a77-5b69-4769-818f-aae2b54d415a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 200 len: 835 time: 0.1522353 Nov 24 14:03:29.971403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:29.972276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:30.031221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-38be21ad-94cd-4a0e-94a1-4b0957f8cc6f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1585424 Nov 24 14:03:30.145761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:30.189145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.190276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Fanout notify agent at l3_agent the message router_deleted on router 17f4c6c2-7440-4257-8a4e-2fe40c552fe2 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:03:30.242584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffe4fac4-41b5-4e8d-bfff-4de0400f44ed None None] Pushing event updated for resources: {'Port': ['ID=4b26afa3-9da7-4980-8671-1b407c238e25,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:30.253146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ffe4fac4-41b5-4e8d-bfff-4de0400f44ed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.584s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:30.261400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.344s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:30.358946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.360235 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8ddbb284-48d8-481d-b976-fa5ecad7a33f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/routers/17f4c6c2-7440-4257-8a4e-2fe40c552fe2 HTTP/1.1" status: 204 len: 168 time: 1.6557364 Nov 24 14:03:30.479301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port b67892e5-6903-4056-a39c-c16f1bdf953c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:30.530243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b67892e5-6903-4056-a39c-c16f1bdf953c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:30.531100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.539491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44994) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:30.592349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:30.655876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:30.669385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.408s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:30.674394 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-940b1e32-340b-46f5-b26a-0821e121674f service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6317730 Nov 24 14:03:30.697370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-17d75299-6bba-4445-90a8-9992319dbfd8 None None] Provisioning for port c00f8af4-02eb-44ba-975c-36393223efb1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:30.718386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-17d75299-6bba-4445-90a8-9992319dbfd8 None None] Provisioning complete for port c00f8af4-02eb-44ba-975c-36393223efb1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:30.719146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-17d75299-6bba-4445-90a8-9992319dbfd8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.745805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] For port 4832f4ab-6378-462d-8a74-3985955ea45a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4832f4ab-6378-462d-8a74-3985955ea45a,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:30.746220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.746754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.760359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.761290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:30.770996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331c3af5-a5e6-4999-ac05-f7c51c23fd07 req-8b543a2b-3c46-4da9-879f-65f4cb377db3 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:30.772456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-331c3af5-a5e6-4999-ac05-f7c51c23fd07 req-8b543a2b-3c46-4da9-879f-65f4cb377db3 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.5114427 Nov 24 14:03:30.775365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:30.931632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-49200a71-1b30-4e1a-8e44-e697f1bc179d req-d5ba27e8-cd25-4f4c-86ea-473fb773ae71 service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2475202 Nov 24 14:03:30.964990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Calling delete_port for 4832f4ab-6378-462d-8a74-3985955ea45a owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:30.992617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:31.000859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-320c8ed1-aa26-4f5f-a45f-9f23eb0e5185 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.002318 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-320c8ed1-aa26-4f5f-a45f-9f23eb0e5185 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.4576283 Nov 24 14:03:31.007165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 44998) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:31.007353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45000) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:31.010208 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/4c184764-fcb9-452b-b4f7-fde29787047c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.5957012 Nov 24 14:03:31.068144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:31.109020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:31.120097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-17d75299-6bba-4445-90a8-9992319dbfd8 None None] Port c00f8af4-02eb-44ba-975c-36393223efb1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:31.122812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:31.124698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=188270d0-aa74-4ce2-8132-d7380095ed80,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:31.147643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:31.232047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:31.232594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:31.298268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd1e3824-c47a-4a3a-870a-1b41c4e1d1fa None None] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:31.388084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.613s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:31.478642 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-331c3af5-a5e6-4999-ac05-f7c51c23fd07 req-efd4939a-5d37-4e0f-9b0a-049b7f13be29 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6729302 Nov 24 14:03:31.491086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dc6aefd-6792-4a9d-9d19-e14ce10a4ee0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.491786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2dc6aefd-6792-4a9d-9d19-e14ce10a4ee0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:31.508612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:31.533560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-db4548ae-9db5-46a8-b08d-654d327441e6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:31.559929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2dc6aefd-6792-4a9d-9d19-e14ce10a4ee0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:31.563474 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2dc6aefd-6792-4a9d-9d19-e14ce10a4ee0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.5476389 Nov 24 14:03:31.563946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45008) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:31.646711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port b67892e5-6903-4056-a39c-c16f1bdf953c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b67892e5-6903-4056-a39c-c16f1bdf953c,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:31.665567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Pushing event deleted for resources: {'Port': ['ID=4832f4ab-6378-462d-8a74-3985955ea45a,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:31.668042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:31.701307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.701684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.703102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.703102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.703102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.703102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.703530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.703724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.704098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.704987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.704987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.706872 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c241b89a-4285-407e-a024-65adcd3ddd56 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 7692 time: 0.6948903 Nov 24 14:03:31.707808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:31.708876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4e00e88e-9388-4bcc-8187-59317dd35bd2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:31.714277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:31.720324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3c800e4f-9d78-461e-89d3-e27070806ffd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:31.758717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] No DVR routers for this DVR port 4832f4ab-6378-462d-8a74-3985955ea45a on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:31.761680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4e00e88e-9388-4bcc-8187-59317dd35bd2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:31.767947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4e00e88e-9388-4bcc-8187-59317dd35bd2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1986046 Nov 24 14:03:31.774499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45016) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:31.795863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:31.863166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.863535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.864472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.864820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.865274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.865624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.865976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.866438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.866757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.867105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:31.869063 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f6b66711-d514-4ce8-b4fe-a89d001cead0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 6485 time: 0.1538787 Nov 24 14:03:31.872389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45022) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:31.983244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:32.015166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63d82b6b-f257-4c97-9d36-4353e7913033 None None] Provisioning complete for port c00f8af4-02eb-44ba-975c-36393223efb1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:32.015519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-63d82b6b-f257-4c97-9d36-4353e7913033 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.028178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:32.040324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:32.051884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:32.062573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 607ec195-0937-45ce-81e9-74522676e7b6 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:32.150152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:32.163850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.205513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=b67892e5-6903-4056-a39c-c16f1bdf953c,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:32.219888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.500s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:32.240557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-63d82b6b-f257-4c97-9d36-4353e7913033 None None] Port c00f8af4-02eb-44ba-975c-36393223efb1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:32.251804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:28Z', 'revision_number': 1, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:32.263005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3e434e1-4724-4c7b-b240-84e255849d0d None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:28Z', 'revision_number': 1, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:32.324933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-803cc662-d11c-43d4-9248-c9da85794a9b req-0e88235b-889b-49ca-af14-5f3d289b1e00 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:32.327020 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-803cc662-d11c-43d4-9248-c9da85794a9b req-0e88235b-889b-49ca-af14-5f3d289b1e00 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.2787631 Nov 24 14:03:32.425656 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f227dd21-333e-4a93-955e-0988d35290aa tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2868 time: 0.5517807 Nov 24 14:03:32.447288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-803cc662-d11c-43d4-9248-c9da85794a9b req-659c393a-5835-41a2-b123-39774d405e91 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1029494 Nov 24 14:03:32.455608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:32.468665 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.5725625 Nov 24 14:03:32.471234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45030) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:32.487920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 607ec195-0937-45ce-81e9-74522676e7b6 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:32.488309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.501601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2086173424'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:32.509446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:32.516145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:network and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:32.521169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for network was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:32.538104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource network. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:32.569141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:32.574049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.638460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 869} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:03:32.659200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.662970 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added segment d8647adf-0af1-4db0-8351-e6cffbbeec2a of type vlan for network 9f701968-870a-427f-95eb-df8bebab0c4c Nov 24 14:03:32.736347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.781708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.788412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:32.789252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.793681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2e52a0f-47e4-4249-9086-597d30f08686 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:32.795920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5ff96e2f-1055-4aff-a0c9-5253dfb6b0f7 None None] Provisioning for port 30e3e157-e213-4382-9978-63db425af94d completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:32.826857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:03:32.828255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:32.842199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:32.960313 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4873927 Nov 24 14:03:32.964408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45034) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:32.981736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=ec750fdd-063c-49a4-a9fd-037b3423c10f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:32.993011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:32.999386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'subnet': {'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:33.026554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Network': ['ID=9f701968-870a-427f-95eb-df8bebab0c4c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:33.027434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:33.029788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:33.031124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:33.040842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:33.047202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:33.057067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.127649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45038) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:33.136103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1891153700', 'description': 'tempest-secgroup-smoke-1891153700 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:33.146065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 9f701968-870a-427f-95eb-df8bebab0c4c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:03:33.146335 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.3669198 Nov 24 14:03:33.146335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:33.148055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45042) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:33.154467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:33.157113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f39283e-cd47-4bb8-956e-d48694cd0c0a None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:33.237374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:33.244330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:subnet and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:33.247909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for subnet was recalculated. Used quota:3. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:33.257908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource subnet. Total usage: 3; quota limit: 100; headroom:97 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:33.272435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Made reservation on behalf of 101b6d3e2d324980acf3f246ca68fb39 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:33.274102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:33.284199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:33.294860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:33.328786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.394750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:33.419325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:33.420037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d6f3b75e-43fb-48fe-82b2-1f1449c2939c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.426937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:33.437624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:33.440543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:33.442663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:33.450149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:33.456425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:33.462314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:33.462938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Updating router 4c184764-fcb9-452b-b4f7-fde29787047c port c00f8af4-02eb-44ba-975c-36393223efb1 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:33.467247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:33.473957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:33.478301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.490857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.577019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:33.577653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.637802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.711634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.729030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.759113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de32c1f0-b8a5-4d03-95af-b83b77a87b89 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:33.769089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.770657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.6417630 Nov 24 14:03:33.777656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:33.788274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-99965ca7-6f62-43eb-bf83-10c88237cf37 None None] Provisioning for port 188270d0-aa74-4ce2-8132-d7380095ed80 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:33.792150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.796537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '69a2a9ea-c083-424f-95cf-7b693d0d888b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:33.819258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:33.826495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=69a2a9ea-c083-424f-95cf-7b693d0d888b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:33.829517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:33.830875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:33.837606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:33.854853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-99965ca7-6f62-43eb-bf83-10c88237cf37 None None] Provisioning complete for port 188270d0-aa74-4ce2-8132-d7380095ed80 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:33.855443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-99965ca7-6f62-43eb-bf83-10c88237cf37 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:33.879576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:33.922618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.022624 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:34.038755 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.044354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.045354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-99965ca7-6f62-43eb-bf83-10c88237cf37 None None] Port 188270d0-aa74-4ce2-8132-d7380095ed80 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:34.058939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:34.072436 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:34.073375 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:34.087314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.093298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-77caa436-538f-4ab6-a987-5dc448267050 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:34.102004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'ec750fdd-063c-49a4-a9fd-037b3423c10f'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:34.102852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.173006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Subnet': ['ID=b9d08fe6-f61a-4110-b46e-7c03f6921df1,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:34.179582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30e3e157-e213-4382-9978-63db425af94d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:34.181815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:34.251381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.261799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a1c960a-4b73-4355-b877-026bbd6c81d8 req-4f263405-3ad1-4af3-a1cb-fc303ddd6107 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:34.265688 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5a1c960a-4b73-4355-b877-026bbd6c81d8 req-4f263405-3ad1-4af3-a1cb-fc303ddd6107 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.3381426 Nov 24 14:03:34.285034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:34.298047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:34.300929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:34.302140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.359940 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2079830 Nov 24 14:03:34.359940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=d7488947-72a5-4438-b697-6c051a0aae30,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:34.360933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.302s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:34.361824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.362916 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.5809841 Nov 24 14:03:34.365095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45052) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:34.365655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.094s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:34.381853 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:34.383047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:1a:fc:3c', 'name': 'tempest-NetworksTestDHCPv6-1378140548'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:34.386574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45054) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:34.391072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Checking segment: {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:34.392319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network hostable DHCP agents. Network: 9f701968-870a-427f-95eb-df8bebab0c4c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:03:34.397447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4c96ae1e-679c-4a1c-a1d9-9ae8a4767f9e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:34.400067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:34.409300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '69a2a9ea-c083-424f-95cf-7b693d0d888b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:34.418192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-28433c33-e477-4851-90a7-5a674879155c None None] Provisioning complete for port 188270d0-aa74-4ce2-8132-d7380095ed80 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:34.418578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28433c33-e477-4851-90a7-5a674879155c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.433074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-1092e8ae-0b83-440a-b483-697ca2625e6a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:34.433486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:34.434515 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-1092e8ae-0b83-440a-b483-697ca2625e6a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.47 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.2170291 Nov 24 14:03:34.456659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:34.469870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:34.477265 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5a1c960a-4b73-4355-b877-026bbd6c81d8 req-2553afe4-37f8-41e1-ab56-4f2ae4b7c472 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1969397 Nov 24 14:03:34.481986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 9f701968-870a-427f-95eb-df8bebab0c4c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:03:34.486659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:34.502440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 9f701968-870a-427f-95eb-df8bebab0c4c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:34.517064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:34.518103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.520750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c44d271d-c487-4c99-905c-c03ef057cd29 None None] Network 9f701968-870a-427f-95eb-df8bebab0c4c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:34.532561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.580880 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.6150944 Nov 24 14:03:34.583578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45060) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:34.632238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.637411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.639158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:34.648023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-28433c33-e477-4851-90a7-5a674879155c None None] Port 188270d0-aa74-4ce2-8132-d7380095ed80 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:34.680030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Allocated IP 2001:db8::f816:3eff:fede:9655 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/ec750fdd-063c-49a4-a9fd-037b3423c10f/32248440-534c-460b-aa7b-965b1062bba8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:34.686177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=62d0c399-7680-483b-b7c9-0f0d59119e7b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:34.687719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Deleting port 5556426c-12cf-49da-8d89-bede94f2996e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:34.689778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 30e3e157-e213-4382-9978-63db425af94d completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:34.693037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:34.703608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.705836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.709869 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.3177555 Nov 24 14:03:34.711992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45064) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:34.721683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '69a2a9ea-c083-424f-95cf-7b693d0d888b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:34.725468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 30e3e157-e213-4382-9978-63db425af94d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:34.725945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.730122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:34.735842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:34.742470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:34.749692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:34.781303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.837792 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:30Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:34.843135 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:34.843507 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Updating router 9447f30d-a2f1-408d-906a-0bcd23151ed7 port 188270d0-aa74-4ce2-8132-d7380095ed80 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:34.875515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:34.883877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.888539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.901580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2b79a73c-1ff0-499f-ba73-7f819e88adfd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:34.913108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:34.917619 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.921625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=25c09377-4f7b-4c68-9888-bd9158e1f768,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:34.922543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:34.932806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:34.940061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:34.955313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:34.959626 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2434616 Nov 24 14:03:34.959904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45068) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:34.969744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '69a2a9ea-c083-424f-95cf-7b693d0d888b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:34.980387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:34.986158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:34.991668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:34.999014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:35.017710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.020115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:35.024254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.030055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.085114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Transition to ACTIVE for port object c00f8af4-02eb-44ba-975c-36393223efb1 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:35.139292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.139665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.146753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 0700818f-07ef-4c14-84cd-c19f5c4cc919 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:03:35.147494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cf4430bc-ef76-4dcf-aa27-917c72c25c8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:35.150625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.152631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a731eb62-a2f3-417a-9f7a-103097b88725 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:35.193788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-9f701968-870a-427f-95eb-df8bebab0c4c', 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'fixed_ips': [{'subnet_id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:35.194744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.230860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.234685 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.2728863 Nov 24 14:03:35.240871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45072) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:35.244453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=183c3d4f-2e99-4e7f-8de0-7244b5a882e9,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:35.252429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '69a2a9ea-c083-424f-95cf-7b693d0d888b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:35.263784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:35.279385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.287420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:35.297359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:35.377105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:35.400412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:35.421493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] For port 5556426c-12cf-49da-8d89-bede94f2996e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5556426c-12cf-49da-8d89-bede94f2996e,segment=NetworkSegment(097f0e42-3015-4e27-9c16-edc8dbc9112d),segment_id=097f0e42-3015-4e27-9c16-edc8dbc9112d)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:35.421930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.457114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1675f08-d7df-4204-bd86-0a8be996cec7 None None] Pushing event updated for resources: {'Port': ['ID=c00f8af4-02eb-44ba-975c-36393223efb1,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:35.477049 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.483519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.486208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f1675f08-d7df-4204-bd86-0a8be996cec7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:35.495475 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Transition to ACTIVE for port object 188270d0-aa74-4ce2-8132-d7380095ed80 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:35.503594 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.508889 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:35.590662 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cba2de-48ba-4831-97c5-656b236d9432 None None] Pushing event updated for resources: {'Port': ['ID=188270d0-aa74-4ce2-8132-d7380095ed80,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:35.601009 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d9cba2de-48ba-4831-97c5-656b236d9432 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:35.697364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Allocated IP 2001:db8:3::2 (9f701968-870a-427f-95eb-df8bebab0c4c/b9d08fe6-f61a-4110-b46e-7c03f6921df1/b64007ec-f1c9-40fd-b37b-daa1062d10a4) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:35.710997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Calling delete_port for 5556426c-12cf-49da-8d89-bede94f2996e owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:35.740427 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:03:35.807487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.813522 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Attempting to bind port 188270d0-aa74-4ce2-8132-d7380095ed80 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:35.813895 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Attempting to bind port 188270d0-aa74-4ce2-8132-d7380095ed80 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:35.814399 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Attempting to bind port 188270d0-aa74-4ce2-8132-d7380095ed80 on network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:35.822739 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:35.823116 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Checking segment: {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:35.823520 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.823942 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Bound using segment: {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:35.824534 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Bound port: 188270d0-aa74-4ce2-8132-d7380095ed80, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '760e440b-8386-4e18-b96a-54ed57dc5c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 857, 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:35.824911 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.921061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 30e3e157-e213-4382-9978-63db425af94d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30e3e157-e213-4382-9978-63db425af94d,segment=NetworkSegment(760e440b-8386-4e18-b96a-54ed57dc5c0b),segment_id=760e440b-8386-4e18-b96a-54ed57dc5c0b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:35.929000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Transition to ACTIVE for port object 32248440-534c-460b-aa7b-965b1062bba8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:35.931845 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] For port 188270d0-aa74-4ce2-8132-d7380095ed80, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:35.935920 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] For port 188270d0-aa74-4ce2-8132-d7380095ed80, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=188270d0-aa74-4ce2-8132-d7380095ed80,segment=NetworkSegment(760e440b-8386-4e18-b96a-54ed57dc5c0b),segment_id=760e440b-8386-4e18-b96a-54ed57dc5c0b)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:35.944226 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:35.948764 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:35.997010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.014424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-02ad081d-b56e-4358-ae9b-26d5c01f9fc5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:36.073098 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:36.073945 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:36.129788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=30e3e157-e213-4382-9978-63db425af94d,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.140220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4832f4ab-6378-462d-8a74-3985955ea45a no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:36.154887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.172424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.174700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:36.182243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 4832f4ab-6378-462d-8a74-3985955ea45a {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:36.182546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6868ffa6-b84b-47f2-9676-a472f1576841 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:36.182678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4832f4ab-6378-462d-8a74-3985955ea45a not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:36.183006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:36.196195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd2af5d4-bae9-4522-b57b-0ba3f5b76d4f req-cbd4c136-2316-464a-9a03-3218fc01a056 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:36.203180 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd2af5d4-bae9-4522-b57b-0ba3f5b76d4f req-cbd4c136-2316-464a-9a03-3218fc01a056 tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/ports?device_id=df53bf60-279b-4810-8d32-609ad4f8aff0 HTTP/1.1" status: 200 len: 945 time: 0.4998763 Nov 24 14:03:36.220619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.236820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Transition to ACTIVE for port object b64007ec-f1c9-40fd-b37b-daa1062d10a4 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:36.244980 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:36.263588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Transition to ACTIVE for port object b64007ec-f1c9-40fd-b37b-daa1062d10a4 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:36.273577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Transition to ACTIVE for port object 32248440-534c-460b-aa7b-965b1062bba8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:36.283453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2c71eed0-81df-4405-af3c-6f6a56fb8ef7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.305795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:36.306248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1e3b7ee4-f2a8-453e-a9af-1575ce74da44 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:36.315288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.321927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.327443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c6a963a4-5e4a-4f7b-b2da-b3d126f7644b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:36.389781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Attempting to bind port c00f8af4-02eb-44ba-975c-36393223efb1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:36.390402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Attempting to bind port c00f8af4-02eb-44ba-975c-36393223efb1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:36.390917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Attempting to bind port c00f8af4-02eb-44ba-975c-36393223efb1 on network 1a509ac2-7dc4-4e91-864c-101a02b01959 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:36.414215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=619b3980-2ba7-46d2-ac96-79f004af4263,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.432661 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cba2de-48ba-4831-97c5-656b236d9432 None None] Pushing event updated for resources: {'Port': ['ID=188270d0-aa74-4ce2-8132-d7380095ed80,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.433053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:36.433675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Checking segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:36.434549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.435019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Bound using segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:36.435676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Bound port: c00f8af4-02eb-44ba-975c-36393223efb1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:36.436213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.471911 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d9cba2de-48ba-4831-97c5-656b236d9432 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.523s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:36.477365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.295s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:36.496514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Network 9f701968-870a-427f-95eb-df8bebab0c4c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:36.515925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.528819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fe63f46-6d92-41b9-981c-f04f02143292 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:36.537134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:36.539004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:36.541098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Pushing event updated for resources: {'Port': ['ID=b64007ec-f1c9-40fd-b37b-daa1062d10a4,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.543683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:36.554138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:36.572999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.574188 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 1.3296878 Nov 24 14:03:36.577358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45078) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:36.584721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '69a2a9ea-c083-424f-95cf-7b693d0d888b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:36.592164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:36.594045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Pushing event deleted for resources: {'Port': ['ID=5556426c-12cf-49da-8d89-bede94f2996e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.598916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:36.599106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:36.603434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:36.608112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b26afa3-9da7-4980-8671-1b407c238e25 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:36.610647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:36.613723 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd2af5d4-bae9-4522-b57b-0ba3f5b76d4f req-2d728686-f879-44fe-a8b0-fdebed73081a tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.70 "GET /v2.0/security-groups?id=4f12eed9-2db6-4361-a8ad-5dc58a811270&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4094565 Nov 24 14:03:36.618656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:36.637391 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:03:36.646882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.706218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 172.20.0.4 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/d7488947-72a5-4438-b697-6c051a0aae30/0700818f-07ef-4c14-84cd-c19f5c4cc919) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:36.716281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe1a:fc3c (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/ec750fdd-063c-49a4-a9fd-037b3423c10f/0700818f-07ef-4c14-84cd-c19f5c4cc919) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:36.738262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.744442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.746956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a23de77c-2045-4756-8b95-3e1744e3167a tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:36.749935 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:35Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:36.754429 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-967686b7-1f1d-429b-b060-6d8c1ca34c10 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:35Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:36.779919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c4474ef4-aa88-4eca-b864-7e698f838b21,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.783241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:36.806153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.816356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.2326429 Nov 24 14:03:36.839294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] No DVR routers for this DVR port 5556426c-12cf-49da-8d89-bede94f2996e on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:36.841680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:36.843779 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b500dd6-cc7a-4bb1-84c8-30fb47863531 req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] 10.222.0.47 "DELETE /v2.0/ports/5556426c-12cf-49da-8d89-bede94f2996e HTTP/1.1" status: 204 len: 173 time: 2.3574357 Nov 24 14:03:36.855717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'name': 'network-vif-deleted', 'tag': '5556426c-12cf-49da-8d89-bede94f2996e'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:03:36.915430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:36.996138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.669s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:37.013821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.013821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.621s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:37.014673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df53bf60-279b-4810-8d32-609ad4f8aff0', 'name': 'network-vif-deleted', 'tag': '5556426c-12cf-49da-8d89-bede94f2996e', 'status': 'completed', 'code': 200} Nov 24 14:03:37.014775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:37.014775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Attempting to bind port b64007ec-f1c9-40fd-b37b-daa1062d10a4 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:37.014775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Attempting to bind port b64007ec-f1c9-40fd-b37b-daa1062d10a4 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:37.014775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Attempting to bind port b64007ec-f1c9-40fd-b37b-daa1062d10a4 on network 9f701968-870a-427f-95eb-df8bebab0c4c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:37.026293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] For port c00f8af4-02eb-44ba-975c-36393223efb1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:37.054651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:37.055090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Checking segment: {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:37.055559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.055871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Bound using segment: {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:37.056355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Bound port: b64007ec-f1c9-40fd-b37b-daa1062d10a4, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:37.056755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.066604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] For port c00f8af4-02eb-44ba-975c-36393223efb1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c00f8af4-02eb-44ba-975c-36393223efb1,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:37.070416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Attempting to bind port 32248440-534c-460b-aa7b-965b1062bba8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:37.070808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Attempting to bind port 32248440-534c-460b-aa7b-965b1062bba8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:37.071213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Attempting to bind port 32248440-534c-460b-aa7b-965b1062bba8 on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:37.081147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.088870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-546869b1-90b3-4e91-a025-cfdf4bda72e1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:37.168729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:37.169447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:37.169447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.169817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:37.170309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Bound port: 32248440-534c-460b-aa7b-965b1062bba8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:37.170695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.212640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4b26afa3-9da7-4980-8671-1b407c238e25 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:37.238071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4b26afa3-9da7-4980-8671-1b407c238e25 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:37.239425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.258769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-b811f9ca-5866-4b3d-9581-d5a7b440bee4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:37.277932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.307779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-b811f9ca-5866-4b3d-9581-d5a7b440bee4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:37.309281 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-b811f9ca-5866-4b3d-9581-d5a7b440bee4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1891153700&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.2212362 Nov 24 14:03:37.347056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1675f08-d7df-4204-bd86-0a8be996cec7 None None] Pushing event updated for resources: {'Port': ['ID=c00f8af4-02eb-44ba-975c-36393223efb1,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:37.356883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.366216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f1675f08-d7df-4204-bd86-0a8be996cec7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:37.372701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 0700818f-07ef-4c14-84cd-c19f5c4cc919 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:37.395306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] For port b64007ec-f1c9-40fd-b37b-daa1062d10a4, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:37.429082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] For port b64007ec-f1c9-40fd-b37b-daa1062d10a4, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b64007ec-f1c9-40fd-b37b-daa1062d10a4,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:37.430034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:37.430781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:37.507731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.516411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-64c87a8e-9fa1-4167-a3cf-0db2ce379a13 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:37.571307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:37.608297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:37.679425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-f472962d-493f-4691-8173-6bf47a833478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:37.680054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-f472962d-493f-4691-8173-6bf47a833478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:37.697855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.714283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c95fc8e5-e560-4377-a6ca-f71f57cabd69 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:37.726460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45094) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:37.769491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.780720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:37.791846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Deleting subnet 81ea79c9-beb6-43bc-8036-8717cf3b026f {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:37.794906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.808916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Pushing event updated for resources: {'Port': ['ID=b64007ec-f1c9-40fd-b37b-daa1062d10a4,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:37.825069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:37.826913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:37.840256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:37.840868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.058s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:37.854193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.885572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-f472962d-493f-4691-8173-6bf47a833478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:37.887271 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-f472962d-493f-4691-8173-6bf47a833478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 200 len: 797 time: 0.5635490 Nov 24 14:03:37.914259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.921290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=0700818f-07ef-4c14-84cd-c19f5c4cc919,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:37.929287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:37.946704 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-33b89f28-c58f-4bbb-86e4-6cdbb27c6aff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0463769 Nov 24 14:03:37.950061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.966122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:37.966869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:37.971298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:38.042069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:38.058349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:38.059729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.070429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7e5f8163-e1cc-42dd-90b8-9f5388a0866a tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:38.104211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 4b26afa3-9da7-4980-8671-1b407c238e25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b26afa3-9da7-4980-8671-1b407c238e25,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:38.121842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 3.7408104 Nov 24 14:03:38.128899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45098) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:38.136951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.143414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b67892e5-6903-4056-a39c-c16f1bdf953c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:38.193947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:38.206204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=81ea79c9-beb6-43bc-8036-8717cf3b026f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:38.259374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:38.281423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.313250 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/81ea79c9-beb6-43bc-8036-8717cf3b026f HTTP/1.1" status: 204 len: 168 time: 0.5857899 Nov 24 14:03:38.318826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45102) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:38.329710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5556426c-12cf-49da-8d89-bede94f2996e no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:38.395666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=4b26afa3-9da7-4980-8671-1b407c238e25,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:38.398833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 5556426c-12cf-49da-8d89-bede94f2996e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:38.399181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5556426c-12cf-49da-8d89-bede94f2996e not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:38.473400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:38.514727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dec2e279-e238-440c-9e4e-273114ecebc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:38.519100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dec2e279-e238-440c-9e4e-273114ecebc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:38.520061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-389dca43-1d8f-4b34-892f-c5136e944fd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:38.520867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-dec2e279-e238-440c-9e4e-273114ecebc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1782 time: 0.3868577 Nov 24 14:03:38.523935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45108) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:38.541441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.558573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-389dca43-1d8f-4b34-892f-c5136e944fd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:38.561311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-389dca43-1d8f-4b34-892f-c5136e944fd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5987575 Nov 24 14:03:38.562432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Allocated IP 2001:db8:3::1 (9f701968-870a-427f-95eb-df8bebab0c4c/b9d08fe6-f61a-4110-b46e-7c03f6921df1/1b112932-ded2-4d27-9ad6-654d5a9dda33) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:38.573450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.641438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 0700818f-07ef-4c14-84cd-c19f5c4cc919 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:38.642381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.678271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b67892e5-6903-4056-a39c-c16f1bdf953c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:38.678643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.809502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.848831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['99ebbc60-aad0-4014-a19e-55e6165ad0ef']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:38.850476 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-f24ae48a-ef6f-490b-81ad-0a02bf9daed1 service neutron] 10.222.0.70 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2687471 Nov 24 14:03:38.861292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:36Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:38.869696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30e3e157-e213-4382-9978-63db425af94d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:38.886893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.888939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '097f0e42-3015-4e27-9c16-edc8dbc9112d') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:38.889421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '097f0e42-3015-4e27-9c16-edc8dbc9112d') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:38.893087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-548f052a-b3d5-4edc-928b-b1dd870ea28c None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:36Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:38.911900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.985706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 30e3e157-e213-4382-9978-63db425af94d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:38.986078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:38.994964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Transition to ACTIVE for port object 1b112932-ded2-4d27-9ad6-654d5a9dda33 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:39.021681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.041192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Releasing vlan 851 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:03:39.041625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:03:39.056405 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:03:39.076472 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-2070abc0-09e6-4851-8172-e3ee64c68a96 service neutron] 10.222.0.70 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2141979 Nov 24 14:03:39.123177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.127525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a98f359e-835f-41d2-8b51-8351b0c6eaeb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:39.273623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 9f701968-870a-427f-95eb-df8bebab0c4c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:39.277490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:39.279988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:39.280513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.283502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=1b112932-ded2-4d27-9ad6-654d5a9dda33,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:39.292918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:39.572914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.629731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.648757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.662272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4cd15f71-3adc-4714-ae20-3493fa604ba0 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:39.705594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-89e86061-4347-4760-9903-23214f14d998 req-913453ca-a600-46c8-861a-f9d0afd255c4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 210 time: 0.1543519 Nov 24 14:03:39.725253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:39.812247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fe8991e-c98a-4d73-8eb1-ed705eab60e4 None None] Network 9f701968-870a-427f-95eb-df8bebab0c4c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:39.877506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Pushing event deleted for resources: {'Network': ['ID=99ebbc60-aad0-4014-a19e-55e6165ad0ef,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:39.968677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32248440-534c-460b-aa7b-965b1062bba8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:40.009044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.346s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:40.018897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 0700818f-07ef-4c14-84cd-c19f5c4cc919 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:40.089058 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] 10.222.0.70 "DELETE /v2.0/networks/99ebbc60-aad0-4014-a19e-55e6165ad0ef HTTP/1.1" status: 204 len: 168 time: 1.7537043 Nov 24 14:03:40.103549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45122) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:40.118605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-47a1f967-377a-4b7d-9da9-040583b2d70c None None] Provisioning for port b64007ec-f1c9-40fd-b37b-daa1062d10a4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:40.126334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-509798c8-eb93-4a68-985b-04bcfe1c43e1 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:40.264652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Deleting subnet e12572d5-b975-4c19-86e4-11bfb71d8338 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:40.268950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.322970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.337657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.338749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.343211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9bc9c8a9-fa5a-47a1-9407-89fe63752fb7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:40.407947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.459165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 32248440-534c-460b-aa7b-965b1062bba8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:40.509060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b26afa3-9da7-4980-8671-1b407c238e25 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:40.585623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.595581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event updated for resources: {'Port': ['ID=1b112932-ded2-4d27-9ad6-654d5a9dda33,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:40.600629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:40.669983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Network 9f701968-870a-427f-95eb-df8bebab0c4c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:40.671297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:40.693094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.699899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6bc018f9-23da-4be1-8bb9-b8b5185463af tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:40.753075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=0700818f-07ef-4c14-84cd-c19f5c4cc919,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:40.760478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:40.808163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Provisioning for port 32248440-534c-460b-aa7b-965b1062bba8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:40.833613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:40.834201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.944508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:40.961325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a4ae8006-3bdd-461a-b2e6-ab7afcfd907c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:40.982336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4b26afa3-9da7-4980-8671-1b407c238e25 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:40.982657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.002761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.012220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e12572d5-b975-4c19-86e4-11bfb71d8338,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:41.021186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:41.050441 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/e12572d5-b975-4c19-86e4-11bfb71d8338 HTTP/1.1" status: 204 len: 168 time: 0.9439170 Nov 24 14:03:41.051581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45128) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:41.052896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.057685 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/0700818f-07ef-4c14-84cd-c19f5c4cc919 HTTP/1.1" status: 204 len: 168 time: 2.5299442 Nov 24 14:03:41.073877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45132) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:41.176803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.221963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2038ea30-29d8-4839-8b4f-32db9e1e45a1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:41.225681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2038ea30-29d8-4839-8b4f-32db9e1e45a1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:41.232228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2038ea30-29d8-4839-8b4f-32db9e1e45a1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:41.239643 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2038ea30-29d8-4839-8b4f-32db9e1e45a1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1623621 Nov 24 14:03:41.249657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45136) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:41.264213 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2cbfb7bf-3175-41ae-94c4-5bf3e4daf771 req-8ddf38e6-eb5e-40c7-b76d-f86d1eb682e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 210 time: 0.3124039 Nov 24 14:03:41.306607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:41.308716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': 'ec750fdd-063c-49a4-a9fd-037b3423c10f', 'ip_address': '2001:db8::f816:3eff:fede:9655'}, {'subnet_id': 'd7488947-72a5-4438-b697-6c051a0aae30'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '32248440-534c-460b-aa7b-965b1062bba8'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:03:41.390398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.480487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.549840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-a7ff51e9-6e39-4516-bf5b-c73bc107dec5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:41.551322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-a7ff51e9-6e39-4516-bf5b-c73bc107dec5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 200 len: 797 time: 0.3819869 Nov 24 14:03:41.564266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:41.653988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.662415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8ff992a2-8e8f-4da1-bbcd-65b75c774232 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:41.708642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Allocated IP 172.20.0.2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/d7488947-72a5-4438-b697-6c051a0aae30/32248440-534c-460b-aa7b-965b1062bba8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:41.755541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.765695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c00f8af4-02eb-44ba-975c-36393223efb1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:41.783115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-c07f93d8-427d-4bdd-ab7a-b3e500da3f89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 380 time: 0.2062519 Nov 24 14:03:41.793476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['69a2a9ea-c083-424f-95cf-7b693d0d888b']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:41.804279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet d7488947-72a5-4438-b697-6c051a0aae30 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:41.807122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['95844fa5-55bb-4e49-a847-77b43b74f899']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:41.821692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b6c90f5-e312-477e-bda0-1f9d2b2a6111') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:41.822039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b6c90f5-e312-477e-bda0-1f9d2b2a6111') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:41.836926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.862023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.870210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Releasing vlan 891 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:03:41.870793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:41.912113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:41.926623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:42.009968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:42.022403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.4376774 Nov 24 14:03:42.023847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-de8ef2f9-427c-497f-9b46-cfa86476af39 None None] Provisioning for port 1b112932-ded2-4d27-9ad6-654d5a9dda33 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:42.024077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45140) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:42.028383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:42.032656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-de8ef2f9-427c-497f-9b46-cfa86476af39 None None] Provisioning complete for port 1b112932-ded2-4d27-9ad6-654d5a9dda33 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:42.033035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-de8ef2f9-427c-497f-9b46-cfa86476af39 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.034411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:42.063085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:42.077830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:03:42.085899 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:03:42.096254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c00f8af4-02eb-44ba-975c-36393223efb1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:42.111156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c00f8af4-02eb-44ba-975c-36393223efb1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:42.111535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.164272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:42.179650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.180215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:42.181089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:42.183583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5da45eba-5a40-4f63-99f5-de82688af413 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:42.185118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:42.188078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.208164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.216186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Pushing event deleted for resources: {'Network': ['ID=95844fa5-55bb-4e49-a847-77b43b74f899,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:42.222438 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] 10.222.0.70 "DELETE /v2.0/networks/95844fa5-55bb-4e49-a847-77b43b74f899 HTTP/1.1" status: 204 len: 168 time: 1.1663237 Nov 24 14:03:42.224163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:42.250667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-de8ef2f9-427c-497f-9b46-cfa86476af39 None None] Port 1b112932-ded2-4d27-9ad6-654d5a9dda33 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:42.314214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.371520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Transition to ACTIVE for port object 32248440-534c-460b-aa7b-965b1062bba8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:42.383893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.393627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.409044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:42.506205 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cfd25dbe-48e0-4021-9910-b18a4f21da10 req-c39fdb26-744c-4d5a-b9c7-8e2861fa66ca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 210 time: 0.0552955 Nov 24 14:03:42.530066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45148) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:42.530208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.549822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.558958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.12 (1a509ac2-7dc4-4e91-864c-101a02b01959/592f062e-f3d4-49e3-bd1d-81be732122e4/d63435aa-64d2-4de8-b8ef-04e0392fcab4) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:42.633533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9e29feaf-08ce-4ad9-ab9a-31d38587ccbf None None] Provisioning complete for port 1b112932-ded2-4d27-9ad6-654d5a9dda33 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:42.634094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9e29feaf-08ce-4ad9-ab9a-31d38587ccbf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.645406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.694431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:42.721796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.725783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a9bbd70-6564-49ed-a6b5-98318053f745 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:42.750806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a527987c-c38d-473f-9673-98885ef30e46 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=d8f8b834cdff4f678fb27b967b7aa48b&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2177250 Nov 24 14:03:42.756459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45152) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:42.777862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=d7488947-72a5-4438-b697-6c051a0aae30,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:42.787500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:42.791504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.803919 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/d7488947-72a5-4438-b697-6c051a0aae30 HTTP/1.1" status: 204 len: 168 time: 1.5520840 Nov 24 14:03:42.811073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45156) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:42.888379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet ec750fdd-063c-49a4-a9fd-037b3423c10f {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:42.892015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.950935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:42.962725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:42.969986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.561s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:43.005697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9e29feaf-08ce-4ad9-ab9a-31d38587ccbf None None] Port 1b112932-ded2-4d27-9ad6-654d5a9dda33 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:03:43.062786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.065707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port c00f8af4-02eb-44ba-975c-36393223efb1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c00f8af4-02eb-44ba-975c-36393223efb1,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:43.073114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.074169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b64007ec-f1c9-40fd-b37b-daa1062d10a4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:43.105129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:43.157666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.163915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-636d4746-8ab8-43c6-87be-8ebfed284654 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:43.187457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.216313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object d63435aa-64d2-4de8-b8ef-04e0392fcab4 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:43.227476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=ec750fdd-063c-49a4-a9fd-037b3423c10f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:43.233743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:43.267735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.284906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.300499 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/ec750fdd-063c-49a4-a9fd-037b3423c10f HTTP/1.1" status: 204 len: 168 time: 0.4883878 Nov 24 14:03:43.303919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45160) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:43.326099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=c00f8af4-02eb-44ba-975c-36393223efb1,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:43.328205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:113}} Nov 24 14:03:43.337551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:43.363100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:39Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:35Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '1b112932-ded2-4d27-9ad6-654d5a9dda33', 'name': '', 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:77:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:37Z', 'updated_at': '2021-11-24T14:03:40Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:43.364573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Removed routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:121}} Nov 24 14:03:43.365257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.368387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:43.368999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Updating router 9447f30d-a2f1-408d-906a-0bcd23151ed7 port 1b112932-ded2-4d27-9ad6-654d5a9dda33 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:03:43.375264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.388049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f433d4a4-750a-47b3-b894-f088aebd4b50 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:43.391003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-46da4ec9-b3f3-4992-9066-33ab99560a4b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:43.408911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.418818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port b64007ec-f1c9-40fd-b37b-daa1062d10a4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:43.430619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b64007ec-f1c9-40fd-b37b-daa1062d10a4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:43.431257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.472615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-46da4ec9-b3f3-4992-9066-33ab99560a4b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:router {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:43.477175 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-46da4ec9-b3f3-4992-9066-33ab99560a4b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1719379 Nov 24 14:03:43.477792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45164) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:43.483809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:43.485240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.582484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.589818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-567993b7-7a5b-41f9-b423-d90b7188d2f8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:43.628266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f12eed9-2db6-4361-a8ad-5dc58a811270,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:43.633602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:43.639918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:43.644694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:43.651735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:43.658724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:43.676008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.678066 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/4f12eed9-2db6-4361-a8ad-5dc58a811270 HTTP/1.1" status: 204 len: 168 time: 0.9205992 Nov 24 14:03:43.679486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:43.683813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:43.700914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:43.709995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=d63435aa-64d2-4de8-b8ef-04e0392fcab4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:43.714091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:43.719145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.331s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:43.720157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:43.849916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d959875a-20ce-499b-be17-6c32ffb4904a None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:43.896325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1b039d62-af09-48a3-8064-c30c0dfadfcb None None] Could not find standard attr ID for object 0700818f-07ef-4c14-84cd-c19f5c4cc919. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:03:43.940003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:43.940644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.010762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303dd2b3-d291-420a-8bc1-01c16948fb59 req-de54aa89-953a-42d2-a902-6a4afeca3452 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:44.011783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-303dd2b3-d291-420a-8bc1-01c16948fb59 req-de54aa89-953a-42d2-a902-6a4afeca3452 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:44.020840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2314885 Nov 24 14:03:44.046019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.103510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Request body: {'port': {'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:44.250731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-303dd2b3-d291-420a-8bc1-01c16948fb59 req-de54aa89-953a-42d2-a902-6a4afeca3452 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:44.251807 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dd2b3-d291-420a-8bc1-01c16948fb59 req-de54aa89-953a-42d2-a902-6a4afeca3452 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 932 time: 0.4753807 Nov 24 14:03:44.276244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1b039d62-af09-48a3-8064-c30c0dfadfcb None None] Provisioning for port 32248440-534c-460b-aa7b-965b1062bba8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:44.299886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1b039d62-af09-48a3-8064-c30c0dfadfcb None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:44.299886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1b039d62-af09-48a3-8064-c30c0dfadfcb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.336387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port b64007ec-f1c9-40fd-b37b-daa1062d10a4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b64007ec-f1c9-40fd-b37b-daa1062d10a4,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:44.352983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:03:44.382995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.383872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 188270d0-aa74-4ce2-8132-d7380095ed80 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:44.389324 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dd2b3-d291-420a-8bc1-01c16948fb59 req-c8230e17-1930-444e-b5a0-6b9d0b2754e5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1237729 Nov 24 14:03:44.422986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:44.485895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.497122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45174) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:44.501304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.510696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.511440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=b64007ec-f1c9-40fd-b37b-daa1062d10a4,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:44.524623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:44.604579 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9ef697f9-cf39-41e5-862a-6a5050b568d8 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=7928240e87714d5b8136dff57f1deb6b&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1032732 Nov 24 14:03:44.605511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45178) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:44.643795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.772940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.795467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.816234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 188270d0-aa74-4ce2-8132-d7380095ed80 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:44.833673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Transition to ACTIVE for port object 1b112932-ded2-4d27-9ad6-654d5a9dda33 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:44.836194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 188270d0-aa74-4ce2-8132-d7380095ed80 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:44.836645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.870977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.876078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:44.884715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9a22a4db-fdc7-40ba-b822-f7d831fe429f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:44.904853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:45.004634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': 'c3f6596d-3a60-4809-acb1-3062b3b91f87'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '32248440-534c-460b-aa7b-965b1062bba8'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:03:45.104793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:45.109477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.114053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4a7ac5bc-9ac3-4c31-841b-58cccf4bc83a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:45.126483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b17aa10-3ddb-48c1-a8fc-fdcd73db0a70,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:45.141375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:45.170919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.173731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6e14d9-b799-4aee-8d74-d612dfda1c48 None None] Pushing event updated for resources: {'Port': ['ID=1b112932-ded2-4d27-9ad6-654d5a9dda33,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:45.176488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.178012 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/3b17aa10-3ddb-48c1-a8fc-fdcd73db0a70 HTTP/1.1" status: 204 len: 168 time: 0.5713093 Nov 24 14:03:45.178403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae6e14d9-b799-4aee-8d74-d612dfda1c48 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:45.188503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.191307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.196783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfe7-3fd1-409d-ad85-5b204a31c385 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:45.270478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.283227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:45.288167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:45.292711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:45.293294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.322641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d63435aa-64d2-4de8-b8ef-04e0392fcab4 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:03:45.333266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.354537 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.8752508 Nov 24 14:03:45.356054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45184) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:45.361201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=8']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:45.365133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Transition to ACTIVE for port object d63435aa-64d2-4de8-b8ef-04e0392fcab4 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:45.378002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:45.378245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.382863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f963b292-093b-4777-bc8d-f7bd451c45fa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:45.394432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:45.398549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8376422a-4b9a-4172-88bc-d5bdce3895d1 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.168s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:45.511915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:45.538339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.550286 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b330e43-3c1f-4fd0-bb1b-af9419659f7a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 954 time: 3.5239358 Nov 24 14:03:45.559665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45190) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:45.638390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Pushing event updated for resources: {'Port': ['ID=d63435aa-64d2-4de8-b8ef-04e0392fcab4,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:45.648997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:45.689940 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9ee9912e-2eb0-4e0a-b05d-0b7dbdf51ce8 None None] Provisioning for port d63435aa-64d2-4de8-b8ef-04e0392fcab4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:45.826891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=c3f6596d-3a60-4809-acb1-3062b3b91f87,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:45.829542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.431s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:45.841510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.882606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Attempting to bind port d63435aa-64d2-4de8-b8ef-04e0392fcab4 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:45.883102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Attempting to bind port d63435aa-64d2-4de8-b8ef-04e0392fcab4 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:45.883538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Attempting to bind port d63435aa-64d2-4de8-b8ef-04e0392fcab4 on network 1a509ac2-7dc4-4e91-864c-101a02b01959 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:45.893734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Port d63435aa-64d2-4de8-b8ef-04e0392fcab4 on network 1a509ac2-7dc4-4e91-864c-101a02b01959 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:03:45.894219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Attempting to bind port d63435aa-64d2-4de8-b8ef-04e0392fcab4 on network 1a509ac2-7dc4-4e91-864c-101a02b01959 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:45.895543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:45.904149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:45.908054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:45.908654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Checking segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:45.908798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:45.909223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Bound using segment: {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:45.909769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Bound port: d63435aa-64d2-4de8-b8ef-04e0392fcab4, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '09329ff1-fa04-43a6-bab2-843d53b31d28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 875, 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:45.910809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.911026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Attempting to bind port 1b112932-ded2-4d27-9ad6-654d5a9dda33 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:45.911553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Attempting to bind port 1b112932-ded2-4d27-9ad6-654d5a9dda33 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:45.912199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Attempting to bind port 1b112932-ded2-4d27-9ad6-654d5a9dda33 on network 9f701968-870a-427f-95eb-df8bebab0c4c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:45.922299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:45.951959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:45.952660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Checking segment: {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:45.953077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.953453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Bound using segment: {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:45.953945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Bound port: 1b112932-ded2-4d27-9ad6-654d5a9dda33, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8647adf-0af1-4db0-8351-e6cffbbeec2a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 869, 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:45.954406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:45.962821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:45.966583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.000644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 188270d0-aa74-4ce2-8132-d7380095ed80, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=188270d0-aa74-4ce2-8132-d7380095ed80,segment=NetworkSegment(760e440b-8386-4e18-b96a-54ed57dc5c0b),segment_id=760e440b-8386-4e18-b96a-54ed57dc5c0b)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:46.001297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696f7e57-1c02-480e-92ed-41d93d0de301 req-a758f8cb-d2a3-4276-a33c-b77ac4911cf4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:46.002917 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-696f7e57-1c02-480e-92ed-41d93d0de301 req-a758f8cb-d2a3-4276-a33c-b77ac4911cf4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 944 time: 0.3287873 Nov 24 14:03:46.042461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.053771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] For port d63435aa-64d2-4de8-b8ef-04e0392fcab4, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:46.059895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-200101e9-309e-4e33-8bbc-c51fc64732cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:46.069019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] For port d63435aa-64d2-4de8-b8ef-04e0392fcab4, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:46.076743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.083492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c3aeb514-de1d-4995-afe9-58c0c72bbdfa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:46.118759 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a8c8866b-221a-412f-8b54-b196ee6a3802 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 954 time: 0.5528288 Nov 24 14:03:46.131788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45196) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:46.138145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=188270d0-aa74-4ce2-8132-d7380095ed80,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:46.141549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'routes': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:46.145926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:46.193385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Pushing event updated for resources: {'Port': ['ID=d63435aa-64d2-4de8-b8ef-04e0392fcab4,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:46.199410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:46.200000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32248440-534c-460b-aa7b-965b1062bba8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:46.219875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.221698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] 10.222.0.47 "PUT /v2.0/ports/d63435aa-64d2-4de8-b8ef-04e0392fcab4 HTTP/1.1" status: 200 len: 1094 time: 2.1305337 Nov 24 14:03:46.222613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:03:46.397279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'status': 'completed', 'code': 200} Nov 24 14:03:46.414432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] For port 1b112932-ded2-4d27-9ad6-654d5a9dda33, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:46.435018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:46.440030 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-696f7e57-1c02-480e-92ed-41d93d0de301 req-4c20a972-1398-4c3a-bded-f61a2471f11f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4274490 Nov 24 14:03:46.446025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] For port 1b112932-ded2-4d27-9ad6-654d5a9dda33, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1b112932-ded2-4d27-9ad6-654d5a9dda33,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:46.449077 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-1709346c-fe1c-4095-9e2e-7d463eecd9da service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 1097 time: 0.1741359 Nov 24 14:03:46.456209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.464314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-319336be-de9b-445f-8460-affa1ec9495a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:46.531555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.538548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:46.539148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.559087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-bf86ac6c-7b66-402c-b901-21b352804be0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4 HTTP/1.1" status: 200 len: 217 time: 0.0996387 Nov 24 14:03:46.583412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:46.623538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6e14d9-b799-4aee-8d74-d612dfda1c48 None None] Pushing event updated for resources: {'Port': ['ID=1b112932-ded2-4d27-9ad6-654d5a9dda33,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:46.626587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae6e14d9-b799-4aee-8d74-d612dfda1c48 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:46.636339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.036s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:46.647227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3499a39e-4ee4-42fa-bf6a-b27c937702a5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:46.649633 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-3499a39e-4ee4-42fa-bf6a-b27c937702a5 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=592f062e-f3d4-49e3-bd1d-81be732122e4 HTTP/1.1" status: 200 len: 835 time: 0.0833514 Nov 24 14:03:46.700444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:46.701088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:46.775489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-d4665fa7-fc8f-4d3d-8f65-a0a0c3706203 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=1a509ac2-7dc4-4e91-864c-101a02b01959&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1164126 Nov 24 14:03:46.944752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:46.947966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.312s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:46.975426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.001846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-746fa74d-829f-496b-a482-c56e21950040 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:47.003130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c00f8af4-02eb-44ba-975c-36393223efb1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:47.037617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-185d8785-0502-4efd-8e5c-bb80f129fdfe service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2487876 Nov 24 14:03:47.048382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:47.108591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:47.122404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:47.128693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:47.129828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.160017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=038e398a-2b0a-45e4-82c9-5c5dcd11ea72,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:47.169825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:47.241300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b237e02-a7bd-49fa-bcaa-aa4ce6d60ed5 req-b9ce6eb0-938f-467c-ae72-44fbffa272f9 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1971469 Nov 24 14:03:47.368588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0055981 Nov 24 14:03:47.369050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45202) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:47.381997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:b2:01:12', 'name': 'tempest-NetworksTestDHCPv6-1220224649'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:47.406140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c00f8af4-02eb-44ba-975c-36393223efb1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:47.406638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.427059 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-f9bfb9db-6878-4758-b6e2-c1fa9557a02a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 1097 time: 0.1218653 Nov 24 14:03:47.532494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71b5cce7-bfa4-4dde-b5a4-bd00e0b26395 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:47.542160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:47.582440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:47.590586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:47.599656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:47.628297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.extraroute_db [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added routes are [] {{(pid=83525) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:113}} Nov 24 14:03:47.628603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.extraroute_db [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Removed routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}] {{(pid=83525) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:121}} Nov 24 14:03:47.630965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:47.678626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-3bbb0099-7529-419d-9e9b-be10d85965e1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:47.680021 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-3bbb0099-7529-419d-9e9b-be10d85965e1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 200 len: 898 time: 0.2433929 Nov 24 14:03:47.710675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.745627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.753111 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-6a2a8f60-a80b-46b7-8c34-c5fb5ee59ca8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4 HTTP/1.1" status: 200 len: 217 time: 0.0635254 Nov 24 14:03:47.816609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-168b6042-7702-413a-833b-c5798c03512f None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:47.817018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-168b6042-7702-413a-833b-c5798c03512f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.844369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:47.886816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b64007ec-f1c9-40fd-b37b-daa1062d10a4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:47.919644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578c2351-32bc-4f43-9306-cd11b0514633 req-1615c635-ce08-4f7c-92cf-3e1a61381b2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:47.923401 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-578c2351-32bc-4f43-9306-cd11b0514633 req-1615c635-ce08-4f7c-92cf-3e1a61381b2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 944 time: 0.3175042 Nov 24 14:03:47.933467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 144fba37-10fe-4d2b-9cae-09d86999cb6f yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:03:47.961613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-85f4417e-f420-4b7f-b4ad-bed95964093e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:47.963257 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-85f4417e-f420-4b7f-b4ad-bed95964093e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=592f062e-f3d4-49e3-bd1d-81be732122e4 HTTP/1.1" status: 200 len: 835 time: 0.2012601 Nov 24 14:03:48.039279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-578c2351-32bc-4f43-9306-cd11b0514633 req-be056386-7b0d-4e8e-bc03-e766f3529972 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1068985 Nov 24 14:03:48.040305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:43Z', 'revision_number': 6, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:45Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '1b112932-ded2-4d27-9ad6-654d5a9dda33', 'name': '', 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:77:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:37Z', 'updated_at': '2021-11-24T14:03:46Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:48.051777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ddf9cf-a566-4e05-a514-9047eb3b64a2 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:43Z', 'revision_number': 6, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:45Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '1b112932-ded2-4d27-9ad6-654d5a9dda33', 'name': '', 'network_id': '9f701968-870a-427f-95eb-df8bebab0c4c', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:77:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:37Z', 'updated_at': '2021-11-24T14:03:46Z', 'revision_number': 4, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'b9d08fe6-f61a-4110-b46e-7c03f6921df1', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:48.067906 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-7fa783d1-13fc-44b7-812e-2000a32b0cf9 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=1a509ac2-7dc4-4e91-864c-101a02b01959&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0909593 Nov 24 14:03:48.137254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b64007ec-f1c9-40fd-b37b-daa1062d10a4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:48.137646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.239010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 172.20.0.13 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/038e398a-2b0a-45e4-82c9-5c5dcd11ea72/144fba37-10fe-4d2b-9cae-09d86999cb6f) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:48.312992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-0405c0de-d4cb-4bf4-b241-b218780a8b47 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2384951 Nov 24 14:03:48.379636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:feb2:112 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/c3f6596d-3a60-4809-acb1-3062b3b91f87/144fba37-10fe-4d2b-9cae-09d86999cb6f) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:48.455946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': 'c3f6596d-3a60-4809-acb1-3062b3b91f87', 'ip_address': '2001:db8::f816:3eff:fede:9655'}, {'subnet_id': '038e398a-2b0a-45e4-82c9-5c5dcd11ea72'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '32248440-534c-460b-aa7b-965b1062bba8'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:03:48.464826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.479449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.534319 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91a9aea1-e63a-4995-afe8-9f1264efd430 req-c22cefd0-5261-4516-a447-15ed65fcdb86 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2116327 Nov 24 14:03:48.554338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.686770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b112932-ded2-4d27-9ad6-654d5a9dda33 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:48.791081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1b112932-ded2-4d27-9ad6-654d5a9dda33 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:48.795655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1b112932-ded2-4d27-9ad6-654d5a9dda33 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:48.796062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.796483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.820907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 144fba37-10fe-4d2b-9cae-09d86999cb6f will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:48.841035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:48.913905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.930163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:48.963947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:48.986344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Allocated IP 172.20.0.2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/038e398a-2b0a-45e4-82c9-5c5dcd11ea72/32248440-534c-460b-aa7b-965b1062bba8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:49.031949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1b112932-ded2-4d27-9ad6-654d5a9dda33, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1b112932-ded2-4d27-9ad6-654d5a9dda33,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:49.037104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.037953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 188270d0-aa74-4ce2-8132-d7380095ed80 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:49.067735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:49.181650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:49.193432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:49.196116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:49.277826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=144fba37-10fe-4d2b-9cae-09d86999cb6f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:49.289676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.360s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:49.298444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1b112932-ded2-4d27-9ad6-654d5a9dda33,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:49.307197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:49.312275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:49.336050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:49.336655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.339929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 188270d0-aa74-4ce2-8132-d7380095ed80 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:49.340312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.380214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.392380 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 2.0223167 Nov 24 14:03:49.395849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45210) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:49.409212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e240cdf-261c-4501-84ba-8564d4358c20 req-c6bd3aa7-2ab4-4e2a-a9e7-3cd7602c96ca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:49.411133 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8e240cdf-261c-4501-84ba-8564d4358c20 req-c6bd3aa7-2ab4-4e2a-a9e7-3cd7602c96ca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 944 time: 0.1802802 Nov 24 14:03:49.413444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Transition to ACTIVE for port object 32248440-534c-460b-aa7b-965b1062bba8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:49.422269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.423580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:49.426990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6cdad6b7-2cd2-4660-aacc-476eb61c7b41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:49.431383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.432643 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bc0a8b89-1fb6-4714-802d-422fe73a5626 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 704 time: 3.2995863 Nov 24 14:03:49.448462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45214) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:49.519455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf0b0516-27b5-484b-af4a-1e62366b5229 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:49.523790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf0b0516-27b5-484b-af4a-1e62366b5229 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:49.524739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cf0b0516-27b5-484b-af4a-1e62366b5229 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:49.541778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cf0b0516-27b5-484b-af4a-1e62366b5229 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:49.544784 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cf0b0516-27b5-484b-af4a-1e62366b5229 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1864 time: 0.1472142 Nov 24 14:03:49.547489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45218) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:49.619900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Pushing event updated for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=10']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:49.633526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:49.654970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 144fba37-10fe-4d2b-9cae-09d86999cb6f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:49.655322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:49.694399 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8e240cdf-261c-4501-84ba-8564d4358c20 req-3e21cee1-c735-406c-9527-28ce7e88a233 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2733285 Nov 24 14:03:49.748157 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ce5feb79-2ba5-4e52-b16c-a4bf02a078c2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 704 time: 0.2959480 Nov 24 14:03:49.748411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45222) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:49.942025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.068173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 144fba37-10fe-4d2b-9cae-09d86999cb6f owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:50.114695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.221658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device d63435aa-64d2-4de8-b8ef-04e0392fcab4 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:03:50.299702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.307174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a48af195-cecb-43cb-8f6e-213846917e84 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:50.326495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d0bb0c8-305c-4662-9091-7e8496f9d929 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:50.361030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=144fba37-10fe-4d2b-9cae-09d86999cb6f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:50.364097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:50.426468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-51a34ab2-f510-474c-a275-44a818c2b4df None None] Provisioning for port 32248440-534c-460b-aa7b-965b1062bba8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:50.458164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-51a34ab2-f510-474c-a275-44a818c2b4df None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:50.458303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51a34ab2-f510-474c-a275-44a818c2b4df None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.519815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.543825 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/144fba37-10fe-4d2b-9cae-09d86999cb6f HTTP/1.1" status: 204 len: 168 time: 0.9949014 Nov 24 14:03:50.545200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45226) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:50.567401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port d63435aa-64d2-4de8-b8ef-04e0392fcab4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:50.580968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32248440-534c-460b-aa7b-965b1062bba8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:50.625755 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-951e06eb-73d4-4137-90fe-5df0a3255174 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:50.627277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-951e06eb-73d4-4137-90fe-5df0a3255174 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:50.629381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-951e06eb-73d4-4137-90fe-5df0a3255174 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:50.630411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-951e06eb-73d4-4137-90fe-5df0a3255174 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:50.650657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-951e06eb-73d4-4137-90fe-5df0a3255174 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:50.652658 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-951e06eb-73d4-4137-90fe-5df0a3255174 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1060996 Nov 24 14:03:50.653556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 875, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:03:50.655544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45230) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:50.845680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.882462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d63435aa-64d2-4de8-b8ef-04e0392fcab4 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:03:50.903864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:50.904256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.916560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 038e398a-2b0a-45e4-82c9-5c5dcd11ea72 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:50.947153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port d63435aa-64d2-4de8-b8ef-04e0392fcab4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:50.951633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 1b112932-ded2-4d27-9ad6-654d5a9dda33 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:50.952323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.956617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:50.967325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f1675f08-d7df-4204-bd86-0a8be996cec7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:51.024606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.067455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=d63435aa-64d2-4de8-b8ef-04e0392fcab4,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:51.070655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:51.095856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.125096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b112932-ded2-4d27-9ad6-654d5a9dda33 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:51.171088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 1b112932-ded2-4d27-9ad6-654d5a9dda33, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1b112932-ded2-4d27-9ad6-654d5a9dda33,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:51.171711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.193983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2562e2-4119-48a1-a44b-f7819b66cad1 req-fff71ecf-dc16-4483-a295-48f6a5e471ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:51.195511 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0e2562e2-4119-48a1-a44b-f7819b66cad1 req-fff71ecf-dc16-4483-a295-48f6a5e471ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 945 time: 0.3204966 Nov 24 14:03:51.218315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1b112932-ded2-4d27-9ad6-654d5a9dda33 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:51.218708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.331292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 1b112932-ded2-4d27-9ad6-654d5a9dda33 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:51.344777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0e2562e2-4119-48a1-a44b-f7819b66cad1 req-a1383305-75fe-428d-842c-7e43f01925ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1391187 Nov 24 14:03:51.362069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.379729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['d63435aa-64d2-4de8-b8ef-04e0392fcab4'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:03:51.470057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.485678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-576dac9c-afd3-466c-b916-d46b714b0ab6 None None] Provisioning complete for port 32248440-534c-460b-aa7b-965b1062bba8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:51.486168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-576dac9c-afd3-466c-b916-d46b714b0ab6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.487013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fee9b24a-49de-4a6b-b51f-f75e640dd01e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:51.533261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=038e398a-2b0a-45e4-82c9-5c5dcd11ea72,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:51.535227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.548423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:51.558891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/038e398a-2b0a-45e4-82c9-5c5dcd11ea72 HTTP/1.1" status: 204 len: 168 time: 0.8999007 Nov 24 14:03:51.559138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45236) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:51.582219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.589707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb00b11e-5076-4ea2-bbf9-bcd82995dd98 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:51.637293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet c3f6596d-3a60-4809-acb1-3062b3b91f87 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:51.640534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.643920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=1b112932-ded2-4d27-9ad6-654d5a9dda33,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:51.647005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:51.740291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.759887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4ff9e0b1-f2c6-4f1c-b01b-d442b47030fe None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:51.839465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.918339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.935530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:51.944028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2839027a-270b-462b-b37e-83e0f17b7de3 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:51.989148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=c3f6596d-3a60-4809-acb1-3062b3b91f87,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:51.991678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:51.995056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.008898 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acd29823-9fc8-4f5d-9b75-49a478d8d92b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/c3f6596d-3a60-4809-acb1-3062b3b91f87 HTTP/1.1" status: 204 len: 168 time: 0.4464900 Nov 24 14:03:52.009191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45240) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:52.030112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-88978ca3-e108-44b7-8d1d-d37c93f672fb None None] Could not find standard attr ID for object 0700818f-07ef-4c14-84cd-c19f5c4cc919. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:03:52.079231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0d3280ce-15ff-4656-a58b-dc4ca8096e7f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0689816 Nov 24 14:03:52.082458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45244) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:52.088263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:52.198882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:03:52.203726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Deleting port 32248440-534c-460b-aa7b-965b1062bba8 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:52.204291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.209250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:52.213911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:52.216730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:52.222803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:52.233655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:52.239387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.440798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] For port 32248440-534c-460b-aa7b-965b1062bba8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=32248440-534c-460b-aa7b-965b1062bba8,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:52.441091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.477725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:52.508209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.521531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ca860e8d-cd44-4dc9-8254-226caafea0a8 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:52.609764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 32248440-534c-460b-aa7b-965b1062bba8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:52.620690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:52.623870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:52.625612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=07b617b1-2d06-4741-9f6f-9ae81cf0d1fe,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:52.627923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:52.628495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.635505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:52.639460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Calling delete_port for 32248440-534c-460b-aa7b-965b1062bba8 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:52.657209 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5734732 Nov 24 14:03:52.661069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45250) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:52.672756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:52.779686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.788934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ffe4fac4-41b5-4e8d-bfff-4de0400f44ed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:52.834762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:52.839510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:52.842737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:52.845326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27914fa9-a90f-4201-96af-d64513c6dbe5 req-2825e5d7-8f65-470a-83d1-c94756b2cdf5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:52.846730 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-27914fa9-a90f-4201-96af-d64513c6dbe5 req-2825e5d7-8f65-470a-83d1-c94756b2cdf5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 945 time: 0.1700428 Nov 24 14:03:52.850372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:52.853400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Pushing event deleted for resources: {'Port': ['ID=32248440-534c-460b-aa7b-965b1062bba8,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:52.856162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.864123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:52.865951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:52.866568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:52.873303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] No DVR routers for this DVR port 32248440-534c-460b-aa7b-965b1062bba8 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:52.873794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:52.878280 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1289148 Nov 24 14:03:52.895959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45254) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:52.915563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ad83107-e61d-4567-9586-5838a843ddc4 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:52.991484 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:53.009594 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:53.010372 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:53.018446 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-27914fa9-a90f-4201-96af-d64513c6dbe5 req-8e44b368-6148-4578-b514-6e952ac7a9b0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1389201 Nov 24 14:03:53.142912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet b9d08fe6-f61a-4110-b46e-7c03f6921df1 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:53.147128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.193724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '07b617b1-2d06-4741-9f6f-9ae81cf0d1fe'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:53.194785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.231819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.317496 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:53.350676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.403736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Allocated IP 172.20.0.2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/07b617b1-2d06-4741-9f6f-9ae81cf0d1fe/5e43037a-45e8-4869-803a-445f403da97e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:53.420422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:03:53.421915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.427187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0a55555f-f93a-47cd-860c-046c3f28a2be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:53.462170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.467217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2794376-509d-4036-ab61-1b9c7ed4fcb5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:53.506144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=b9d08fe6-f61a-4110-b46e-7c03f6921df1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:53.509726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:53.510879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.517874 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/b9d08fe6-f61a-4110-b46e-7c03f6921df1 HTTP/1.1" status: 204 len: 168 time: 0.6171088 Nov 24 14:03:53.524441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45258) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:53.547187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccf0d571-36e8-486a-a443-5006bb50a2e7 None None] Network 9f701968-870a-427f-95eb-df8bebab0c4c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:53.602786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:53.606319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:53.610639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:53.611218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.641065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.9783671 Nov 24 14:03:53.643930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45262) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:53.649991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:e6:98:a8', 'name': 'tempest-NetworksTestDHCPv6-1115227950'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:53.664674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=4855d51e-bae1-4442-bf87-6404cddc372c,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:53.670670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:53.699021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.712787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port b64007ec-f1c9-40fd-b37b-daa1062d10a4 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:53.713137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.741019 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:51Z', 'revision_number': 8, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:45Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:53.746854 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:03:53.758952 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:53.759971 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:53.811388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:53.815904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:53.820203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:53.826865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:53.840360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:53.845584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.884911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 3d408d24-ae8b-4edb-855a-59f46609239c yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:03:53.944037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.949516 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:53.966720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Transition to ACTIVE for port object 5e43037a-45e8-4869-803a-445f403da97e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:53.975636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port b64007ec-f1c9-40fd-b37b-daa1062d10a4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b64007ec-f1c9-40fd-b37b-daa1062d10a4,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:53.976019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:53.991993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Transition to ACTIVE for port object 5e43037a-45e8-4869-803a-445f403da97e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:54.000613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.012695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:54.080225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] DHCP port deletion for 9f701968-870a-427f-95eb-df8bebab0c4c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:03:54.087099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:54.088316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Deleting port b64007ec-f1c9-40fd-b37b-daa1062d10a4 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:54.089069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.119402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:54.130966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:54.189726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 172.20.0.4 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/07b617b1-2d06-4741-9f6f-9ae81cf0d1fe/3d408d24-ae8b-4edb-855a-59f46609239c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:54.199657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fee6:98a8 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/4855d51e-bae1-4442-bf87-6404cddc372c/3d408d24-ae8b-4edb-855a-59f46609239c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:03:54.201612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Pushing event updated for resources: {'Port': ['ID=5e43037a-45e8-4869-803a-445f403da97e,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:54.236359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:54.245586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for b64007ec-f1c9-40fd-b37b-daa1062d10a4 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:54.265361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device d63435aa-64d2-4de8-b8ef-04e0392fcab4 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:54.344516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Attempting to bind port 5e43037a-45e8-4869-803a-445f403da97e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:03:54.344901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Attempting to bind port 5e43037a-45e8-4869-803a-445f403da97e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:03:54.345162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Attempting to bind port 5e43037a-45e8-4869-803a-445f403da97e on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:03:54.378047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:03:54.378465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:03:54.378875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.379428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:03:54.388323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Bound port: 5e43037a-45e8-4869-803a-445f403da97e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:03:54.388951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.392103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.398375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-71a90b65-bef1-4e49-bfd3-f55dcf8cb76f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:54.437617 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:51Z', 'revision_number': 8, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:45Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:54.442466 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0bc8006f-d5c6-40f7-9f39-a9c2cd9f7868 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:51Z', 'revision_number': 8, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '188270d0-aa74-4ce2-8132-d7380095ed80', 'name': '', 'network_id': '73ccd08d-b5d4-43ae-bd73-1ed0580e6920', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:63:ba:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:27Z', 'updated_at': '2021-11-24T14:03:45Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '719afdec-c525-4346-b69e-a76bdf8a686f', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:03:54.446723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=b64007ec-f1c9-40fd-b37b-daa1062d10a4,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:54.449912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:54.463267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No DVR routers for this DVR port b64007ec-f1c9-40fd-b37b-daa1062d10a4 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:54.524487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8adc8b-48d3-4bf0-95f1-cb5991406150 req-f0317231-b6db-4cc5-b4e6-c6b7d136b160 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:54.525949 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7e8adc8b-48d3-4bf0-95f1-cb5991406150 req-f0317231-b6db-4cc5-b4e6-c6b7d136b160 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 945 time: 0.2296774 Nov 24 14:03:54.573098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.587807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port d63435aa-64d2-4de8-b8ef-04e0392fcab4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:54.607057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 3d408d24-ae8b-4edb-855a-59f46609239c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:03:54.616118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port d63435aa-64d2-4de8-b8ef-04e0392fcab4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:54.616118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.620270 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7e8adc8b-48d3-4bf0-95f1-cb5991406150 req-38811e47-4331-450c-87b1-2c9154e4b9c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0759130 Nov 24 14:03:54.645924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.653980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:54.705369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] For port b64007ec-f1c9-40fd-b37b-daa1062d10a4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b64007ec-f1c9-40fd-b37b-daa1062d10a4,segment=NetworkSegment(d8647adf-0af1-4db0-8351-e6cffbbeec2a),segment_id=d8647adf-0af1-4db0-8351-e6cffbbeec2a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:54.705818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.762459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:54.766845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:54.775582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:03:54.787293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.816192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9f701968-870a-427f-95eb-df8bebab0c4c']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:54.835023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=3d408d24-ae8b-4edb-855a-59f46609239c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:54.841038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd8647adf-0af1-4db0-8351-e6cffbbeec2a') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:54.841336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd8647adf-0af1-4db0-8351-e6cffbbeec2a') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:54.845802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:54.857004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.886307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.887632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:54.888389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.895671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Calling delete_port for b64007ec-f1c9-40fd-b37b-daa1062d10a4 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:54.897295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 869 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:03:54.897872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:03:54.914982 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:03:54.920715 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 1.2756534 Nov 24 14:03:54.921693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45276) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:54.947121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b64007ec-f1c9-40fd-b37b-daa1062d10a4 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:55.002995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] For port 5e43037a-45e8-4869-803a-445f403da97e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:03:55.008011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: b64007ec-f1c9-40fd-b37b-daa1062d10a4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:55.008486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b64007ec-f1c9-40fd-b37b-daa1062d10a4 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:55.037386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.043227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5e7d8944-17d9-49b3-941f-a0a6ebd2801c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:55.050294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4afc303b-c9cf-4b97-85c6-db13c2726374 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:55.054807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4afc303b-c9cf-4b97-85c6-db13c2726374 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:55.056007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4afc303b-c9cf-4b97-85c6-db13c2726374 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:55.068519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.071712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=9f701968-870a-427f-95eb-df8bebab0c4c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:55.077697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4afc303b-c9cf-4b97-85c6-db13c2726374 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:55.083226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:55.084199 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4afc303b-c9cf-4b97-85c6-db13c2726374 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1763 time: 0.1613810 Nov 24 14:03:55.085075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45280) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:55.092282 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/9f701968-870a-427f-95eb-df8bebab0c4c HTTP/1.1" status: 204 len: 168 time: 1.5662627 Nov 24 14:03:55.095304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45284) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:55.123352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.160899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 3d408d24-ae8b-4edb-855a-59f46609239c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:55.161244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.188942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] For port 5e43037a-45e8-4869-803a-445f403da97e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5e43037a-45e8-4869-803a-445f403da97e,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:03:55.262693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port d63435aa-64d2-4de8-b8ef-04e0392fcab4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:55.265843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:03:55.271535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.279710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:55.337316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.361603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:03:55.361966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:03:55.379246 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'code': 200} Nov 24 14:03:55.444087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Pushing event updated for resources: {'Port': ['ID=5e43037a-45e8-4869-803a-445f403da97e,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:55.448177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:55.452245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:55.534288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=d63435aa-64d2-4de8-b8ef-04e0392fcab4,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:55.551473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:55.643427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.663503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7f8311-3af7-46e5-8abe-bff7240fe06e req-1ac9b2de-7e38-45dd-929e-ff94480a918e tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:55.665163 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9d7f8311-3af7-46e5-8abe-bff7240fe06e req-1ac9b2de-7e38-45dd-929e-ff94480a918e tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.2425683 Nov 24 14:03:55.864236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Deleting port b64007ec-f1c9-40fd-b37b-daa1062d10a4 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:55.864872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.878262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:55.899773 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9d7f8311-3af7-46e5-8abe-bff7240fe06e req-ba894c04-944f-422c-9934-443f98631696 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2255187 Nov 24 14:03:55.960946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-23a9101a-97d2-4280-aaf9-e24284a35b10 None None] The port 'b64007ec-f1c9-40fd-b37b-daa1062d10a4' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:03:56.023478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958d832c-2773-476a-ba64-d26a288ee8e6 req-11908043-4ab8-41d6-b6cf-fd10a43d9456 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:56.024984 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-958d832c-2773-476a-ba64-d26a288ee8e6 req-11908043-4ab8-41d6-b6cf-fd10a43d9456 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.1591265 Nov 24 14:03:56.046349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 3d408d24-ae8b-4edb-855a-59f46609239c owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:56.101564 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-09e7a756-7c68-4605-aeee-e704857f454f req-4457af9f-c2ef-4e7d-a8d2-6826d67c4bfb service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 1099 time: 0.3806875 Nov 24 14:03:56.182244 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-958d832c-2773-476a-ba64-d26a288ee8e6 req-a3e17d31-407d-4a4b-badb-b284a126071d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1461048 Nov 24 14:03:56.281850 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-09e7a756-7c68-4605-aeee-e704857f454f req-d364c68f-4843-4049-a914-a52c7ae860c5 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1731093 Nov 24 14:03:56.416348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:56.423609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b2b0c1a-6249-4fa0-badf-9339c6c071a3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:56.472986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=3d408d24-ae8b-4edb-855a-59f46609239c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:56.476841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:56.510727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 188270d0-aa74-4ce2-8132-d7380095ed80 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:56.511068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:56.600562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5e43037a-45e8-4869-803a-445f403da97e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:03:56.676374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:56.688181 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/3d408d24-ae8b-4edb-855a-59f46609239c HTTP/1.1" status: 204 len: 168 time: 1.5993314 Nov 24 14:03:56.689049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45296) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:56.696144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 5e43037a-45e8-4869-803a-445f403da97e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:56.712937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b112932-ded2-4d27-9ad6-654d5a9dda33 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:56.747269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 188270d0-aa74-4ce2-8132-d7380095ed80, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=188270d0-aa74-4ce2-8132-d7380095ed80,segment=NetworkSegment(760e440b-8386-4e18-b96a-54ed57dc5c0b),segment_id=760e440b-8386-4e18-b96a-54ed57dc5c0b)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:56.747941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:56.751202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1b112932-ded2-4d27-9ad6-654d5a9dda33 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:03:56.751560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b112932-ded2-4d27-9ad6-654d5a9dda33 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:03:56.762999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fa48179-ee32-4ddc-89df-e4d9dc1b7329 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:56.772527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76d1e04d-1299-4cd6-95ba-e27137535c2d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:56.774014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76d1e04d-1299-4cd6-95ba-e27137535c2d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:56.775442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76d1e04d-1299-4cd6-95ba-e27137535c2d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:56.776467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76d1e04d-1299-4cd6-95ba-e27137535c2d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:03:56.796459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76d1e04d-1299-4cd6-95ba-e27137535c2d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:03:56.800432 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-76d1e04d-1299-4cd6-95ba-e27137535c2d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.1093583 Nov 24 14:03:56.801427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45300) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:56.913243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Provisioning for port 5e43037a-45e8-4869-803a-445f403da97e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:03:56.923311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Provisioning complete for port 5e43037a-45e8-4869-803a-445f403da97e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:56.923685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.047984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 188270d0-aa74-4ce2-8132-d7380095ed80 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:57.104516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 07b617b1-2d06-4741-9f6f-9ae81cf0d1fe {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:57.108054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.168566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.253320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.254532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.277112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8fe05737-e855-4b6e-9143-244415b53c64 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:57.314589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] For port 5e43037a-45e8-4869-803a-445f403da97e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5e43037a-45e8-4869-803a-445f403da97e,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:57.319637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.323358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:57.385983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e13c527-a9af-4a0a-95a0-db6c5fc533c0 req-38f87c2a-6283-46df-bacb-4ca7332887c7 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:57.387469 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7e13c527-a9af-4a0a-95a0-db6c5fc533c0 req-38f87c2a-6283-46df-bacb-4ca7332887c7 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.1904252 Nov 24 14:03:57.426900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.471840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=188270d0-aa74-4ce2-8132-d7380095ed80,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:57.522344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Pushing event updated for resources: {'Port': ['ID=5e43037a-45e8-4869-803a-445f403da97e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:57.536132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:57.538377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65961aab-d252-4274-8aa3-0e839a351be3 None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '07b617b1-2d06-4741-9f6f-9ae81cf0d1fe', 'ip_address': '172.20.0.2'}, {'subnet_id': '4855d51e-bae1-4442-bf87-6404cddc372c'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '5e43037a-45e8-4869-803a-445f403da97e'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:03:57.552242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7e13c527-a9af-4a0a-95a0-db6c5fc533c0 req-9e3accb7-f33e-4a78-adea-af89aa064b97 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1576562 Nov 24 14:03:57.569871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.572184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:57.579285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16e664a6-161c-4063-9984-8737aea0080c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:57.641019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=07b617b1-2d06-4741-9f6f-9ae81cf0d1fe,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:57.643949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:57.651665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.673607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb32e44-66b1-483e-a134-88277d2a7db1 req-48f0ab4d-74d3-49a3-b760-29315a09811a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:57.675125 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/07b617b1-2d06-4741-9f6f-9ae81cf0d1fe HTTP/1.1" status: 204 len: 168 time: 0.8720164 Nov 24 14:03:57.677261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45308) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:57.678513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-65961aab-d252-4274-8aa3-0e839a351be3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.682752 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1cb32e44-66b1-483e-a134-88277d2a7db1 req-48f0ab4d-74d3-49a3-b760-29315a09811a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.3127513 Nov 24 14:03:57.773517 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1cb32e44-66b1-483e-a134-88277d2a7db1 req-6a20117b-b915-468b-ae6e-797b0e37e028 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0893953 Nov 24 14:03:57.780132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 4855d51e-bae1-4442-bf87-6404cddc372c {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:57.784292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.789416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.862437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.920716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.991932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:57.995558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a6d19e67-33d7-4171-bc39-d01832f5cf2a tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server [None req-65961aab-d252-4274-8aa3-0e839a351be3 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 4855d51e-bae1-4442-bf87-6404cddc372c: This subnet is being modified by another concurrent operation. Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 311, in update_dhcp_port Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 101, in _port_action Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 685, in inner Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1671, in update_port Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1493, in update_port Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 712, in update_port Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 669, in _ipam_get_subnets Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise exception Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 4855d51e-bae1-4442-bf87-6404cddc372c: This subnet is being modified by another concurrent operation. Nov 24 14:03:57.998644 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Nov 24 14:03:58.034587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=4855d51e-bae1-4442-bf87-6404cddc372c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:58.038181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:58.042572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.055880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/4855d51e-bae1-4442-bf87-6404cddc372c HTTP/1.1" status: 204 len: 168 time: 0.3748255 Nov 24 14:03:58.056184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45312) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:58.096392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00247c85-c087-48fb-bf95-4a0e087ad95d None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:58.124403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7d8e35ab-3dbe-4c5f-976a-fdfab3806e63 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0647116 Nov 24 14:03:58.124806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45316) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:58.134726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:58.250973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:58.256901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:58.260026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:58.266383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:58.275611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1c2c0742-0925-4cad-b51f-d95ad8d6e063 None None] Provisioning complete for port 5e43037a-45e8-4869-803a-445f403da97e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:03:58.276361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1c2c0742-0925-4cad-b51f-d95ad8d6e063 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.280419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:58.284557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.341959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:03:58.421392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:03:58.427059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Deleting port 5e43037a-45e8-4869-803a-445f403da97e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:58.427589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.563184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.571997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-18a1a669-7de3-475c-b32c-d36189f08d57 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:58.640308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5e43037a-45e8-4869-803a-445f403da97e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:03:58.645702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:58.649800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:58.653059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:58.653789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.666508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:03:58.687370 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5897634 Nov 24 14:03:58.688988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45322) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:58.690422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:03:58.703252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=93a0bbf6-b678-4ac9-aa23-b2d136549f99,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:58.716973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:58.737375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] For port 5e43037a-45e8-4869-803a-445f403da97e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5e43037a-45e8-4869-803a-445f403da97e,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:58.737773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:58.766880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6386058 Nov 24 14:03:58.772353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45326) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:58.861610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:03:58.862258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:03:58.917007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:58.918364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet 719afdec-c525-4346-b69e-a76bdf8a686f {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:03:58.919308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Calling delete_port for 5e43037a-45e8-4869-803a-445f403da97e owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:03:58.961810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.035841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.060814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da44059-1464-46b0-9676-f2826d5fd697 req-a5c143b6-9f90-4768-8785-0c60968a7d4c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:59.062320 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3da44059-1464-46b0-9676-f2826d5fd697 req-a5c143b6-9f90-4768-8785-0c60968a7d4c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.3402956 Nov 24 14:03:59.116632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:59.128427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:59.133441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3c556d-120f-4937-baac-667c0a61ab11 req-8da0dcaf-e8a6-44f7-96a6-2c8595f5200c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:59.133651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:59.139726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9a3c556d-120f-4937-baac-667c0a61ab11 req-8da0dcaf-e8a6-44f7-96a6-2c8595f5200c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.2189019 Nov 24 14:03:59.144927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:59.156152 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3da44059-1464-46b0-9676-f2826d5fd697 req-83f40086-abd5-4c94-9247-f4a9305385dd tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0721693 Nov 24 14:03:59.163962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:03:59.168978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.196670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.209647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.216576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f1675f08-d7df-4204-bd86-0a8be996cec7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:59.228042 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9a3c556d-120f-4937-baac-667c0a61ab11 req-2f0d4199-28aa-4b29-8b40-c3a050404d3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0872455 Nov 24 14:03:59.247629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.252600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:03:59.315462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Pushing event deleted for resources: {'Port': ['ID=5e43037a-45e8-4869-803a-445f403da97e,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:59.323920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:59.328975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] No DVR routers for this DVR port 5e43037a-45e8-4869-803a-445f403da97e on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:03:59.379998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b7af02b-e562-4799-a381-c242b702793f None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:59.417576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.421738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-635f65f6-a103-4efd-b783-b4e6e96d2f81 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:59.468571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=719afdec-c525-4346-b69e-a76bdf8a686f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:59.471228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:59.483151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.492481 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4c824659-c145-41ba-bb35-9fbd2d0a425c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/719afdec-c525-4346-b69e-a76bdf8a686f HTTP/1.1" status: 204 len: 168 time: 0.8022208 Nov 24 14:03:59.495360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45334) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:59.541279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d5946f0-4d1a-4160-8d95-d0f7319478e4 None None] Network 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:03:59.577882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a0d2e2-c5f6-4a11-922a-2aeac14f6595 req-7de4bc7f-5791-4092-94f2-e7f9bee21b28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:59.579373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a8a0d2e2-c5f6-4a11-922a-2aeac14f6595 req-7de4bc7f-5791-4092-94f2-e7f9bee21b28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.1655500 Nov 24 14:03:59.625021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.637552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 30e3e157-e213-4382-9978-63db425af94d {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:03:59.637924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.662683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a8a0d2e2-c5f6-4a11-922a-2aeac14f6595 req-9fd009bd-46c4-4f2b-b447-7350882a2803 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668969 Nov 24 14:03:59.707978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45338) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:59.815449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:03:59.819572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.823860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-957be7e3-7f6c-4a5b-b363-5e42fcfe267c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:03:59.897830 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-334095f8-8cb9-44c7-a054-16b209cd0c9f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 1094 time: 0.1885202 Nov 24 14:03:59.901988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:03:59.902631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45342) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:59.902976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 30e3e157-e213-4382-9978-63db425af94d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30e3e157-e213-4382-9978-63db425af94d,segment=NetworkSegment(760e440b-8386-4e18-b96a-54ed57dc5c0b),segment_id=760e440b-8386-4e18-b96a-54ed57dc5c0b)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:03:59.903874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.910160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:59.916645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:03:59.923375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:03:59.923375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:03:59.927534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=9ddf359d-8737-4e46-94db-85077ef13e7b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:03:59.931852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:03:59.940692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:03:59.946340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:03:59.951433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:03:59.961093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:03:59.970282 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.0584753 Nov 24 14:03:59.970470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45346) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:03:59.976473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:9c:82:da', 'name': 'tempest-NetworksTestDHCPv6-520359130'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:03:59.992967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '93a0bbf6-b678-4ac9-aa23-b2d136549f99'}, {'subnet_id': '9ddf359d-8737-4e46-94db-85077ef13e7b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:03:59.993821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.011238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.057930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 30e3e157-e213-4382-9978-63db425af94d owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:00.070491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:57Z', 'revision_number': 9, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:00.096259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:04:00.125833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9917b442-a64f-4a56-a987-4befdf381f0c None None] DHCP port deletion for 73ccd08d-b5d4-43ae-bd73-1ed0580e6920 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:00.140253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9917b442-a64f-4a56-a987-4befdf381f0c None None] Deleting port 30e3e157-e213-4382-9978-63db425af94d {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:00.140661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9917b442-a64f-4a56-a987-4befdf381f0c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.161532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.168372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b5e3c07-f662-4c78-a68f-236ef6ab1546 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:00.194308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:00.194504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:00.209761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:00.218786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=30e3e157-e213-4382-9978-63db425af94d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:00.221508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:00.225099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No DVR routers for this DVR port 30e3e157-e213-4382-9978-63db425af94d on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:00.225302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:00.228961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:00.236906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:00.259082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:00.263005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.308007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:00.368937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.441815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.445978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9917b442-a64f-4a56-a987-4befdf381f0c None None] The port '30e3e157-e213-4382-9978-63db425af94d' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:04:00.486432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['73ccd08d-b5d4-43ae-bd73-1ed0580e6920']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:00.500853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '760e440b-8386-4e18-b96a-54ed57dc5c0b') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:00.501143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '760e440b-8386-4e18-b96a-54ed57dc5c0b') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:00.514153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.563582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30e3e157-e213-4382-9978-63db425af94d no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:00.577877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.22 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/8227a9f1-9a9f-4b76-a399-0d205b294ed9) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:00.578803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.590301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 857 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:04:00.591016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.611994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 30e3e157-e213-4382-9978-63db425af94d {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:00.612335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30e3e157-e213-4382-9978-63db425af94d not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:04:00.616276 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:04:00.627796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:00.687329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Allocated IP 172.20.0.2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/93a0bbf6-b678-4ac9-aa23-b2d136549f99/1089cacc-3f72-49af-9aba-458fab23d6dd) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:00.694010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Allocated IP 2001:db8::f816:3eff:fee8:cdd5 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/9ddf359d-8737-4e46-94db-85077ef13e7b/1089cacc-3f72-49af-9aba-458fab23d6dd) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:00.708602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b67a9bca-f5e4-48aa-ae1e-1f3fc4f420d7 req-fcf11500-9f46-469b-8c22-53eeaabb3f10 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:00.710144 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b67a9bca-f5e4-48aa-ae1e-1f3fc4f420d7 req-fcf11500-9f46-469b-8c22-53eeaabb3f10 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.1888781 Nov 24 14:04:00.719845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.725009 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ade4474-5a76-423a-b25a-11089a537690 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:00.745676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.748163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.769808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=73ccd08d-b5d4-43ae-bd73-1ed0580e6920,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:00.778709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:00.780684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:00.784228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4395e835-f3ee-497c-a7bc-0499bf9b3038 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:00.791408 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/73ccd08d-b5d4-43ae-bd73-1ed0580e6920 HTTP/1.1" status: 204 len: 168 time: 1.2923195 Nov 24 14:04:00.796028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45352) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:00.804209 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:04:00.867597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:00.873980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:00.879810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:00.952552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=8227a9f1-9a9f-4b76-a399-0d205b294ed9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:00.959518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:01.051839 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b67a9bca-f5e4-48aa-ae1e-1f3fc4f420d7 req-d8c6b804-864c-4931-bc0b-6107c69415db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3079462 Nov 24 14:04:01.110200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.155706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Transition to ACTIVE for port object 1089cacc-3f72-49af-9aba-458fab23d6dd will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:01.183274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Transition to ACTIVE for port object 1089cacc-3f72-49af-9aba-458fab23d6dd will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:01.198289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.202986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:01.304460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:01.306941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:57Z', 'revision_number': 9, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:01.309268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Pushing event updated for resources: {'Port': ['ID=1089cacc-3f72-49af-9aba-458fab23d6dd,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:01.316604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:01.319037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:01.323770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f07dac4-941c-4dda-b198-658dc62986f9 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:03:57Z', 'revision_number': 9, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '4b26afa3-9da7-4980-8671-1b407c238e25', 'name': '', 'network_id': '8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:38:f0:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:21Z', 'updated_at': '2021-11-24T14:03:37Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': '02987e09-a307-477d-8b4e-5a4c97ae1c9f', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:04:01.326786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:01.357384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.468122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Attempting to bind port 1089cacc-3f72-49af-9aba-458fab23d6dd on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:01.468705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Attempting to bind port 1089cacc-3f72-49af-9aba-458fab23d6dd by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:01.469849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Attempting to bind port 1089cacc-3f72-49af-9aba-458fab23d6dd on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:01.479924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 3, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:01.480405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:01.480996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.481466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:01.482083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Bound port: 1089cacc-3f72-49af-9aba-458fab23d6dd, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:01.482536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.516347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 172.20.0.5 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/93a0bbf6-b678-4ac9-aa23-b2d136549f99/ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:01.529035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe9c:82da (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/9ddf359d-8737-4e46-94db-85077ef13e7b/ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:01.590091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] For port 1089cacc-3f72-49af-9aba-458fab23d6dd, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:01.594730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] For port 1089cacc-3f72-49af-9aba-458fab23d6dd, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1089cacc-3f72-49af-9aba-458fab23d6dd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:01.600312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.604806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae6e14d9-b799-4aee-8d74-d612dfda1c48 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:01.688281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Pushing event updated for resources: {'Port': ['ID=1089cacc-3f72-49af-9aba-458fab23d6dd,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:01.691420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:01.843332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:01.952173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:02.024535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.026143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.033810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:02.079205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 4b26afa3-9da7-4980-8671-1b407c238e25 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:02.079805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.163927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:02.164792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.203768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:02.206347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:02.279863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 4b26afa3-9da7-4980-8671-1b407c238e25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4b26afa3-9da7-4980-8671-1b407c238e25,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:02.280354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.283116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:02.287349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:02.385403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:02.386019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.416641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 4b26afa3-9da7-4980-8671-1b407c238e25 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:02.507976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1026 time: 2.5365782 Nov 24 14:04:02.511054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45358) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:02.527951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8caf17-1f02-4c9a-9bf8-502d5a6c175f req-bbc66149-a62a-412b-9aeb-9b17f8135fb2 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:02.527951 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba8caf17-1f02-4c9a-9bf8-502d5a6c175f req-bbc66149-a62a-412b-9aeb-9b17f8135fb2 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.3255591 Nov 24 14:04:02.623067 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba8caf17-1f02-4c9a-9bf8-502d5a6c175f req-c1661cb1-db01-434a-bb9d-7b4699a511c0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789671 Nov 24 14:04:02.625922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.626348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f562efc4-563e-45f7-879c-f28eceeb89e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:02.631326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f562efc4-563e-45f7-879c-f28eceeb89e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:02.632249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f562efc4-563e-45f7-879c-f28eceeb89e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:02.633253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.633809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1089cacc-3f72-49af-9aba-458fab23d6dd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:02.639482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:02.764943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=8227a9f1-9a9f-4b76-a399-0d205b294ed9,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:02.766888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1089cacc-3f72-49af-9aba-458fab23d6dd completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:02.768761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:02.784172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 188270d0-aa74-4ce2-8132-d7380095ed80 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:02.787433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.832439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 188270d0-aa74-4ce2-8132-d7380095ed80 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:02.833444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 188270d0-aa74-4ce2-8132-d7380095ed80 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:02.866126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f562efc4-563e-45f7-879c-f28eceeb89e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:02.867840 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f562efc4-563e-45f7-879c-f28eceeb89e3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1860 time: 0.3558269 Nov 24 14:04:02.871587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45362) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:02.889978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:02.893762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:02.919712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-986eef54-89da-4c26-bc9a-03b44b97fe42 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:02.938270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=4b26afa3-9da7-4980-8671-1b407c238e25,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:02.942510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:03.049890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Provisioning for port 1089cacc-3f72-49af-9aba-458fab23d6dd completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:03.068186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Provisioning complete for port 1089cacc-3f72-49af-9aba-458fab23d6dd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:03.068828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.155090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:03.155950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.178978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fc3a6e10-daf8-45d1-8d0a-afca35b5fc73 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.215016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.333835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.383101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] For port 1089cacc-3f72-49af-9aba-458fab23d6dd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1089cacc-3f72-49af-9aba-458fab23d6dd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:03.387970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.391179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ae6e14d9-b799-4aee-8d74-d612dfda1c48 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:03.462705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.480184 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 63b51789-24dc-42f8-9f30-1eeb2ace8f45 associated. External IP: 172.26.4.22, port: d63435aa-64d2-4de8-b8ef-04e0392fcab4. Nov 24 14:04:03.548971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Pushing event updated for resources: {'Port': ['ID=1089cacc-3f72-49af-9aba-458fab23d6dd,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:03.554475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:03.559139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.672730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:03.841926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-566bf458-4983-4e73-8b53-793e894e88c3 None None] Provisioning complete for port 1089cacc-3f72-49af-9aba-458fab23d6dd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:03.842503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-566bf458-4983-4e73-8b53-793e894e88c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:03.871971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:04:03.882547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee0584f-e049-4809-a79d-d2069e92a00a req-1d35a5b4-16e8-4333-925c-ba62686fd14b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:03.884174 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ee0584f-e049-4809-a79d-d2069e92a00a req-1d35a5b4-16e8-4333-925c-ba62686fd14b tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.1070096 Nov 24 14:04:04.076332 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ee0584f-e049-4809-a79d-d2069e92a00a req-a9a23d57-adce-47e3-a9d5-178eecba25d3 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1856627 Nov 24 14:04:04.077584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-566bf458-4983-4e73-8b53-793e894e88c3 None None] Provisioning for port ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:04.079728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.086141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-566bf458-4983-4e73-8b53-793e894e88c3 None None] Provisioning complete for port ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:04.086289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-566bf458-4983-4e73-8b53-793e894e88c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.096574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:04.141587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:04:04.153787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:04.155587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-566bf458-4983-4e73-8b53-793e894e88c3 None None] Port ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 14:04:04.159715 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3600450 Nov 24 14:04:04.160720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:04.161616 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:04:04.169027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:04.188486 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:04.189639 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:04.287576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-432563e1-4301-456a-873b-69904123d95d None None] Could not find standard attr ID for object 144fba37-10fe-4d2b-9cae-09d86999cb6f. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:04.401488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-df9613bb-99af-4399-b5fa-35517028d457 None None] Could not find standard attr ID for object 3d408d24-ae8b-4edb-855a-59f46609239c. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:04.404898 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:04.413247 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet 02987e09-a307-477d-8b4e-5a4c97ae1c9f {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:04.417039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.511635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.624740 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 HTTP/1.1" status: 204 len: 168 time: 1.7487123 Nov 24 14:04:04.627212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.629552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45372) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:04.662277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1089cacc-3f72-49af-9aba-458fab23d6dd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:04.735189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7322b450-1523-4898-8055-913154cdf2fd None None] Could not find standard attr ID for object ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:04.763048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1e0d82a-3fb4-4015-b306-e9dc192769d5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:04.764590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.771202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1e0d82a-3fb4-4015-b306-e9dc192769d5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:04.773520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1e0d82a-3fb4-4015-b306-e9dc192769d5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:04.780170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f1e0d82a-3fb4-4015-b306-e9dc192769d5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:04.788211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1089cacc-3f72-49af-9aba-458fab23d6dd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:04.789027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:04.810846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f1e0d82a-3fb4-4015-b306-e9dc192769d5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:04.812762 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f1e0d82a-3fb4-4015-b306-e9dc192769d5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.1811790 Nov 24 14:04:04.817441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45376) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:04.846493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:04:04.908640 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:02Z', 'revision_number': 10, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:04.914735 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:04:04.934764 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:04.935543 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:05.033739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.042836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9b70df01-a046-4aff-aa54-6059bef1a26f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:05.087363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=02987e09-a307-477d-8b4e-5a4c97ae1c9f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:05.108438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:05.112772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.139724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4eabce90-72fb-4825-b10e-a22293487425 None None] Network 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:05.154071 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/02987e09-a307-477d-8b4e-5a4c97ae1c9f HTTP/1.1" status: 204 len: 168 time: 0.9899838 Nov 24 14:04:05.174806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45382) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:05.193696 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:05.414366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.434995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 93a0bbf6-b678-4ac9-aa23-b2d136549f99 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:05.449751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.519954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e41d61-f481-4163-8eb2-9204ca287e23 req-6ce2106f-2e76-4a8a-b33d-8927d6ea296f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:05.521641 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7e41d61-f481-4163-8eb2-9204ca287e23 req-6ce2106f-2e76-4a8a-b33d-8927d6ea296f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.2344303 Nov 24 14:04:05.523787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:04:05.537136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:04:05.558707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 607ec195-0937-45ce-81e9-74522676e7b6 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:05.562894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.570669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:05.572311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:03:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:05.588014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.649455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.658141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] DHCP port deletion for 8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:05.679185 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7e41d61-f481-4163-8eb2-9204ca287e23 req-7841d794-277b-43b4-8f92-20e56b17ae2d tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1471987 Nov 24 14:04:05.679822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Deleting port 607ec195-0937-45ce-81e9-74522676e7b6 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:05.680418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.713886 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:02Z', 'revision_number': 10, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:05.723064 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf4449b-f8e0-451a-9b91-7314db27adc5 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:02Z', 'revision_number': 10, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None, '_interfaces': [{'id': '018b7562-3559-4086-8655-8c9a25f8b83b', 'name': '', 'network_id': 'fa522dda-607e-4bb3-af91-d3f819546827', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'mac_address': 'fa:16:3e:96:39:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:11Z', 'updated_at': '2021-11-24T14:03:22Z', 'revision_number': 5, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'subnets': [{'id': 'ddef1ee6-c276-4b6d-b1ac-958e76e20b11', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:04:05.723849 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 5.8181925 Nov 24 14:04:05.724945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:04:05.727450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45386) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:05.812400 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'status': 'completed', 'code': 200} Nov 24 14:04:05.908822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-81136d07-0952-4a57-8de3-6b3a0dd69c87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:05.924675 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-62fd21cf-a0aa-479d-af3a-3ade1a0c85c0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 1099 time: 0.0885966 Nov 24 14:04:06.024010 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e27bb35b-ce29-462f-84ec-e8438adfb2d1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/63b51789-24dc-42f8-9f30-1eeb2ace8f45 HTTP/1.1" status: 200 len: 991 time: 0.2745202 Nov 24 14:04:06.059064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:06.059421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.069718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-0558369a-acc6-4789-b693-d2b15efd8c37 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:06.070872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-0558369a-acc6-4789-b693-d2b15efd8c37 service neutron] 10.222.0.47 "GET /v2.0/networks?id=1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 200 len: 898 time: 0.1385589 Nov 24 14:04:06.100661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 607ec195-0937-45ce-81e9-74522676e7b6, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=607ec195-0937-45ce-81e9-74522676e7b6,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:06.101379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.113365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] For port 607ec195-0937-45ce-81e9-74522676e7b6, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=607ec195-0937-45ce-81e9-74522676e7b6,segment=NetworkSegment(790e0a33-d350-4c81-8cd4-d3aa67feae20),segment_id=790e0a33-d350-4c81-8cd4-d3aa67feae20)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:06.113905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.198929 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-faa5ed73-3f4e-48a5-8a4b-11154e45e675 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4 HTTP/1.1" status: 200 len: 999 time: 0.1152096 Nov 24 14:04:06.256483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Calling delete_port for 607ec195-0937-45ce-81e9-74522676e7b6 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:06.281005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-07fbb421-93a4-47c6-80ee-15cedbf7bd75 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:06.282858 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-07fbb421-93a4-47c6-80ee-15cedbf7bd75 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=592f062e-f3d4-49e3-bd1d-81be732122e4 HTTP/1.1" status: 200 len: 835 time: 0.0767443 Nov 24 14:04:06.284282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 607ec195-0937-45ce-81e9-74522676e7b6 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:06.369383 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-99a95890-8ec5-466d-b84a-4ad722bbc3c0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=1a509ac2-7dc4-4e91-864c-101a02b01959&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0791786 Nov 24 14:04:06.395946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.401185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-98c7d0b1-af6e-49e0-b0e9-13678398033f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:06.431569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.443095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=93a0bbf6-b678-4ac9-aa23-b2d136549f99,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:06.450983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:06.451350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:06.460331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.463134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No DVR routers for this DVR port 607ec195-0937-45ce-81e9-74522676e7b6 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:06.465761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.466142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.466670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.467047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.467414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.467859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.468225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.468588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.468949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.469305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.469664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:06.527019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:06.533218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.092s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:06.542615 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-fd2a0b67-fb61-4125-a64f-32f927ff9b10 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1655722 Nov 24 14:04:06.568025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1da96e9-41a4-4aac-9dfe-be69a4dd335c None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:06.580293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 607ec195-0937-45ce-81e9-74522676e7b6 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:06.634121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 607ec195-0937-45ce-81e9-74522676e7b6 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:06.634508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 607ec195-0937-45ce-81e9-74522676e7b6 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:06.634898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b26afa3-9da7-4980-8671-1b407c238e25 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:06.687006 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d89d49d-7e9f-4b93-9f51-a41479bbd572 req-2152ad55-0860-43c4-b2af-da1a00a5f700 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371238 Nov 24 14:04:06.742999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 4b26afa3-9da7-4980-8671-1b407c238e25 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:06.743374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4b26afa3-9da7-4980-8671-1b407c238e25 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:06.756194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=607ec195-0937-45ce-81e9-74522676e7b6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:06.771595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:06.775908 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/93a0bbf6-b678-4ac9-aa23-b2d136549f99 HTTP/1.1" status: 204 len: 168 time: 1.9528701 Nov 24 14:04:06.779458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45394) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:06.782157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.785492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.853768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:06.872735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '790e0a33-d350-4c81-8cd4-d3aa67feae20') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:06.873129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '790e0a33-d350-4c81-8cd4-d3aa67feae20') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:06.892416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 9ddf359d-8737-4e46-94db-85077ef13e7b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:06.897188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.903711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.908303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafc7436-1f8d-48c9-b631-be04e2a152d7 req-90c20c1d-46cd-481f-82e5-2f029242b991 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:06.910069 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cafc7436-1f8d-48c9-b631-be04e2a152d7 req-90c20c1d-46cd-481f-82e5-2f029242b991 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.0973940 Nov 24 14:04:06.953398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.957906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Deleting port 607ec195-0937-45ce-81e9-74522676e7b6 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:06.958125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.970451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 859 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:04:06.970843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:06.972520 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cafc7436-1f8d-48c9-b631-be04e2a152d7 req-3af346ec-9062-430a-a288-31d7786f6925 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543275 Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:04:06.985190 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:04:06.994921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.028611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45398) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.052221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8351679d-fa9c-49a1-aa38-9c4f34eaf3ce None None] The port '607ec195-0937-45ce-81e9-74522676e7b6' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:04:07.056500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:01Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:07.071514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:04:07.098738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:07.099588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:07.124023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.130193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d254dbf-8fde-4f27-a49a-dd08c3621db8 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:07.146134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.165010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:07.168876 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/8d16ffde-29bc-4fe5-a9bb-ee0b48cb578b HTTP/1.1" status: 204 len: 168 time: 1.9923472 Nov 24 14:04:07.170003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:07.181628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45402) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.186146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.322618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.338789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-81d6ddea-c72a-4483-b41c-7fa464035615 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:07.354244 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-41995d3a-e154-4db2-a308-ffd9fdc00634 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/63b51789-24dc-42f8-9f30-1eeb2ace8f45 HTTP/1.1" status: 200 len: 991 time: 0.3217359 Nov 24 14:04:07.418549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:07.452190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=9ddf359d-8737-4e46-94db-85077ef13e7b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:07.467221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:07.473543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.495469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8eeb2a05-3737-4ecb-956d-996b6cd2db5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/9ddf359d-8737-4e46-94db-85077ef13e7b HTTP/1.1" status: 204 len: 168 time: 0.7156773 Nov 24 14:04:07.500262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45406) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.585038 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4df21790-8023-4cf1-9dd1-ddf456908f5b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0827618 Nov 24 14:04:07.588404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45410) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.685142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-832f7abc-8f45-461a-94b5-81db896ac6cd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:07.688959 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-832f7abc-8f45-461a-94b5-81db896ac6cd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0970945 Nov 24 14:04:07.689190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45414) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.764797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:07.777636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ff5e230-8605-4555-ae90-02b5950600bf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:07.778336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5ff5e230-8605-4555-ae90-02b5950600bf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:07.797421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5ff5e230-8605-4555-ae90-02b5950600bf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:07.798943 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5ff5e230-8605-4555-ae90-02b5950600bf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1059778 Nov 24 14:04:07.802267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45418) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.889892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72ac17fc-a984-404f-8ee2-4597854019e4 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:07.893756 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d459ab8f-d989-45e1-ac11-49b1088bd84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0850317 Nov 24 14:04:07.901413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45422) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:07.907782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:08.037399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c244b0c6-d600-472d-8fc5-64c74b1ae810 None None] Provisioning complete for port 1089cacc-3f72-49af-9aba-458fab23d6dd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:08.037778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c244b0c6-d600-472d-8fc5-64c74b1ae810 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.054201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:08.070970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:08.082889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:08.086890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.089884 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:08.089884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:08.117860 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f0a7bd80-5b06-408d-8f98-4139ec2a093c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.2149568 Nov 24 14:04:08.120699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45428) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:08.128877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:08.187856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:01Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:08.198692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-733c4a07-85f0-401d-bde3-063b25b54bbe None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:27Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:01Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:04:08.204798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6334778-11f1-4cea-98f4-2d19f733b80a req-a3775f06-1f13-4a9b-aed4-c20cd669b852 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:08.205717 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c6334778-11f1-4cea-98f4-2d19f733b80a req-a3775f06-1f13-4a9b-aed4-c20cd669b852 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.0861506 Nov 24 14:04:08.298857 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c6334778-11f1-4cea-98f4-2d19f733b80a req-cb892335-eba1-4d78-abe6-66d254ddf441 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0703182 Nov 24 14:04:08.358750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45432) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:08.368719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.376208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:08.382861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Deleting port 1089cacc-3f72-49af-9aba-458fab23d6dd {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:08.383256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.409247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:08.431161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:08.476523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:08.547368 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6906c194-34fe-4f91-a9de-2ac5a2a2cf46 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/63b51789-24dc-42f8-9f30-1eeb2ace8f45 HTTP/1.1" status: 200 len: 991 time: 0.1754262 Nov 24 14:04:08.574448 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95b7d00e-4e6b-427e-89bf-cffb8a5e789f None None] New status for floating IP 63b51789-24dc-42f8-9f30-1eeb2ace8f45: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:04:08.576150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1089cacc-3f72-49af-9aba-458fab23d6dd no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:08.651501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.652929 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:08.653359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:08.712322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-35c7a7f5-cd10-450a-b8d3-d3d866373d75 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.5903347 Nov 24 14:04:08.713899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45436) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:08.722172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:08.828656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] For port 1089cacc-3f72-49af-9aba-458fab23d6dd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1089cacc-3f72-49af-9aba-458fab23d6dd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:08.829082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.859654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:08.870227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:08.882294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:08.887105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.888702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:08.889123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:08.917301 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1720770e-ce7e-4810-9aa7-b0ae8c23f961 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.1990094 Nov 24 14:04:08.917535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45440) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:08.924642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 018b7562-3559-4086-8655-8c9a25f8b83b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:08.925677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:08.927220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:08.968448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Calling delete_port for 1089cacc-3f72-49af-9aba-458fab23d6dd owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:08.995615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.055250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:09.067813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:09.071335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1089cacc-3f72-49af-9aba-458fab23d6dd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1089cacc-3f72-49af-9aba-458fab23d6dd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:09.076935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.077436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:09.082495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afca2b69-b689-4102-95ee-67bb09b81527 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:09.082938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.084653 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:09.085089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:09.112125 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2f208db-fae7-4373-9770-50845c374bf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.1933749 Nov 24 14:04:09.116528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45444) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:09.123787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:09.124735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:09.125097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:09.154157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 018b7562-3559-4086-8655-8c9a25f8b83b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=018b7562-3559-4086-8655-8c9a25f8b83b,segment=NetworkSegment(5a4f0363-fcd1-4d99-863b-a1c699da9e84),segment_id=5a4f0363-fcd1-4d99-863b-a1c699da9e84)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:09.154632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.156495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1089cacc-3f72-49af-9aba-458fab23d6dd,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:09.166560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.166910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.167249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.167640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.167945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.168274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.168600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.168927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.169247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.169568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.169885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.176097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:09.245094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:09.258882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:09.271251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:09.274882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.276243 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:09.276650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:09.299701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 018b7562-3559-4086-8655-8c9a25f8b83b owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:09.419022 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-869ef079-cc78-40de-a670-b522786dd2ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.3010230 Nov 24 14:04:09.421888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45450) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:09.429399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:09.542384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.543464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:09.547660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eb414293-62ca-47a8-b0d4-c80390b873dc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:09.551738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45454) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:09.557126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:09.601851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=018b7562-3559-4086-8655-8c9a25f8b83b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:09.626868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Deleting port 1089cacc-3f72-49af-9aba-458fab23d6dd {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:09.628013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.649538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:09.653258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.654670 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:09.655096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:09.694018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-daa18550-1fd0-4576-a237-dbb032d47f5a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/63b51789-24dc-42f8-9f30-1eeb2ace8f45 HTTP/1.1" status: 200 len: 993 time: 0.1409340 Nov 24 14:04:09.707687 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5a43ffaf-8ecb-432e-810e-bcb0895ab6f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2844753 Nov 24 14:04:09.708503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45458) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:09.780637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.781020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.781397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.781765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.782128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.782492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.782851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.783207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.783562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.783963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.784318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:04:09.799549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:09.812759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf733fb2-13b3-4f5e-bc0d-bcba48b3c3aa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:09.817309 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cf733fb2-13b3-4f5e-bc0d-bcba48b3c3aa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.1052208 Nov 24 14:04:09.817759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45462) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:09.887127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700ef290-de80-4346-84c0-58acb54f9ce9 req-e07b0060-3ed9-4b04-a34c-a821e8cda075 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:09.892485 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-700ef290-de80-4346-84c0-58acb54f9ce9 req-e07b0060-3ed9-4b04-a34c-a821e8cda075 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.4238920 Nov 24 14:04:09.918550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] For port 1089cacc-3f72-49af-9aba-458fab23d6dd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1089cacc-3f72-49af-9aba-458fab23d6dd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:09.918956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:09.920110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b0bd77c-9b63-43d3-9392-b86e7314e1a6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:09.924197 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0b0bd77c-9b63-43d3-9392-b86e7314e1a6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1029470 Nov 24 14:04:09.924486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45466) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:10.003214 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-56000dba-6d08-49f3-ba7c-85d39d1e3947 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0712931 Nov 24 14:04:10.004750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45470) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:10.007205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-700ef290-de80-4346-84c0-58acb54f9ce9 req-b1b96fe4-9f9b-4afc-9813-dbda0f5ce7a3 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0591393 Nov 24 14:04:10.012435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.021401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:10.060579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Calling delete_port for 1089cacc-3f72-49af-9aba-458fab23d6dd owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:10.141053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.145953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-871c1174-ef41-475e-bf39-55844768dea8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:10.158426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:10.169298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:10.183241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:10.185456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Pushing event deleted for resources: {'Port': ['ID=1089cacc-3f72-49af-9aba-458fab23d6dd,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:10.189311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.189511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:10.196157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] No DVR routers for this DVR port 1089cacc-3f72-49af-9aba-458fab23d6dd on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:10.230870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-341dbb8b-539d-4a7e-a741-1a7cf4342e23 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:04:10.272954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:04:10.277073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:10.570233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:04:10.582233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b6f164b-a477-4e55-a7ac-7d9ef70c9a83 req-29b141a6-838f-4f58-97f4-c5bebd97739a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1098 time: 0.1169062 Nov 24 14:04:10.616000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:10.617622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.622102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d56fa66a-bd40-43f2-8e68-97019a38b774 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:10.622721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:10.632646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.667830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '67fa1194-0c3d-4202-9709-065dd857e200', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'port_id': '67fa1194-0c3d-4202-9709-065dd857e200', 'mac_address': 'fa:16:3e:86:5a:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 882, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:04:10.680832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:10.684189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:10.692641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:10.693219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.716099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=dff1a110-2346-4451-a232-367ca629021b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:10.721124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:10.734535 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.7287447 Nov 24 14:04:10.737371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45474) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:10.744388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:65:97:e3', 'name': 'tempest-NetworksTestDHCPv6-75078063'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:10.770669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b6f164b-a477-4e55-a7ac-7d9ef70c9a83 req-f9311943-17bb-4c17-b16d-1e71e8b3169d service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1811283 Nov 24 14:04:10.773369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:04:10.787204 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6034806 Nov 24 14:04:10.789807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:04:10.790120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:10.800156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:04:10.823517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-341dbb8b-539d-4a7e-a741-1a7cf4342e23 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:04:10.836323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:10.837386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.860704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:10.868240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:10.901104 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'code': 200} Nov 24 14:04:10.914333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:10.914986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:10.952373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:10.958041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:10.962584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 67fa1194-0c3d-4202-9709-065dd857e200 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:04:10.963396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:10.974227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:10.986792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:11.015943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting subnet ddef1ee6-c276-4b6d-b1ac-958e76e20b11 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:11.019086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.088899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.165512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.195799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 2fee02ef-2163-4387-9bfb-c4bc2e307868 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:11.217671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:11.235554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:11.237232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:11.261028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4520f638-bcd6-42ce-b70c-7592442b6009 req-54cc2db7-042a-48e8-a62b-eb25108f5314 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:11.262693 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4520f638-bcd6-42ce-b70c-7592442b6009 req-54cc2db7-042a-48e8-a62b-eb25108f5314 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 943 time: 0.1134930 Nov 24 14:04:11.274970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.286845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:11.287439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:11.361081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe65:97e3 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/dff1a110-2346-4451-a232-367ca629021b/2fee02ef-2163-4387-9bfb-c4bc2e307868) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:11.395149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:09Z', 'revision_number': 11, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:11.417608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:04:11.477647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:11.478401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:11.497627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4520f638-bcd6-42ce-b70c-7592442b6009 req-a7c72a15-9990-467a-bb67-3635d2d9956f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2287834 Nov 24 14:04:11.522900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.534726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0af09db-d964-4af6-92fc-edbf5026a40a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:11.566349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.580995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Subnet': ['ID=ddef1ee6-c276-4b6d-b1ac-958e76e20b11,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:11.584927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:11.589476 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/ddef1ee6-c276-4b6d-b1ac-958e76e20b11 HTTP/1.1" status: 204 len: 168 time: 0.7983303 Nov 24 14:04:11.590353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45486) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:11.639833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:11.717605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.718232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.733006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Deleting port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:11.733989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.735742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 2fee02ef-2163-4387-9bfb-c4bc2e307868 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:11.760363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.766712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3a1eeae8-02e0-452f-9f40-8cb6d8b8d975 tempest-AllowedAddressPairIpV6TestJSON-1708515592 tempest-AllowedAddressPairIpV6TestJSON-1708515592-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:11.798293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:09Z', 'revision_number': 11, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:11.829983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:11.839469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:11.839690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b0d9d18-e95c-4666-affe-85040de2d52a None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:09Z', 'revision_number': 11, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:04:11.844544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:11.852761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:11.853576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.862038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=2fee02ef-2163-4387-9bfb-c4bc2e307868,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:11.869851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:11.891564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.904462 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 1.1657617 Nov 24 14:04:11.906013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45490) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:11.920974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 67fa1194-0c3d-4202-9709-065dd857e200 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:04:11.930387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'dff1a110-2346-4451-a232-367ca629021b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:11.931543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:11.960453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:11.999256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.004075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:12.007365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] For port 5fe9a561-187e-4f27-b3c9-c2031208e0d5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5fe9a561-187e-4f27-b3c9-c2031208e0d5,segment=NetworkSegment(5a4f0363-fcd1-4d99-863b-a1c699da9e84),segment_id=5a4f0363-fcd1-4d99-863b-a1c699da9e84)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:12.007835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.022712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-287fd0f5-adeb-48f8-8d09-21c8e44f3ae7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:12.023917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-287fd0f5-adeb-48f8-8d09-21c8e44f3ae7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:12.044697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-287fd0f5-adeb-48f8-8d09-21c8e44f3ae7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:12.046590 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-287fd0f5-adeb-48f8-8d09-21c8e44f3ae7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 944 time: 0.1372473 Nov 24 14:04:12.049688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45494) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:12.135947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:12.142298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:12.151076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Calling delete_port for 5fe9a561-187e-4f27-b3c9-c2031208e0d5 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:12.154242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 2fee02ef-2163-4387-9bfb-c4bc2e307868 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:12.154242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.185779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Allocated IP 2001:db8::f816:3eff:fec7:6422 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/dff1a110-2346-4451-a232-367ca629021b/b780dbab-c278-4a22-8899-ded009bd53cd) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:12.277835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.283627 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d2dfe760-08c7-44c5-891e-32c4f9fd1d51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:12.386213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Port': ['ID=5fe9a561-187e-4f27-b3c9-c2031208e0d5,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:12.389055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:12.392054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No DVR routers for this DVR port 5fe9a561-187e-4f27-b3c9-c2031208e0d5 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:12.510195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.530310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.540120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['67fa1194-0c3d-4202-9709-065dd857e200'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:04:12.560526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fa522dda-607e-4bb3-af91-d3f819546827']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:12.577547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5a4f0363-fcd1-4d99-863b-a1c699da9e84') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:12.577769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5a4f0363-fcd1-4d99-863b-a1c699da9e84') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:12.593975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.602440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 018b7562-3559-4086-8655-8c9a25f8b83b no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:12.619245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.626744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Releasing vlan 853 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:04:12.627382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:04:12.645038 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:04:12.654196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 018b7562-3559-4086-8655-8c9a25f8b83b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:12.654778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 018b7562-3559-4086-8655-8c9a25f8b83b not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:12.669007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 2fee02ef-2163-4387-9bfb-c4bc2e307868 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:12.670955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.696810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Transition to ACTIVE for port object b780dbab-c278-4a22-8899-ded009bd53cd will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:12.746554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Transition to ACTIVE for port object b780dbab-c278-4a22-8899-ded009bd53cd will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:12.747457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.751449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72acc08d-c341-4862-8e7f-75f000acb8db tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:12.764242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.770925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.771167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c77ed176-5237-4b0c-b24c-a54e3cd76374 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:12.782483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Pushing event deleted for resources: {'Network': ['ID=fa522dda-607e-4bb3-af91-d3f819546827,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:12.790004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:12.791969 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/networks/fa522dda-607e-4bb3-af91-d3f819546827 HTTP/1.1" status: 204 len: 168 time: 1.2006240 Nov 24 14:04:12.794635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45500) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:12.802255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'routes': None}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:12.834715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd81010-fe56-431c-b53e-6b12d7a1065c req-cfec9e6d-2b22-43bf-97bf-3688541f928f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:12.837441 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-acd81010-fe56-431c-b53e-6b12d7a1065c req-cfec9e6d-2b22-43bf-97bf-3688541f928f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 944 time: 0.1299875 Nov 24 14:04:12.879269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:12.886558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Pushing event updated for resources: {'Port': ['ID=b780dbab-c278-4a22-8899-ded009bd53cd,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:12.889961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:12.894258 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:12.897229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:12.947954 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-acd81010-fe56-431c-b53e-6b12d7a1065c req-61822ef2-5d17-41c4-8e45-3889926f079f tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693824 Nov 24 14:04:12.958673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:12.964901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2070215d-fdb4-43c7-8f44-e41561d18772 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:13.002866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45504) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:13.025425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Attempting to bind port b780dbab-c278-4a22-8899-ded009bd53cd on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:13.025811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Attempting to bind port b780dbab-c278-4a22-8899-ded009bd53cd by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:13.026181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Attempting to bind port b780dbab-c278-4a22-8899-ded009bd53cd on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:13.047831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:13.048214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:13.048624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.049023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:13.049498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Bound port: b780dbab-c278-4a22-8899-ded009bd53cd, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:13.049878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.077328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=2fee02ef-2163-4387-9bfb-c4bc2e307868,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:13.088982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:13.155480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.166129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Added routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:113}} Nov 24 14:04:13.166694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.extraroute_db [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Removed routes are [] {{(pid=83526) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:121}} Nov 24 14:04:13.166810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.183469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/2fee02ef-2163-4387-9bfb-c4bc2e307868 HTTP/1.1" status: 204 len: 168 time: 1.1286864 Nov 24 14:04:13.185358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45508) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:13.220748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] For port b780dbab-c278-4a22-8899-ded009bd53cd, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:13.234120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] For port b780dbab-c278-4a22-8899-ded009bd53cd, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b780dbab-c278-4a22-8899-ded009bd53cd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:13.242378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.246287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:13.296414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8f57fe3-b566-4ad8-bada-08de84272d4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:13.302932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8f57fe3-b566-4ad8-bada-08de84272d4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:13.305075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c8f57fe3-b566-4ad8-bada-08de84272d4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:13.313741 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-84850099-f180-4d29-a0aa-9cc90c65c339 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/floatingips/23e79b9e-c628-41f7-8df7-6750470f80dc HTTP/1.1" status: 200 len: 991 time: 0.3058476 Nov 24 14:04:13.329152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c8f57fe3-b566-4ad8-bada-08de84272d4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:13.333314 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c8f57fe3-b566-4ad8-bada-08de84272d4f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.1443505 Nov 24 14:04:13.333757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45512) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:13.341817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Pushing event updated for resources: {'Port': ['ID=b780dbab-c278-4a22-8899-ded009bd53cd,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:13.344653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:13.424395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet dff1a110-2346-4451-a232-367ca629021b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:13.429003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.523221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.575336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.578815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.615865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.703504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.708993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-586b3a4c-6241-44f4-8286-b2f16d75d2de tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:13.733482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 9447f30d-a2f1-408d-906a-0bcd23151ed7 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:04:13.746784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=dff1a110-2346-4451-a232-367ca629021b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:13.750264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:13.756150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.773002 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/dff1a110-2346-4451-a232-367ca629021b HTTP/1.1" status: 204 len: 168 time: 0.4375339 Nov 24 14:04:13.773670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45516) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:13.849216 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-851296c7-433e-4535-a3ce-8562b1012da3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0710566 Nov 24 14:04:13.849888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45520) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:13.854996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:13.882886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:04:13.888939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:13.890069 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d653dc32-a287-4442-aa0a-3ffc3330420d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 705 time: 1.0943792 Nov 24 14:04:13.893094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45524) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:13.895554 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] Sync routers for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:04:13.913319 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:13.914487 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:13.942292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bde5bbb4-f6a5-43ee-a601-c976f4dc8364 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:13.966332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bde5bbb4-f6a5-43ee-a601-c976f4dc8364 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:13.971089 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bde5bbb4-f6a5-43ee-a601-c976f4dc8364 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 205 time: 0.0768421 Nov 24 14:04:13.972065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45528) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:14.093874 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:14.140296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:14.145913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:14.149490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:14.162935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:14.177532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:14.182301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:14.188178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:14.232588 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:09Z', 'revision_number': 11, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:14.238128 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] Checking router: 9447f30d-a2f1-408d-906a-0bcd23151ed7 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:04:14.250380 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] Routers {'9447f30d-a2f1-408d-906a-0bcd23151ed7'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:14.251705 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9447f30d-a2f1-408d-906a-0bcd23151ed7'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:14.272981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:14.400545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 67fa1194-0c3d-4202-9709-065dd857e200 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:14.400932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:14.559254 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] Set router 9447f30d-a2f1-408d-906a-0bcd23151ed7 gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:14.666706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:14.677650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e116b57e-b3ea-42e9-ab9a-1afb435f82ea None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:14.710289 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:09Z', 'revision_number': 11, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:14.724768 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60c536e7-efef-4931-80ce-1d8fa2b62f85 None None] The sync data for ids ['9447f30d-a2f1-408d-906a-0bcd23151ed7'] in dv-neutron-818151-2-hyperv is: [{'id': '9447f30d-a2f1-408d-906a-0bcd23151ed7', 'name': 'tempest-RoutersIpV6Test-router-1671239507', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:08Z', 'updated_at': '2021-11-24T14:04:09Z', 'revision_number': 11, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:04:14.768268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cb2b261-3446-4ec1-bc9c-d07ea7076e3a None None] Network fa522dda-607e-4bb3-af91-d3f819546827 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:14.786263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b780dbab-c278-4a22-8899-ded009bd53cd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:14.872894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cb2b261-3446-4ec1-bc9c-d07ea7076e3a None None] Network fa522dda-607e-4bb3-af91-d3f819546827 could not be found, it might have been deleted concurrently. {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:205}} Nov 24 14:04:14.874236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0e0d3b13-7c4c-4927-8106-1a1d6854453d None None] Provisioning for port b780dbab-c278-4a22-8899-ded009bd53cd completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:14.920184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:14.964162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1738ebbf-ac6d-4d0b-af98-7b6a58d52e3a None None] DHCP port deletion for fa522dda-607e-4bb3-af91-d3f819546827 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:14.975420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:04:15.023272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:15.048186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.056352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-96abc9c1-800f-4095-905c-385c9307f6c2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:15.095220 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'code': 200} Nov 24 14:04:15.096060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.101765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.130632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.132673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.133414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router 9447f30d-a2f1-408d-906a-0bcd23151ed7 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:04:15.137924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port b780dbab-c278-4a22-8899-ded009bd53cd completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:15.152954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b780dbab-c278-4a22-8899-ded009bd53cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:15.153335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.154986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.162090 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6e3a13bb-7513-4e72-90e0-5d07bb25c9f2 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 204 len: 168 time: 1.1885047 Nov 24 14:04:15.162705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45534) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:15.168283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-385859047', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:15.176023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:15.184264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Usage tracker for resource:router and tenant:101b6d3e2d324980acf3f246ca68fb39 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:15.187462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:15.196202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:15.226006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.228286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.236447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:15.258303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:15.262644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.295607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.337332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.342301 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-792d96f1-dc5b-4bbd-9409-da9b37b2b538 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.1758230 Nov 24 14:04:15.344061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45538) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:15.352072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Request body: {'router': {'admin_state_up': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:15.423102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port b780dbab-c278-4a22-8899-ded009bd53cd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b780dbab-c278-4a22-8899-ded009bd53cd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:15.424890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.450410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.455470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.456996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.462390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-71a98512-3220-4903-8f3f-63691f24f12b tempest-RoutersAdminNegativeTest-1143889805 tempest-RoutersAdminNegativeTest-1143889805-project-admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:15.519165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:15.519694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:15.538018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:15.542045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:15.547549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:15.548149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.574622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=b780dbab-c278-4a22-8899-ded009bd53cd,revision_number=5']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:15.579629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:15.581800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9118f120-d747-4b58-b2c7-96a9f0c2d393 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.084s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:15.615968 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7654879 Nov 24 14:04:15.616651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45542) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:15.629177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:0d:95:cc', 'name': 'tempest-NetworksTestDHCPv6-43316821'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:15.685875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ead404c-09e8-4b10-a8f9-b095c989504c None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:15.728282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=cf702fb7-641f-484f-a903-212d8a5f97c9,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:15.732730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:15.794943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:15.799637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:15.803357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:15.810290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:15.811607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.822012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:15.825520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.826221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:15.856945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 69d075dc-82c5-4976-8c43-180c18495066 yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:15.883087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d197b2e8-75c8-48d4-9790-ba530ac2b64c None None] Provisioning complete for port b780dbab-c278-4a22-8899-ded009bd53cd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:15.883573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d197b2e8-75c8-48d4-9790-ba530ac2b64c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.001794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Router 6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:04:16.020320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe0d:95cc (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/cf702fb7-641f-484f-a903-212d8a5f97c9/69d075dc-82c5-4976-8c43-180c18495066) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:16.150892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.151330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:04:16.157554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.162252 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-31ec98d5-614c-4d3d-82d1-ad7b9df81b96 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "PUT /v2.0/routers/6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee HTTP/1.1" status: 200 len: 697 time: 0.8133481 Nov 24 14:04:16.163352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d197b2e8-75c8-48d4-9790-ba530ac2b64c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.163505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45546) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:16.180686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] Sync routers for ids ['6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:04:16.245448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port b780dbab-c278-4a22-8899-ded009bd53cd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b780dbab-c278-4a22-8899-ded009bd53cd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:16.248499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] Routers {'6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:16.249109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:16.254847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.276767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 69d075dc-82c5-4976-8c43-180c18495066 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:16.309874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.312093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.329378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-47b0b803-b847-4615-a9f3-54fb6760e1fd tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:16.351002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b3b098c6-61da-485c-9fb5-c0be3828c329 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/routers/6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee HTTP/1.1" status: 200 len: 703 time: 0.1869349 Nov 24 14:04:16.353746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45550) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:16.397717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fa67a7f7-29c4-48e7-9192-9720597f465e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:16.398940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=69d075dc-82c5-4976-8c43-180c18495066,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:16.405142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:16.412489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acf520a3-b81a-493c-9bfa-fd678202dd95 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee HTTP/1.1" status: 200 len: 205 time: 0.0575032 Nov 24 14:04:16.413111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45554) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:16.415561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:16.416804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:16.419369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:16.423967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:16.424749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.454470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 0.8322067 Nov 24 14:04:16.458548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:16.579546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.586864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-d197b2e8-75c8-48d4-9790-ba530ac2b64c None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:16.587793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-d197b2e8-75c8-48d4-9790-ba530ac2b64c None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:16.600780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c90e6a89-0964-4b02-bc4f-3838434a9b0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:16.601243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] Set router 6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:16.607405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c90e6a89-0964-4b02-bc4f-3838434a9b0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:16.609147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c90e6a89-0964-4b02-bc4f-3838434a9b0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:16.633767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c90e6a89-0964-4b02-bc4f-3838434a9b0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:16.635191 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c90e6a89-0964-4b02-bc4f-3838434a9b0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1751075 Nov 24 14:04:16.637755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45562) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:16.715685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 69d075dc-82c5-4976-8c43-180c18495066 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:16.716076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:16.737046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee', 'name': 'tempest-RoutersIpV6Test-router-385859047', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:04:15Z', 'updated_at': '2021-11-24T14:04:15Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:16.739994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b780dbab-c278-4a22-8899-ded009bd53cd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:16.784536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] Checking router: 6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:04:16.796402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=b780dbab-c278-4a22-8899-ded009bd53cd,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:16.803865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.406s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:16.830814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] Routers {'6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:04:16.831564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:16.975038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] Set router 6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:04:17.016617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b780dbab-c278-4a22-8899-ded009bd53cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:17.017006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.148021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.158332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee', 'name': 'tempest-RoutersIpV6Test-router-385859047', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:04:15Z', 'updated_at': '2021-11-24T14:04:15Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:17.180091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c0bc381c-0202-4841-8ec2-04ee9d366e6f None None] The sync data for ids ['6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee'] in dv-neutron-818151-2-hyperv is: [{'id': '6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee', 'name': 'tempest-RoutersIpV6Test-router-385859047', 'tenant_id': '101b6d3e2d324980acf3f246ca68fb39', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:04:15Z', 'updated_at': '2021-11-24T14:04:15Z', 'revision_number': 2, 'project_id': '101b6d3e2d324980acf3f246ca68fb39', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:04:17.201140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.233224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.284408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.285162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Fanout notify agent at l3_agent the message router_deleted on router 6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:04:17.301156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.308867 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1f482165-bf24-48e3-99b6-800c23d63883 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee HTTP/1.1" status: 204 len: 168 time: 0.8941839 Nov 24 14:04:17.310912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45566) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.313036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5fe9a561-187e-4f27-b3c9-c2031208e0d5 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:17.336696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 69d075dc-82c5-4976-8c43-180c18495066 owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:17.356589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 5fe9a561-187e-4f27-b3c9-c2031208e0d5 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:17.356942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5fe9a561-187e-4f27-b3c9-c2031208e0d5 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:17.366755 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6f13621b-2637-40a8-9736-d4318e1672ec tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee HTTP/1.1" status: 200 len: 205 time: 0.0540652 Nov 24 14:04:17.368914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45570) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.370545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Provisioning for port 69d075dc-82c5-4976-8c43-180c18495066 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:17.376266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Provisioning complete for port 69d075dc-82c5-4976-8c43-180c18495066 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:17.376627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.439497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-9b031c01-0794-4ff1-9691-2fdb8900f46c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:17.443371 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9b031c01-0794-4ff1-9691-2fdb8900f46c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/6a3760dd-48d0-4273-bf1a-a5fb3ec4f7ee HTTP/1.1" status: 404 len: 336 time: 0.0705907 Nov 24 14:04:17.443721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45574) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.482944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c135c250-3618-4b2d-a4da-5efecf8c679b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:17.483571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c135c250-3618-4b2d-a4da-5efecf8c679b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:17.485236 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c135c250-3618-4b2d-a4da-5efecf8c679b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/b9d08fe6-f61a-4110-b46e-7c03f6921df1 HTTP/1.1" status: 404 len: 337 time: 0.0401900 Nov 24 14:04:17.488431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45578) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.496612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Port 69d075dc-82c5-4976-8c43-180c18495066 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:04:17.499658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Could not find standard attr ID for object 2fee02ef-2163-4387-9bfb-c4bc2e307868. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:17.514082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Provisioning complete for port b780dbab-c278-4a22-8899-ded009bd53cd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:17.514543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69ccce9a-e91e-4d28-bd9f-5bf3620625dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.516155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.522612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:17.530982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-e426eeba-1dcd-4740-9e0c-c5355ef224ea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:17.531417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e426eeba-1dcd-4740-9e0c-c5355ef224ea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:17.537481 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e426eeba-1dcd-4740-9e0c-c5355ef224ea tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/719afdec-c525-4346-b69e-a76bdf8a686f HTTP/1.1" status: 404 len: 337 time: 0.0434871 Nov 24 14:04:17.537743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45582) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.565771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=69d075dc-82c5-4976-8c43-180c18495066,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:17.569656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:17.578758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-7becedf3-95f8-45ab-844d-3b2c5828fbfc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:17.579191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7becedf3-95f8-45ab-844d-3b2c5828fbfc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:17.584029 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7becedf3-95f8-45ab-844d-3b2c5828fbfc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/02987e09-a307-477d-8b4e-5a4c97ae1c9f HTTP/1.1" status: 404 len: 337 time: 0.0425117 Nov 24 14:04:17.584253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45586) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.598572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.615487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:17.625655 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-63a73e2b-fc29-4a43-9870-a63b0c2b7a1c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:17.626343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-63a73e2b-fc29-4a43-9870-a63b0c2b7a1c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:17.628819 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-63a73e2b-fc29-4a43-9870-a63b0c2b7a1c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/ddef1ee6-c276-4b6d-b1ac-958e76e20b11 HTTP/1.1" status: 404 len: 337 time: 0.0430634 Nov 24 14:04:17.631782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45590) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.637148 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/69d075dc-82c5-4976-8c43-180c18495066 HTTP/1.1" status: 204 len: 168 time: 0.9966731 Nov 24 14:04:17.638147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.677644 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4d5540b2-d758-417d-a17b-eba1f859edc3 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 200 len: 205 time: 0.0443799 Nov 24 14:04:17.681487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.758648 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-20ecc59c-de55-41cb-9f01-62ddb95708a6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:17.759666 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-20ecc59c-de55-41cb-9f01-62ddb95708a6 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/9447f30d-a2f1-408d-906a-0bcd23151ed7 HTTP/1.1" status: 404 len: 336 time: 0.0772526 Nov 24 14:04:17.762609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45602) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.820315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ac2a5d6b-103c-4fa7-8118-7ef47d6ecda4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Synchronizing usage tracker for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:17.831194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8132cd89-13f4-46f2-9e25-12650ea8914f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:17.832570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8132cd89-13f4-46f2-9e25-12650ea8914f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:17.833274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8132cd89-13f4-46f2-9e25-12650ea8914f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:17.849741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ac2a5d6b-103c-4fa7-8118-7ef47d6ecda4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Unset dirty status for tenant:101b6d3e2d324980acf3f246ca68fb39 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:17.850846 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ac2a5d6b-103c-4fa7-8118-7ef47d6ecda4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=78413ccb-dcd3-4839-aa79-4f283250f59b HTTP/1.1" status: 200 len: 205 time: 0.0873156 Nov 24 14:04:17.853677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45606) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.913712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8132cd89-13f4-46f2-9e25-12650ea8914f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:17.914768 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8132cd89-13f4-46f2-9e25-12650ea8914f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.2755420 Nov 24 14:04:17.917564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45610) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.922168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-931b4436-21dc-4a5a-89ea-051030fb57e9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:17.925619 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-931b4436-21dc-4a5a-89ea-051030fb57e9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/78413ccb-dcd3-4839-aa79-4f283250f59b HTTP/1.1" status: 404 len: 336 time: 0.0685554 Nov 24 14:04:17.926674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45614) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:17.965559 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-c6e21b04-f226-4d57-91ff-a6abcbad017c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:17.965994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c6e21b04-f226-4d57-91ff-a6abcbad017c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:17.967663 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c6e21b04-f226-4d57-91ff-a6abcbad017c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/4bc554d1-6739-430f-b728-4d4a0b7a83a1 HTTP/1.1" status: 404 len: 337 time: 0.0398469 Nov 24 14:04:17.970287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.016220 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-487e6224-edfd-4b6d-b69b-fa16a2d2c05a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 200 len: 205 time: 0.0426278 Nov 24 14:04:18.016453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45622) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.085045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-66a027a5-52ba-4cde-951a-0dd82841c907 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:18.086093 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-66a027a5-52ba-4cde-951a-0dd82841c907 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/a38fe41f-1d91-4edf-8039-9ef7af56c186 HTTP/1.1" status: 404 len: 336 time: 0.0688350 Nov 24 14:04:18.088949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45626) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.119903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet cf702fb7-641f-484f-a903-212d8a5f97c9 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:18.122878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.134823 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-45eebf9a-12f6-4678-851e-509b72daae0d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 HTTP/1.1" status: 200 len: 205 time: 0.0425351 Nov 24 14:04:18.135275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45630) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.177302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.204622 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-05c9038e-b0bf-4de2-8349-c99015d5981a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:18.205648 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-05c9038e-b0bf-4de2-8349-c99015d5981a tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/62e1e4da-34fc-44d6-b3e7-c5f88e6b6277 HTTP/1.1" status: 404 len: 336 time: 0.0692511 Nov 24 14:04:18.208836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45634) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.252626 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-9149fba9-ea88-4caa-be88-a29123f329d7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:18.253144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9149fba9-ea88-4caa-be88-a29123f329d7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:18.255506 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9149fba9-ea88-4caa-be88-a29123f329d7 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/b0c0b927-55d5-4214-8f61-2ab7cfdd60b9 HTTP/1.1" status: 404 len: 337 time: 0.0452673 Nov 24 14:04:18.258266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45638) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.263083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.305660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d32550fc-1bd8-425b-9f71-156836202028 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=a5d3c148-c0d8-42cc-8713-772f9e9b7f4e HTTP/1.1" status: 200 len: 205 time: 0.0457382 Nov 24 14:04:18.308015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45642) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.346231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.351689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd0a9294-5a4c-4c1e-8b41-e0bc309e6292 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:18.374166 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-05612135-fc95-4a5d-a029-8e040a399d27 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:18.375179 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-05612135-fc95-4a5d-a029-8e040a399d27 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/a5d3c148-c0d8-42cc-8713-772f9e9b7f4e HTTP/1.1" status: 404 len: 336 time: 0.0660822 Nov 24 14:04:18.377808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45646) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.386829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=cf702fb7-641f-484f-a903-212d8a5f97c9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:18.390889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:18.395218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.401207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-384c5d9d-f73a-43c3-8675-0417d71340a0 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:18.413574 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/cf702fb7-641f-484f-a903-212d8a5f97c9 HTTP/1.1" status: 204 len: 168 time: 0.4947200 Nov 24 14:04:18.414295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45650) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.421443 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-0018f21c-8308-46d2-9d4a-3ec48bd8c703 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:18.422176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0018f21c-8308-46d2-9d4a-3ec48bd8c703 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:18.424188 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0018f21c-8308-46d2-9d4a-3ec48bd8c703 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/c0cc5abe-3445-4c29-81ec-0d6912e36933 HTTP/1.1" status: 404 len: 337 time: 0.0449317 Nov 24 14:04:18.426747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45654) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.471585 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-449b901b-36de-49e7-9c45-42006be52196 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "GET /v2.0/ports?device_id=42b1bdf4-68b9-47df-8d46-bae330c84cdb HTTP/1.1" status: 200 len: 205 time: 0.0436237 Nov 24 14:04:18.474842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45658) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.495872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2e401844-53f7-426b-9d8e-afa36314ecd3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0801170 Nov 24 14:04:18.496745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45662) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.552760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b780dbab-c278-4a22-8899-ded009bd53cd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:18.585662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8985cf98-9ceb-4769-a991-037bcd15cc94 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:18.586731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8985cf98-9ceb-4769-a991-037bcd15cc94 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:18.605750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8985cf98-9ceb-4769-a991-037bcd15cc94 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:18.609896 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8985cf98-9ceb-4769-a991-037bcd15cc94 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1097560 Nov 24 14:04:18.610186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45666) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.676853 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-3625fee6-5ca2-4bb2-9df8-a8453c738cc4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] delete failed (client error): The resource could not be found. Nov 24 14:04:18.678950 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3625fee6-5ca2-4bb2-9df8-a8453c738cc4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/routers/42b1bdf4-68b9-47df-8d46-bae330c84cdb HTTP/1.1" status: 404 len: 336 time: 0.2018883 Nov 24 14:04:18.680611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45670) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.684676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b780dbab-c278-4a22-8899-ded009bd53cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:18.685686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.722510 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-0dd8ddd3-991d-4b2e-8e7c-4ae9027bcf88 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:18.723044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0dd8ddd3-991d-4b2e-8e7c-4ae9027bcf88 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:18.724837 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0dd8ddd3-991d-4b2e-8e7c-4ae9027bcf88 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/eab0d0fe-90d2-4c39-b7fb-965833a7b41a HTTP/1.1" status: 404 len: 337 time: 0.0432277 Nov 24 14:04:18.727427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45674) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.771318 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-3436efe7-ef6b-43f6-8960-20c8dffdfd37 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:18.771949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3436efe7-ef6b-43f6-8960-20c8dffdfd37 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:18.773928 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3436efe7-ef6b-43f6-8960-20c8dffdfd37 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] 10.222.0.70 "DELETE /v2.0/subnets/472eec3c-b375-4ea9-b4df-ba09d7003ada HTTP/1.1" status: 404 len: 337 time: 0.0451343 Nov 24 14:04:18.786448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a317fdab-830a-48af-beb8-455cce65064c None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:18.801792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Deleting port b780dbab-c278-4a22-8899-ded009bd53cd {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:18.802171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:18.815339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97a6bec6-fba0-468a-901a-d8db8be2adc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:18.816226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-97a6bec6-fba0-468a-901a-d8db8be2adc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:18.838401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-97a6bec6-fba0-468a-901a-d8db8be2adc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:18.841553 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97a6bec6-fba0-468a-901a-d8db8be2adc8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.2303321 Nov 24 14:04:18.844413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45680) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.948509 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f0ddc125-44e4-4aea-984c-698373231776 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1027768 Nov 24 14:04:18.952814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45684) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:18.961584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:19.085472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a317fdab-830a-48af-beb8-455cce65064c None None] For port b780dbab-c278-4a22-8899-ded009bd53cd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b780dbab-c278-4a22-8899-ded009bd53cd,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:19.085776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.092182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:19.102176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:19.114681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:19.142246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45690) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:19.214256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Calling delete_port for b780dbab-c278-4a22-8899-ded009bd53cd owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:19.234091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.312301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.318917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3e57cb27-1e6f-4efb-8bd6-0431c9f2779f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:19.368867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Pushing event deleted for resources: {'Port': ['ID=b780dbab-c278-4a22-8899-ded009bd53cd,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:19.371890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:19.380742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a317fdab-830a-48af-beb8-455cce65064c None None] No DVR routers for this DVR port b780dbab-c278-4a22-8899-ded009bd53cd on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:19.470971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-00b86508-f0ff-44f7-b031-53c7dc0e890b admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=101b6d3e2d324980acf3f246ca68fb39&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3245084 Nov 24 14:04:19.471132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45696) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:19.541391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.569988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.624456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.628867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0ad30ea0-e9dd-488b-a4c9-a9ad508dab23 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:19.640450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9393a0b9-1033-4d62-8bdb-8d27b11e2e5d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:19.644665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:19.648742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.649864 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/9393a0b9-1033-4d62-8bdb-8d27b11e2e5d HTTP/1.1" status: 204 len: 168 time: 0.1783605 Nov 24 14:04:19.655514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:19.657572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.663723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:19.726076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:19.730934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:19.734576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:19.735610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.742401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-729ad5dc-cc51-43b2-b8cf-7e6579869dd9 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:19.752595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=2af9d605-7630-4ff0-9b75-42a380cebe3e,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:19.756590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:19.780259 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 0.8221819 Nov 24 14:04:19.780615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45702) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:19.787548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:12:86:4d', 'name': 'tempest-NetworksTestDHCPv6-84016132'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:19.945587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:19.955401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:19.966827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:19.970936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:19.987592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': '2af9d605-7630-4ff0-9b75-42a380cebe3e'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:19.988707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.003511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 1e59ba05-1a2f-4262-b7f3-3142c037185c yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:20.151249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe12:864d (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/2af9d605-7630-4ff0-9b75-42a380cebe3e/1e59ba05-1a2f-4262-b7f3-3142c037185c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:20.356615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.372593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 1e59ba05-1a2f-4262-b7f3-3142c037185c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:20.394930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.400745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:20.458911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Allocated IP 2001:db8::f816:3eff:fed9:716c (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/2af9d605-7630-4ff0-9b75-42a380cebe3e/9dd931e9-35cf-4371-8de8-fe32bc018f5f) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:20.466019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:20.473698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:20.476354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:20.480535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:20.481247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.497598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=1e59ba05-1a2f-4262-b7f3-3142c037185c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:20.502328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:20.523259 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 0.7413309 Nov 24 14:04:20.525831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45706) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:20.559866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b780dbab-c278-4a22-8899-ded009bd53cd no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:20.597938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: b780dbab-c278-4a22-8899-ded009bd53cd {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:20.598285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b780dbab-c278-4a22-8899-ded009bd53cd not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:20.606199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76a93f69-8ee7-4ddb-ab4d-c32c9e710fd5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:20.606768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76a93f69-8ee7-4ddb-ab4d-c32c9e710fd5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:20.624651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76a93f69-8ee7-4ddb-ab4d-c32c9e710fd5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:20.626187 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-76a93f69-8ee7-4ddb-ab4d-c32c9e710fd5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 944 time: 0.0992641 Nov 24 14:04:20.629805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45710) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:20.700779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 1e59ba05-1a2f-4262-b7f3-3142c037185c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:20.701225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.760403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.771061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Transition to ACTIVE for port object 9dd931e9-35cf-4371-8de8-fe32bc018f5f will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:20.789875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Transition to ACTIVE for port object 9dd931e9-35cf-4371-8de8-fe32bc018f5f will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:20.799002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.804795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a317fdab-830a-48af-beb8-455cce65064c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:20.872313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:20.875494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:20.879857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:20.881942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Pushing event updated for resources: {'Port': ['ID=9dd931e9-35cf-4371-8de8-fe32bc018f5f,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:20.884775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:20.950268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.969950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Attempting to bind port 9dd931e9-35cf-4371-8de8-fe32bc018f5f on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:20.970324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Attempting to bind port 9dd931e9-35cf-4371-8de8-fe32bc018f5f by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:20.970690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Attempting to bind port 9dd931e9-35cf-4371-8de8-fe32bc018f5f on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:20.978255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:20.978630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:20.979037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:20.979434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:20.979927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Bound port: 9dd931e9-35cf-4371-8de8-fe32bc018f5f, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:20.980309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.071344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] For port 9dd931e9-35cf-4371-8de8-fe32bc018f5f, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:21.072296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 1e59ba05-1a2f-4262-b7f3-3142c037185c owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:21.075038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] For port 9dd931e9-35cf-4371-8de8-fe32bc018f5f, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9dd931e9-35cf-4371-8de8-fe32bc018f5f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:21.079336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.083025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:21.169036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Pushing event updated for resources: {'Port': ['ID=9dd931e9-35cf-4371-8de8-fe32bc018f5f,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:21.173674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:21.233835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.243993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:21.290349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=1e59ba05-1a2f-4262-b7f3-3142c037185c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:21.293729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:21.364487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.376612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/1e59ba05-1a2f-4262-b7f3-3142c037185c HTTP/1.1" status: 204 len: 168 time: 0.7457740 Nov 24 14:04:21.378958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45714) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:21.450861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2dc5e7f-250d-4e2d-9d76-a7bef32d7740 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:21.452626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2dc5e7f-250d-4e2d-9d76-a7bef32d7740 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:21.454135 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a2dc5e7f-250d-4e2d-9d76-a7bef32d7740 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.0742605 Nov 24 14:04:21.457438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45718) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:21.531898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 2af9d605-7630-4ff0-9b75-42a380cebe3e {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:21.536044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.591646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.694487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.773506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.777351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3d59514-74e0-40df-9f2f-577d9c84b09b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:21.812201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=2af9d605-7630-4ff0-9b75-42a380cebe3e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:21.815138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:21.821885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:21.832563 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/2af9d605-7630-4ff0-9b75-42a380cebe3e HTTP/1.1" status: 204 len: 168 time: 0.3740766 Nov 24 14:04:21.835357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45722) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:21.904076 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-34608a49-f23a-406c-abfd-8fb11decb291 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0674493 Nov 24 14:04:21.906546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45726) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:21.912753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:22.029192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:22.033435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:22.037044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:22.043115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:22.053636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:22.057324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.123636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7c3edde-07fa-42fc-973d-7b6583552d7b None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:22.307996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-17e3fd92-48b8-4b4c-b49c-5d1db70256d9 None None] Provisioning for port 9dd931e9-35cf-4371-8de8-fe32bc018f5f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:22.403939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:22.408431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Deleting port 9dd931e9-35cf-4371-8de8-fe32bc018f5f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:22.408815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.557538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:22.637255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] For port 9dd931e9-35cf-4371-8de8-fe32bc018f5f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9dd931e9-35cf-4371-8de8-fe32bc018f5f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:22.637567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.715274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.785262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Calling delete_port for 9dd931e9-35cf-4371-8de8-fe32bc018f5f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:22.942885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 9dd931e9-35cf-4371-8de8-fe32bc018f5f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9dd931e9-35cf-4371-8de8-fe32bc018f5f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:22.968932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.974501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.975266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:22.980083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d9f7032-7e00-4cb1-81fb-81be61fd469c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:22.980762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:22.981219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:23.041490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:23.048973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:23.054318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:23.054892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.073788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=9dd931e9-35cf-4371-8de8-fe32bc018f5f,revision_number=5']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:23.079691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:23.082915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a603aebf-f125-42d7-84c3-d5d7ce8fbd8f tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.069s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:23.121046 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.2134192 Nov 24 14:04:23.123611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45730) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:23.130861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:56:f1:80', 'name': 'tempest-NetworksTestDHCPv6-1949879734'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:23.220191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=d73fc6ba-d83b-420f-a93b-770c85bec555,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:23.224978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:23.281660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:23.287925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:23.290848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:23.296571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:23.307738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:23.311542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.344848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 0d731738-5081-4546-9eb5-d5e9a46052fb yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:23.482723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Deleting port 9dd931e9-35cf-4371-8de8-fe32bc018f5f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:23.483319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.488505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe56:f180 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/d73fc6ba-d83b-420f-a93b-770c85bec555/0d731738-5081-4546-9eb5-d5e9a46052fb) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:23.697345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.714579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 0d731738-5081-4546-9eb5-d5e9a46052fb will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:23.718701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] For port 9dd931e9-35cf-4371-8de8-fe32bc018f5f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9dd931e9-35cf-4371-8de8-fe32bc018f5f,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:23.719100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.744182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.751786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c6838044-f075-43fc-be83-42aba62e74b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:23.820448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:23.828166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:23.833841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:23.837790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:23.838513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:23.842839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Calling delete_port for 9dd931e9-35cf-4371-8de8-fe32bc018f5f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:23.846209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=0d731738-5081-4546-9eb5-d5e9a46052fb,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:23.854915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:23.869671 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 0.7448883 Nov 24 14:04:23.872292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45734) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:23.957874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b537a495-641f-4b96-8199-44eba11e8b04 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:23.962028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b537a495-641f-4b96-8199-44eba11e8b04 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:23.962827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b537a495-641f-4b96-8199-44eba11e8b04 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:23.980132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b537a495-641f-4b96-8199-44eba11e8b04 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:23.981556 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b537a495-641f-4b96-8199-44eba11e8b04 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1081645 Nov 24 14:04:23.985319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45738) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:24.026876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.030269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e926a4bb-07d3-4af0-a18b-931e9b39af95 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:24.054793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 0d731738-5081-4546-9eb5-d5e9a46052fb {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:24.055219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.069694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Pushing event deleted for resources: {'Port': ['ID=9dd931e9-35cf-4371-8de8-fe32bc018f5f,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:24.073082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:24.144346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] No DVR routers for this DVR port 9dd931e9-35cf-4371-8de8-fe32bc018f5f on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:24.159706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14724908-3f8d-487d-bdad-e49f85ec0917 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:24.323716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.413399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'd73fc6ba-d83b-420f-a93b-770c85bec555'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:24.414279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.564238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 0d731738-5081-4546-9eb5-d5e9a46052fb owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:24.577087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Allocated IP 2001:db8::f816:3eff:fe0f:1888 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/d73fc6ba-d83b-420f-a93b-770c85bec555/80dd1800-d6cc-4636-9485-32e3192d787d) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:24.718557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.726048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:24.776225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=0d731738-5081-4546-9eb5-d5e9a46052fb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:24.778658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:24.798841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.809014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Transition to ACTIVE for port object 80dd1800-d6cc-4636-9485-32e3192d787d will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:24.820853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.829587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Transition to ACTIVE for port object 80dd1800-d6cc-4636-9485-32e3192d787d will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:24.835138 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/0d731738-5081-4546-9eb5-d5e9a46052fb HTTP/1.1" status: 204 len: 168 time: 0.8486569 Nov 24 14:04:24.836166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:24.837534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45742) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:24.840733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:24.905466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5162346c-8aac-4acb-916b-69d42bcca10c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:24.906805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5162346c-8aac-4acb-916b-69d42bcca10c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:24.907543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5162346c-8aac-4acb-916b-69d42bcca10c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:24.909611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:24.910648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Pushing event updated for resources: {'Port': ['ID=80dd1800-d6cc-4636-9485-32e3192d787d,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:24.913266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:24.915088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:24.915672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:24.925080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5162346c-8aac-4acb-916b-69d42bcca10c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:24.928279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5162346c-8aac-4acb-916b-69d42bcca10c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.0897038 Nov 24 14:04:24.929247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45746) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:25.014126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Attempting to bind port 80dd1800-d6cc-4636-9485-32e3192d787d on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:25.015355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Attempting to bind port 80dd1800-d6cc-4636-9485-32e3192d787d by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:25.015355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Attempting to bind port 80dd1800-d6cc-4636-9485-32e3192d787d on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:25.022740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:25.023133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:25.023537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.023958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:25.024419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Bound port: 80dd1800-d6cc-4636-9485-32e3192d787d, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:25.024795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.123881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] For port 80dd1800-d6cc-4636-9485-32e3192d787d, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:25.127836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] For port 80dd1800-d6cc-4636-9485-32e3192d787d, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=80dd1800-d6cc-4636-9485-32e3192d787d,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:25.133568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.137444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-097b470f-f8ce-4883-9a21-7c2b03ca1714 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:25.220015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Pushing event updated for resources: {'Port': ['ID=80dd1800-d6cc-4636-9485-32e3192d787d,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:25.220143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet d73fc6ba-d83b-420f-a93b-770c85bec555 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:25.223405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:25.226535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.289189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.399468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.485372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.490013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4304335-6efd-4889-ba10-e68421df8491 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:25.529345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=d73fc6ba-d83b-420f-a93b-770c85bec555,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:25.532919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:25.540716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:25.555386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/d73fc6ba-d83b-420f-a93b-770c85bec555 HTTP/1.1" status: 204 len: 168 time: 0.6248143 Nov 24 14:04:25.558043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45750) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:25.623614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e1e53a02-6234-421c-a260-483041f97fc3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0643721 Nov 24 14:04:25.625913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45754) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:25.705159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aae5fd06-7d33-43c2-abb9-cae96f333275 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:25.705709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-aae5fd06-7d33-43c2-abb9-cae96f333275 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:25.723596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-aae5fd06-7d33-43c2-abb9-cae96f333275 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:25.724769 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-aae5fd06-7d33-43c2-abb9-cae96f333275 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0979316 Nov 24 14:04:25.727552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45758) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:25.794918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5678283a-250f-48a0-98d9-afb45d4028ec tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:25.795586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5678283a-250f-48a0-98d9-afb45d4028ec tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:25.813585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5678283a-250f-48a0-98d9-afb45d4028ec tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:25.814723 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5678283a-250f-48a0-98d9-afb45d4028ec tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0851285 Nov 24 14:04:25.817699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45762) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:25.887243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f52e115-3b5e-4c5c-b398-f380e294430e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0683427 Nov 24 14:04:25.891093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45766) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:25.898584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:26.019679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:26.029749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:26.041924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:26.149803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:26.263910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-031e9d79-47f8-49c5-8426-c003635a58af None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:26.420891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:26.421951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-09fb35c2-3de7-450e-b763-020104e607ed None None] Provisioning for port 80dd1800-d6cc-4636-9485-32e3192d787d completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:26.427599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f1fa2843-0345-4cb1-9ebd-b7587ade0d8a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:26.439785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-09fb35c2-3de7-450e-b763-020104e607ed None None] Could not find standard attr ID for object 0d731738-5081-4546-9eb5-d5e9a46052fb. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:26.498971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:26.502411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:26.506754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:26.507343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:26.515035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=7325dca3-b00b-4c05-9028-efb649c79f97,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:26.518665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:26.554774 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6625586 Nov 24 14:04:26.555079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45772) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:26.562599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:08:d8:ad', 'name': 'tempest-NetworksTestDHCPv6-1848958229'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:26.612137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 80dd1800-d6cc-4636-9485-32e3192d787d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:26.696777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 80dd1800-d6cc-4636-9485-32e3192d787d completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:26.709211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 80dd1800-d6cc-4636-9485-32e3192d787d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:26.709597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:26.773129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b4afdf4-18de-4dd1-a999-37c661a2330a None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:26.774405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:26.785030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:26.795952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:26.800546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:26.831446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port eaf32161-9d13-4b3a-9a66-e2f26406762d yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:26.992020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::1cf (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/7325dca3-b00b-4c05-9028-efb649c79f97/eaf32161-9d13-4b3a-9a66-e2f26406762d) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:27.011563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c0a9650c-3928-47b0-90e4-a3835b47f3b9 None None] Provisioning complete for port 80dd1800-d6cc-4636-9485-32e3192d787d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:27.011873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0a9650c-3928-47b0-90e4-a3835b47f3b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.068892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.180691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 80dd1800-d6cc-4636-9485-32e3192d787d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=80dd1800-d6cc-4636-9485-32e3192d787d,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:27.188156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.190188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e1e67701-12fe-4cc0-bbf6-50ab01cd0f0a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:27.209431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.231134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object eaf32161-9d13-4b3a-9a66-e2f26406762d will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:27.262853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.269974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:27.327379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=80dd1800-d6cc-4636-9485-32e3192d787d,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:27.330449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:27.359212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:27.360933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=eaf32161-9d13-4b3a-9a66-e2f26406762d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:27.362939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:27.365765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:27.366560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:27.370887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:27.371684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.407052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 0.8500957 Nov 24 14:04:27.411123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45776) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:27.501111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-205b3774-3126-46ad-9e83-6bbc166b35e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:27.505770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-205b3774-3126-46ad-9e83-6bbc166b35e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:27.506562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-205b3774-3126-46ad-9e83-6bbc166b35e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:27.524889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-205b3774-3126-46ad-9e83-6bbc166b35e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:27.527545 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-205b3774-3126-46ad-9e83-6bbc166b35e8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1592 time: 0.1148219 Nov 24 14:04:27.530406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45780) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:27.549071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-147fef25-985f-48bb-90dd-7bce12054708 None None] Provisioning complete for port 80dd1800-d6cc-4636-9485-32e3192d787d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:27.549448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-147fef25-985f-48bb-90dd-7bce12054708 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.606271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port eaf32161-9d13-4b3a-9a66-e2f26406762d {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:27.606857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:27.791233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7fbed89b-7d07-4160-ab73-ea1f61e079ec None None] Could not find standard attr ID for object 1e59ba05-1a2f-4262-b7f3-3142c037185c. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:27.879477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.010061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-77a2b13f-4996-4741-91b3-b213a005ce4d None None] Could not find standard attr ID for object 0d731738-5081-4546-9eb5-d5e9a46052fb. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:28.112872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for eaf32161-9d13-4b3a-9a66-e2f26406762d owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:28.269217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.275144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5c1c5ebd-53e2-4dfd-a421-6f96c7081b0a None None] Provisioning for port eaf32161-9d13-4b3a-9a66-e2f26406762d completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:28.279144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1fc965d-5014-4bc5-9b12-2def8f2e07eb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:28.281326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5c1c5ebd-53e2-4dfd-a421-6f96c7081b0a None None] Provisioning complete for port eaf32161-9d13-4b3a-9a66-e2f26406762d triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:28.281706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5c1c5ebd-53e2-4dfd-a421-6f96c7081b0a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.318298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5c1c5ebd-53e2-4dfd-a421-6f96c7081b0a None None] Port eaf32161-9d13-4b3a-9a66-e2f26406762d was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 14:04:28.329917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=eaf32161-9d13-4b3a-9a66-e2f26406762d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:28.334483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:28.380875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.396056 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/eaf32161-9d13-4b3a-9a66-e2f26406762d HTTP/1.1" status: 204 len: 168 time: 0.8626828 Nov 24 14:04:28.397610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45784) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:28.466216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f29e67d-36b6-45d0-94d9-c80bde711a36 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:28.467708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f29e67d-36b6-45d0-94d9-c80bde711a36 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:28.472488 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2f29e67d-36b6-45d0-94d9-c80bde711a36 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.0738020 Nov 24 14:04:28.472672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45788) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:28.544759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 80dd1800-d6cc-4636-9485-32e3192d787d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:28.552016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 7325dca3-b00b-4c05-9028-efb649c79f97 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:28.555733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.616014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.623628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 80dd1800-d6cc-4636-9485-32e3192d787d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:28.624130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.686773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.780145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.784230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7013fa0a-13f9-46aa-a132-ef19bf2bcf90 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:28.820160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=7325dca3-b00b-4c05-9028-efb649c79f97,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:28.823695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:28.827072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:28.835593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a31837e7-3067-439e-b2d2-bb35e1f3263c None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:28.837698 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/7325dca3-b00b-4c05-9028-efb649c79f97 HTTP/1.1" status: 204 len: 168 time: 0.3640072 Nov 24 14:04:28.840632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45792) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:28.911537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-365f9aa9-c82b-4569-a1b0-85124d37625d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0696084 Nov 24 14:04:28.913856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45796) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:28.993040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48f52c80-49c0-445a-899a-5287de7280a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:28.994556 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48f52c80-49c0-445a-899a-5287de7280a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0797195 Nov 24 14:04:28.997083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45800) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:29.070026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b4843651-7f6b-4c8d-b99b-9b39463b4506 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:29.070755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b4843651-7f6b-4c8d-b99b-9b39463b4506 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:29.092441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b4843651-7f6b-4c8d-b99b-9b39463b4506 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:29.093632 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b4843651-7f6b-4c8d-b99b-9b39463b4506 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0956573 Nov 24 14:04:29.096301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45804) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:29.104186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:29.108741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Deleting port 80dd1800-d6cc-4636-9485-32e3192d787d {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:29.109124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:29.172922 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09b08538-0006-461d-a053-3c5970281b3f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0748434 Nov 24 14:04:29.177445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45808) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:29.183067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:29.291669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:29.302149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:29.312850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:29.317437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:29.320336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] For port 80dd1800-d6cc-4636-9485-32e3192d787d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=80dd1800-d6cc-4636-9485-32e3192d787d,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:29.320685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:29.459324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Calling delete_port for 80dd1800-d6cc-4636-9485-32e3192d787d owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:29.605448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:29.610211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2ce84fc1-4c2e-4f17-9326-cbf48a094b98 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:29.652967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Pushing event deleted for resources: {'Port': ['ID=80dd1800-d6cc-4636-9485-32e3192d787d,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:29.658175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:29.663610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] No DVR routers for this DVR port 80dd1800-d6cc-4636-9485-32e3192d787d on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:29.767401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:29.769360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:29.773233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd76d993-d4fc-447e-bde9-d174b13aecff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:29.836781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:29.840620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:29.843465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:29.844113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:29.850574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5411233-dd76-43b7-90ee-8369f005a408 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:29.860119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=a4025d13-8d2d-4476-be2c-fe2317bbe26b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:29.862959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:29.879702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.7011886 Nov 24 14:04:29.883091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45812) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:29.888747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:30.028931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:30.032881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:30.035869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:30.041616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:30.051646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:30.055328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.068834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'tenant_id': '303f30b20dd547718e1105de03480ea7', 'fixed_ips': [{'subnet_id': 'a4025d13-8d2d-4476-be2c-fe2317bbe26b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:30.069714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.192573 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet a4025d13-8d2d-4476-be2c-fe2317bbe26b (CIDR: 2001:db8::/64) Nov 24 14:04:30.196281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:30.196803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:30.215835 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd3ffae0-23dc-452f-88d3-d462b0c9d006 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3316550 Nov 24 14:04:30.218589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45816) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:30.224540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:30.228888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Allocated IP 2001:db8::f816:3eff:fe99:cbf1 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/a4025d13-8d2d-4476-be2c-fe2317bbe26b/2ba87734-db03-47d6-9be4-3098fcecabbf) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:30.364658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:30.368860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:30.372015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:30.378298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:30.388509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:30.434985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.445100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Transition to ACTIVE for port object 2ba87734-db03-47d6-9be4-3098fcecabbf will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:30.466659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Transition to ACTIVE for port object 2ba87734-db03-47d6-9be4-3098fcecabbf will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:30.473760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.478536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-640af773-b2d5-409f-95bf-ee5f5a0ed551 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:30.514504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.540527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 80dd1800-d6cc-4636-9485-32e3192d787d no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:30.564520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:30.578067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:30.580533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:30.590688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 80dd1800-d6cc-4636-9485-32e3192d787d {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:04:30.591044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 80dd1800-d6cc-4636-9485-32e3192d787d not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:04:30.599206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:30.602722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:30.688723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Attempting to bind port 2ba87734-db03-47d6-9be4-3098fcecabbf on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:30.689420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Attempting to bind port 2ba87734-db03-47d6-9be4-3098fcecabbf by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:30.689570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Attempting to bind port 2ba87734-db03-47d6-9be4-3098fcecabbf on network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:30.696282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:30.696583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Checking segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:30.696987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.697382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Bound using segment: {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:30.697851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Bound port: 2ba87734-db03-47d6-9be4-3098fcecabbf, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 858, 'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:30.698221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.783810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.789052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:30.800631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:30.805066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:30.809443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.814828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e2b94f25-3139-4a1f-a65f-fd830f81c2e7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:30.853244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:30.856758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:30.861597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:30.862804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:30.874357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=3ff66e62-b9e2-4d51-a987-a6f20437a84f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:30.878684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:30.893958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6714838 Nov 24 14:04:30.894196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45820) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:30.900008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:3b:1c:a1', 'name': 'tempest-NetworksTestDHCPv6-1885108345'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:30.901266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:30.904380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:31.064918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:31.070335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:port and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:31.073236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for port was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:31.078906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:31.089586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:31.093974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:31.126492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 97aa987e-d161-402f-8092-283ce8e00406 yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:31.343843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8:0:1::244 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/3ff66e62-b9e2-4d51-a987-a6f20437a84f/97aa987e-d161-402f-8092-283ce8e00406) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:31.350403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fe3b:1ca1 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/a4025d13-8d2d-4476-be2c-fe2317bbe26b/97aa987e-d161-402f-8092-283ce8e00406) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:31.565940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:31.582452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 97aa987e-d161-402f-8092-283ce8e00406 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:31.609461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:31.616603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cbbd736d-7afc-4d8e-9f7b-abce901745da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:31.797761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:31.801447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:31.805723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:31.809693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:31.810273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:31.812558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86d0c15a-3cbf-485d-81cf-771502bff12e None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:31.814051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=97aa987e-d161-402f-8092-283ce8e00406,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:31.818037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:31.839028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 0.9437587 Nov 24 14:04:31.841643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45824) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:31.914784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 97aa987e-d161-402f-8092-283ce8e00406 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:31.915155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:31.926181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3ed4ff8d-83ec-4370-9cf7-a8b60e9a100f None None] Provisioning for port 2ba87734-db03-47d6-9be4-3098fcecabbf completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:32.145680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': 'a4025d13-8d2d-4476-be2c-fe2317bbe26b', 'ip_address': '2001:db8::f816:3eff:fe99:cbf1'}, {'subnet_id': '3ff66e62-b9e2-4d51-a987-a6f20437a84f'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:32.153004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.197864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.277122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 97aa987e-d161-402f-8092-283ce8e00406 owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:32.405846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Allocated IP 2001:db8:0:1::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/3ff66e62-b9e2-4d51-a987-a6f20437a84f/2ba87734-db03-47d6-9be4-3098fcecabbf) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:32.489045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.498534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-874432d5-6242-4e35-9ceb-1ab1319c6bda tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:32.545587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=97aa987e-d161-402f-8092-283ce8e00406,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:32.549793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:32.577035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:32.625924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.636002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/97aa987e-d161-402f-8092-283ce8e00406 HTTP/1.1" status: 204 len: 168 time: 0.7933609 Nov 24 14:04:32.638372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45828) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:32.647053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:32.681750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.698029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 2ba87734-db03-47d6-9be4-3098fcecabbf completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:32.703627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Transition to ACTIVE for port object 2ba87734-db03-47d6-9be4-3098fcecabbf will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:32.704332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:32.704810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.717606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17962af9-f87b-4f73-8bf3-7fe49d76972d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:32.718326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-17962af9-f87b-4f73-8bf3-7fe49d76972d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:32.733468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:32.734774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-17962af9-f87b-4f73-8bf3-7fe49d76972d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:32.735974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-17962af9-f87b-4f73-8bf3-7fe49d76972d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 961 time: 0.0966794 Nov 24 14:04:32.739192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45832) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:32.742378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:32.816586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23dcd6f7-e5b2-4cde-ac9d-d929c77d8169 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:32.818073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-23dcd6f7-e5b2-4cde-ac9d-d929c77d8169 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1045 time: 0.0779076 Nov 24 14:04:32.820619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45836) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:32.890646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9fc472e-c695-40e2-b686-a066f99d9b25 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:32.892104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9fc472e-c695-40e2-b686-a066f99d9b25 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:32.894171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9fc472e-c695-40e2-b686-a066f99d9b25 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:32.895409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d9fc472e-c695-40e2-b686-a066f99d9b25 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:32.897081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Port 2ba87734-db03-47d6-9be4-3098fcecabbf had new provisioning blocks added so it will not transition to active. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:321}} Nov 24 14:04:32.899684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:32.903100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:32.912677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d9fc472e-c695-40e2-b686-a066f99d9b25 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:32.913856 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d9fc472e-c695-40e2-b686-a066f99d9b25 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0923555 Nov 24 14:04:32.916684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45840) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:32.984398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 3ff66e62-b9e2-4d51-a987-a6f20437a84f {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:32.987950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.048208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.137078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.153582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f05177b8-ac4e-460d-9f11-ba6b3a65f259 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.217366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.226641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-df3fc894-5df4-4e4e-8331-1e176862cd50 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:33.267523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=3ff66e62-b9e2-4d51-a987-a6f20437a84f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:33.270322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.274356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:33.288971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/3ff66e62-b9e2-4d51-a987-a6f20437a84f HTTP/1.1" status: 204 len: 168 time: 0.3687739 Nov 24 14:04:33.289294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45844) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:33.405299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eb32150-420f-407c-b31d-4d206637e719 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:33.490066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet a4025d13-8d2d-4476-be2c-fe2317bbe26b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:33.492956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.512701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Provisioning for port 2ba87734-db03-47d6-9be4-3098fcecabbf completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:33.538339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:33.538690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.551880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.620665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.632553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.710337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.714279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5a8fb162-2d8e-40cc-8a93-604f7d150946 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:33.751181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=a4025d13-8d2d-4476-be2c-fe2317bbe26b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:33.754154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:33.756355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.760423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.770588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/a4025d13-8d2d-4476-be2c-fe2317bbe26b HTTP/1.1" status: 204 len: 168 time: 0.4801052 Nov 24 14:04:33.772954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45848) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:33.801970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:33.806993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.809445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:33.846496 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-72704cd4-d9ac-493e-8af4-fcf0ed8cf4d1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0723395 Nov 24 14:04:33.849418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45852) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:33.856010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:33.886733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Could not find standard attr ID for object 97aa987e-d161-402f-8092-283ce8e00406. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:33.937971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:33.943746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:33.944791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cfba0fe-2fe3-4dbd-91e9-90c4153cf358 None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': 'a4025d13-8d2d-4476-be2c-fe2317bbe26b'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:33.969298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:33.973730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:33.976587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:33.982132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:33.992044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:33.995681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:33.997814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1cfba0fe-2fe3-4dbd-91e9-90c4153cf358 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.186812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60f54054-1ece-4b10-996b-cc1189810477 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:34.296328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2e1b2f12-c779-46d3-86d7-426cd4ec28b3 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:34.296709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2e1b2f12-c779-46d3-86d7-426cd4ec28b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.448103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.objects.ports [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=83526) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:34.557382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:34.607274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.640925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '63660e84-ac27-49c8-9bcb-b2e5fcc7edcb'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:34.778537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.789304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.822110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:34.847481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.852989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.853763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.858174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8e97d17e-412c-4cb9-ab9b-7b264bae77ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:34.931710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:34.935109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:34.938111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:34.938683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:34.957796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:34.958463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:34.959604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=8']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:34.963170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:34.966555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a288b619-4596-4928-9daa-b49a0f568ef3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.075s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:35.007268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.1566553 Nov 24 14:04:35.010098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45856) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:35.017354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:35.041712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:35.041986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:35.109243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=63660e84-ac27-49c8-9bcb-b2e5fcc7edcb,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:35.112014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:35.170182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:35.174098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:35.177970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:35.183469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:35.192993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:35.196489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.329230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.ipam_backend_mixin [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 63660e84-ac27-49c8-9bcb-b2e5fcc7edcb (CIDR: 2001:db8::/64) Nov 24 14:04:35.332800 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:35.333254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:35.352145 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1a09037-09ce-4a34-82a8-66fc09505f1f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3410466 Nov 24 14:04:35.355258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45860) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:35.360810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:35.499162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:35.503865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:35.506792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:35.510897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.512440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:35.522714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:35.543285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:35.575352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.583065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:35.647847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.651949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.715099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:35.726488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:35.747502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b2e85578-866f-40c9-b224-5fa130608d41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.936827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:35.941492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7ae50f2c-bf7e-4599-8cf1-10e95342805d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:35.997651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:36.000775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:36.005564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:36.006171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.020006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=1c2d10fc-8b37-4d39-bbab-0716508d9702,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:36.022824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:36.024169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:36.036254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6799266 Nov 24 14:04:36.038951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45870) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:36.044394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:a5:ac:65', 'name': 'tempest-NetworksTestDHCPv6-291844612'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:36.050518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.056766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.059888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:36.144887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=10']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:36.160124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:36.312845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:36.323084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:36.334112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:36.338259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.371983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 3e591235-6bee-492c-b8ec-a429c17ad9da yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:36.574994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:36.607228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8:0:1::71 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/1c2d10fc-8b37-4d39-bbab-0716508d9702/3e591235-6bee-492c-b8ec-a429c17ad9da) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:36.615248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::f816:3eff:fea5:ac65 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/63660e84-ac27-49c8-9bcb-b2e5fcc7edcb/3e591235-6bee-492c-b8ec-a429c17ad9da) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:36.651602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:36.652014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.700368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f40d4e36-dfc3-460e-a1eb-9afbcaff017c None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:36.743953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.825065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.840983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 3e591235-6bee-492c-b8ec-a429c17ad9da will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:36.845106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8ffa081d-aa8e-41bb-ac05-01f546370e71 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:36.845490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ffa081d-aa8e-41bb-ac05-01f546370e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.864508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.871414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad966b7c-d211-4465-8399-a0e162fc5e5d tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:36.930899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:36.938259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:36.940951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:36.945337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:36.945933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:36.964675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=3e591235-6bee-492c-b8ec-a429c17ad9da,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:36.967653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:36.983338 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 0.9433422 Nov 24 14:04:36.985919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45874) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:37.003722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.054271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 3e591235-6bee-492c-b8ec-a429c17ad9da {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:37.054614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.127142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:37.141244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.146325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:37.178219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ffa081d-aa8e-41bb-ac05-01f546370e71 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.312834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.355737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=11']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:37.371920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:37.381042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8ffa081d-aa8e-41bb-ac05-01f546370e71 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:37.381396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8ffa081d-aa8e-41bb-ac05-01f546370e71 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:37.403582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '63660e84-ac27-49c8-9bcb-b2e5fcc7edcb', 'ip_address': '2001:db8::f816:3eff:fe99:cbf1'}, {'subnet_id': '1c2d10fc-8b37-4d39-bbab-0716508d9702'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:37.437122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 3e591235-6bee-492c-b8ec-a429c17ad9da owned by {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:37.457099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.640362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.645777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e388ffb7-4afa-445b-a1d3-2c12d287ede8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:37.661365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Allocated IP 2001:db8:0:1::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/1c2d10fc-8b37-4d39-bbab-0716508d9702/2ba87734-db03-47d6-9be4-3098fcecabbf) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:37.687133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=3e591235-6bee-492c-b8ec-a429c17ad9da,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:37.690948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:37.765988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.776078 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/3e591235-6bee-492c-b8ec-a429c17ad9da HTTP/1.1" status: 204 len: 168 time: 0.7891641 Nov 24 14:04:37.778390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45878) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:37.799076 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:04:37.801466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:37.826455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.844892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Transition to ACTIVE for port object 2ba87734-db03-47d6-9be4-3098fcecabbf will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:37.849643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:37.853336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9c649e7d-f467-415a-9abb-3da4f4658ecd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:37.854557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03887a76-dde6-460e-9511-0d33795bd2a9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:37.855250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-03887a76-dde6-460e-9511-0d33795bd2a9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:37.870030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-03887a76-dde6-460e-9511-0d33795bd2a9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:37.873557 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-03887a76-dde6-460e-9511-0d33795bd2a9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 964 time: 0.0918531 Nov 24 14:04:37.873746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45882) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:37.958041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d94aefd8-afcd-4cdb-8f70-248004f54cb0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:37.959444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d94aefd8-afcd-4cdb-8f70-248004f54cb0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1048 time: 0.0847855 Nov 24 14:04:37.962195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45886) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:38.029660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=12']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:38.029888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dccddde0-ca41-40af-ae2b-9b730fff3f5c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:38.030778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dccddde0-ca41-40af-ae2b-9b730fff3f5c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:38.032239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dccddde0-ca41-40af-ae2b-9b730fff3f5c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:38.033049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-dccddde0-ca41-40af-ae2b-9b730fff3f5c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:38.037121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:38.051860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-dccddde0-ca41-40af-ae2b-9b730fff3f5c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:38.055635 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dccddde0-ca41-40af-ae2b-9b730fff3f5c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0898974 Nov 24 14:04:38.056019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45890) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:38.233645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 1c2d10fc-8b37-4d39-bbab-0716508d9702 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:38.237547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.295841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.365375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.387940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.467677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.473464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c561f014-9437-4b91-9414-6a7cdd9a6ce6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:38.509166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=1c2d10fc-8b37-4d39-bbab-0716508d9702,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:38.511552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:38.519346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.536671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45896) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:38.537223 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/1c2d10fc-8b37-4d39-bbab-0716508d9702 HTTP/1.1" status: 204 len: 168 time: 0.4792271 Nov 24 14:04:38.545697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:38.573933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2368259b-8e3e-466b-8353-c39b9ff2ebfb None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:38.713242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b413b357-fd63-42b2-bed4-9791c507cf62 None None] Provisioning for port 2ba87734-db03-47d6-9be4-3098fcecabbf completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:38.732413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 63660e84-ac27-49c8-9bcb-b2e5fcc7edcb {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:38.732638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b413b357-fd63-42b2-bed4-9791c507cf62 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:38.732919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b413b357-fd63-42b2-bed4-9791c507cf62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.735171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.793104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.822327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:38.822713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.874007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.946554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:38.950270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8c0cb736-11ff-4ebd-aeec-2c199f3497fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:39.044064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b413b357-fd63-42b2-bed4-9791c507cf62 None None] Could not find standard attr ID for object 3e591235-6bee-492c-b8ec-a429c17ad9da. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:39.095849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=63660e84-ac27-49c8-9bcb-b2e5fcc7edcb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:39.100880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:39.101853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.114569 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/63660e84-ac27-49c8-9bcb-b2e5fcc7edcb HTTP/1.1" status: 204 len: 168 time: 0.5740521 Nov 24 14:04:39.114761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45900) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:39.156155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccd1f33e-b350-45cb-b73a-7b2c5b38776a None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '63660e84-ac27-49c8-9bcb-b2e5fcc7edcb'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:39.179966 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-23d5412c-6b93-4162-a397-028a8af44794 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0640295 Nov 24 14:04:39.182843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45904) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:39.188282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:39.214401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ccd1f33e-b350-45cb-b73a-7b2c5b38776a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.300386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:39.304571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:39.307391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:39.313142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:39.324816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:39.328290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.414537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3ef0ed4-d6d1-4228-ad36-b15e4a7fe86a None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:39.558573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.562362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a8d0c63-b0f3-4c40-944c-c901d3d5ebf4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:39.604071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a6a0a993-0301-4868-afe2-90630aa6420e None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:39.604449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a6a0a993-0301-4868-afe2-90630aa6420e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.621451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:39.624446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:39.628766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:39.629281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.640274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=7c6c2c59-1a99-4b28-8b79-684df396e032,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:39.644583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:39.657015 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.4732029 Nov 24 14:04:39.660279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45908) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:39.665786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:39.805904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:39.810022 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:39.812836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:39.820144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:39.830133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:39.834407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.857813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '7c6c2c59-1a99-4b28-8b79-684df396e032'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:39.909815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:39.969859 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.ipam_backend_mixin [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 7c6c2c59-1a99-4b28-8b79-684df396e032 (CIDR: 2001:db8::/64) Nov 24 14:04:39.974554 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:39.975072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:39.993118 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec2a6a04-af9b-4ce6-9fa4-dfd95b14487b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3318002 Nov 24 14:04:39.995771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45912) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:40.001400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:40.110191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/7c6c2c59-1a99-4b28-8b79-684df396e032/2ba87734-db03-47d6-9be4-3098fcecabbf) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:40.144998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:40.149548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:40.154072 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:40.161614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:40.174644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:40.178107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:40.275937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:40.302753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:40.321585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Transition to ACTIVE for port object 2ba87734-db03-47d6-9be4-3098fcecabbf will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:40.325143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:40.328566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:40.432643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=15']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:40.435509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:40.565418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:40.599898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:40.692888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:40.773920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:40.774340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:04:40.774713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:04:41.041403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcae6503-2302-487a-823f-6d9a5002bd97 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:41.112825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:41.137598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.142499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.143514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.147955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d44118e-ff58-48cc-9c35-62f3f357cfe0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:41.155390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-01f701d1-48ce-4979-90e4-ea3ae558f2c0 None None] Provisioning for port 2ba87734-db03-47d6-9be4-3098fcecabbf completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:41.171682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-01f701d1-48ce-4979-90e4-ea3ae558f2c0 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:41.172149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01f701d1-48ce-4979-90e4-ea3ae558f2c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.221675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:41.224258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:41.227152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:41.227733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.243432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=17']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:41.246995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:41.248295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8272f402-bd4a-49e0-9b7f-5b192aee0f1c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.072s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:41.297504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.3005066 Nov 24 14:04:41.301264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45916) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:41.312063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:ba:3b:b2', 'name': 'tempest-NetworksTestDHCPv6-2051876368'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:41.384961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.388610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=ee33eccb-258c-4f8b-84ff-f1bc965a4155,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:41.390992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:41.461418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:41.470964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:41.482985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:41.484977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:41.488144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.489777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:41.490723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:41.524545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 9b5cb6a5-3f04-46d2-a43d-919482eead6a yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:41.574789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=18']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:41.579023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:41.757483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::3d0 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/7c6c2c59-1a99-4b28-8b79-684df396e032/9b5cb6a5-3f04-46d2-a43d-919482eead6a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:41.763821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8:0:1:f816:3eff:feba:3bb2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/ee33eccb-258c-4f8b-84ff-f1bc965a4155/9b5cb6a5-3f04-46d2-a43d-919482eead6a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:41.984402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.001495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 9b5cb6a5-3f04-46d2-a43d-919482eead6a will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:42.026246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.033174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37a787fd-8ea5-4d97-9587-8998df35e07c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:42.048936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f670df0-a588-446d-8f8e-a7d90c1019c4 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:42.106654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:42.110226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:42.112799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:42.117223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:42.117845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.130998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=9b5cb6a5-3f04-46d2-a43d-919482eead6a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:42.133878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:42.151642 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 0.8494895 Nov 24 14:04:42.154201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45922) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:42.214638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:42.215012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.222600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 9b5cb6a5-3f04-46d2-a43d-919482eead6a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:42.222942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.414590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.460809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:42.467288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.469032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:42.488145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.556724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=19']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:42.559942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:42.591720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:42.627732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 9b5cb6a5-3f04-46d2-a43d-919482eead6a owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:42.664652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:42.665036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.805237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-049dea93-645d-414b-a184-0066f2b90ae2 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:42.805664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-049dea93-645d-414b-a184-0066f2b90ae2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.856896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:42.865098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e51e44a7-c971-4744-8493-3bb4be861171 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:42.910983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=9b5cb6a5-3f04-46d2-a43d-919482eead6a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:42.915275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:42.932192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-049dea93-645d-414b-a184-0066f2b90ae2 None None] Could not find standard attr ID for object 9b5cb6a5-3f04-46d2-a43d-919482eead6a. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:42.991712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:43.001709 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/9b5cb6a5-3f04-46d2-a43d-919482eead6a HTTP/1.1" status: 204 len: 168 time: 0.8464868 Nov 24 14:04:43.005024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45926) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:43.049097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ae40351e-1d90-467d-86dc-d77da2af148a None None] Could not find standard attr ID for object 97aa987e-d161-402f-8092-283ce8e00406. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:43.168585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5f09649c-1440-4942-a274-c5c7ba5f9a64 None None] Could not find standard attr ID for object 3e591235-6bee-492c-b8ec-a429c17ad9da. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:43.199950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77ea51f2-d130-4480-bdc9-4fffea40b0f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:43.200656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-77ea51f2-d130-4480-bdc9-4fffea40b0f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:43.216932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-77ea51f2-d130-4480-bdc9-4fffea40b0f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:43.220544 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-77ea51f2-d130-4480-bdc9-4fffea40b0f8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.2123921 Nov 24 14:04:43.220767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45930) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:43.303088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a27bb0b5-ce38-4817-b227-2c5cd57ab41b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:43.306795 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a27bb0b5-ce38-4817-b227-2c5cd57ab41b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0828931 Nov 24 14:04:43.307245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45934) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:43.382300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2098c138-af8b-4609-a6a1-c28845a4051a None None] Could not find standard attr ID for object 9b5cb6a5-3f04-46d2-a43d-919482eead6a. {{(pid=83527) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Nov 24 14:04:43.382698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81538c97-4585-4de5-a521-64c223e57eb5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:43.384204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81538c97-4585-4de5-a521-64c223e57eb5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:43.385714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81538c97-4585-4de5-a521-64c223e57eb5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:43.386523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-81538c97-4585-4de5-a521-64c223e57eb5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:43.402656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-81538c97-4585-4de5-a521-64c223e57eb5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:43.406319 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-81538c97-4585-4de5-a521-64c223e57eb5 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0953748 Nov 24 14:04:43.406588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45938) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:43.477422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 7c6c2c59-1a99-4b28-8b79-684df396e032 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:43.480534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:43.541538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:43.627364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:43.704687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:43.709298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-65541e0c-a7c8-4742-a09c-eada71e7739e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:43.751628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=7c6c2c59-1a99-4b28-8b79-684df396e032,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:43.754713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:43.757805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:43.775412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45942) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:43.776186 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/7c6c2c59-1a99-4b28-8b79-684df396e032 HTTP/1.1" status: 204 len: 168 time: 0.3678777 Nov 24 14:04:43.891158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14665c84-b54c-43ea-a2f2-9e17395e7b80 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:43.975904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet ee33eccb-258c-4f8b-84ff-f1bc965a4155 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:43.978884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.032895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.115243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.194766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.200701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-87243d41-4ffa-420c-9493-808af60df04c tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:44.240129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.243614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=ee33eccb-258c-4f8b-84ff-f1bc965a4155,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:44.246783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:44.255781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/ee33eccb-258c-4f8b-84ff-f1bc965a4155 HTTP/1.1" status: 204 len: 168 time: 0.4768953 Nov 24 14:04:44.256835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45946) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:44.331339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-81f82314-c551-49ec-b187-36a0ed28c95d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0729134 Nov 24 14:04:44.334718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45950) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:44.341151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:44.458056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:44.462121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:44.465248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:44.471876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:44.485724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:44.491140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.546528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:44.629792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:44.630060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.668452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48226f67-78e6-4e65-8c06-ca79b774387f None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:44.746110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.750494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5aa58d4-3f0d-4c8b-a64e-2b9656e88ddd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:44.814143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:44.817963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:44.820668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:44.821439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.834709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e3f616de-8746-456f-9f99-0cdf6d41e2bf None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:44.835096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e3f616de-8746-456f-9f99-0cdf6d41e2bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:44.837384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:44.840420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:44.854891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5189748 Nov 24 14:04:44.857658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45954) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:44.863793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:45.001747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:45.005949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:45.008830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:45.014394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:45.025069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:45.028661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:45.153121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Update dhcp port {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'fixed_ips': [{'subnet_id': '71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6'}], 'binding:host_id': 'dv-neutron-818151-2-hyperv'}, 'id': '2ba87734-db03-47d6-9be4-3098fcecabbf'} from dv-neutron-818151-2-hyperv. {{(pid=83527) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:307}} Nov 24 14:04:45.165894 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.ipam_backend_mixin [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6 (CIDR: 2001:db8::/64) Nov 24 14:04:45.169118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:04:45.169564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:45.191365 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-eb3db018-a363-4493-85f0-0ac125d39232 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3285856 Nov 24 14:04:45.191578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45958) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:45.196464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'subnet': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:45.208439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:45.342045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:45.346296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Usage tracker for resource:subnet and tenant:303f30b20dd547718e1105de03480ea7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:45.350984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:45.357202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:45.367635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:45.476895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Allocated IP 2001:db8::2 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6/2ba87734-db03-47d6-9be4-3098fcecabbf) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:45.500772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:45.636582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:45.664299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:45.684253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Transition to ACTIVE for port object 2ba87734-db03-47d6-9be4-3098fcecabbf will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:45.689778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:45.694704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c92824c5-5fcd-4bf9-a16d-aba4fa31715f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:45.815346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=22']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:45.819353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:45.999839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.objects.ports [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=83525) get_objects /opt/stack/neutron/neutron/objects/ports.py:422}} Nov 24 14:04:46.179830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.376724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03a2854c-3bb8-4e56-a765-ddbad6f47c02 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:46.448243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:46.468555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-784b702b-f80b-4828-aa29-95a1e56b71b5 None None] Provisioning for port 2ba87734-db03-47d6-9be4-3098fcecabbf completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:46.476192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.478313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-784b702b-f80b-4828-aa29-95a1e56b71b5 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:46.478687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-784b702b-f80b-4828-aa29-95a1e56b71b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.482372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.482372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.487088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:46.547391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:46.683861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:46.686737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=24']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:46.689567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:46.691213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:46.691723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b731c81c-db78-43be-a1a4-ac06038df118 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.174s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:46.718138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:46.718686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.757520 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 1.5656681 Nov 24 14:04:46.760526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45964) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:46.768814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Request body: {'port': {'network_id': '60454f28-a3b3-4176-9b9d-ec6e6f5c9527', 'mac_address': 'fa:16:3e:ab:a7:a9', 'name': 'tempest-NetworksTestDHCPv6-317604233'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:46.773827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:46.774203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.793572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Subnet': ['ID=7481fbe6-3265-4a13-ad19-b3e23e5f09d0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:46.798418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:46.915820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:46.926774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:46.937396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Made reservation on behalf of 303f30b20dd547718e1105de03480ea7 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:46.942294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:46.973546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] device_id is not set on port 9de4210d-312c-4833-97e3-041a40052bde yet. {{(pid=83525) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:04:47.196173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8::dc (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6/9de4210d-312c-4833-97e3-041a40052bde) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:47.202343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Allocated IP 2001:db8:0:1:f816:3eff:feab:a7a9 (60454f28-a3b3-4176-9b9d-ec6e6f5c9527/7481fbe6-3265-4a13-ad19-b3e23e5f09d0/9de4210d-312c-4833-97e3-041a40052bde) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:47.359743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9788413e-197e-457e-afb8-931addc04551 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:47.429734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.447340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Transition to ACTIVE for port object 9de4210d-312c-4833-97e3-041a40052bde will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:47.471128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.478262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6859a089-6f1d-432b-a7eb-572cf3b85412 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:47.483167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f26ef598-6176-4b47-8fb9-e633092f3067 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:47.483680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f26ef598-6176-4b47-8fb9-e633092f3067 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.546827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:47.550888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:47.555519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:47.559493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:47.560151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.564165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event updated for resources: {'Port': ['ID=9de4210d-312c-4833-97e3-041a40052bde,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:47.569371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:47.592338 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1031 time: 0.8287232 Nov 24 14:04:47.592673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45968) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:47.606080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.663117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting port 9de4210d-312c-4833-97e3-041a40052bde {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:47.663600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.913566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.931434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3430c7e5-1dbd-49a3-86e9-422aeb36feb9 None None] Provisioning for port 9de4210d-312c-4833-97e3-041a40052bde completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:47.937109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3430c7e5-1dbd-49a3-86e9-422aeb36feb9 None None] Provisioning complete for port 9de4210d-312c-4833-97e3-041a40052bde triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:47.937525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3430c7e5-1dbd-49a3-86e9-422aeb36feb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:47.995418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3430c7e5-1dbd-49a3-86e9-422aeb36feb9 None None] Port 9de4210d-312c-4833-97e3-041a40052bde cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:04:48.009126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3430c7e5-1dbd-49a3-86e9-422aeb36feb9 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:48.009446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3430c7e5-1dbd-49a3-86e9-422aeb36feb9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:48.046224 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Calling delete_port for 9de4210d-312c-4833-97e3-041a40052bde owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:48.254949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-87733e05-ff42-4f5a-a068-58dde5fe60c2 None None] Provisioning complete for port 9de4210d-312c-4833-97e3-041a40052bde triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:48.255314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87733e05-ff42-4f5a-a068-58dde5fe60c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:48.258081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:48.271002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:48.290056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-87733e05-ff42-4f5a-a068-58dde5fe60c2 None None] Port 9de4210d-312c-4833-97e3-041a40052bde was deleted so its status cannot be updated. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:304}} Nov 24 14:04:48.341172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Port': ['ID=9de4210d-312c-4833-97e3-041a40052bde,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:48.352813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:48.390251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:48.400815 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/9de4210d-312c-4833-97e3-041a40052bde HTTP/1.1" status: 204 len: 168 time: 0.8070567 Nov 24 14:04:48.403205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 45972) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:48.483239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c222e80e-b146-4486-8ecb-c5413f044a80 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:48.484018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c222e80e-b146-4486-8ecb-c5413f044a80 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:48.503635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c222e80e-b146-4486-8ecb-c5413f044a80 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:48.507561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45976) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:48.508103 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c222e80e-b146-4486-8ecb-c5413f044a80 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.1035545 Nov 24 14:04:48.546965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:48.588379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b99a1995-69ae-485d-a5d8-cf1853d30cfe tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:48.589968 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b99a1995-69ae-485d-a5d8-cf1853d30cfe tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0814018 Nov 24 14:04:48.592619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45980) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:48.616553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:48.617031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:48.664395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18e9474b-dfec-48fa-bf5d-65775516af08 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:48.665828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18e9474b-dfec-48fa-bf5d-65775516af08 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:48.667270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18e9474b-dfec-48fa-bf5d-65775516af08 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:48.668108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-18e9474b-dfec-48fa-bf5d-65775516af08 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:48.684845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-18e9474b-dfec-48fa-bf5d-65775516af08 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:48.685970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-18e9474b-dfec-48fa-bf5d-65775516af08 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.0924640 Nov 24 14:04:48.688707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45984) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:48.753885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:48.756942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:48.915142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.002336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.076332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.081404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:49.120970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:49.123658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:49.129626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.135638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-749126a7-a59b-437d-aa0b-c78c26aedb37 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:49.144275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6 HTTP/1.1" status: 204 len: 168 time: 0.4544120 Nov 24 14:04:49.146875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45988) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:49.348511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Deleting subnet 7481fbe6-3265-4a13-ad19-b3e23e5f09d0 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:04:49.351722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.417004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.508186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.585324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.589522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eeca05f4-a27f-47c2-bc83-507b7eeb59eb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:49.630551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Subnet': ['ID=7481fbe6-3265-4a13-ad19-b3e23e5f09d0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:49.633260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:49.636587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:49.646964 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/7481fbe6-3265-4a13-ad19-b3e23e5f09d0 HTTP/1.1" status: 204 len: 168 time: 0.4990151 Nov 24 14:04:49.649400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45992) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:49.716504 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-da49bdbb-d4ad-4793-a698-02cec07c51b3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0657408 Nov 24 14:04:49.718854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 45996) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:49.800338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d773544-e09a-4d5e-ad15-ff308a4c8cbb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:49.801697 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3d773544-e09a-4d5e-ad15-ff308a4c8cbb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports HTTP/1.1" status: 200 len: 867 time: 0.0818055 Nov 24 14:04:49.804331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46000) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:49.870642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5345400e-d548-4b73-bec1-64b7e5b51f1a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:49.871312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5345400e-d548-4b73-bec1-64b7e5b51f1a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Synchronizing usage tracker for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:04:49.884199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58a76963-edd6-454f-ad39-2f73d4afda77 None None] Network 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:49.888617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5345400e-d548-4b73-bec1-64b7e5b51f1a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Unset dirty status for tenant:303f30b20dd547718e1105de03480ea7 on resource:subnet {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:04:49.889765 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5345400e-d548-4b73-bec1-64b7e5b51f1a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0845222 Nov 24 14:04:49.892314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46004) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:49.960768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-de8689b4-6255-4382-b71f-fce4950b99c8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0672438 Nov 24 14:04:49.966491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46008) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.013526 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-f90b3ef7-afbe-41b6-a648-7d6937317e48 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.014051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f90b3ef7-afbe-41b6-a648-7d6937317e48 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.015669 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f90b3ef7-afbe-41b6-a648-7d6937317e48 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/9de4210d-312c-4833-97e3-041a40052bde HTTP/1.1" status: 404 len: 333 time: 0.0480378 Nov 24 14:04:50.018321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.023376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2a32dc19-5759-4eec-94fc-dec7f25ce47a None None] Provisioning complete for port 2ba87734-db03-47d6-9be4-3098fcecabbf triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:50.023948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2a32dc19-5759-4eec-94fc-dec7f25ce47a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:50.157601 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-b61126cf-0990-4f77-bc52-7831e15d71a4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.157954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b61126cf-0990-4f77-bc52-7831e15d71a4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.160793 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b61126cf-0990-4f77-bc52-7831e15d71a4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/7481fbe6-3265-4a13-ad19-b3e23e5f09d0 HTTP/1.1" status: 404 len: 337 time: 0.1408508 Nov 24 14:04:50.162719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46016) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.200935 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-48ba416f-a864-473e-a3e6-12b333b36551 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.201380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-48ba416f-a864-473e-a3e6-12b333b36551 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.203014 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48ba416f-a864-473e-a3e6-12b333b36551 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/71e8c5f1-3f9f-4c8f-a079-e5eb886af5c6 HTTP/1.1" status: 404 len: 337 time: 0.0394077 Nov 24 14:04:50.205782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46020) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.246998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] DHCP port deletion for 60454f28-a3b3-4176-9b9d-ec6e6f5c9527 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:04:50.247243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-577df982-c2f3-49cc-a126-7fe41335bd41 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.247460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-577df982-c2f3-49cc-a126-7fe41335bd41 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.251557 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-577df982-c2f3-49cc-a126-7fe41335bd41 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/9b5cb6a5-3f04-46d2-a43d-919482eead6a HTTP/1.1" status: 404 len: 333 time: 0.0422323 Nov 24 14:04:50.251738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46024) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.252101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Deleting port 2ba87734-db03-47d6-9be4-3098fcecabbf {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:04:50.252556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:50.292836 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d5682b4-b081-4a04-85b9-34a2f8d85676 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.293279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9d5682b4-b081-4a04-85b9-34a2f8d85676 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.294952 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d5682b4-b081-4a04-85b9-34a2f8d85676 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/ee33eccb-258c-4f8b-84ff-f1bc965a4155 HTTP/1.1" status: 404 len: 337 time: 0.0422027 Nov 24 14:04:50.297371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46028) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.336754 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f54f124-5f18-40f5-bd2c-0f431375c21d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.337229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f54f124-5f18-40f5-bd2c-0f431375c21d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.339257 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8f54f124-5f18-40f5-bd2c-0f431375c21d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/7c6c2c59-1a99-4b28-8b79-684df396e032 HTTP/1.1" status: 404 len: 337 time: 0.0406621 Nov 24 14:04:50.342211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46032) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.382298 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-0a7cea78-eb58-419d-8553-037ece084431 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.382736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0a7cea78-eb58-419d-8553-037ece084431 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.386654 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0a7cea78-eb58-419d-8553-037ece084431 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/3e591235-6bee-492c-b8ec-a429c17ad9da HTTP/1.1" status: 404 len: 333 time: 0.0412366 Nov 24 14:04:50.386871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46036) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.428113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac2cd11b-7405-44c0-a412-678ad0611d88 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.428465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac2cd11b-7405-44c0-a412-678ad0611d88 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.430066 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ac2cd11b-7405-44c0-a412-678ad0611d88 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/1c2d10fc-8b37-4d39-bbab-0716508d9702 HTTP/1.1" status: 404 len: 337 time: 0.0423245 Nov 24 14:04:50.432514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46040) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.458727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] For port 2ba87734-db03-47d6-9be4-3098fcecabbf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=2ba87734-db03-47d6-9be4-3098fcecabbf,segment=NetworkSegment(9bb1c113-5cd8-4f33-a63f-dbdb934a70f4),segment_id=9bb1c113-5cd8-4f33-a63f-dbdb934a70f4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:50.459119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:50.471105 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-d398571c-a738-4ee3-a863-273538aadf6b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.471468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d398571c-a738-4ee3-a863-273538aadf6b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.473125 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d398571c-a738-4ee3-a863-273538aadf6b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/63660e84-ac27-49c8-9bcb-b2e5fcc7edcb HTTP/1.1" status: 404 len: 337 time: 0.0397365 Nov 24 14:04:50.475580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46044) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.520357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f2905ef-c0c1-4112-94ef-fe6d1e9a44d6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.521651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f2905ef-c0c1-4112-94ef-fe6d1e9a44d6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.523141 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3f2905ef-c0c1-4112-94ef-fe6d1e9a44d6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/97aa987e-d161-402f-8092-283ce8e00406 HTTP/1.1" status: 404 len: 333 time: 0.0466263 Nov 24 14:04:50.529166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.571853 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-acc34f90-6116-494e-90b8-be43f9285f7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.572365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-acc34f90-6116-494e-90b8-be43f9285f7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.574612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acc34f90-6116-494e-90b8-be43f9285f7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/3ff66e62-b9e2-4d51-a987-a6f20437a84f HTTP/1.1" status: 404 len: 337 time: 0.0443981 Nov 24 14:04:50.574868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 2ba87734-db03-47d6-9be4-3098fcecabbf no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:04:50.576409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46052) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.608275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Calling delete_port for 2ba87734-db03-47d6-9be4-3098fcecabbf owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:04:50.615444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-acc939c3-f6fe-4475-bc0b-ff59cda6adb6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.615918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-acc939c3-f6fe-4475-bc0b-ff59cda6adb6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.617666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acc939c3-f6fe-4475-bc0b-ff59cda6adb6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/a4025d13-8d2d-4476-be2c-fe2317bbe26b HTTP/1.1" status: 404 len: 337 time: 0.0403605 Nov 24 14:04:50.620247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46056) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.659297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-539cdc5f-e5ad-4664-8d47-2edf48bb13cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.659731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-539cdc5f-e5ad-4664-8d47-2edf48bb13cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.661370 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-539cdc5f-e5ad-4664-8d47-2edf48bb13cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/eaf32161-9d13-4b3a-9a66-e2f26406762d HTTP/1.1" status: 404 len: 333 time: 0.0402355 Nov 24 14:04:50.663973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46060) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.704763 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a6497a6-2c3c-445f-b615-ce48d78b83fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.705102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1a6497a6-2c3c-445f-b615-ce48d78b83fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.706931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1a6497a6-2c3c-445f-b615-ce48d78b83fc tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/7325dca3-b00b-4c05-9028-efb649c79f97 HTTP/1.1" status: 404 len: 337 time: 0.0420830 Nov 24 14:04:50.709964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.735073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:50.740692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:50.750039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-27c17e3b-69a9-4d1f-bf87-ee7e09fa6490 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.750473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-27c17e3b-69a9-4d1f-bf87-ee7e09fa6490 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.752805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-27c17e3b-69a9-4d1f-bf87-ee7e09fa6490 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/0d731738-5081-4546-9eb5-d5e9a46052fb HTTP/1.1" status: 404 len: 333 time: 0.0412254 Nov 24 14:04:50.755420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46068) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.791223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Pushing event deleted for resources: {'Port': ['ID=2ba87734-db03-47d6-9be4-3098fcecabbf,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:50.791619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-940ec339-0912-428c-b604-fcbf34543b8f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.792081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-940ec339-0912-428c-b604-fcbf34543b8f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.793689 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-940ec339-0912-428c-b604-fcbf34543b8f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/d73fc6ba-d83b-420f-a93b-770c85bec555 HTTP/1.1" status: 404 len: 337 time: 0.0373614 Nov 24 14:04:50.796387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46072) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.796680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:50.800104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:50.811748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] No DVR routers for this DVR port 2ba87734-db03-47d6-9be4-3098fcecabbf on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:04:50.840186 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b9b71c1e-a21c-404c-b5c1-f04a6bff9fc3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.840651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b9b71c1e-a21c-404c-b5c1-f04a6bff9fc3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.842231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b9b71c1e-a21c-404c-b5c1-f04a6bff9fc3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/1e59ba05-1a2f-4262-b7f3-3142c037185c HTTP/1.1" status: 404 len: 333 time: 0.0448136 Nov 24 14:04:50.844897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46076) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:50.976163 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-5ae75380-2d47-4657-8da0-3d11bd1d275e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:50.976519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5ae75380-2d47-4657-8da0-3d11bd1d275e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:50.978133 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5ae75380-2d47-4657-8da0-3d11bd1d275e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/2af9d605-7630-4ff0-9b75-42a380cebe3e HTTP/1.1" status: 404 len: 337 time: 0.1323748 Nov 24 14:04:50.980794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46080) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.020447 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-aaa4262d-f776-4963-9ee9-09df17e0bd78 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.020879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-aaa4262d-f776-4963-9ee9-09df17e0bd78 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.022476 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-aaa4262d-f776-4963-9ee9-09df17e0bd78 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/69d075dc-82c5-4976-8c43-180c18495066 HTTP/1.1" status: 404 len: 333 time: 0.0408170 Nov 24 14:04:51.025182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46084) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.065868 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c7a2b8f-05d6-418c-8dd5-235b5801a3fb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.066298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2c7a2b8f-05d6-418c-8dd5-235b5801a3fb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.067891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2c7a2b8f-05d6-418c-8dd5-235b5801a3fb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/cf702fb7-641f-484f-a903-212d8a5f97c9 HTTP/1.1" status: 404 len: 337 time: 0.0417979 Nov 24 14:04:51.070414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46088) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.108502 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-5a5a668f-723a-4f37-8221-dfcb031d443e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.108850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5a5a668f-723a-4f37-8221-dfcb031d443e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.110400 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5a5a668f-723a-4f37-8221-dfcb031d443e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/2fee02ef-2163-4387-9bfb-c4bc2e307868 HTTP/1.1" status: 404 len: 333 time: 0.0391343 Nov 24 14:04:51.114053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46092) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.150584 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d54cb42-f490-42ba-a7f3-60aca0a55ccd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.151002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5d54cb42-f490-42ba-a7f3-60aca0a55ccd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.152555 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5d54cb42-f490-42ba-a7f3-60aca0a55ccd tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/dff1a110-2346-4451-a232-367ca629021b HTTP/1.1" status: 404 len: 337 time: 0.0376401 Nov 24 14:04:51.155033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46096) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.197049 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-694dda14-cc41-4e0e-be6b-ac4115246fcf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.197478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-694dda14-cc41-4e0e-be6b-ac4115246fcf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.199119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-694dda14-cc41-4e0e-be6b-ac4115246fcf tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/ec8cedd4-b1fd-4a8c-95a5-e9c719c3ca21 HTTP/1.1" status: 404 len: 333 time: 0.0432174 Nov 24 14:04:51.201650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46100) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.241373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-2adcb0b2-6c91-4d03-81d9-4b3b9f26558d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.241373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2adcb0b2-6c91-4d03-81d9-4b3b9f26558d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.241373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2adcb0b2-6c91-4d03-81d9-4b3b9f26558d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/9ddf359d-8737-4e46-94db-85077ef13e7b HTTP/1.1" status: 404 len: 337 time: 0.0383701 Nov 24 14:04:51.243575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46104) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.280652 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-5e64a269-b47b-4084-bc2c-c543f5c8af7d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.281081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5e64a269-b47b-4084-bc2c-c543f5c8af7d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.282666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5e64a269-b47b-4084-bc2c-c543f5c8af7d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/93a0bbf6-b678-4ac9-aa23-b2d136549f99 HTTP/1.1" status: 404 len: 337 time: 0.0381794 Nov 24 14:04:51.285913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46108) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.328299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-512fcf21-b188-4dc9-92b8-5444a544923c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.328736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-512fcf21-b188-4dc9-92b8-5444a544923c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.330951 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-512fcf21-b188-4dc9-92b8-5444a544923c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/3d408d24-ae8b-4edb-855a-59f46609239c HTTP/1.1" status: 404 len: 333 time: 0.0434713 Nov 24 14:04:51.333356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46112) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.371994 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c4c019ba-54d1-42ac-828d-60664caef599 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.372433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c4c019ba-54d1-42ac-828d-60664caef599 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.374044 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c4c019ba-54d1-42ac-828d-60664caef599 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/4855d51e-bae1-4442-bf87-6404cddc372c HTTP/1.1" status: 404 len: 337 time: 0.0397699 Nov 24 14:04:51.376698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46116) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.414064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-433a18b6-759b-4013-a6d8-7cbb62d7f180 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.414492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-433a18b6-759b-4013-a6d8-7cbb62d7f180 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.416073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-433a18b6-759b-4013-a6d8-7cbb62d7f180 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/07b617b1-2d06-4741-9f6f-9ae81cf0d1fe HTTP/1.1" status: 404 len: 337 time: 0.0383692 Nov 24 14:04:51.418485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46120) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.460598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-f499f7e8-7964-48d5-ba16-474ee3c693cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.461035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f499f7e8-7964-48d5-ba16-474ee3c693cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.462609 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f499f7e8-7964-48d5-ba16-474ee3c693cb tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/144fba37-10fe-4d2b-9cae-09d86999cb6f HTTP/1.1" status: 404 len: 333 time: 0.0432673 Nov 24 14:04:51.465302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46124) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.502362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-58e6c612-1320-4925-b99d-6f4acf1ee043 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.502700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-58e6c612-1320-4925-b99d-6f4acf1ee043 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.504399 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-58e6c612-1320-4925-b99d-6f4acf1ee043 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/038e398a-2b0a-45e4-82c9-5c5dcd11ea72 HTTP/1.1" status: 404 len: 337 time: 0.0381503 Nov 24 14:04:51.506900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46128) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.544982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-9b749de2-7fcb-4ed7-80b8-1f8ccbe235aa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.545617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9b749de2-7fcb-4ed7-80b8-1f8ccbe235aa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.546953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9b749de2-7fcb-4ed7-80b8-1f8ccbe235aa tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/c3f6596d-3a60-4809-acb1-3062b3b91f87 HTTP/1.1" status: 404 len: 337 time: 0.0390093 Nov 24 14:04:51.549603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46132) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.592118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a918d33-e6db-4476-a62a-22aff1ff36a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.592549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4a918d33-e6db-4476-a62a-22aff1ff36a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.594169 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4a918d33-e6db-4476-a62a-22aff1ff36a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/0700818f-07ef-4c14-84cd-c19f5c4cc919 HTTP/1.1" status: 404 len: 333 time: 0.0435331 Nov 24 14:04:51.597448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46136) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.634556 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-bb9447f4-83f8-478d-8607-736a6d3f7441 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.634990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bb9447f4-83f8-478d-8607-736a6d3f7441 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.636588 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bb9447f4-83f8-478d-8607-736a6d3f7441 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/d7488947-72a5-4438-b697-6c051a0aae30 HTTP/1.1" status: 404 len: 337 time: 0.0382309 Nov 24 14:04:51.639011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46140) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.677826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-d8161acb-daed-4deb-9fe3-ca211b840873 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.678268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d8161acb-daed-4deb-9fe3-ca211b840873 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.679894 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d8161acb-daed-4deb-9fe3-ca211b840873 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/ec750fdd-063c-49a4-a9fd-037b3423c10f HTTP/1.1" status: 404 len: 337 time: 0.0399663 Nov 24 14:04:51.682554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.729047 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-53938371-7bbb-4b93-9fdb-7150f6146c9c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports?device_id=17f4c6c2-7440-4257-8a4e-2fe40c552fe2 HTTP/1.1" status: 200 len: 205 time: 0.0452766 Nov 24 14:04:51.731163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46148) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.795143 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-62687226-9f7c-4f34-91cc-3926c4218559 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] delete failed (client error): The resource could not be found. Nov 24 14:04:51.796100 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-62687226-9f7c-4f34-91cc-3926c4218559 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/routers/17f4c6c2-7440-4257-8a4e-2fe40c552fe2 HTTP/1.1" status: 404 len: 336 time: 0.0640137 Nov 24 14:04:51.798603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46152) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.839496 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b37e9159-c183-4de8-8eb4-2d4d0bbff785 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.839964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b37e9159-c183-4de8-8eb4-2d4d0bbff785 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.841547 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b37e9159-c183-4de8-8eb4-2d4d0bbff785 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/e68f21f8-8124-451d-99a7-719e6649aeb4 HTTP/1.1" status: 404 len: 337 time: 0.0418048 Nov 24 14:04:51.844101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46156) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.886420 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3eb164f1-f5c4-46d0-bf7e-5ec332e0c289 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "GET /v2.0/ports?device_id=4e21ef91-d38d-4172-a98f-e6ab3fadcbcb HTTP/1.1" status: 200 len: 205 time: 0.0411963 Nov 24 14:04:51.888706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46160) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.954218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-02c2de62-0ac2-4362-9f9c-ff24e3ae4193 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] delete failed (client error): The resource could not be found. Nov 24 14:04:51.955243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-02c2de62-0ac2-4362-9f9c-ff24e3ae4193 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/routers/4e21ef91-d38d-4172-a98f-e6ab3fadcbcb HTTP/1.1" status: 404 len: 336 time: 0.0656176 Nov 24 14:04:51.958583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46164) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:51.996294 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-c4382f82-4538-49db-99da-466bf42c745d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:51.996725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c4382f82-4538-49db-99da-466bf42c745d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:51.998297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c4382f82-4538-49db-99da-466bf42c745d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/338204ce-3673-456a-a63b-f11102fb7365 HTTP/1.1" status: 404 len: 337 time: 0.0388415 Nov 24 14:04:52.000678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46170) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.041831 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-1a6d8b2a-a999-4682-8bdf-61a38df6f461 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.042267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1a6d8b2a-a999-4682-8bdf-61a38df6f461 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.043889 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1a6d8b2a-a999-4682-8bdf-61a38df6f461 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/9a200a16-41b8-4533-8fbe-6c6901bb8703 HTTP/1.1" status: 404 len: 337 time: 0.0423229 Nov 24 14:04:52.046456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46174) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.089498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-1d6fdb78-aa9b-45f5-b58b-2bf08d0c46b7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.089926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1d6fdb78-aa9b-45f5-b58b-2bf08d0c46b7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.091498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d6fdb78-aa9b-45f5-b58b-2bf08d0c46b7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/f0547738-89f8-438b-9cce-bc8ab1aa5034 HTTP/1.1" status: 404 len: 333 time: 0.0442297 Nov 24 14:04:52.093952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46178) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.131750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-525bf50a-3bb6-4899-a42d-1d1b7849a1d8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.132202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-525bf50a-3bb6-4899-a42d-1d1b7849a1d8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.133750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-525bf50a-3bb6-4899-a42d-1d1b7849a1d8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/6b444e4b-4b18-4009-bf57-a34612117a83 HTTP/1.1" status: 404 len: 337 time: 0.0389378 Nov 24 14:04:52.136141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46182) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.174554 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-b4893798-1903-4a59-948c-dc383fcd26ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.174988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b4893798-1903-4a59-948c-dc383fcd26ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.176595 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b4893798-1903-4a59-948c-dc383fcd26ef tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/c25f1efc-c87e-4115-8967-d51e4c113afc HTTP/1.1" status: 404 len: 333 time: 0.0395892 Nov 24 14:04:52.179016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46186) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.219572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-64fbe3f6-3894-40c0-a3ea-bdc962059974 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.220017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-64fbe3f6-3894-40c0-a3ea-bdc962059974 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.221628 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-64fbe3f6-3894-40c0-a3ea-bdc962059974 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/8efebbc3-38b5-4f82-b1bb-1e57cd4bcd09 HTTP/1.1" status: 404 len: 337 time: 0.0417492 Nov 24 14:04:52.224263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46190) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.263917 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-fb988067-f79b-45ee-b6b2-3d8f82793c55 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.264354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fb988067-f79b-45ee-b6b2-3d8f82793c55 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.265955 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fb988067-f79b-45ee-b6b2-3d8f82793c55 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/7f96edb0-5f88-4dc8-8586-3e3bb745d6ce HTTP/1.1" status: 404 len: 333 time: 0.0408075 Nov 24 14:04:52.268634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46194) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.310377 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a80a53ea-e82c-4d3a-9936-a2993ee7df97 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.310742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a80a53ea-e82c-4d3a-9936-a2993ee7df97 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.312389 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a80a53ea-e82c-4d3a-9936-a2993ee7df97 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/3beec28a-ce17-48a9-9b76-a06666aba35b HTTP/1.1" status: 404 len: 337 time: 0.0426691 Nov 24 14:04:52.315537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46198) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.356586 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-2692c860-b9c3-49f0-9a9d-bab1512b1658 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.357024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2692c860-b9c3-49f0-9a9d-bab1512b1658 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.358662 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2692c860-b9c3-49f0-9a9d-bab1512b1658 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/dde3bd15-c291-4a14-9254-ed586f2dce00 HTTP/1.1" status: 404 len: 333 time: 0.0421517 Nov 24 14:04:52.361269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46202) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.398521 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-64c677ce-8eb0-407a-9258-a0cb26a0643f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.398956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-64c677ce-8eb0-407a-9258-a0cb26a0643f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.400583 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64c677ce-8eb0-407a-9258-a0cb26a0643f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/94112229-d317-4154-8ac7-11540198b68c HTTP/1.1" status: 404 len: 337 time: 0.0378232 Nov 24 14:04:52.403062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46206) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.445474 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-02c9e723-95bc-42bc-9016-50475cdbe06a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.445906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-02c9e723-95bc-42bc-9016-50475cdbe06a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.447480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-02c9e723-95bc-42bc-9016-50475cdbe06a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/ac884e28-67a7-4c9f-af27-85e451f61546 HTTP/1.1" status: 404 len: 333 time: 0.0435569 Nov 24 14:04:52.449943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46210) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.488043 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-a4a98ae2-517d-4f9c-aba5-efebbde3f165 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.488492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a4a98ae2-517d-4f9c-aba5-efebbde3f165 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.490125 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a4a98ae2-517d-4f9c-aba5-efebbde3f165 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/c9658e4c-8e13-4a45-84ed-b1f7129b80e1 HTTP/1.1" status: 404 len: 337 time: 0.0393224 Nov 24 14:04:52.492766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46214) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.531371 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-42587d81-1ad8-4ede-825a-b1be4d7a9902 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.531822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42587d81-1ad8-4ede-825a-b1be4d7a9902 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.533927 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-42587d81-1ad8-4ede-825a-b1be4d7a9902 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/bf2021ff-ac29-417c-8e8e-e39e46729d3d HTTP/1.1" status: 404 len: 333 time: 0.0398471 Nov 24 14:04:52.536331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46218) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.576948 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-8188a609-d277-4236-8d94-fdb0448226e0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.577293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8188a609-d277-4236-8d94-fdb0448226e0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.578874 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8188a609-d277-4236-8d94-fdb0448226e0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/477fd692-0f29-400a-8c35-e3498d58acb9 HTTP/1.1" status: 404 len: 337 time: 0.0416806 Nov 24 14:04:52.581580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46222) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.620997 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-37abbc60-8fea-4887-84de-c58972e7f474 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.621424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-37abbc60-8fea-4887-84de-c58972e7f474 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.622995 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-37abbc60-8fea-4887-84de-c58972e7f474 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/ports/f8403a41-5b46-40ba-907d-af0947d9ee77 HTTP/1.1" status: 404 len: 333 time: 0.0405488 Nov 24 14:04:52.625345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46226) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.663148 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-33141ef5-5f52-4850-a3ae-f6be70d6e3ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] DELETE failed (client error): The resource could not be found. Nov 24 14:04:52.663580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-33141ef5-5f52-4850-a3ae-f6be70d6e3ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:04:52.665214 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-33141ef5-5f52-4850-a3ae-f6be70d6e3ad tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/subnets/ce5e5071-d58f-4320-b342-412ff32bd3d5 HTTP/1.1" status: 404 len: 337 time: 0.0390151 Nov 24 14:04:52.667709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46230) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:52.779908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:52.911481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:52.936358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['60454f28-a3b3-4176-9b9d-ec6e6f5c9527']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:52.950111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:52.950421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9bb1c113-5cd8-4f33-a63f-dbdb934a70f4') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:04:52.968238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:52.988423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:52.994489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Releasing vlan 858 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:04:52.994872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:04:53.009746 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:04:53.085195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.089272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-593bdf47-efc1-43e2-a1ba-b5af2ec021bc tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:53.103940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.117920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Pushing event deleted for resources: {'Network': ['ID=60454f28-a3b3-4176-9b9d-ec6e6f5c9527,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:53.120747 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] 10.222.0.70 "DELETE /v2.0/networks/60454f28-a3b3-4176-9b9d-ec6e6f5c9527 HTTP/1.1" status: 204 len: 168 time: 0.4520788 Nov 24 14:04:53.121613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:53.415614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46238) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:53.591477 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ac6ec88f-cf64-4082-adfa-c59f27abc02d admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=303f30b20dd547718e1105de03480ea7&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1746216 Nov 24 14:04:53.593877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46246) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:53.652548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.677804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.824519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.828027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-daad5c06-b07b-43c6-9c92-ddbf9d7e7d87 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:53.839424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b4e42b4-db5a-4a5f-9874-be2a0c39e3c9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:53.842725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:53.846286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:53.850430 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/8b4e42b4-db5a-4a5f-9874-be2a0c39e3c9 HTTP/1.1" status: 204 len: 168 time: 0.2532279 Nov 24 14:04:54.648210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46272) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:54.775047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-1716115495', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:54.781287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:54.785269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:router and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:54.788090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:54.794378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:54.804552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.805460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.824331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.842139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.862992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.864167 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7c128110-a7f1-4a23-85c8-d23e51d41d71 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.2149827 Nov 24 14:04:54.866728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46278) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:54.872213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1709489556'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:54.877511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:54.881200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:network and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:54.884406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:54.889941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:54.900384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Made reservation on behalf of 451b6f6fc9ce4c9c82a107f7a1f7e84a for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:54.903120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.915705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:54.946089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:54.949696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:security_group_rule and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:54.952492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:54.958765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:55.026277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.029929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.034222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-224f3d7d-ee47-48c6-b15f-45c09bb3a9c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:55.059632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 890} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:04:55.072890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f7aa2203-bc73-49ae-ba43-bae136a7ac38,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:55.077021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:55.077923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.078258 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Added segment ca65b806-1640-461f-ad5d-1b0e83986188 of type vlan for network 2fbb2731-bdc9-499b-a665-09cf5e695354 Nov 24 14:04:55.104541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.138664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.142846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:55.143428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.148428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6dd365ec-db95-4d0c-b737-740c12dd13f5 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:55.253564 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.3857305 Nov 24 14:04:55.256502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46282) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:55.256999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Network': ['ID=2fbb2731-bdc9-499b-a665-09cf5e695354,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:55.259671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:55.263498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'subnet': {'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:55.268012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:04:55.374875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:55.378893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:subnet and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:55.381851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:55.387474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:55.397269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Made reservation on behalf of 451b6f6fc9ce4c9c82a107f7a1f7e84a for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:55.499719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.723931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.727584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-decf5beb-8ea9-4f71-a0fa-754885bd92e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:55.803683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Subnet': ['ID=bd8923d8-ab7f-4f64-a7c8-853bbb910fcf,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:55.806240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:55.817028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Checking segment: {'id': 'ca65b806-1640-461f-ad5d-1b0e83986188', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 890, 'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:55.817382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network hostable DHCP agents. Network: 2fbb2731-bdc9-499b-a665-09cf5e695354, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:04:55.840278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:04:55.849976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 2fbb2731-bdc9-499b-a665-09cf5e695354) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:55.854365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:55.855459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.858516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80d27160-8cbd-4cd2-86ea-c0a16a19ab39 None None] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:55.877860 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6201365 Nov 24 14:04:55.881194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46286) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:55.886886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'network': {'name': 'tempest-router-network01--256630892'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:55.891919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:55.897429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:network and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:55.900924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:55.907013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:55.919529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Made reservation on behalf of 451b6f6fc9ce4c9c82a107f7a1f7e84a for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:55.922531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.952359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:04:55.961967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:55.962326 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Added segment 158137b5-eadc-40fc-9e02-bf7ba4183822 of type vlan for network aa815e77-cec0-4529-9c9a-1cbd88b29228 Nov 24 14:04:55.989885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.025278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.029393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:56.029985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.037445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b238dc09-8003-4095-80bc-63e29c279ca5 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:56.121495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-2fbb2731-bdc9-499b-a665-09cf5e695354', 'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354', 'tenant_id': '451b6f6fc9ce4c9c82a107f7a1f7e84a', 'fixed_ips': [{'subnet_id': 'bd8923d8-ab7f-4f64-a7c8-853bbb910fcf'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:56.122308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.129181 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.2437727 Nov 24 14:04:56.129585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46290) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:56.136834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'network': {'name': 'tempest-router-network02--1375155973'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:56.142317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:56.146832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:network and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:56.149419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Network': ['ID=aa815e77-cec0-4529-9c9a-1cbd88b29228,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:56.149985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:56.152565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:56.155966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:56.166996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Made reservation on behalf of 451b6f6fc9ce4c9c82a107f7a1f7e84a for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:56.170208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.177633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:04:56.202855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 898} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:04:56.213413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.213728 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Added segment 648b9d51-bc9c-4507-91c3-9eb5deb04edf of type vlan for network 7a4fa1d2-ce37-4875-9759-cea122092449 Nov 24 14:04:56.243983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.280644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.285998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:56.287288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.293214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-640b4487-a222-4545-b7f7-f1aecfb53454 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:56.365986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Allocated IP 172.20.0.2 (2fbb2731-bdc9-499b-a665-09cf5e695354/bd8923d8-ab7f-4f64-a7c8-853bbb910fcf/f52a97b4-360f-4ace-a86a-cdf6a04af1c7) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:56.496167 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3652995 Nov 24 14:04:56.498778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46294) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:56.506901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'subnet': {'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:56.520782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Network': ['ID=7a4fa1d2-ce37-4875-9759-cea122092449,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:56.525494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:56.545862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7a4fa1d2-ce37-4875-9759-cea122092449 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:04:56.617812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:56.621551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:subnet and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:56.624346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:56.630684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:56.640580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Made reservation on behalf of 451b6f6fc9ce4c9c82a107f7a1f7e84a for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:56.662091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.677446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Transition to ACTIVE for port object f52a97b4-360f-4ace-a86a-cdf6a04af1c7 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:56.697602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Transition to ACTIVE for port object f52a97b4-360f-4ace-a86a-cdf6a04af1c7 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:56.703546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.707497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-09a9d079-707b-4d3c-af9c-c7b18b1a3979 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:56.744610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.777999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:56.781371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:56.783068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Pushing event updated for resources: {'Port': ['ID=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:56.785223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:56.787329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:56.874927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Attempting to bind port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:56.875318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Attempting to bind port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ca65b806-1640-461f-ad5d-1b0e83986188', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 890, 'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:56.875676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Attempting to bind port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 on network 2fbb2731-bdc9-499b-a665-09cf5e695354 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:56.882207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:56.882586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Checking segment: {'id': 'ca65b806-1640-461f-ad5d-1b0e83986188', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 890, 'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:56.882999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.883397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Bound using segment: {'id': 'ca65b806-1640-461f-ad5d-1b0e83986188', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 890, 'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:56.883888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Bound port: f52a97b4-360f-4ace-a86a-cdf6a04af1c7, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ca65b806-1640-461f-ad5d-1b0e83986188', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 890, 'network_id': '2fbb2731-bdc9-499b-a665-09cf5e695354'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:56.884262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.968487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.972942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d8df33c-e716-44ee-842a-f081fa5c7c7f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:56.975908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] For port f52a97b4-360f-4ace-a86a-cdf6a04af1c7, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:56.979117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] For port f52a97b4-360f-4ace-a86a-cdf6a04af1c7, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,segment=NetworkSegment(ca65b806-1640-461f-ad5d-1b0e83986188),segment_id=ca65b806-1640-461f-ad5d-1b0e83986188)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:56.982769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:56.986331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b3dcee91-de04-4da1-863c-8e1c474d4800 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:57.048316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Subnet': ['ID=9ffcb889-65a6-4c09-80d3-3ac99809d690,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:57.052861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:57.061833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Checking segment: {'id': '158137b5-eadc-40fc-9e02-bf7ba4183822', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:57.062304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network hostable DHCP agents. Network: aa815e77-cec0-4529-9c9a-1cbd88b29228, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:04:57.069583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Pushing event updated for resources: {'Port': ['ID=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:57.072613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:57.093238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:04:57.104756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, aa815e77-cec0-4529-9c9a-1cbd88b29228) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:57.109062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:57.109978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.116889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86d86f49-959c-4121-9680-2044995780d1 None None] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:57.136009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6361821 Nov 24 14:04:57.139002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46300) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:57.145030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'subnet': {'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:04:57.289427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:04:57.293303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Usage tracker for resource:subnet and tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:04:57.296409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:04:57.302609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:04:57.317164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Made reservation on behalf of 451b6f6fc9ce4c9c82a107f7a1f7e84a for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:04:57.390917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-aa815e77-cec0-4529-9c9a-1cbd88b29228', 'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228', 'tenant_id': '451b6f6fc9ce4c9c82a107f7a1f7e84a', 'fixed_ips': [{'subnet_id': '9ffcb889-65a6-4c09-80d3-3ac99809d690'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:57.393226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.428402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.553333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Allocated IP 172.20.0.2 (aa815e77-cec0-4529-9c9a-1cbd88b29228/9ffcb889-65a6-4c09-80d3-3ac99809d690/67741bc4-5f64-4168-a35f-a88c6dfeb2d3) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:57.651484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.655373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d58e4eac-32b1-44a4-a497-69b11b190127 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:57.738643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Subnet': ['ID=3c09e4fe-d062-43ec-a86e-e5c9adf91d42,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:57.742612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:57.745922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Checking segment: {'id': '648b9d51-bc9c-4507-91c3-9eb5deb04edf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:57.746281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network hostable DHCP agents. Network: 7a4fa1d2-ce37-4875-9759-cea122092449, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:04:57.772992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network 7a4fa1d2-ce37-4875-9759-cea122092449 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:04:57.784287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7a4fa1d2-ce37-4875-9759-cea122092449) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:57.788575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:04:57.789223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.802668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d64e1e68-448a-4199-a8c8-86b99c41fd4c None None] Network 7a4fa1d2-ce37-4875-9759-cea122092449 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:57.816792 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6765690 Nov 24 14:04:57.819150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46304) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:04:57.877721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.888586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Transition to ACTIVE for port object 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:57.916496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Transition to ACTIVE for port object 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:57.931432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:57.945306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a42380a7-e49b-4bd6-8f37-988fc75f33ba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:57.995450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:58.012746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:58.020025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:58.118741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df0f0495-57dc-4938-a7eb-e0e798f8cbde None None] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:04:58.131613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Pushing event updated for resources: {'Port': ['ID=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:58.149941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:58.275504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5587c5fa-d6ce-4943-a876-09fabf94f520 None None] Provisioning for port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:58.330492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Attempting to bind port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:58.331483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Attempting to bind port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '158137b5-eadc-40fc-9e02-bf7ba4183822', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:58.331879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Attempting to bind port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 on network aa815e77-cec0-4529-9c9a-1cbd88b29228 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:58.360010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7a4fa1d2-ce37-4875-9759-cea122092449', 'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449', 'tenant_id': '451b6f6fc9ce4c9c82a107f7a1f7e84a', 'fixed_ips': [{'subnet_id': '3c09e4fe-d062-43ec-a86e-e5c9adf91d42'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:04:58.360810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.382275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:58.382651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Checking segment: {'id': '158137b5-eadc-40fc-9e02-bf7ba4183822', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:58.383051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.383437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Bound using segment: {'id': '158137b5-eadc-40fc-9e02-bf7ba4183822', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:58.383939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Bound port: 67741bc4-5f64-4168-a35f-a88c6dfeb2d3, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '158137b5-eadc-40fc-9e02-bf7ba4183822', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': 'aa815e77-cec0-4529-9c9a-1cbd88b29228'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:58.384316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.432416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.600727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f52a97b4-360f-4ace-a86a-cdf6a04af1c7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:04:58.730307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] For port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:58.762947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] For port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,segment=NetworkSegment(158137b5-eadc-40fc-9e02-bf7ba4183822),segment_id=158137b5-eadc-40fc-9e02-bf7ba4183822)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:58.774876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.780512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ed45f4be-1577-453e-a64f-a0c7afe5b533 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:58.788385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Allocated IP 172.20.0.1 (aa815e77-cec0-4529-9c9a-1cbd88b29228/9ffcb889-65a6-4c09-80d3-3ac99809d690/436f79cd-a8a4-4b8f-b2a9-83307bf08471) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:58.826402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Allocated IP 172.20.0.2 (7a4fa1d2-ce37-4875-9759-cea122092449/3c09e4fe-d062-43ec-a86e-e5c9adf91d42/12530989-5fd0-4ed1-ac2e-d9a3792e01d0) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:04:58.911236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Pushing event updated for resources: {'Port': ['ID=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:58.917544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:04:58.923461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:58.968828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.975769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:58.976167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:58.988099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Transition to ACTIVE for port object 436f79cd-a8a4-4b8f-b2a9-83307bf08471 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:59.018027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.022729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-67bb3396-28f8-402e-bbd6-e7765722d97f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:59.109588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Port': ['ID=436f79cd-a8a4-4b8f-b2a9-83307bf08471,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:59.115990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:59.122413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:59.123520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:59.125876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:59.201968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.222948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.232016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.250745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Transition to ACTIVE for port object 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:59.290171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Transition to ACTIVE for port object 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:04:59.298854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f52a97b4-360f-4ace-a86a-cdf6a04af1c7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,segment=NetworkSegment(ca65b806-1640-461f-ad5d-1b0e83986188),segment_id=ca65b806-1640-461f-ad5d-1b0e83986188)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:04:59.302395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.306689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d7e72bb0-ed5f-4c2b-baf3-4ecd71122487 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:59.339020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.341572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.343406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cd7f95e9-bb9c-484e-82e3-6e44170a70f9 None None] Provisioning complete for port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:04:59.343796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cd7f95e9-bb9c-484e-82e3-6e44170a70f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.494430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Network 7a4fa1d2-ce37-4875-9759-cea122092449 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:04:59.501071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:04:59.505494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Pushing event updated for resources: {'Port': ['ID=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:59.507600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:04:59.510950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:59.512122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4c9e05f2-cea7-47da-bbc3-7cb36142a5bb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.137s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:59.697066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:59.709743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:59.713872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Attempting to bind port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:04:59.714575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Attempting to bind port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '648b9d51-bc9c-4507-91c3-9eb5deb04edf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:04:59.714828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Attempting to bind port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 on network 7a4fa1d2-ce37-4875-9759-cea122092449 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:04:59.726222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 4, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:04:59.726595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Checking segment: {'id': '648b9d51-bc9c-4507-91c3-9eb5deb04edf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:04:59.726999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.727392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Bound using segment: {'id': '648b9d51-bc9c-4507-91c3-9eb5deb04edf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:04:59.727887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Bound port: 12530989-5fd0-4ed1-ac2e-d9a3792e01d0, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '648b9d51-bc9c-4507-91c3-9eb5deb04edf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 898, 'network_id': '7a4fa1d2-ce37-4875-9759-cea122092449'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:04:59.728263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.730571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.735610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.772302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-95607615-d67d-4ce3-a507-cb058af2ce9e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:59.841539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] For port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:04:59.844716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] For port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,segment=NetworkSegment(648b9d51-bc9c-4507-91c3-9eb5deb04edf),segment_id=648b9d51-bc9c-4507-91c3-9eb5deb04edf)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:04:59.850341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.852455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:04:59.856553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Port': ['ID=436f79cd-a8a4-4b8f-b2a9-83307bf08471,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:59.857045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:04:59.860038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:04:59.953807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Pushing event updated for resources: {'Port': ['ID=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:04:59.957828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:00.138786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:00.141081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:00.206394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-854a6dac-aed3-4cc5-8e7d-c8439cae5697 None None] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:00.315915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6d0766bb-1be4-4534-9e8e-36a958ea7f11 None None] Provisioning for port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:00.546652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Router db74c33a-b997-4f7d-9d03-b1f89da740d8 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:05:00.671125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:00.733105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:00.747882 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] Sync routers for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:00.748577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46312) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:00.752428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9295695 Nov 24 14:05:00.761256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:00.766490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:00.766876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:00.776290 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:00.776915 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:00.855616 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:00.867867 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:00.868746 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:00.953183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:00.972852 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:00.973303 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15fbead9-c0fe-4b74-ad5d-69813afc70a2 None None] The sync data for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:01.011722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f1736fce-2fe0-4526-bb65-9b2e4eaa0bff None None] Provisioning for port 436f79cd-a8a4-4b8f-b2a9-83307bf08471 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:01.022000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f1736fce-2fe0-4526-bb65-9b2e4eaa0bff None None] Provisioning complete for port 436f79cd-a8a4-4b8f-b2a9-83307bf08471 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:01.022401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1736fce-2fe0-4526-bb65-9b2e4eaa0bff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:01.062130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,segment=NetworkSegment(158137b5-eadc-40fc-9e02-bf7ba4183822),segment_id=158137b5-eadc-40fc-9e02-bf7ba4183822)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:01.071733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:01.072659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:01.103637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:01.185486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f1736fce-2fe0-4526-bb65-9b2e4eaa0bff None None] Port 436f79cd-a8a4-4b8f-b2a9-83307bf08471 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:01.187073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f0c9575-7a9f-4c35-92b4-2c1a69b33efe None None] Network 7a4fa1d2-ce37-4875-9759-cea122092449 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:01.333845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:01.337568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:01.351681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f1736fce-2fe0-4526-bb65-9b2e4eaa0bff None None] Provisioning complete for port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:01.352136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1736fce-2fe0-4526-bb65-9b2e4eaa0bff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:01.423525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:01.465804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f52a97b4-360f-4ace-a86a-cdf6a04af1c7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:01.480316 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-9532d9d2-e008-4c55-bcba-a0cd7339c591 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:01.481403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9532d9d2-e008-4c55-bcba-a0cd7339c591 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.7319582 Nov 24 14:05:01.484339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46318) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:01.660084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:01.660465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:01.821046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Provisioning for port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:01.826838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Provisioning complete for port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:01.827228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:01.989876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:01.999542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.030467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] For port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,segment=NetworkSegment(648b9d51-bc9c-4507-91c3-9eb5deb04edf),segment_id=648b9d51-bc9c-4507-91c3-9eb5deb04edf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:02.034821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.036723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-aec795a0-76f0-480a-982e-3242edfcf043 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:02.108100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Provisioning complete for port 436f79cd-a8a4-4b8f-b2a9-83307bf08471 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:02.108476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.145187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Pushing event updated for resources: {'Port': ['ID=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:02.149737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:02.165075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Port 436f79cd-a8a4-4b8f-b2a9-83307bf08471 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:02.287969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-68aa1034-9e6c-49d2-b780-37287436ee44 None None] Provisioning complete for port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:02.288429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-68aa1034-9e6c-49d2-b780-37287436ee44 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.557150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:02.582227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting port 436f79cd-a8a4-4b8f-b2a9-83307bf08471 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:02.582575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.629814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:02.630190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.745233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:02.770715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.811806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:02.812181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:02.892294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Calling delete_port for 436f79cd-a8a4-4b8f-b2a9-83307bf08471 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:03.062894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:03.066379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db25fd4f-74d1-40af-a284-5b32f6815288 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:03.113158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Port': ['ID=436f79cd-a8a4-4b8f-b2a9-83307bf08471,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:03.116436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:03.154173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-334537ef-15c6-4078-96cc-ea7adc833637 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:03.348192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:03.534731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:03.849345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Router db74c33a-b997-4f7d-9d03-b1f89da740d8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:05:03.983092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:03.992665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] Sync routers for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:03.993032 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5077496 Nov 24 14:05:03.996916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46322) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:04.005930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:04.006544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:04.062675 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-f8d91644-81ac-484d-8cc8-b2beedb44b7d tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] delete failed (client error): The resource could not be found. Nov 24 14:05:04.063700 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f8d91644-81ac-484d-8cc8-b2beedb44b7d tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/routers/tempest-non_exist_router-456060796 HTTP/1.1" status: 404 len: 334 time: 0.0658724 Nov 24 14:05:04.066288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:04.068394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46326) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:04.073492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9891c79d-21cb-4f74-bbee-41cd1b720260 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'router': {'external_gateway_info': {'network_id': 'db74c33a-b997-4f7d-9d03-b1f89da740d8'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:04.077538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:04.078129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:04:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:04.143247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:04.143863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c29a0f28-c0e0-4cf0-8339-11f6974c17b7 None None] The sync data for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:04.459169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9891c79d-21cb-4f74-bbee-41cd1b720260 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:04.487840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-9891c79d-21cb-4f74-bbee-41cd1b720260 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] update failed (client error): The resource could not be found. Nov 24 14:05:04.488860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9891c79d-21cb-4f74-bbee-41cd1b720260 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8 HTTP/1.1" status: 404 len: 339 time: 0.4195600 Nov 24 14:05:04.493044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46330) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:05.080138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:05.419658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Allocated IP 172.20.0.1 (2fbb2731-bdc9-499b-a665-09cf5e695354/bd8923d8-ab7f-4f64-a7c8-853bbb910fcf/8ac547d5-43b1-4d50-9b92-28ad53763bce) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:05:05.573685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:05.589776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Transition to ACTIVE for port object 8ac547d5-43b1-4d50-9b92-28ad53763bce will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:05.610754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:05.615014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7d35bb5d-fad3-4a74-bcf6-bc66aa308c0c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:05.684432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:05.687736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:05.691972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:05:05.720185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Port': ['ID=8ac547d5-43b1-4d50-9b92-28ad53763bce,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:05.723489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-61accacd-87c2-4c21-994b-b9d992ddb283 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:05.728301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:05.753136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:05.842880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:05.954688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c2371cc2-6d57-4d54-8d32-49fc8e1dd4f1 None None] Provisioning for port 8ac547d5-43b1-4d50-9b92-28ad53763bce completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:05.959826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c2371cc2-6d57-4d54-8d32-49fc8e1dd4f1 None None] Provisioning complete for port 8ac547d5-43b1-4d50-9b92-28ad53763bce triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:05.960242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2371cc2-6d57-4d54-8d32-49fc8e1dd4f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:06.011788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c2371cc2-6d57-4d54-8d32-49fc8e1dd4f1 None None] Port 8ac547d5-43b1-4d50-9b92-28ad53763bce cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:06.321486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:06.326081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:06.352076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d193e6b7-a2a1-4f39-906b-092f5b15b8b2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:06.437647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:06.441040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event updated for resources: {'Port': ['ID=8ac547d5-43b1-4d50-9b92-28ad53763bce,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:06.443980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:06.576263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:06.577234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:06.684871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:06.839397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bb86cf6a-5151-44b7-bc7d-cba41bf68f7c None None] Provisioning complete for port 8ac547d5-43b1-4d50-9b92-28ad53763bce triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:06.840085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bb86cf6a-5151-44b7-bc7d-cba41bf68f7c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:06.894832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-bb86cf6a-5151-44b7-bc7d-cba41bf68f7c None None] Port 8ac547d5-43b1-4d50-9b92-28ad53763bce cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:06.918586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Router db74c33a-b997-4f7d-9d03-b1f89da740d8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:05:07.086357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:07.097223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] Sync routers for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:07.098213 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6045721 Nov 24 14:05:07.099081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46338) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:07.108625 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:07.109223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:07.175545 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:07.186907 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:07.187497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:07.246258 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:07.246666 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1966ec62-4ea7-4739-9163-52fd3993d8c5 None None] The sync data for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:07.266650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c888640-da8a-4748-a9ff-8db1baae3923 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:07.424402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-1c888640-da8a-4748-a9ff-8db1baae3923 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] delete failed (client error): There was a conflict when trying to complete your request. Nov 24 14:05:07.425407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1c888640-da8a-4748-a9ff-8db1baae3923 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8 HTTP/1.1" status: 409 len: 329 time: 0.3253725 Nov 24 14:05:07.428237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46342) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:07.872293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:08.367183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:08.446853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting port 8ac547d5-43b1-4d50-9b92-28ad53763bce {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:08.447416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:08.631999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:08.748925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Calling delete_port for 8ac547d5-43b1-4d50-9b92-28ad53763bce owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:08.917624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:08.921185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9076b61e-ec09-4f23-a174-91a31748f6fb tempest-TestServerAdvancedOps-1709566871 tempest-TestServerAdvancedOps-1709566871-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:08.964093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Port': ['ID=8ac547d5-43b1-4d50-9b92-28ad53763bce,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:08.966833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:09.299187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:09.699626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Router db74c33a-b997-4f7d-9d03-b1f89da740d8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:05:09.833824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:09.843009 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4138479 Nov 24 14:05:09.847282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46346) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:09.848506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] Sync routers for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:09.865084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:09.865702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:09.913673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-914c8e67-a627-4396-b006-d8d9b9642729 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] show failed (client error): The resource could not be found. Nov 24 14:05:09.914675 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-914c8e67-a627-4396-b006-d8d9b9642729 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "GET /v2.0/routers/tempest-non_exist_router-1678576023 HTTP/1.1" status: 404 len: 335 time: 0.0664546 Nov 24 14:05:09.918487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46350) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:09.923466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3f7621a7-aee0-40fd-9e23-086a630f4d2a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Request body: {'router': {'name': 'new_name'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:09.924505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:09.935473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] Routers {'db74c33a-b997-4f7d-9d03-b1f89da740d8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:09.936111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db74c33a-b997-4f7d-9d03-b1f89da740d8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:09.984226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-3f7621a7-aee0-40fd-9e23-086a630f4d2a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] update failed (client error): The resource could not be found. Nov 24 14:05:09.988917 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3f7621a7-aee0-40fd-9e23-086a630f4d2a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "PUT /v2.0/routers/tempest-non_exist_router-116236626 HTTP/1.1" status: 404 len: 334 time: 0.0657189 Nov 24 14:05:09.989504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46354) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:09.998226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:09.998645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1593176c-a68b-4bd1-8cbb-7cc86faa46d3 None None] The sync data for ids ['db74c33a-b997-4f7d-9d03-b1f89da740d8'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:10.178780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting subnet 3c09e4fe-d062-43ec-a86e-e5c9adf91d42 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:05:10.181669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.234718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.316986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.391054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.394572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a0b25fc-776d-4ce5-af11-74f50cdcb00c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:10.431416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Subnet': ['ID=3c09e4fe-d062-43ec-a86e-e5c9adf91d42,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:10.441445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.445982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dbe9b36-9256-48f3-98ea-2a19b998e3bc None None] Network 7a4fa1d2-ce37-4875-9759-cea122092449 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:10.447233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.447614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.448017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.448389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.448758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.449125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.449488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.449863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.450213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.450566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.450922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:10.456433 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/subnets/3c09e4fe-d062-43ec-a86e-e5c9adf91d42 HTTP/1.1" status: 204 len: 168 time: 0.4658225 Nov 24 14:05:10.458677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:10.458985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46358) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:10.650064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting subnet 9ffcb889-65a6-4c09-80d3-3ac99809d690 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:05:10.653426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.687987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] DHCP port deletion for 7a4fa1d2-ce37-4875-9759-cea122092449 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:05:10.693067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Deleting port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:10.693447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.710765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.793660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.948965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] For port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,segment=NetworkSegment(648b9d51-bc9c-4507-91c3-9eb5deb04edf),segment_id=648b9d51-bc9c-4507-91c3-9eb5deb04edf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:10.949527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.987166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:10.991309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f4b7773c-7a33-417a-95ff-9e6305d8232c tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:11.027875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Subnet': ['ID=9ffcb889-65a6-4c09-80d3-3ac99809d690,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:11.031117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:11.032101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.039094 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/subnets/9ffcb889-65a6-4c09-80d3-3ac99809d690 HTTP/1.1" status: 204 len: 168 time: 0.5786853 Nov 24 14:05:11.041407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46364) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:11.064801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42f92b2c-85b4-48c7-832a-9e0f5d1b8417 None None] Network aa815e77-cec0-4529-9c9a-1cbd88b29228 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:11.087428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Calling delete_port for 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:11.156962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.168832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:11.168832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.304341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.308884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9cce6107-83d5-44b0-8958-5b9baf1e40b7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:11.357334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Pushing event deleted for resources: {'Port': ['ID=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:11.368552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] No DVR routers for this DVR port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:05:11.382362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.382703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.383031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.383356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.383681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.384183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.384507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.384828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.385146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.385456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.385769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:11.388789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:11.402551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] For port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=12530989-5fd0-4ed1-ac2e-d9a3792e01d0,segment=NetworkSegment(648b9d51-bc9c-4507-91c3-9eb5deb04edf),segment_id=648b9d51-bc9c-4507-91c3-9eb5deb04edf)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:11.402905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.451230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] DHCP port deletion for aa815e77-cec0-4529-9c9a-1cbd88b29228 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:05:11.456161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Deleting port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:11.456541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.530859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Calling delete_port for 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:11.620470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:05:11.620790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:05:11.658946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] For port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,segment=NetworkSegment(158137b5-eadc-40fc-9e02-bf7ba4183822),segment_id=158137b5-eadc-40fc-9e02-bf7ba4183822)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:11.659352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.777410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Calling delete_port for 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:11.851432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:11.855278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e4da9f82-5436-4723-bd08-548884611a1a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:11.894459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Pushing event deleted for resources: {'Port': ['ID=67741bc4-5f64-4168-a35f-a88c6dfeb2d3,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:11.898317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:11.900769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] No DVR routers for this DVR port 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:05:12.121870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting port 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:12.122435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.190944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] The port '12530989-5fd0-4ed1-ac2e-d9a3792e01d0' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:05:12.313920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.342028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7a4fa1d2-ce37-4875-9759-cea122092449']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:12.356023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '648b9d51-bc9c-4507-91c3-9eb5deb04edf') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:12.356322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '648b9d51-bc9c-4507-91c3-9eb5deb04edf') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:12.368080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.383810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.390151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Releasing vlan 898 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:05:12.390680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: util.warn( Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:05:12.405489 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:05:12.486008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.489496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3003e481-8b81-493f-99b0-3b731617ce01 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:12.505372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.517549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Network': ['ID=7a4fa1d2-ce37-4875-9759-cea122092449,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:12.520899 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/networks/7a4fa1d2-ce37-4875-9759-cea122092449 HTTP/1.1" status: 204 len: 168 time: 1.4784217 Nov 24 14:05:12.522814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:12.523184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:12.555334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:12.591369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:12.591729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 67741bc4-5f64-4168-a35f-a88c6dfeb2d3 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:12.592172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:12.623500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:12.623877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 12530989-5fd0-4ed1-ac2e-d9a3792e01d0 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:12.637614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.770767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.794632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aa815e77-cec0-4529-9c9a-1cbd88b29228']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:12.809545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '158137b5-eadc-40fc-9e02-bf7ba4183822') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:12.809839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '158137b5-eadc-40fc-9e02-bf7ba4183822') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:12.821461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.837093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.843203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:05:12.843569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:05:12.857510 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:05:12.933415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.936826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-869bb757-afc5-45d0-bb3a-91d2ab96f248 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:12.955419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:12.966201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Network': ['ID=aa815e77-cec0-4529-9c9a-1cbd88b29228,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:12.968715 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/networks/aa815e77-cec0-4529-9c9a-1cbd88b29228 HTTP/1.1" status: 204 len: 168 time: 0.4446583 Nov 24 14:05:12.969566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:12.971734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46372) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:13.159932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting subnet bd8923d8-ab7f-4f64-a7c8-853bbb910fcf {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:05:13.162794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.217002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.406575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.477329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.481530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5f549118-d2fc-44df-ad19-fdaa63a7f65a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:13.519072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Subnet': ['ID=bd8923d8-ab7f-4f64-a7c8-853bbb910fcf,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:13.528549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.534992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bfbe79de-c55d-46af-b10e-2c49db6e6e6e None None] Network 2fbb2731-bdc9-499b-a665-09cf5e695354 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:13.535324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.535837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.536222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.536597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.536968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.537337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.537703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.538067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.538432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.538788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.539146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:13.542740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:13.547052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/subnets/bd8923d8-ab7f-4f64-a7c8-853bbb910fcf HTTP/1.1" status: 204 len: 168 time: 0.5721648 Nov 24 14:05:13.547052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46376) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:13.659132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.669347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Deleting port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:13.669671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.780791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] DHCP port deletion for 2fbb2731-bdc9-499b-a665-09cf5e695354 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:05:13.786021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Deleting port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:13.786400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:13.886363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] For port f52a97b4-360f-4ace-a86a-cdf6a04af1c7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,segment=NetworkSegment(ca65b806-1640-461f-ad5d-1b0e83986188),segment_id=ca65b806-1640-461f-ad5d-1b0e83986188)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:13.886740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.017770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Calling delete_port for f52a97b4-360f-4ace-a86a-cdf6a04af1c7 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:14.037024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] For port f52a97b4-360f-4ace-a86a-cdf6a04af1c7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,segment=NetworkSegment(ca65b806-1640-461f-ad5d-1b0e83986188),segment_id=ca65b806-1640-461f-ad5d-1b0e83986188)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:14.037414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.096691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.101118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-106b59f0-0f5c-4de9-b3f1-cd6c47d126a8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:14.143055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Port': ['ID=f52a97b4-360f-4ace-a86a-cdf6a04af1c7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:14.149799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:14.150675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] No DVR routers for this DVR port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:05:14.158890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Calling delete_port for f52a97b4-360f-4ace-a86a-cdf6a04af1c7 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:14.238341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:05:14.238714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:05:14.291288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.321736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2fbb2731-bdc9-499b-a665-09cf5e695354']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:14.334571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca65b806-1640-461f-ad5d-1b0e83986188') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:14.334916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca65b806-1640-461f-ad5d-1b0e83986188') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:14.348223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.365506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.371835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Releasing vlan 890 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:05:14.372321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:05:14.388349 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:05:14.468232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.473170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.475894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36c727c2-9e2d-407d-a5b7-360f3c6bbd21 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:14.505836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Pushing event deleted for resources: {'Network': ['ID=2fbb2731-bdc9-499b-a665-09cf5e695354,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:14.510024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:14.510024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/networks/2fbb2731-bdc9-499b-a665-09cf5e695354 HTTP/1.1" status: 204 len: 168 time: 0.9619126 Nov 24 14:05:14.512360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46380) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:14.556031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1e1ed096-34b1-486e-924f-c01a1256db47 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Synchronizing usage tracker for tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:14.559795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f52a97b4-360f-4ace-a86a-cdf6a04af1c7 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:14.575781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1e1ed096-34b1-486e-924f-c01a1256db47 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Unset dirty status for tenant:451b6f6fc9ce4c9c82a107f7a1f7e84a on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:14.576992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1e1ed096-34b1-486e-924f-c01a1256db47 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "GET /v2.0/ports?device_id=db74c33a-b997-4f7d-9d03-b1f89da740d8 HTTP/1.1" status: 200 len: 205 time: 0.0636816 Nov 24 14:05:14.579700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46386) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:14.594795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f52a97b4-360f-4ace-a86a-cdf6a04af1c7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:14.595202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f52a97b4-360f-4ace-a86a-cdf6a04af1c7 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:14.718058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.739710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Deleting port f52a97b4-360f-4ace-a86a-cdf6a04af1c7 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:14.740212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:14.798860 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:05:14.804035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7a62ab1c-0fb6-4494-bc1d-c2ab867e0665 None None] The port 'f52a97b4-360f-4ace-a86a-cdf6a04af1c7' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:05:14.919501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46390) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:14.999026 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cf006df9-1f8d-4cb5-8b73-1e80690adbc9 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?project_id=8266f75badc14ec9b01ae6b8d8f4370b&network_id=1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 200 len: 3000 time: 0.0782242 Nov 24 14:05:15.222376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.226714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.251874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.252397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Fanout notify agent at l3_agent the message router_deleted on router db74c33a-b997-4f7d-9d03-b1f89da740d8 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:05:15.262598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.263665 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b350c04b-f9df-4cfe-9f4f-35697512cb23 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] 10.222.0.70 "DELETE /v2.0/routers/db74c33a-b997-4f7d-9d03-b1f89da740d8 HTTP/1.1" status: 204 len: 168 time: 0.6829462 Nov 24 14:05:15.555229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46402) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:15.733385 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c6ec5bf5-3cc1-4087-b96e-b9c1e98fd423 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=451b6f6fc9ce4c9c82a107f7a1f7e84a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1768930 Nov 24 14:05:15.735729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46408) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:15.794950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.823955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.972523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.976297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8b09c6b-f562-4eed-a54e-7f42e4ddc8a7 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:15.989346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7aa2203-bc73-49ae-ba43-bae136a7ac38,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:15.992319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:15.994340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:15.995376 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/f7aa2203-bc73-49ae-ba43-bae136a7ac38 HTTP/1.1" status: 204 len: 168 time: 0.2581482 Nov 24 14:05:16.793504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46432) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:16.919070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-af51669c-0a03-461d-9306-192f2b617873 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'default'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:16.919638 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-af51669c-0a03-461d-9306-192f2b617873 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 14:05:16.920602 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-af51669c-0a03-461d-9306-192f2b617873 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1260517 Nov 24 14:05:16.924775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46438) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:16.929726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--1625088265'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:16.936498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:16.940861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:16.943658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:16.949271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:16.958862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:16.972132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.004057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:17.008172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:17.011113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:17.017117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:17.089722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.093325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.098429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09f68e94-8ae9-40fd-965c-c55f610574ed tempest-PortsIpV6TestJSON-32391149 tempest-PortsIpV6TestJSON-32391149-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:17.134713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:17.138749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=089e567d-68c5-4465-bc16-07306e2db9bc,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:17.141373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:17.144137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:17.144926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:17.150753 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:17.209363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.213614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.216813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:17.256020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=db3eb0a9-5701-43cb-8243-f3e0248ed578,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:17.258802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.263049 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.3373594 Nov 24 14:05:17.264001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:17.264411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46444) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:17.271090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'db3eb0a9-5701-43cb-8243-f3e0248ed578', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:17.277637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:17.281401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:17.285299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:17.291216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:17.308379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.371790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.375791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.377809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d0266cff-a98c-42de-b172-2451f671e0a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:17.399142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e9d3e4e-24ea-41ef-b695-43f12027c2a5,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:17.401696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:17.409841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.411176 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1454222 Nov 24 14:05:17.414036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46448) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:17.419739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'db3eb0a9-5701-43cb-8243-f3e0248ed578', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:17.426586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:17.430350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:17.433225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:17.438959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:17.457021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.515720 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): There was a conflict when trying to complete your request. Nov 24 14:05:17.516799 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50b12d61-cf3e-49a0-8069-d901472a5725 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.1017644 Nov 24 14:05:17.520103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46454) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:17.583250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.587586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.611491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.662759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.666604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d50782a8-94db-49bb-b7bd-2331d66a32ac tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:17.680851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=db3eb0a9-5701-43cb-8243-f3e0248ed578,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:17.683787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:17.685700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.687428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/db3eb0a9-5701-43cb-8243-f3e0248ed578 HTTP/1.1" status: 204 len: 168 time: 0.1657689 Nov 24 14:05:17.689641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46458) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:17.744633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd57d73f-0d5e-4e42-9ca9-b308d5012ce8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:17.762814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd57d73f-0d5e-4e42-9ca9-b308d5012ce8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:17.764288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd57d73f-0d5e-4e42-9ca9-b308d5012ce8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0734270 Nov 24 14:05:17.768568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46462) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:17.774108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--615043170'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:17.780706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:17.790913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:17.800872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.835001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:17.838704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:17.841714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:17.848158 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:17.903723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.907078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.910529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:17.948729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a61b2dfa-85fa-42be-b5ad-e0472b388729,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:17.953456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:17.959946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:17.961484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.1918519 Nov 24 14:05:17.964144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46466) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:17.969727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-63668739-cd14-46e5-82f6-62cea8a99783 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'a61b2dfa-85fa-42be-b5ad-e0472b388729', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:17.970419 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-63668739-cd14-46e5-82f6-62cea8a99783 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:17.971361 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-63668739-cd14-46e5-82f6-62cea8a99783 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0060880 Nov 24 14:05:17.973621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46470) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.038807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.065843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.112259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.116244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:18.130138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a61b2dfa-85fa-42be-b5ad-e0472b388729,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:18.133459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:18.139032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.140180 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/a61b2dfa-85fa-42be-b5ad-e0472b388729 HTTP/1.1" status: 204 len: 168 time: 0.1657219 Nov 24 14:05:18.143974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.197768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-833061a8-de5f-44d1-8bc8-b31a5153f116 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0524926 Nov 24 14:05:18.201224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.207269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--109844331'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.213583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:18.217920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:18.221784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:18.227460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:18.237524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.275678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:18.279878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:18.282683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:18.288705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:18.319004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46482) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.347115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.350955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.356332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:18.384895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1f352bc-7b42-4b48-a1f0-6656a4b5f1fe tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:18.386339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f1f352bc-7b42-4b48-a1f0-6656a4b5f1fe tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 814 time: 0.0663440 Nov 24 14:05:18.398347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=212c5905-c343-46dd-9897-ba082946302d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:18.401072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:18.401884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.403050 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.2009187 Nov 24 14:05:18.406079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46488) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.412279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2f81fa58-a0b5-42cd-92ae-26a3ed403732 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': '212c5905-c343-46dd-9897-ba082946302d', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.412886 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-2f81fa58-a0b5-42cd-92ae-26a3ed403732 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:18.413792 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2f81fa58-a0b5-42cd-92ae-26a3ed403732 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0065804 Nov 24 14:05:18.416249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46492) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.478137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.505343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.550021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.554327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-375078f3-c811-417e-86a5-e3810ae30acc tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:18.570293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=212c5905-c343-46dd-9897-ba082946302d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:18.573919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:18.577179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.579693 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/212c5905-c343-46dd-9897-ba082946302d HTTP/1.1" status: 204 len: 168 time: 0.1625347 Nov 24 14:05:18.581155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46498) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.632271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5f8a4bd3-fb33-4e16-826f-87d1135d6836 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:18.647023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5f8a4bd3-fb33-4e16-826f-87d1135d6836 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:18.648237 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5f8a4bd3-fb33-4e16-826f-87d1135d6836 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0664840 Nov 24 14:05:18.652023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46502) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.657995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--1758364094'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.664519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:18.674489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:18.684230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.724251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:18.727529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:18.730774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:18.737207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:18.793011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.796695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.801499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ee0c55d-b65c-48bc-adc4-f5b6d4ddfe25 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:18.841502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ae13c8f7-0e2a-49a8-9122-d1f526462c84,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:18.844584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:18.848296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.849471 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.1965442 Nov 24 14:05:18.852350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46506) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.857697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a6941edb-bdb0-49f2-972c-c860f38e060a tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'ae13c8f7-0e2a-49a8-9122-d1f526462c84', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.858380 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-a6941edb-bdb0-49f2-972c-c860f38e060a tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:18.859286 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a6941edb-bdb0-49f2-972c-c860f38e060a tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0060773 Nov 24 14:05:18.862411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46510) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.867402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d5982e29-8e7b-4437-899f-e605bf84a5d8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'ae13c8f7-0e2a-49a8-9122-d1f526462c84', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.868052 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-d5982e29-8e7b-4437-899f-e605bf84a5d8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:18.868931 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d5982e29-8e7b-4437-899f-e605bf84a5d8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0056219 Nov 24 14:05:18.871481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46514) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.877518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-13b5c991-59b2-4a5d-9e74-f71e8d695e9c tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'ae13c8f7-0e2a-49a8-9122-d1f526462c84', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.878116 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-13b5c991-59b2-4a5d-9e74-f71e8d695e9c tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:18.878994 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-13b5c991-59b2-4a5d-9e74-f71e8d695e9c tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0065742 Nov 24 14:05:18.881212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46518) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.885893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-48091a5d-583f-433c-9413-41b48f329a41 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'ae13c8f7-0e2a-49a8-9122-d1f526462c84', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:18.886509 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-48091a5d-583f-433c-9413-41b48f329a41 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:18.887383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48091a5d-583f-433c-9413-41b48f329a41 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0053422 Nov 24 14:05:18.889569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46522) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:18.951953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:18.979587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.027486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.031119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d75df548-ceb7-484e-b977-d450666e8443 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:19.046636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae13c8f7-0e2a-49a8-9122-d1f526462c84,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:19.050824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:19.053991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.055070 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/ae13c8f7-0e2a-49a8-9122-d1f526462c84 HTTP/1.1" status: 204 len: 168 time: 0.1646984 Nov 24 14:05:19.057795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46526) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.109394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0475e637-c209-493a-a27b-8766a26292ba tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:19.125037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0475e637-c209-493a-a27b-8766a26292ba tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:19.126282 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0475e637-c209-493a-a27b-8766a26292ba tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0675979 Nov 24 14:05:19.130490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46530) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.136173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--1730741667'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.142415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.152555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.163602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.198357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.202243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:19.205557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:19.211333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.266102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.270253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.273913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7739dd67-b0b4-40c4-8ffe-d54837aa773d tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:19.311795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f9453bba-51b4-430e-aab5-f58073c50230,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:19.315368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:19.322787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.324117 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.1926167 Nov 24 14:05:19.326716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46534) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.333029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-979089de-2f80-4ed9-b1af-9b1deee8fb03 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.333648 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-979089de-2f80-4ed9-b1af-9b1deee8fb03 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.334537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-979089de-2f80-4ed9-b1af-9b1deee8fb03 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0069418 Nov 24 14:05:19.336826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46538) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.342313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.350178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.353931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:19.356772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:19.362556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.394057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.395097 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d52960b7-6a87-43ec-83ab-0919232167bf tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0573614 Nov 24 14:05:19.398228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46542) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.404668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b5ce60c6-e0e1-42e7-860f-b029db75d306 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.405279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-b5ce60c6-e0e1-42e7-860f-b029db75d306 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.406199 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b5ce60c6-e0e1-42e7-860f-b029db75d306 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0069773 Nov 24 14:05:19.409226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46546) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.415436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.421476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.425590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:19.428480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:19.434128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.464029 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.465302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a0fac2f1-d1ce-4310-ba73-be9117da45f7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0551209 Nov 24 14:05:19.468323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46550) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.473324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46554) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.473598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-542d0bc2-13ce-413c-903a-40630b57e64e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.474171 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-542d0bc2-13ce-413c-903a-40630b57e64e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.475060 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-542d0bc2-13ce-413c-903a-40630b57e64e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0058708 Nov 24 14:05:19.477518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.478975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--394510719', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.482405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.489040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.489242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.493640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:19.496650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:19.499295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.503294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.509576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:05:19.512500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.532009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.533544 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2d198b7f-7e9b-4048-af54-1d47c86f8800 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0546720 Nov 24 14:05:19.536325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46562) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.543820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-24fb740c-9643-4df2-8667-7626b6885d5a tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.544358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-24fb740c-9643-4df2-8667-7626b6885d5a tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.545255 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-24fb740c-9643-4df2-8667-7626b6885d5a tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0080273 Nov 24 14:05:19.547729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46566) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.550829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 893} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:05:19.555748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.565087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.570633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:19.573334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.573666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment e6ec3314-6d92-4962-91c2-c2ca383adb52 of type vlan for network 418d8eb8-2526-4583-ab4d-5243e4cf0892 Nov 24 14:05:19.574769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:19.584602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.612276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.644308 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.645307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a7e3008c-ebb2-4ae9-a951-acd82abcd5cb tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.0965440 Nov 24 14:05:19.648328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46570) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.655103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'f9453bba-51b4-430e-aab5-f58073c50230', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:19.660879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.664402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:19.664962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.670367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:19.672411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c0d8238-77c2-4165-a77c-07a45a4d5393 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:19.694234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:19.700691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:19.715723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:19.791011 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3166206 Nov 24 14:05:19.794614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46574) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.794789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=418d8eb8-2526-4583-ab4d-5243e4cf0892,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:19.801833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:19.806754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:05:19.821727 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:19.825491 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-465bd45c-e5e5-486c-93b6-f5fdbffd9329 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.1735280 Nov 24 14:05:19.825661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46578) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.867333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0274bcb-ce47-4c89-914f-de450cb1537f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:19.868874 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b0274bcb-ce47-4c89-914f-de450cb1537f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.0732028 Nov 24 14:05:19.872169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:19.894518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.921716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.968216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:19.973847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-03338d9c-2f6f-4673-9b6b-3060792a1448 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:19.992109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9453bba-51b4-430e-aab5-f58073c50230,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:19.996013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:20.004738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.008393 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/f9453bba-51b4-430e-aab5-f58073c50230 HTTP/1.1" status: 204 len: 168 time: 0.1795053 Nov 24 14:05:20.008703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46586) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.011863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f767139-1146-4f23-8a77-8f2e600250ba tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:20.013309 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4f767139-1146-4f23-8a77-8f2e600250ba tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1401069 Nov 24 14:05:20.016064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46590) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.059055 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4127f206-6b21-406c-aabb-dd2ad7162d39 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0386145 Nov 24 14:05:20.059255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46594) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.063879 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-63b82200-19b9-4dd9-97dd-fb152b112f85 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0538495 Nov 24 14:05:20.070154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.075465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--640966715'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:20.081846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:20.085927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:20.089720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:20.096369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:20.100892 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4d41de62-5c22-4dc1-86e8-dd5142d472e6 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0404975 Nov 24 14:05:20.103627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46602) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.123879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.235204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:20.250897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:20.255478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:20.268342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:20.281449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74f3126d-8c29-4acb-83d7-c9eab2f9c88b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:20.284202 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-74f3126d-8c29-4acb-83d7-c9eab2f9c88b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1788690 Nov 24 14:05:20.286826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46606) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.330939 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-632f5614-bebd-4514-8a46-fa58d54507fa tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0426342 Nov 24 14:05:20.333707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46610) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.333960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.337951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.340178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-480948327', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:20.342341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b214163c-637b-454c-96e1-3f9d90861743 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:20.384150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=79d237db-1d0d-4871-b315-8af9a7682e92,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:20.387698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:20.388630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.389948 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.3187747 Nov 24 14:05:20.394002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46614) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.399861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': '79d237db-1d0d-4871-b315-8af9a7682e92', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:20.405918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:20.410417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:20.413298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:20.418948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:20.451621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:20.458572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:20.461937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:20.462495 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The resource could not be found. Nov 24 14:05:20.466371 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c5ff9b3b-a140-4e08-8c55-429265d3cf13 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.0685716 Nov 24 14:05:20.466706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.470630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:20.472313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': '79d237db-1d0d-4871-b315-8af9a7682e92', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'a0de95a0-1598-470a-905f-ec8221902c86'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:20.478373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:20.480466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:05:20.482405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:20.485321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:20.492637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:20.529108 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The resource could not be found. Nov 24 14:05:20.530135 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-581983b5-04bc-442e-9a27-d19d5c79c25f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0625324 Nov 24 14:05:20.532890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46622) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.586234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.597607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.625467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.672038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.677734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ea51cbb6-a8d7-4d71-9b26-2479fa82f168 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:20.693960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=79d237db-1d0d-4871-b315-8af9a7682e92,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:20.698369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:20.700713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.702006 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/79d237db-1d0d-4871-b315-8af9a7682e92 HTTP/1.1" status: 204 len: 168 time: 0.1679776 Nov 24 14:05:20.707188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46626) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.912256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-726f20b3-8488-4aad-bf2c-b1a57b2b52d9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:20.952046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-726f20b3-8488-4aad-bf2c-b1a57b2b52d9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:20.953251 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-726f20b3-8488-4aad-bf2c-b1a57b2b52d9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.2449632 Nov 24 14:05:20.958008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46630) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:20.963852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': 'af83b9e1-6214-4b4b-84a0-f3c3f5901b03', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:20.969801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:20.974361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:20.975240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:20.977926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:20.978752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-663e2ffd-fdf2-40a4-af7e-259486ae95fd tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:20.983703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.026951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The resource could not be found. Nov 24 14:05:21.028018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-48ecc671-79cd-4a9c-8e35-3a799ced64c8 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0690255 Nov 24 14:05:21.031584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46634) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.037881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--192879997'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:21.043662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.053636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=8afe716c-0204-4fc4-888c-9768ce795406,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:21.053936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.058008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:21.065840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.068950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:05:21.069309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: 418d8eb8-2526-4583-ab4d-5243e4cf0892, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:05:21.092337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:05:21.102987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 418d8eb8-2526-4583-ab4d-5243e4cf0892) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:21.104488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.107617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:21.107823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:21.108532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.110660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:21.116430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.116996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbfafef9-c5ca-4ef7-9632-a66040df2216 None None] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:21.133664 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.7989130 Nov 24 14:05:21.177962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.183267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.215800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dfdb2945-18ed-4128-851f-fb467c733365 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:21.230502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.231844 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1577 time: 0.1992805 Nov 24 14:05:21.234452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46640) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.247530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--1006335440'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:21.255017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.259195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:21.262159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:21.268471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.282005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7a120ada-5bb8-48f2-95a5-fc0508b5822b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:21.285927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:21.287514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.330090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.335389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:21.338397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:21.346382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.392019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-418d8eb8-2526-4583-ab4d-5243e4cf0892', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': '8afe716c-0204-4fc4-888c-9768ce795406'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:05:21.393240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.406893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.410872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.416749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-27182248-18be-48a7-9428-225e7e9d2813 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:21.463229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4ac29c7-76aa-49de-bf2d-40b7452a63fa,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:21.466364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:21.468101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.472166 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.2340109 Nov 24 14:05:21.472544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46644) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.481601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group_rule': {'security_group_id': '7a120ada-5bb8-48f2-95a5-fc0508b5822b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': 'b4ac29c7-76aa-49de-bf2d-40b7452a63fa'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:21.488318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.492524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:21.495490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:21.502028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.557804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Allocated IP 172.20.0.18 (418d8eb8-2526-4583-ab4d-5243e4cf0892/8afe716c-0204-4fc4-888c-9768ce795406/8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:05:21.631618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46648) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.634732 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:05:21.638735 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-403f14a5-e840-4927-9097-69a8c2cca0b4 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 360 time: 0.1595199 Nov 24 14:05:21.638912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1489831016', 'description': 'tempest-secgroup-smoke-1489831016 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:21.639131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46652) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.644697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.654655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.666767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.705414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.710023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.710255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:21.713043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:21.719331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.740139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.789308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.793450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.795409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.799626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1be7c625-d145-446c-b7a7-06c27280b5a3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:21.800474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.801961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Transition to ACTIVE for port object 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:21.805802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5f737cd7-10c2-4339-8982-48d299c12471 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:21.815509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4ac29c7-76aa-49de-bf2d-40b7452a63fa,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:21.819530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:21.821075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Transition to ACTIVE for port object 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:21.823381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.824493 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/b4ac29c7-76aa-49de-bf2d-40b7452a63fa HTTP/1.1" status: 204 len: 168 time: 0.1843402 Nov 24 14:05:21.827571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46656) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.841933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.848096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=10c5c56e-15eb-465b-a695-07a890e29a1b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:21.851385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:21.856259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:21.861809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.863623 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e243dc7b-c1f8-4f74-9980-83cb39276de2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2307072 Nov 24 14:05:21.866271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46660) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:21.874217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '10c5c56e-15eb-465b-a695-07a890e29a1b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:21.891449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:21.900040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:21.908894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:21.909970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:14. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:21.913282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:21.919150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 14; quota limit: 100; headroom:86 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:21.924739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:05:21.927786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2f598808-6a62-44cb-a1c3-52ca7828e33f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:21.930960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Pushing event updated for resources: {'Port': ['ID=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:21.934511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:21.948420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:21.958336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2f598808-6a62-44cb-a1c3-52ca7828e33f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:21.959610 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2f598808-6a62-44cb-a1c3-52ca7828e33f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4006 time: 0.1309066 Nov 24 14:05:21.962651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46664) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.020012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Attempting to bind port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:05:22.020394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Attempting to bind port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:05:22.020772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Attempting to bind port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 on network 418d8eb8-2526-4583-ab4d-5243e4cf0892 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:05:22.027105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 5, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:05:22.027490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Checking segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:05:22.027927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.028326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Bound using segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:05:22.028796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Bound port: 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:05:22.029175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.058684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.064532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.066513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f81a0e39-bc93-4933-92ad-ed06ec94900b tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.072265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.101603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c2afec71-efd9-4540-b38a-41a932361e94,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.106220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.117382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] For port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:05:22.120589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] For port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:05:22.121981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.124912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.129226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2066d42a-f254-471b-b06a-e98e7bb5e305 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.130576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.131733 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2644863 Nov 24 14:05:22.135461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46668) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.141902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '10c5c56e-15eb-465b-a695-07a890e29a1b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:22.149880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:22.153757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:22.156710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:15. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:22.163327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 15; quota limit: 100; headroom:85 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:22.176102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.186211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.192081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6f6f6840-9827-4929-8c1a-26545aa57bc3 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.208850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a120ada-5bb8-48f2-95a5-fc0508b5822b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.212087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.216215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Pushing event updated for resources: {'Port': ['ID=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.217783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.219649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.224095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/7a120ada-5bb8-48f2-95a5-fc0508b5822b HTTP/1.1" status: 204 len: 168 time: 0.2603004 Nov 24 14:05:22.225671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46672) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.288909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.293906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.295180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6e7e1971-5ca5-48bf-9e9c-48ef63e3beee tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:22.313019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.315478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6e7e1971-5ca5-48bf-9e9c-48ef63e3beee tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:22.320428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6e7e1971-5ca5-48bf-9e9c-48ef63e3beee tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.0898507 Nov 24 14:05:22.320830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46676) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.334194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'tempest-secgroup--1153102037'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:22.343851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:22.348237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e30d6aa0-10a1-4c4d-843e-45c914aa81bc,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.350750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.353405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.354914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.2179403 Nov 24 14:05:22.357429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46680) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.363133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:22.364425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '10c5c56e-15eb-465b-a695-07a890e29a1b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:22.372331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:22.374727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.377184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:22.380443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:16. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:22.386688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 16; quota limit: 100; headroom:84 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:22.413068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.416066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:22.434414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Usage tracker for resource:security_group_rule and tenant:ec035605f8a6472e9537071d70490aa0 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:22.437877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:22.451945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:22.512024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.518414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.527695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b37bf488-62ef-48e6-b666-76ca3b681f98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.533726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.538261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.542329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2e00504c-2d10-4cad-b7ea-083c069be45d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.573687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d6dc5b18-ed7b-431c-893b-a90f54aadac8,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.581208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.583211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aac6091c-2927-4175-bb12-66e656712aa3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.586317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.587130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.591364 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2296629 Nov 24 14:05:22.591982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46684) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.602267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '10c5c56e-15eb-465b-a695-07a890e29a1b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:22.616131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.617354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1578 time: 0.2934244 Nov 24 14:05:22.618424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:22.620890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46688) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.629457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6f7f10a2-1d58-4b13-8a31-99bea7f49d8c tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Request body: {'security_group': {'name': 'default'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:22.630099 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-6f7f10a2-1d58-4b13-8a31-99bea7f49d8c tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] update failed (client error): There was a conflict when trying to complete your request. Nov 24 14:05:22.631326 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6f7f10a2-1d58-4b13-8a31-99bea7f49d8c tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "PUT /v2.0/security-groups/aac6091c-2927-4175-bb12-66e656712aa3 HTTP/1.1" status: 409 len: 330 time: 0.0093908 Nov 24 14:05:22.632510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:22.634069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46692) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.637092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:22.638439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:22.645778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:22.666489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.701240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.722143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:22.730027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.741231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.745769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.748041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-46690c57-91df-40a9-92de-5e9d41f72fc3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.770421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64e4541a-859f-4c84-ac6e-23db309bcf9b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.772942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.783532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.784492 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1917918 Nov 24 14:05:22.787363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46696) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.793140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '10c5c56e-15eb-465b-a695-07a890e29a1b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:22.800134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.803933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:22.806990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3b48870e-8363-47f8-a019-670ad9a73bc6 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:22.820769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:22.825920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:18. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:22.828829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aac6091c-2927-4175-bb12-66e656712aa3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:22.836590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:22.838422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 18; quota limit: 100; headroom:82 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:22.844163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.845507 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/aac6091c-2927-4175-bb12-66e656712aa3 HTTP/1.1" status: 204 len: 168 time: 0.2101953 Nov 24 14:05:22.848225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46700) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.866464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:05:22.878408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.937974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c066e370-44ee-4e7b-8b2a-dd426f705296 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Synchronizing usage tracker for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:22.964179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c066e370-44ee-4e7b-8b2a-dd426f705296 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Unset dirty status for tenant:ec035605f8a6472e9537071d70490aa0 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:22.965838 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c066e370-44ee-4e7b-8b2a-dd426f705296 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 2647 time: 0.1165910 Nov 24 14:05:22.969549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46704) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:22.997243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:22.998821 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-ed0925b8-17ab-4d98-a728-7621439e2abe tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] delete failed (client error): The resource could not be found. Nov 24 14:05:23.000009 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ed0925b8-17ab-4d98-a728-7621439e2abe tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "DELETE /v2.0/security-groups/e78bf0e1-573a-4059-aa63-5923ecf12fdd HTTP/1.1" status: 404 len: 347 time: 0.0292661 Nov 24 14:05:23.002064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.005345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46708) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:23.008299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec6fbc88-be22-4d00-bbbe-df924f141240 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:23.027415 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-adbd9365-2521-4201-aec4-a7f7089ac6de tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] show failed (client error): The resource could not be found. Nov 24 14:05:23.027910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=598d92cb-4632-4992-b611-dacc4e08fd33,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:23.029056 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-adbd9365-2521-4201-aec4-a7f7089ac6de tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-groups/cb567d26-2dd9-46f1-9f8a-d5dc4c10ebe7 HTTP/1.1" status: 404 len: 347 time: 0.0226586 Nov 24 14:05:23.030421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:23.033906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46712) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:23.041615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.043094 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.2542162 Nov 24 14:05:23.045994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46716) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:23.058538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '10c5c56e-15eb-465b-a695-07a890e29a1b', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:23.067633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:23.070114 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-81718168-0cb7-4dff-8477-828dc844cdb9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] show failed (client error): The resource could not be found. Nov 24 14:05:23.071122 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-81718168-0cb7-4dff-8477-828dc844cdb9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] 10.222.0.70 "GET /v2.0/security-group-rules/f75bb09f-af20-45a9-8c60-62fb885284e4 HTTP/1.1" status: 404 len: 356 time: 0.0360088 Nov 24 14:05:23.074502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:23.078015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:23.084500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:23.097975 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:05:23.105132 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.203448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.209704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.212306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-429c1e9a-f47b-408c-b074-888257389b7d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:23.247721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64abe9d3-fe8b-4613-b9b5-455de22b12b8,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:23.256215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:23.273120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.280596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.2222033 Nov 24 14:05:23.405863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d4be522-ce0b-46ec-9ebd-64228f2e3ea5 None None] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:23.495274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46730) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:23.603102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-a63b38d1-7805-4d92-8cbb-301b82edd105 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:23.621956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-a63b38d1-7805-4d92-8cbb-301b82edd105 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:23.623394 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-a63b38d1-7805-4d92-8cbb-301b82edd105 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1489831016&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0730393 Nov 24 14:05:23.634549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Provisioning for port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:23.647470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Provisioning complete for port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:23.647958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.808708 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ccbc76f0-3b6f-4358-84ed-48d4dcf6648d admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ec035605f8a6472e9537071d70490aa0&name=default HTTP/1.1" status: 200 len: 2647 time: 0.3117883 Nov 24 14:05:23.811577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46738) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:23.820001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-66729ae1-299c-4329-bcd4-e6ff10f38bb6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:23.820690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-66729ae1-299c-4329-bcd4-e6ff10f38bb6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:23.822752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.838566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-66729ae1-299c-4329-bcd4-e6ff10f38bb6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:23.840006 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-66729ae1-299c-4329-bcd4-e6ff10f38bb6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=418d8eb8-2526-4583-ab4d-5243e4cf0892 HTTP/1.1" status: 200 len: 796 time: 0.2093828 Nov 24 14:05:23.856956 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-b4839c38-a4e6-4a44-a329-4fb485b76160 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0110567 Nov 24 14:05:23.862388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] For port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:23.869518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.872249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:23.905166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.937959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:23.943076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Pushing event updated for resources: {'Port': ['ID=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:23.954071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:23.966712 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-f4453b5b-4262-4957-a17b-8de746aab159 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1028352 Nov 24 14:05:23.999087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:24.006016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ee0288e-51dc-4c10-b497-642b1fd463a0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:24.026007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=089e567d-68c5-4465-bc16-07306e2db9bc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:24.028815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:24.036230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:24.040822 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/089e567d-68c5-4465-bc16-07306e2db9bc HTTP/1.1" status: 204 len: 168 time: 0.2279272 Nov 24 14:05:24.091920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-76bb0877-6ab5-4832-b3d5-5b698e972d5a None None] Provisioning complete for port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:24.092381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-76bb0877-6ab5-4832-b3d5-5b698e972d5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:24.138139 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-021d7864-7e61-49ab-ba5b-1bf698fd6041 service neutron] 10.222.0.70 "GET /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1585288 Nov 24 14:05:24.303261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-f2511b07-6582-4c8e-b3bd-88ccf65e0f10 service neutron] 10.222.0.70 "GET /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1573992 Nov 24 14:05:24.495191 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a5d275b4-ca5f-4522-b5e0-68b52acaaa21 req-83d28436-96e1-4a36-8dd3-f1ea34abdd28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 210 time: 0.0430932 Nov 24 14:05:24.565404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:24.640085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:24.640462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:25.518065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-d5a4356a-e1fd-4473-a974-d2e6280a5f88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:25.519467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-d5a4356a-e1fd-4473-a974-d2e6280a5f88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=418d8eb8-2526-4583-ab4d-5243e4cf0892 HTTP/1.1" status: 200 len: 796 time: 0.1459901 Nov 24 14:05:25.585465 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-98069d34-fbd0-48bd-8c53-09836c181f3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 473 time: 0.0529907 Nov 24 14:05:25.594447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['10c5c56e-15eb-465b-a695-07a890e29a1b']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:25.718018 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f697e646-922b-4efc-9b22-2cff8d8bd8b6 req-c66594e2-4670-4c5a-95c4-8bda7f40b7c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 210 time: 0.0534160 Nov 24 14:05:25.769258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:25.773779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:port and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:25.776652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for port was recalculated. Used quota:5. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:25.783518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:25.792940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:05:25.796166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.045766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.23 (418d8eb8-2526-4583-ab4d-5243e4cf0892/8afe716c-0204-4fc4-888c-9768ce795406/26914a6c-6e8c-4919-bbaf-40d9f35826b3) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:05:26.229765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.248444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 26914a6c-6e8c-4919-bbaf-40d9f35826b3 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:26.270137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.275450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3ae19b77-ff36-4c3c-93b9-fc0a1c74ea94 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:26.346849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:26.350336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:26.354593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:05:26.384748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=26914a6c-6e8c-4919-bbaf-40d9f35826b3,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:26.392249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:26.420610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:26.421210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.446784 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8559272 Nov 24 14:05:26.461113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Request body: {'port': {'device_id': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:05:26.557665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-901461ec-ec3e-47ca-8ef7-5fc7a764aab1 None None] Provisioning for port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:26.562292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-901461ec-ec3e-47ca-8ef7-5fc7a764aab1 None None] Provisioning complete for port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:26.562597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-901461ec-ec3e-47ca-8ef7-5fc7a764aab1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.575470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.615362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-901461ec-ec3e-47ca-8ef7-5fc7a764aab1 None None] Port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:26.935631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 26914a6c-6e8c-4919-bbaf-40d9f35826b3 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:05:26.943132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.958053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Transition to ACTIVE for port object 26914a6c-6e8c-4919-bbaf-40d9f35826b3 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:26.962278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:26.967716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-533c017d-3b22-469d-acf2-9d4bf0362109 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:27.105752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Pushing event updated for resources: {'Port': ['ID=26914a6c-6e8c-4919-bbaf-40d9f35826b3,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:27.108547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:27.143459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff741ec-6946-4002-ac3c-12f517c9f491 req-d76c1e86-5dd8-452c-8bfa-7ef8071a5833 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:27.145222 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eff741ec-6946-4002-ac3c-12f517c9f491 req-d76c1e86-5dd8-452c-8bfa-7ef8071a5833 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 944 time: 0.3048964 Nov 24 14:05:27.198981 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eff741ec-6946-4002-ac3c-12f517c9f491 req-61ea145b-8b6f-485a-8717-6adbf5463d53 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462592 Nov 24 14:05:27.228550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Attempting to bind port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:05:27.229119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Attempting to bind port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:05:27.229518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Attempting to bind port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 on network 418d8eb8-2526-4583-ab4d-5243e4cf0892 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:05:27.240759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 on network 418d8eb8-2526-4583-ab4d-5243e4cf0892 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:05:27.241082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Attempting to bind port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 on network 418d8eb8-2526-4583-ab4d-5243e4cf0892 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:05:27.247884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 5, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:05:27.248212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Checking segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:05:27.248631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Bound using segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:05:27.248991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Bound port: 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:05:27.249330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:27.341224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] For port 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:05:27.344532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] For port 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:05:27.349327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:27.353657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dfcc55d0-050f-4ecb-86c8-d1a734d09601 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:27.405550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:27.407083 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] 10.222.0.47 "PUT /v2.0/ports/26914a6c-6e8c-4919-bbaf-40d9f35826b3 HTTP/1.1" status: 200 len: 1094 time: 0.9502816 Nov 24 14:05:27.410055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'tag': '26914a6c-6e8c-4919-bbaf-40d9f35826b3'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:05:27.442525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Pushing event updated for resources: {'Port': ['ID=26914a6c-6e8c-4919-bbaf-40d9f35826b3,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:27.446785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:27.483604 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'tag': '26914a6c-6e8c-4919-bbaf-40d9f35826b3', 'status': 'completed', 'code': 200} Nov 24 14:05:27.525508 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-05d1068f-7000-4cc3-b81e-031b07b75ac3 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 1097 time: 0.0799274 Nov 24 14:05:27.602347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-268e2377-05ab-45e8-80f4-b4b751da145f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.23&port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3 HTTP/1.1" status: 200 len: 217 time: 0.0675969 Nov 24 14:05:27.671328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-c3e86592-0b1a-4d67-9c66-6502315b13b6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:27.672728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-c3e86592-0b1a-4d67-9c66-6502315b13b6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=8afe716c-0204-4fc4-888c-9768ce795406 HTTP/1.1" status: 200 len: 837 time: 0.0604627 Nov 24 14:05:27.748864 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-f72321e8-e4d2-4c9c-aead-c84bb0a9108e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=418d8eb8-2526-4583-ab4d-5243e4cf0892&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0695491 Nov 24 14:05:28.015245 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-f1e7c93a-4d30-4d5e-8040-fc20ce3543c2 service neutron] 10.222.0.47 "GET /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2592540 Nov 24 14:05:28.129254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-59e9f311-4d45-499c-a6a7-628b217001d9 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1740575 Nov 24 14:05:28.162616 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03c36b51-8932-40d1-894a-6afb2a1235e8 req-be6c963d-fef5-4a81-b0c0-5d2bd52bd440 service neutron] 10.222.0.47 "GET /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1409638 Nov 24 14:05:28.351881 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-6502ffd1-8688-42c6-be86-844618cc4238 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1098 time: 0.1376441 Nov 24 14:05:28.354518 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-863cd851-9121-4610-802b-a5717c48ecbc service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 1097 time: 0.1096506 Nov 24 14:05:28.408644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61b5fce-2f66-4762-9932-1182e94cfcfa req-3f34037b-2a04-4db9-a491-7c0d4267daa2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:28.409875 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d61b5fce-2f66-4762-9932-1182e94cfcfa req-3f34037b-2a04-4db9-a491-7c0d4267daa2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 944 time: 0.0786026 Nov 24 14:05:28.455697 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d61b5fce-2f66-4762-9932-1182e94cfcfa req-17cb0152-e488-467c-b4f3-cfd2b3e3a3cd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398843 Nov 24 14:05:28.599576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-05e2f9aa-8dcd-482e-ad97-59d0a271ad52 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:28.601057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-05e2f9aa-8dcd-482e-ad97-59d0a271ad52 service neutron] 10.222.0.47 "GET /v2.0/networks?id=418d8eb8-2526-4583-ab4d-5243e4cf0892 HTTP/1.1" status: 200 len: 897 time: 0.2374439 Nov 24 14:05:28.602001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-2017321a-65bc-4c54-84f6-6ca66d87b46c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:28.603334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-2017321a-65bc-4c54-84f6-6ca66d87b46c service neutron] 10.222.0.47 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 898 time: 0.2190311 Nov 24 14:05:28.737429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-2dac6787-a927-41bb-a6f9-b4e1ab24d970 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.23&port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3 HTTP/1.1" status: 200 len: 217 time: 0.1230910 Nov 24 14:05:28.814218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-e15750be-d89a-4afe-a24b-d1f34be77679 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 1000 time: 0.1988184 Nov 24 14:05:28.821100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-f0fad1a6-a345-447a-8125-c830c1ab6d8f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:28.822406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-f0fad1a6-a345-447a-8125-c830c1ab6d8f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=8afe716c-0204-4fc4-888c-9768ce795406 HTTP/1.1" status: 200 len: 837 time: 0.0773344 Nov 24 14:05:28.922735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-61df306a-55b6-4507-ba97-b2bdce12fcb4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:28.924794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-61df306a-55b6-4507-ba97-b2bdce12fcb4 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 200 len: 835 time: 0.1015613 Nov 24 14:05:28.983199 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-1f43edc6-0215-4344-bb54-24c29ff43088 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=418d8eb8-2526-4583-ab4d-5243e4cf0892&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1299090 Nov 24 14:05:29.095415 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-988284ee-4b98-465d-b04e-5669cd4aebeb service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1625574 Nov 24 14:05:29.199813 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-270927c2-5e23-440e-bf59-2fc27a48b3c9 service neutron] 10.222.0.47 "GET /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2094374 Nov 24 14:05:29.442806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-281bd3c1-94bb-4b16-8f83-c07969fbcdef service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3338251 Nov 24 14:05:29.554751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-0b8a4823-b87b-433d-8717-f81c0df14599 service neutron] 10.222.0.47 "GET /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3417358 Nov 24 14:05:29.608792 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2209f9e1-dce0-4cb6-a5ab-cda8646ba0ea req-7494fa9b-38c6-45d6-a086-5aefc80b24dd service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1593404 Nov 24 14:05:29.747415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ad8a3b-41d6-481a-b6a2-93b7a0f1af3a req-21ff90f7-f165-4da1-b36f-4807453392ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:29.748048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-40ad8a3b-41d6-481a-b6a2-93b7a0f1af3a req-21ff90f7-f165-4da1-b36f-4807453392ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:29.763783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-40ad8a3b-41d6-481a-b6a2-93b7a0f1af3a req-21ff90f7-f165-4da1-b36f-4807453392ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:29.764906 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ad8a3b-41d6-481a-b6a2-93b7a0f1af3a req-21ff90f7-f165-4da1-b36f-4807453392ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 944 time: 0.1822183 Nov 24 14:05:29.809907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ad8a3b-41d6-481a-b6a2-93b7a0f1af3a req-ef61c3bc-1bb2-4f47-9204-dc9c8631c1ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394692 Nov 24 14:05:30.570273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 26914a6c-6e8c-4919-bbaf-40d9f35826b3 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:05:30.705508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:30.719169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '26914a6c-6e8c-4919-bbaf-40d9f35826b3', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'port_id': '26914a6c-6e8c-4919-bbaf-40d9f35826b3', 'mac_address': 'fa:16:3e:7c:b7:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 893, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8afe716c-0204-4fc4-888c-9768ce795406', 'ip_address': '172.20.0.23'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:05:30.780644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:30.798407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 26914a6c-6e8c-4919-bbaf-40d9f35826b3 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:05:30.813984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:30.818954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:30.820844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-36e94d97-555f-4222-b5ad-38f40284846f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:30.888539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=26914a6c-6e8c-4919-bbaf-40d9f35826b3,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:30.891585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:31.016234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3791ec5b-c7f9-4605-a68a-62600f7f7a34 req-1fc920a9-0726-40de-919f-e03027b8322b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:31.017722 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3791ec5b-c7f9-4605-a68a-62600f7f7a34 req-1fc920a9-0726-40de-919f-e03027b8322b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 945 time: 0.0823915 Nov 24 14:05:31.064213 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3791ec5b-c7f9-4605-a68a-62600f7f7a34 req-65c44b0a-8703-431f-b78d-ced103b9d2be tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403178 Nov 24 14:05:31.193305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['26914a6c-6e8c-4919-bbaf-40d9f35826b3'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:05:32.258469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b637a2ba-54c3-4b0c-a9fb-4d4598b08fa6 req-f17626ef-7083-4613-b45a-a1ad97d5d100 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:32.259965 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b637a2ba-54c3-4b0c-a9fb-4d4598b08fa6 req-f17626ef-7083-4613-b45a-a1ad97d5d100 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 945 time: 0.0770113 Nov 24 14:05:32.309787 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b637a2ba-54c3-4b0c-a9fb-4d4598b08fa6 req-ee2d82b8-e171-42ec-a4b7-2f551aa5c353 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442584 Nov 24 14:05:32.579218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 26914a6c-6e8c-4919-bbaf-40d9f35826b3 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:32.652994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:32.657958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:32.658361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:32.769870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:32.804327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26914a6c-6e8c-4919-bbaf-40d9f35826b3'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:05:32.817432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:32.822677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:32.825720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:32.870370 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '26914a6c-6e8c-4919-bbaf-40d9f35826b3', 'code': 200} Nov 24 14:05:32.896031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=26914a6c-6e8c-4919-bbaf-40d9f35826b3,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:32.898909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:33.112752 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1ae0d71d-6358-48f9-b03d-e63d297ed421 req-d7d6f01a-51ab-4633-bdf8-528b84212f93 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 1099 time: 0.0842340 Nov 24 14:05:33.148346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-034f3493-36d8-489c-b0f1-a661b42a6683 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:33.159019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1ae0d71d-6358-48f9-b03d-e63d297ed421 req-e86349d5-8028-4d1b-9ff7-40baf1821304 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409131 Nov 24 14:05:33.491714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46780) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:33.504962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a25b7b-4b5d-45ae-8f4b-09ba314e2629 req-197c2912-3b4b-4f5b-82bd-bb6c3c1605b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:33.506514 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79a25b7b-4b5d-45ae-8f4b-09ba314e2629 req-197c2912-3b4b-4f5b-82bd-bb6c3c1605b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 946 time: 0.0769472 Nov 24 14:05:33.538265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:33.555280 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79a25b7b-4b5d-45ae-8f4b-09ba314e2629 req-e54d6a4b-2caf-4ace-831b-94683e1eca1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428381 Nov 24 14:05:33.700840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Deleting port ce065fe8-caba-462c-af0c-2aea33f0759e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:33.701176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:33.869477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:33.869801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:33.988128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Calling delete_port for ce065fe8-caba-462c-af0c-2aea33f0759e owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:34.230268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:34.233738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5fd1da75-8214-43e5-9d0f-e6de4aa29e51 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:34.276044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'Port': ['ID=ce065fe8-caba-462c-af0c-2aea33f0759e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:34.278559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:34.373381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:34.819574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b6ff13-70ac-4f41-8195-4ed6430dc6af req-3bb60d3c-bf80-4886-89c8-d90b1e720faf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:34.820951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c0b6ff13-70ac-4f41-8195-4ed6430dc6af req-3bb60d3c-bf80-4886-89c8-d90b1e720faf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 946 time: 0.1086361 Nov 24 14:05:34.879846 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c0b6ff13-70ac-4f41-8195-4ed6430dc6af req-5c545ab2-3db7-42fa-b63a-03f5a3c3db9a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532994 Nov 24 14:05:34.881532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Router 95732bbb-def1-43f3-a30c-c41d29c85119 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:05:35.082259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67bc6eb6-b8b1-4ed2-968e-8c93fdf0cf97 req-38c02d6e-362c-4bda-ba1f-f8986bd62b8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:35.083146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:35.083614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67bc6eb6-b8b1-4ed2-968e-8c93fdf0cf97 req-38c02d6e-362c-4bda-ba1f-f8986bd62b8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 946 time: 0.0827582 Nov 24 14:05:35.092568 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] Sync routers for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:35.105928 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:35.106529 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:35.106702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:35.135491 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67bc6eb6-b8b1-4ed2-968e-8c93fdf0cf97 req-8e7a5cc8-f2bb-4c57-88fe-a7ef9196041c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430484 Nov 24 14:05:35.169478 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "DELETE /v2.0/floatingips/23e79b9e-c628-41f7-8df7-6750470f80dc HTTP/1.1" status: 204 len: 168 time: 1.6741655 Nov 24 14:05:35.169478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:05:35.299680 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:05:35.331011 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'status': 'completed', 'code': 200} Nov 24 14:05:35.438478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-f835983c-ae93-4895-b493-8bf10fa19549 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=84c43153da724ce38453763656256a35&device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 1098 time: 0.0814908 Nov 24 14:05:35.591617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-a450e5d2-a1fd-4241-801e-e31f4baa2b2e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:35.593085 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-a450e5d2-a1fd-4241-801e-e31f4baa2b2e service neutron] 10.222.0.47 "GET /v2.0/networks?id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 200 len: 898 time: 0.1478179 Nov 24 14:05:35.646702 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:22Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:35.650646 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] Checking router: 95732bbb-def1-43f3-a30c-c41d29c85119 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:05:35.661313 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:35.661908 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:35.709238 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-1616e280-c19f-418e-a6f6-e4e6cc273167 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 200 len: 217 time: 0.1088874 Nov 24 14:05:35.721013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fe016e1-6286-4c96-8c50-35a49429c503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:35.795124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-6c196703-84de-4876-a545-b65cf282016e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:35.796614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-6c196703-84de-4876-a545-b65cf282016e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 200 len: 835 time: 0.0805678 Nov 24 14:05:35.803579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad6470a8-8d78-4b80-b714-83bda73cfce9 req-5af4b9fc-0490-44d4-a547-69402836b8c8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:35.804978 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad6470a8-8d78-4b80-b714-83bda73cfce9 req-5af4b9fc-0490-44d4-a547-69402836b8c8 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.1491168 Nov 24 14:05:35.842252 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:05:35.895726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad6470a8-8d78-4b80-b714-83bda73cfce9 req-af73b0f3-a5ac-45b5-a303-5054876387da tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607309 Nov 24 14:05:35.914734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-84f52aa0-cf0d-40cc-bd72-ee55089cea11 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b86c842d-e3f1-4cfd-957a-f6a0ed42384a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1088195 Nov 24 14:05:36.051052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-e0937b7c-78fa-420b-9ce2-5dbb9fa1d218 service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278934 Nov 24 14:05:36.152098 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:22Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:36.156055 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a654dc34-b949-4e2a-9e71-b3a52ea27ae3 None None] The sync data for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv is: [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:02:08Z', 'revision_number': 4, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a3b13ddf-9d2b-4cd3-a527-e52062b6c671', 'name': '', 'network_id': 'b86c842d-e3f1-4cfd-957a-f6a0ed42384a', 'tenant_id': '84c43153da724ce38453763656256a35', 'mac_address': 'fa:16:3e:07:28:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4811f107-9786-45c2-af5e-030f9856728b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:02:07Z', 'updated_at': '2021-11-24T14:02:22Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'subnets': [{'id': '4811f107-9786-45c2-af5e-030f9856728b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:36.187286 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-725d9fda-4267-49f6-a0b4-749d96c0b5c1 req-b34e867e-531c-4485-9265-7d2a1a2a786c service neutron] 10.222.0.47 "GET /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291773 Nov 24 14:05:36.383387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5eb0bb4-420c-419c-a914-94a529a78d9c None None] New status for floating IP 23e79b9e-c628-41f7-8df7-6750470f80dc: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:05:36.623332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46800) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:36.691285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:37.102062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ab3840-1356-4854-972c-60198a00a3de req-eb390697-2aca-4b98-9867-88f9a9471fe0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:37.102790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-18ab3840-1356-4854-972c-60198a00a3de req-eb390697-2aca-4b98-9867-88f9a9471fe0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Synchronizing usage tracker for tenant:84c43153da724ce38453763656256a35 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:05:37.118059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-18ab3840-1356-4854-972c-60198a00a3de req-eb390697-2aca-4b98-9867-88f9a9471fe0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Unset dirty status for tenant:84c43153da724ce38453763656256a35 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:05:37.119383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-18ab3840-1356-4854-972c-60198a00a3de req-eb390697-2aca-4b98-9867-88f9a9471fe0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.0951462 Nov 24 14:05:37.168584 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-18ab3840-1356-4854-972c-60198a00a3de req-47cb7be1-991c-4aa0-8ecb-215cba9cf76c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434513 Nov 24 14:05:37.430999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-2da0a510-c903-4384-8401-50cff5f9afde tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:37.432445 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-2da0a510-c903-4384-8401-50cff5f9afde tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.47 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.1384614 Nov 24 14:05:37.542569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Deleting port 67fa1194-0c3d-4202-9709-065dd857e200 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:37.542815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:37.672984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:37.993595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] For port 67fa1194-0c3d-4202-9709-065dd857e200, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=67fa1194-0c3d-4202-9709-065dd857e200,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:37.993953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:38.156017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Calling delete_port for 67fa1194-0c3d-4202-9709-065dd857e200 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:38.370381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:38.587573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e69495-b69e-48bf-8e3e-17b4049f3f34 req-211efe31-1300-4784-8a84-a8e2a24a0ee7 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:05:38.588933 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68e69495-b69e-48bf-8e3e-17b4049f3f34 req-211efe31-1300-4784-8a84-a8e2a24a0ee7 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/ports?device_id=6b5ac8d3-9600-4747-8787-caefa0821a87 HTTP/1.1" status: 200 len: 945 time: 0.2830369 Nov 24 14:05:38.625006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.17 (418d8eb8-2526-4583-ab4d-5243e4cf0892/8afe716c-0204-4fc4-888c-9768ce795406/49404afd-58b8-4aff-909d-c06c7fe45c49) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:05:38.672067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:38.686232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-716aca45-2ae4-484b-9968-b4002c401f71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:38.787687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'Port': ['ID=67fa1194-0c3d-4202-9709-065dd857e200,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:38.793776 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68e69495-b69e-48bf-8e3e-17b4049f3f34 req-b8bc7f51-1fb7-4706-8631-24f91bc65247 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "GET /v2.0/security-groups?id=c515eff7-1452-46c0-9ddd-403a3742014c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1906507 Nov 24 14:05:38.796911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:38.904052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] No DVR routers for this DVR port 67fa1194-0c3d-4202-9709-065dd857e200 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:05:38.909097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:38.911500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-deleted', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:05:38.942252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:38.949278 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-56d3e148-7a3c-45a7-8f0f-ceb561816006 req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.47 "DELETE /v2.0/ports/67fa1194-0c3d-4202-9709-065dd857e200 HTTP/1.1" status: 204 len: 173 time: 1.5116179 Nov 24 14:05:38.959748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 49404afd-58b8-4aff-909d-c06c7fe45c49 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:38.970853 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b5ac8d3-9600-4747-8787-caefa0821a87', 'name': 'network-vif-deleted', 'tag': '67fa1194-0c3d-4202-9709-065dd857e200', 'status': 'completed', 'code': 200} Nov 24 14:05:38.988287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:38.992124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd52f11b-0b3b-40f7-b0fc-1cd153e8de23 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:39.062701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:39.063913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:39.066286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:05:39.113872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=49404afd-58b8-4aff-909d-c06c7fe45c49,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:39.117336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:39.143161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:39.247927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:39.378823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-08ef4d1c-6b62-4366-83ac-e8f18f31194d None None] Provisioning for port 49404afd-58b8-4aff-909d-c06c7fe45c49 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:39.385557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-08ef4d1c-6b62-4366-83ac-e8f18f31194d None None] Provisioning complete for port 49404afd-58b8-4aff-909d-c06c7fe45c49 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:39.386079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-08ef4d1c-6b62-4366-83ac-e8f18f31194d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:39.450096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-08ef4d1c-6b62-4366-83ac-e8f18f31194d None None] Port 49404afd-58b8-4aff-909d-c06c7fe45c49 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:39.666216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:39.670485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:39.698448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-df1aade6-f10e-4c10-ae29-5332d6d8c80a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:39.781221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:39.785157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=49404afd-58b8-4aff-909d-c06c7fe45c49,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:39.788753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:39.909775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46818) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:39.922701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:05:39.924868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:05:40.175953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8c47534e-85f1-4092-bd51-0f0a566e715d None None] Provisioning complete for port 49404afd-58b8-4aff-909d-c06c7fe45c49 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:40.176324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8c47534e-85f1-4092-bd51-0f0a566e715d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:40.243374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8c47534e-85f1-4092-bd51-0f0a566e715d None None] Port 49404afd-58b8-4aff-909d-c06c7fe45c49 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:05:40.450479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:05:40.463881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:40.622755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:40.660184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:40.661135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 67fa1194-0c3d-4202-9709-065dd857e200 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:40.661565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 67fa1194-0c3d-4202-9709-065dd857e200 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:40.668245 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/4c184764-fcb9-452b-b4f7-fde29787047c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0438244 Nov 24 14:05:40.670918 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:40.683800 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:40.684446 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:40.889989 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:05:41.097988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Deleting port a3b13ddf-9d2b-4cd3-a527-e52062b6c671 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:41.098768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.243027 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:05:39Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:08Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49404afd-58b8-4aff-909d-c06c7fe45c49', 'name': '', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:13:c9:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8afe716c-0204-4fc4-888c-9768ce795406', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:05:38Z', 'updated_at': '2021-11-24T14:05:39Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '8afe716c-0204-4fc4-888c-9768ce795406', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:41.247007 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:05:41.247364 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Updating router 4c184764-fcb9-452b-b4f7-fde29787047c port 49404afd-58b8-4aff-909d-c06c7fe45c49 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:05:41.289687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] For port a3b13ddf-9d2b-4cd3-a527-e52062b6c671, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:41.290041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.305894 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.418537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Calling delete_port for a3b13ddf-9d2b-4cd3-a527-e52062b6c671 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:41.609097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.613365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4093d5d9-6d7d-4d0f-bddd-278a689827ac tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:41.651468 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.657081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'Port': ['ID=a3b13ddf-9d2b-4cd3-a527-e52062b6c671,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:41.661577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:41.664811 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Transition to ACTIVE for port object 49404afd-58b8-4aff-909d-c06c7fe45c49 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:05:41.672103 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.676963 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d9cba2de-48ba-4831-97c5-656b236d9432 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:41.858477 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Pushing event updated for resources: {'Port': ['ID=49404afd-58b8-4aff-909d-c06c7fe45c49,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:41.910685 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.911061 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.911395 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.911724 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.912088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.912418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.912738 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.913075 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.913398 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.913713 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.914066 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:05:41.917696 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.241s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:41.926643 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Attempting to bind port 49404afd-58b8-4aff-909d-c06c7fe45c49 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:05:41.926643 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Attempting to bind port 49404afd-58b8-4aff-909d-c06c7fe45c49 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:05:41.926643 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Attempting to bind port 49404afd-58b8-4aff-909d-c06c7fe45c49 on network 418d8eb8-2526-4583-ab4d-5243e4cf0892 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:05:41.933633 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 5, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:05:41.934068 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Checking segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:05:41.934474 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.934872 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Bound using segment: {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:05:41.935337 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Bound port: 49404afd-58b8-4aff-909d-c06c7fe45c49, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e6ec3314-6d92-4962-91c2-c2ca383adb52', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:05:41.935713 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:41.987386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:42.028764 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] For port 49404afd-58b8-4aff-909d-c06c7fe45c49, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:05:42.032711 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] For port 49404afd-58b8-4aff-909d-c06c7fe45c49, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=49404afd-58b8-4aff-909d-c06c7fe45c49,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:05:42.037854 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:42.041548 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7149d3f1-24f0-40e9-b1f5-9c3e0e409ac3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:42.120045 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Pushing event updated for resources: {'Port': ['ID=49404afd-58b8-4aff-909d-c06c7fe45c49,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:42.124022 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:42.125685 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:42.126320 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:42.329172 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:05:42.725810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Router 95732bbb-def1-43f3-a30c-c41d29c85119 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:05:42.743056 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:05:39Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:08Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49404afd-58b8-4aff-909d-c06c7fe45c49', 'name': '', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:13:c9:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8afe716c-0204-4fc4-888c-9768ce795406', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:05:38Z', 'updated_at': '2021-11-24T14:05:42Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '8afe716c-0204-4fc4-888c-9768ce795406', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:42.746888 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1398dce8-491d-4ff0-937d-8350d1e2babc None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:05:39Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:08Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '49404afd-58b8-4aff-909d-c06c7fe45c49', 'name': '', 'network_id': '418d8eb8-2526-4583-ab4d-5243e4cf0892', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:13:c9:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8afe716c-0204-4fc4-888c-9768ce795406', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:05:38Z', 'updated_at': '2021-11-24T14:05:42Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '8afe716c-0204-4fc4-888c-9768ce795406', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:42.947200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:05:42.958265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] Sync routers for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:05:42.964251 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "PUT /v2.0/routers/95732bbb-def1-43f3-a30c-c41d29c85119/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0508707 Nov 24 14:05:42.964973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46828) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:42.970513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:42.971933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:43.158732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:05:43.158991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Deleting subnet 4811f107-9786-45c2-af5e-030f9856728b {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:05:43.162364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.225120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.320741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.398936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.403416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-28256a5d-1aa6-4c76-8c4e-c34d40928a12 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:43.440025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'Subnet': ['ID=4811f107-9786-45c2-af5e-030f9856728b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:43.442646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:43.445405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.451469 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "DELETE /v2.0/subnets/4811f107-9786-45c2-af5e-030f9856728b HTTP/1.1" status: 204 len: 168 time: 0.4854164 Nov 24 14:05:43.454120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46834) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:43.454345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-642dddaf-5b06-427b-8706-342297dc04c7 None None] Network b86c842d-e3f1-4cfd-957a-f6a0ed42384a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:05:43.479660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:05:41Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:43.539366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] Checking router: 95732bbb-def1-43f3-a30c-c41d29c85119 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:05:43.615729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] Routers {'95732bbb-def1-43f3-a30c-c41d29c85119'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:05:43.616293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:05:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['95732bbb-def1-43f3-a30c-c41d29c85119'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:43.656804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.818204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] Set router 95732bbb-def1-43f3-a30c-c41d29c85119 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:05:43.859631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.869633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Deleting port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:43.869972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:43.916331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] DHCP port deletion for b86c842d-e3f1-4cfd-957a-f6a0ed42384a request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:05:43.941438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Deleting port 5c147714-fdcd-4949-8147-807e126b1eed {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:05:43.941811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:44.163261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] For port 1b50cf83-69a4-4ab1-92e7-dc836a173eb9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:44.163875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:44.285695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Calling delete_port for 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:44.312898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] For port 5c147714-fdcd-4949-8147-807e126b1eed, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5c147714-fdcd-4949-8147-807e126b1eed,segment=NetworkSegment(43da5e1a-72d2-4cde-9863-2082fd9e5bbc),segment_id=43da5e1a-72d2-4cde-9863-2082fd9e5bbc)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:44.312898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:44.436691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Calling delete_port for 5c147714-fdcd-4949-8147-807e126b1eed owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:05:44.455878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:44.459602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6f2fdfca-20f7-4b0e-bfd6-1a8ef67c65da tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:44.499150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:05:41Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:44.500118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'Port': ['ID=1b50cf83-69a4-4ab1-92e7-dc836a173eb9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:44.504710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:44.513161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f48bc03-bb16-4371-8040-0de6879ac3e6 None None] The sync data for ids ['95732bbb-def1-43f3-a30c-c41d29c85119'] in dv-neutron-818151-2-hyperv is: [{'id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'name': 'tempest-TestNetworkAdvancedServerOps-router-763803631', 'tenant_id': '84c43153da724ce38453763656256a35', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69'}], 'enable_snat': True}, 'gw_port_id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:01:53Z', 'updated_at': '2021-11-24T14:05:41Z', 'revision_number': 5, 'project_id': '84c43153da724ce38453763656256a35', 'gw_port': {'id': '1b50cf83-69a4-4ab1-92e7-dc836a173eb9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:86:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95732bbb-def1-43f3-a30c-c41d29c85119', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.69', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:01:55Z', 'updated_at': '2021-11-24T14:02:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:05:44.529672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:44.547119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-42ed2dde-4488-4c96-a732-423261b8a8f9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:44.588648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] No DVR routers for this DVR port 5c147714-fdcd-4949-8147-807e126b1eed on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:05:44.597914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Pushing event deleted for resources: {'Port': ['ID=5c147714-fdcd-4949-8147-807e126b1eed,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:44.601994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:44.736779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:44.958239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 49404afd-58b8-4aff-909d-c06c7fe45c49 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:45.005626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.009932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.030593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 49404afd-58b8-4aff-909d-c06c7fe45c49 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:05:45.036054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 49404afd-58b8-4aff-909d-c06c7fe45c49 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:45.036438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.036573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.037058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Fanout notify agent at l3_agent the message router_deleted on router 95732bbb-def1-43f3-a30c-c41d29c85119 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:05:45.051077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.052202 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "DELETE /v2.0/routers/95732bbb-def1-43f3-a30c-c41d29c85119 HTTP/1.1" status: 204 len: 168 time: 1.5965631 Nov 24 14:05:45.054970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46838) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:45.150997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.167372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.182430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 49404afd-58b8-4aff-909d-c06c7fe45c49, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=49404afd-58b8-4aff-909d-c06c7fe45c49,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:05:45.186167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.188004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:45.245610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5c147714-fdcd-4949-8147-807e126b1eed no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:45.286751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 5c147714-fdcd-4949-8147-807e126b1eed {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:45.286985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5c147714-fdcd-4949-8147-807e126b1eed not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:45.299029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=49404afd-58b8-4aff-909d-c06c7fe45c49,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:45.302047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:45.312508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.342368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b86c842d-e3f1-4cfd-957a-f6a0ed42384a']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:45.459359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '43da5e1a-72d2-4cde-9863-2082fd9e5bbc') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:45.459632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '43da5e1a-72d2-4cde-9863-2082fd9e5bbc') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:05:45.472650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.488727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.494999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Releasing vlan 882 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:05:45.495386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:05:45.510241 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:05:45.592221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.596286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f54853cd-0c24-4e56-9730-53b2f9fb72b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:45.610252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.622975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'Network': ['ID=b86c842d-e3f1-4cfd-957a-f6a0ed42384a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:45.626424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:45.633480 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "DELETE /v2.0/networks/b86c842d-e3f1-4cfd-957a-f6a0ed42384a HTTP/1.1" status: 204 len: 168 time: 0.5775342 Nov 24 14:05:45.636709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46844) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:45.707709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.739437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.807868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.811616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6e5fda48-4a31-4f8d-86e1-d669c4fd8f82 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:45.825272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c515eff7-1452-46c0-9ddd-403a3742014c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:45.828338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:45.837911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:45.839302 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] 10.222.0.70 "DELETE /v2.0/security-groups/c515eff7-1452-46c0-9ddd-403a3742014c HTTP/1.1" status: 204 len: 168 time: 0.2014580 Nov 24 14:05:46.188083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46854) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:46.369374 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-18e8e52a-e9f8-4a8f-b73a-f90f7f9aedf6 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=84c43153da724ce38453763656256a35&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1800289 Nov 24 14:05:46.372453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:46.442297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:46.467696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:46.525931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:46.530032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14ceeb40-eb4e-4909-afe5-e84bc6deef55 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:46.544913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8073cc13-6934-4ef9-81fc-4e1f399f968c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:46.547519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:46.556495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:46.559799 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/8073cc13-6934-4ef9-81fc-4e1f399f968c HTTP/1.1" status: 204 len: 168 time: 0.1842735 Nov 24 14:05:46.591910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 49404afd-58b8-4aff-909d-c06c7fe45c49 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:05:46.679066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 49404afd-58b8-4aff-909d-c06c7fe45c49 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:05:46.679540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:46.810432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a3b13ddf-9d2b-4cd3-a527-e52062b6c671 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:46.854754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: a3b13ddf-9d2b-4cd3-a527-e52062b6c671 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:46.855219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a3b13ddf-9d2b-4cd3-a527-e52062b6c671 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:46.856548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:05:46.894151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:05:46.894504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1b50cf83-69a4-4ab1-92e7-dc836a173eb9 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:05:46.974506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46868) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:46.996865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.030861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:05:47.035011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Usage tracker for resource:security_group_rule and tenant:39db423e73944e62810b991291d77a3a is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:05:47.038864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:05:47.044771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:05:47.118105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.121856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.130712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dedd6e53-6dac-4355-ab89-9463c9eb5ed0 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:47.171615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4460cc91-2970-47e3-b25c-41f67c9a51fc,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:47.175362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:47.179989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=39db423e73944e62810b991291d77a3a&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2044070 Nov 24 14:05:47.182674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46872) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:05:47.261763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.287700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.338409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.347203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-45bae187-b09e-4aa0-bf6a-80ffe02f0e17 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:05:47.362439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4460cc91-2970-47e3-b25c-41f67c9a51fc,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:05:47.364752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:05:47.370470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:47.371482 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/4460cc91-2970-47e3-b25c-41f67c9a51fc HTTP/1.1" status: 204 len: 168 time: 0.1875467 Nov 24 14:05:47.621181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:05:51.799650 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:06:03.152033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20cdffb1-ec3c-4077-bd50-bd6ecc6cb976 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:03.539621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:05.717764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4dafa917-2ad6-4199-a7ae-d7e7de6c5d45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:06.687221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:08.371488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:12.267224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46904) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:12.662410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:13.298187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 49404afd-58b8-4aff-909d-c06c7fe45c49 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:13.298738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:13.576736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 49404afd-58b8-4aff-909d-c06c7fe45c49, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=49404afd-58b8-4aff-909d-c06c7fe45c49,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:13.576992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:13.702958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 49404afd-58b8-4aff-909d-c06c7fe45c49 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:13.891492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:13.895670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dd3ae711-a6be-42ea-90aa-75dd41df42ef tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:13.938557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=49404afd-58b8-4aff-909d-c06c7fe45c49,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:13.951609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.952300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.952793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.953160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.953993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.953993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.954326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.954692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.955090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.955397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.956416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:13.985127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:14.259981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:14.853625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:06:15.156902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:06:15.167655 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:06:15.176289 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/4c184764-fcb9-452b-b4f7-fde29787047c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9052558 Nov 24 14:06:15.180023 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:15.180626 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:15.359724 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:15.561695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5cc2d5-fe6e-4808-b4f8-99089d4ebbeb req-8df1c0d0-616f-4b0d-a791-32d93fbb7506 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:15.563134 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2c5cc2d5-fe6e-4808-b4f8-99089d4ebbeb req-8df1c0d0-616f-4b0d-a791-32d93fbb7506 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 946 time: 0.0791728 Nov 24 14:06:15.613433 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2c5cc2d5-fe6e-4808-b4f8-99089d4ebbeb req-0def0fe6-7fcc-4e01-9936-3e8e62794e34 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437140 Nov 24 14:06:15.704711 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:13Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:08Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:15.709436 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:06:15.719927 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:15.720517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:15.896330 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:16.272689 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:13Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:08Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:16.276792 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-281f7bd0-56e1-480f-a61b-7273efdeb74a None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:13Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '63b51789-24dc-42f8-9f30-1eeb2ace8f45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.22', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'port_id': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'mac_address': 'fa:16:3e:46:c8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:04:01Z', 'updated_at': '2021-11-24T14:04:08Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:06:16.616658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 49404afd-58b8-4aff-909d-c06c7fe45c49 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:16.652226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 49404afd-58b8-4aff-909d-c06c7fe45c49 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:16.652584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 49404afd-58b8-4aff-909d-c06c7fe45c49 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:16.822403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2975109b-cace-4486-a723-545b92595567 req-731f94d1-e089-415d-9a45-558d7a34fb1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:16.823091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2975109b-cace-4486-a723-545b92595567 req-731f94d1-e089-415d-9a45-558d7a34fb1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:16.839095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2975109b-cace-4486-a723-545b92595567 req-731f94d1-e089-415d-9a45-558d7a34fb1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:16.840545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2975109b-cace-4486-a723-545b92595567 req-731f94d1-e089-415d-9a45-558d7a34fb1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 946 time: 0.0978217 Nov 24 14:06:16.886915 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2975109b-cace-4486-a723-545b92595567 req-e6900f08-34a7-4aa1-acbe-99ce918c74e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=10c5c56e-15eb-465b-a695-07a890e29a1b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409091 Nov 24 14:06:17.114624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-7b36a529-4878-4940-8565-20ed4f51211a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:17.115961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-7b36a529-4878-4940-8565-20ed4f51211a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 946 time: 0.0779088 Nov 24 14:06:17.186175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:17.186513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:17.433380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 26914a6c-6e8c-4919-bbaf-40d9f35826b3, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=26914a6c-6e8c-4919-bbaf-40d9f35826b3,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:17.433730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:17.556821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 26914a6c-6e8c-4919-bbaf-40d9f35826b3 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:17.634558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:17.696167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:17.701414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:17.749987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=26914a6c-6e8c-4919-bbaf-40d9f35826b3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:17.754229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:17.823541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 26914a6c-6e8c-4919-bbaf-40d9f35826b3 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:06:17.825936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:17.828481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'name': 'network-vif-deleted', 'tag': '26914a6c-6e8c-4919-bbaf-40d9f35826b3'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:06:17.844871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-24156a26-c4a6-48b7-ac1f-3f79f6bbae6b req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/26914a6c-6e8c-4919-bbaf-40d9f35826b3 HTTP/1.1" status: 204 len: 173 time: 0.7238519 Nov 24 14:06:18.074868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-1dfa8260-2487-4598-bbc8-7d47cc23989e req-5e837dd1-3c5b-434e-ab4c-29afd04e71eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:18.093088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-1dfa8260-2487-4598-bbc8-7d47cc23989e req-5e837dd1-3c5b-434e-ab4c-29afd04e71eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:18.097297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1dfa8260-2487-4598-bbc8-7d47cc23989e req-5e837dd1-3c5b-434e-ab4c-29afd04e71eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=c5b025a7-1cc1-407b-b6ef-0f59dd30b241 HTTP/1.1" status: 200 len: 210 time: 0.0667298 Nov 24 14:06:18.128098 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c5b025a7-1cc1-407b-b6ef-0f59dd30b241', 'name': 'network-vif-deleted', 'tag': '26914a6c-6e8c-4919-bbaf-40d9f35826b3', 'status': 'completed', 'code': 200} Nov 24 14:06:19.200434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46922) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:19.271577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.300420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.361393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.367780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b8dbc560-29fe-42f2-a89c-f875f77eb13f tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:19.382466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=10c5c56e-15eb-465b-a695-07a890e29a1b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:19.385159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:19.394182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.395401 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/10c5c56e-15eb-465b-a695-07a890e29a1b HTTP/1.1" status: 204 len: 168 time: 0.1940045 Nov 24 14:06:19.439595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46928) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:19.626514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet 8afe716c-0204-4fc4-888c-9768ce795406 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:06:19.630076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.682547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.766639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.941207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.945118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b3f5c735-6849-4473-83dd-078fd8bc2163 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:19.980334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=8afe716c-0204-4fc4-888c-9768ce795406,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:19.983353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:19.987951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:19.993437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c548291-e93b-4222-b1d2-25ba9c03c8a5 None None] Network 418d8eb8-2526-4583-ab4d-5243e4cf0892 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:06:19.994668 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-26bb9b74-d58a-4364-a1b8-7ad744efccd9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/8afe716c-0204-4fc4-888c-9768ce795406 HTTP/1.1" status: 204 len: 168 time: 0.5529130 Nov 24 14:06:19.996872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46932) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:20.112687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.123432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:20.123785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.245103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] DHCP port deletion for 418d8eb8-2526-4583-ab4d-5243e4cf0892 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:06:20.249572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Deleting port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:20.250167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.336980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:20.337608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.458624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:20.494514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] For port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,segment=NetworkSegment(e6ec3314-6d92-4962-91c2-c2ca383adb52),segment_id=e6ec3314-6d92-4962-91c2-c2ca383adb52)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:20.494916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.532295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.536728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e31014ba-adb3-4675-98d0-5306deadbffd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:20.582293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:20.584837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:20.587209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:06:20.613006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:20.647239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Calling delete_port for 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:20.682133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:20.682482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:20.710333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1993: SAWarning: Setting backref / back_populates on relationship QosNetworkPolicyBinding.port to refer to viewonly relationship Port.qos_network_policy_binding should include sync_backref=False set on the QosNetworkPolicyBinding.port relationship. (this warning may be suppressed after 10 occurrences) Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn_limited( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/relationships.py:1993: SAWarning: Setting backref / back_populates on relationship Tag.standard_attr to refer to viewonly relationship StandardAttribute.tags should include sync_backref=False set on the Tag.standard_attr relationship. (this warning may be suppressed after 10 occurrences) Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn_limited( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'provisioningblocks' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'provisioningblocks' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:06:20.716082 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 14:06:20.726472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:06:20.726918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:06:20.735881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['418d8eb8-2526-4583-ab4d-5243e4cf0892']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:20.747860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e6ec3314-6d92-4962-91c2-c2ca383adb52') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:20.748151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e6ec3314-6d92-4962-91c2-c2ca383adb52') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:20.759172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.774549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.777653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 26914a6c-6e8c-4919-bbaf-40d9f35826b3 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:20.780515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 893 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:06:20.780890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:06:20.795698 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:06:20.810603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 26914a6c-6e8c-4919-bbaf-40d9f35826b3 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:20.810961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 26914a6c-6e8c-4919-bbaf-40d9f35826b3 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:20.874469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.878880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-034ac3a4-208b-4873-b0af-84fea663a1a4 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:20.899990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:20.908276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=418d8eb8-2526-4583-ab4d-5243e4cf0892,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:20.912180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:20.923820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/418d8eb8-2526-4583-ab4d-5243e4cf0892 HTTP/1.1" status: 204 len: 168 time: 0.9259925 Nov 24 14:06:20.926531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46936) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:21.126807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 8227a9f1-9a9f-4b76-a399-0d205b294ed9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:21.127163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:21.228495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Deleting port 8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:21.229068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:21.295920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:21.296251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:21.300009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-df056e48-f01f-40bf-8f08-515a00e96f05 None None] The port '8fd77e7d-d7bc-46f0-aaf2-7519f8ba3c69' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:06:21.524243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 8227a9f1-9a9f-4b76-a399-0d205b294ed9 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:21.681012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:21.684559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e49d95d-f618-4a33-a35b-6d9fdf708a35 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:21.724990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=8227a9f1-9a9f-4b76-a399-0d205b294ed9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:21.727936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:21.820367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:22.210370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:06:22.415665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:06:22.426100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:06:22.432558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:22.438533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:22.439257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:22.485613 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/63b51789-24dc-42f8-9f30-1eeb2ace8f45 HTTP/1.1" status: 204 len: 168 time: 1.5579636 Nov 24 14:06:22.486274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:06:22.544536 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'status': 'completed', 'code': 200} Nov 24 14:06:22.626557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:22.775886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-5f104be8-c442-4c7d-b345-5596726f43c6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 1099 time: 0.2062552 Nov 24 14:06:22.901545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9bde861-67f4-4955-8a19-da49303103e1 req-61502fa1-c325-41b7-bfe5-1a2d5db230f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:22.902978 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e9bde861-67f4-4955-8a19-da49303103e1 req-61502fa1-c325-41b7-bfe5-1a2d5db230f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.0863199 Nov 24 14:06:22.913578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-759d8225-b756-4580-9962-9a2d7f6d9120 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:22.915018 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-759d8225-b756-4580-9962-9a2d7f6d9120 service neutron] 10.222.0.47 "GET /v2.0/networks?id=1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 200 len: 898 time: 0.1319623 Nov 24 14:06:22.951815 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e9bde861-67f4-4955-8a19-da49303103e1 req-21ff0a06-b63a-4258-9163-eb5d3687ac36 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429473 Nov 24 14:06:22.963213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:13Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:22.967667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:06:22.980310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:22.980916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:22.987601 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-e518bf80-d182-467d-a08f-7fe49458f729 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4 HTTP/1.1" status: 200 len: 217 time: 0.0641701 Nov 24 14:06:23.054274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-e3eac801-9c05-4c00-80b8-c30f2dab53c7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:23.055582 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-e3eac801-9c05-4c00-80b8-c30f2dab53c7 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=592f062e-f3d4-49e3-bd1d-81be732122e4 HTTP/1.1" status: 200 len: 835 time: 0.0612340 Nov 24 14:06:23.133459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-efd53cb7-391e-45e3-98c9-01e496d6059d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=1a509ac2-7dc4-4e91-864c-101a02b01959&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0703032 Nov 24 14:06:23.146264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-7be999db-a1f3-477a-a9da-741dc03391ac service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:06:23.147311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-7be999db-a1f3-477a-a9da-741dc03391ac service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0060127 Nov 24 14:06:23.163609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:23.397236 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-ef37555d-64ef-46ed-9dbd-7ffe6faff3a0 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2425261 Nov 24 14:06:23.532202 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d0195-ac73-4202-94d3-9bb336e9a476 req-891ee783-3f88-4a41-9078-b61af60f1986 service neutron] 10.222.0.47 "GET /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281443 Nov 24 14:06:23.539283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:13Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:23.543278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26f1eff7-5e1c-4259-95ee-fe3a4c98c8e5 None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:13Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c00f8af4-02eb-44ba-975c-36393223efb1', 'name': '', 'network_id': '1a509ac2-7dc4-4e91-864c-101a02b01959', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:88:d8:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:24Z', 'updated_at': '2021-11-24T14:03:42Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '592f062e-f3d4-49e3-bd1d-81be732122e4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:06:23.769435 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdbddc39-0e83-4675-a20e-7a6f2a754d5c None None] New status for floating IP 63b51789-24dc-42f8-9f30-1eeb2ace8f45: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:06:24.157870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f51932-95a4-4be8-867e-3a83022e2703 req-759e9150-93b0-441e-b002-f1b2afd90428 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:24.158521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-38f51932-95a4-4be8-867e-3a83022e2703 req-759e9150-93b0-441e-b002-f1b2afd90428 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:24.174795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-38f51932-95a4-4be8-867e-3a83022e2703 req-759e9150-93b0-441e-b002-f1b2afd90428 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:24.176466 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-38f51932-95a4-4be8-867e-3a83022e2703 req-759e9150-93b0-441e-b002-f1b2afd90428 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.1001277 Nov 24 14:06:24.222755 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-38f51932-95a4-4be8-867e-3a83022e2703 req-e237ad79-9459-46e9-84dc-3b25cacfad9b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:24.239994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-38f51932-95a4-4be8-867e-3a83022e2703 req-e237ad79-9459-46e9-84dc-3b25cacfad9b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:24.241352 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-38f51932-95a4-4be8-867e-3a83022e2703 req-e237ad79-9459-46e9-84dc-3b25cacfad9b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=69a2a9ea-c083-424f-95cf-7b693d0d888b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0592351 Nov 24 14:06:24.474493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-eeb6acec-199b-42f3-b4da-f8aa9af98476 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:24.475845 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-eeb6acec-199b-42f3-b4da-f8aa9af98476 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 946 time: 0.0763223 Nov 24 14:06:24.546722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port d63435aa-64d2-4de8-b8ef-04e0392fcab4 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:24.547058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:24.787413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port d63435aa-64d2-4de8-b8ef-04e0392fcab4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=d63435aa-64d2-4de8-b8ef-04e0392fcab4,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:24.787703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:24.914794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for d63435aa-64d2-4de8-b8ef-04e0392fcab4 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:25.052206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:25.057685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1b1d1940-0e6e-4415-8d0a-cfdb376ff5a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:25.104129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=d63435aa-64d2-4de8-b8ef-04e0392fcab4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:25.106576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:25.181151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port d63435aa-64d2-4de8-b8ef-04e0392fcab4 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:06:25.183394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:25.185933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'name': 'network-vif-deleted', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:06:25.201434 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0386ce7a-a1dd-495d-baba-5284168faf56 req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/d63435aa-64d2-4de8-b8ef-04e0392fcab4 HTTP/1.1" status: 204 len: 173 time: 0.7199297 Nov 24 14:06:25.243255 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd', 'name': 'network-vif-deleted', 'tag': 'd63435aa-64d2-4de8-b8ef-04e0392fcab4', 'status': 'completed', 'code': 200} Nov 24 14:06:25.435343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-cb2231c6-a96f-4ef6-979b-658f4c71d313 req-4d100730-5756-4fcf-a27c-192d0c940e0c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:25.452941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-cb2231c6-a96f-4ef6-979b-658f4c71d313 req-4d100730-5756-4fcf-a27c-192d0c940e0c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:25.454410 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cb2231c6-a96f-4ef6-979b-658f4c71d313 req-4d100730-5756-4fcf-a27c-192d0c940e0c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2ee1ed8-e470-40a8-8439-dfbdb0bb31cd HTTP/1.1" status: 200 len: 210 time: 0.0637062 Nov 24 14:06:26.563415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46956) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:26.634758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:26.663042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:26.724596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:26.729559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a31773a0-8ac9-4110-8fde-58e09f4e5d02 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:26.745427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=69a2a9ea-c083-424f-95cf-7b693d0d888b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:26.749618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:26.753394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:26.754490 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/69a2a9ea-c083-424f-95cf-7b693d0d888b HTTP/1.1" status: 204 len: 168 time: 0.1900718 Nov 24 14:06:26.808473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device d63435aa-64d2-4de8-b8ef-04e0392fcab4 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:26.840416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: d63435aa-64d2-4de8-b8ef-04e0392fcab4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:26.840771 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device d63435aa-64d2-4de8-b8ef-04e0392fcab4 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:27.817319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46964) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:28.308587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:28.800056 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:06:28.913686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port c00f8af4-02eb-44ba-975c-36393223efb1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:28.914312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:29.112744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port c00f8af4-02eb-44ba-975c-36393223efb1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c00f8af4-02eb-44ba-975c-36393223efb1,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:29.113081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:29.237770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for c00f8af4-02eb-44ba-975c-36393223efb1 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:29.422645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:29.427255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9734e881-7203-4104-a6fc-40496caff8ff tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:29.469831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=c00f8af4-02eb-44ba-975c-36393223efb1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:29.473468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:29.872369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:30.446196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 4c184764-fcb9-452b-b4f7-fde29787047c has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:06:30.648030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:06:30.658022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] Sync routers for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:06:30.665566 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/4c184764-fcb9-452b-b4f7-fde29787047c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8470154 Nov 24 14:06:30.668129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 46968) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:30.673448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:30.674699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:30.847511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:30.855666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet 592f062e-f3d4-49e3-bd1d-81be732122e4 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:06:30.858639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:30.917225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.002290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.077292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.081411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ea8dc7f0-6dcf-41fb-9512-1d731e3faf7e tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:31.116393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=592f062e-f3d4-49e3-bd1d-81be732122e4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:31.120267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:31.123012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.130810 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9c0a10a1-cd1d-4feb-96cf-9d04d123f1ac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/592f062e-f3d4-49e3-bd1d-81be732122e4 HTTP/1.1" status: 204 len: 168 time: 0.4616842 Nov 24 14:06:31.132241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f897cde-1a68-4f89-be76-1b803eedccbd None None] Network 1a509ac2-7dc4-4e91-864c-101a02b01959 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:06:31.133631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46972) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:31.157389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:29Z', 'revision_number': 7, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:31.216381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] Checking router: 4c184764-fcb9-452b-b4f7-fde29787047c for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:06:31.300026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] Routers {'4c184764-fcb9-452b-b4f7-fde29787047c'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:31.300678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['4c184764-fcb9-452b-b4f7-fde29787047c'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:31.339651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.542519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] Set router 4c184764-fcb9-452b-b4f7-fde29787047c gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:31.545608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.558809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:31.559491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.652907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] DHCP port deletion for 1a509ac2-7dc4-4e91-864c-101a02b01959 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:06:31.679322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Deleting port b67892e5-6903-4056-a39c-c16f1bdf953c {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:06:31.680080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.862448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 1d9688f8-d3ae-4b46-af07-c33aaa5101f5, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:31.862715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:31.983435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:32.013380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] For port b67892e5-6903-4056-a39c-c16f1bdf953c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b67892e5-6903-4056-a39c-c16f1bdf953c,segment=NetworkSegment(09329ff1-fa04-43a6-bab2-843d53b31d28),segment_id=09329ff1-fa04-43a6-bab2-843d53b31d28)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:32.013779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.141117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Calling delete_port for b67892e5-6903-4056-a39c-c16f1bdf953c owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:06:32.150842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.154342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a80d7a0b-499d-429f-9616-33faac274882 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:32.196116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=1d9688f8-d3ae-4b46-af07-c33aaa5101f5,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:32.198003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:29Z', 'revision_number': 7, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:32.204007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e54d4626-c97c-4f03-bfbc-6b70edfde539 None None] The sync data for ids ['4c184764-fcb9-452b-b4f7-fde29787047c'] in dv-neutron-818151-2-hyperv is: [{'id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'name': 'tempest-TestNetworkBasicOps-router-433416808', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123'}], 'enable_snat': True}, 'gw_port_id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:06:29Z', 'revision_number': 7, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1d9688f8-d3ae-4b46-af07-c33aaa5101f5', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:5e:48:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4c184764-fcb9-452b-b4f7-fde29787047c', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.123', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:03:15Z', 'updated_at': '2021-11-24T14:03:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:06:32.229931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.235386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-afbe67ae-9763-4452-abca-210d424b9981 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:32.238949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.239332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.239701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.240097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.240470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.240824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.241184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.241543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.241938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.242240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.242591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.250948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:32.285391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Pushing event deleted for resources: {'Port': ['ID=b67892e5-6903-4056-a39c-c16f1bdf953c,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:32.291922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] No DVR routers for this DVR port b67892e5-6903-4056-a39c-c16f1bdf953c on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:06:32.304767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.305113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.305456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.305790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.306120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.306451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.306773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.307126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.307476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.307826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.308147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:06:32.311256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:32.446759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.683722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c00f8af4-02eb-44ba-975c-36393223efb1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:32.709708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.714109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.723591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c00f8af4-02eb-44ba-975c-36393223efb1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:32.724046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c00f8af4-02eb-44ba-975c-36393223efb1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:32.724557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b67892e5-6903-4056-a39c-c16f1bdf953c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:32.743064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.743567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router 4c184764-fcb9-452b-b4f7-fde29787047c {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:06:32.758921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:32.759471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: b67892e5-6903-4056-a39c-c16f1bdf953c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:32.759928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b67892e5-6903-4056-a39c-c16f1bdf953c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:32.760201 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/4c184764-fcb9-452b-b4f7-fde29787047c HTTP/1.1" status: 204 len: 168 time: 1.6254032 Nov 24 14:06:32.762667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46976) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:32.887107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.015952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.043546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1a509ac2-7dc4-4e91-864c-101a02b01959']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:33.155867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7df9abf2-4af4-453e-986e-f85ec80449ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.160239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '09329ff1-fa04-43a6-bab2-843d53b31d28') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:33.160970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '09329ff1-fa04-43a6-bab2-843d53b31d28') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:33.174838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.193246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.199458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 875 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:06:33.200004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:06:33.218909 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:06:33.304971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.308411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-389fc664-ac2e-48db-ab4d-76541bbdebee tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:33.322786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.335749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=1a509ac2-7dc4-4e91-864c-101a02b01959,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:33.338246 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/1a509ac2-7dc4-4e91-864c-101a02b01959 HTTP/1.1" status: 204 len: 168 time: 0.5746546 Nov 24 14:06:33.339105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:33.360997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46980) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:33.367743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--503703739', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:33.373119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:33.378096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:33.381041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:33.386630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:33.396506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:06:33.399436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.428449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:06:33.437655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.437981 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment 641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1 of type vlan for network c1697f17-76bd-420e-a706-2126a4fe54fe Nov 24 14:06:33.465557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.495445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.499236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:33.499854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.505427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-393917e8-cfb4-4b63-b78a-6700896c4d9f tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:33.543572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.607463 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2443154 Nov 24 14:06:33.610282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46984) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:33.616055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-64031876', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:33.624257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=c1697f17-76bd-420e-a706-2126a4fe54fe,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:33.626501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:33.628979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-43758ff2-7e39-42f8-806a-db618eeefc5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:33.631183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:33.634109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:33.634393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network c1697f17-76bd-420e-a706-2126a4fe54fe details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:06:33.639795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:33.649410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.650313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.670118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.821197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:33.995773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:34.024479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:34.159715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.166 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/09834853-6b9a-4540-a89e-12fd2e591303) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:06:34.304606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:34.333698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:34.337942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7f342646-37c1-4cde-bb94-982e6631c814 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:34.401577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:06:34.404646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:34.409373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:06:34.436550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=09834853-6b9a-4540-a89e-12fd2e591303,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:34.441534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:34.554943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:06:34.567697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:34.568479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:34.591692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:06:34.592066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1d9688f8-d3ae-4b46-af07-c33aaa5101f5 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:06:34.800476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:06:35.138832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:06:35.148454 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Sync routers for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:06:35.160440 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:35.161043 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:35.167560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:35.168789 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 1.5576012 Nov 24 14:06:35.171900 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46988) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:35.221822 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e34a9773-5d5d-4080-a70e-c4f3034ded66 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0478628 Nov 24 14:06:35.224914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46992) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:35.345504 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:35.405573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6971849-6c1d-4afb-a83b-1095d9702ecb tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:35.406943 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c6971849-6c1d-4afb-a83b-1095d9702ecb tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1807716 Nov 24 14:06:35.410420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 46996) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:35.450301 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5818d43a-9521-405a-a8a5-88cc1c895037 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0386305 Nov 24 14:06:35.452662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47000) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:35.458353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-37332315', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:35.567719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:35.571667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:35.574615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:35.580410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:35.590479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:06:35.632702 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:34Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:35.636516 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Checking router: 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:06:35.636901 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Updating router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 port 09834853-6b9a-4540-a89e-12fd2e591303 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:06:35.686932 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:35.693051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:35.720607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-df2155fd-adc1-4b9a-b183-bc46c308de39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:35.916779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:35.921004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddcefc37-db96-4279-9dfa-e3036736202c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:35.995882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:35.999084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:36.006679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:06:36.007039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: c1697f17-76bd-420e-a706-2126a4fe54fe, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:06:36.015477 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.027642 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Transition to ACTIVE for port object 09834853-6b9a-4540-a89e-12fd2e591303 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:36.029969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network c1697f17-76bd-420e-a706-2126a4fe54fe is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:06:36.034131 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.037531 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8c7f8f9a-bd7d-4ce7-a827-1ee49ba2af67 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:36.040271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, c1697f17-76bd-420e-a706-2126a4fe54fe) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:36.044521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:36.045267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.052279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cacc237d-2ab3-47fe-afd6-469fd4db685f None None] Network c1697f17-76bd-420e-a706-2126a4fe54fe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:06:36.073080 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.6166687 Nov 24 14:06:36.073676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47004) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:36.118536 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Attempting to bind port 09834853-6b9a-4540-a89e-12fd2e591303 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:06:36.118905 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Attempting to bind port 09834853-6b9a-4540-a89e-12fd2e591303 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:06:36.119462 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Attempting to bind port 09834853-6b9a-4540-a89e-12fd2e591303 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:06:36.121648 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2715d9c-202b-4e4c-a637-7cf16a99e477 None None] Pushing event updated for resources: {'Port': ['ID=09834853-6b9a-4540-a89e-12fd2e591303,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:36.124671 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c2715d9c-202b-4e4c-a637-7cf16a99e477 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:36.130944 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 6, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:06:36.131309 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:06:36.131713 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.132121 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:06:36.132581 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Bound port: 09834853-6b9a-4540-a89e-12fd2e591303, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:06:36.132953 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.209551 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] For port 09834853-6b9a-4540-a89e-12fd2e591303, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:06:36.216223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] For port 09834853-6b9a-4540-a89e-12fd2e591303, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=09834853-6b9a-4540-a89e-12fd2e591303,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:06:36.223419 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.241659 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:36.288185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-c1697f17-76bd-420e-a706-2126a4fe54fe', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:06:36.289050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.362909 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:36.363623 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:36.426172 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2715d9c-202b-4e4c-a637-7cf16a99e477 None None] Pushing event updated for resources: {'Port': ['ID=09834853-6b9a-4540-a89e-12fd2e591303,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:36.446119 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c2715d9c-202b-4e4c-a637-7cf16a99e477 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:36.458889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Allocated IP 172.20.0.2 (c1697f17-76bd-420e-a706-2126a4fe54fe/9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc/60d6329c-72bc-45d2-a32f-0364b10a4974) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:06:36.547617 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:36.738772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.744491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.754677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Transition to ACTIVE for port object 60d6329c-72bc-45d2-a32f-0364b10a4974 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:36.773546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Transition to ACTIVE for port object 60d6329c-72bc-45d2-a32f-0364b10a4974 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:36.779445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.794407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-69a32522-75f4-413f-91e6-6e1de0d01eba None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:36.842763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Network c1697f17-76bd-420e-a706-2126a4fe54fe is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:06:36.846483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:36.849427 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:06:36.868088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Pushing event updated for resources: {'Port': ['ID=60d6329c-72bc-45d2-a32f-0364b10a4974,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:36.870808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:36.872088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:34Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:36.877369 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6c3b893-986c-4dbf-9246-5a24c8e2880b None None] The sync data for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv is: [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:34Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:06:36.964144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Attempting to bind port 60d6329c-72bc-45d2-a32f-0364b10a4974 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:06:36.964515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Attempting to bind port 60d6329c-72bc-45d2-a32f-0364b10a4974 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:06:36.965301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Attempting to bind port 60d6329c-72bc-45d2-a32f-0364b10a4974 on network c1697f17-76bd-420e-a706-2126a4fe54fe {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:06:36.973548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 6, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:06:36.973925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Checking segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:06:36.974331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:36.974732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Bound using segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:06:36.975197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Bound port: 60d6329c-72bc-45d2-a32f-0364b10a4974, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:06:36.975576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:37.018773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:37.067837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] For port 60d6329c-72bc-45d2-a32f-0364b10a4974, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:06:37.070997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] For port 60d6329c-72bc-45d2-a32f-0364b10a4974, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=60d6329c-72bc-45d2-a32f-0364b10a4974,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:06:37.076324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:37.090829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:37.191998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Pushing event updated for resources: {'Port': ['ID=60d6329c-72bc-45d2-a32f-0364b10a4974,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:37.193663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:37.521244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (c1697f17-76bd-420e-a706-2126a4fe54fe/9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc/debc19e7-bb70-466f-ad27-46d5fd5c15bc) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:06:37.688098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:37.705652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object debc19e7-bb70-466f-ad27-46d5fd5c15bc will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:37.728326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:37.732007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-604256a6-57a8-47e2-97d3-42281a5dd956 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:37.791685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network c1697f17-76bd-420e-a706-2126a4fe54fe is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:06:37.799075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:37.803787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:06:37.839123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=debc19e7-bb70-466f-ad27-46d5fd5c15bc,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:37.846200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:37.870940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:37.961138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.130606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-328caf36-31e7-4412-af49-cc002c9c54f2 None None] Network c1697f17-76bd-420e-a706-2126a4fe54fe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:06:38.244030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7296fd3f-fb2f-4a98-8c13-1bd61d204e2d None None] Provisioning for port 60d6329c-72bc-45d2-a32f-0364b10a4974 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:38.383592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.499064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.504458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.536069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-438aa2be-eaea-48e6-810c-f237667633c6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:38.627658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=debc19e7-bb70-466f-ad27-46d5fd5c15bc,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:38.628366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8d57b589-414f-4e16-9a49-160575b4cffb None None] Provisioning for port debc19e7-bb70-466f-ad27-46d5fd5c15bc completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:38.634352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8d57b589-414f-4e16-9a49-160575b4cffb None None] Provisioning complete for port debc19e7-bb70-466f-ad27-46d5fd5c15bc triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:38.635147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8d57b589-414f-4e16-9a49-160575b4cffb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.636436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:38.637275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.695127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 09834853-6b9a-4540-a89e-12fd2e591303 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:38.771240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8d57b589-414f-4e16-9a49-160575b4cffb None None] Port debc19e7-bb70-466f-ad27-46d5fd5c15bc cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:06:38.794517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 09834853-6b9a-4540-a89e-12fd2e591303 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:38.796207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network c1697f17-76bd-420e-a706-2126a4fe54fe is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:06:38.797318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:38.799404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 09834853-6b9a-4540-a89e-12fd2e591303 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:38.799833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.934325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.943361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9ecbb85a-3a1f-4235-8009-dad51fe073cb None None] Provisioning complete for port debc19e7-bb70-466f-ad27-46d5fd5c15bc triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:38.943740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ecbb85a-3a1f-4235-8009-dad51fe073cb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:38.993805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 09834853-6b9a-4540-a89e-12fd2e591303, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=09834853-6b9a-4540-a89e-12fd2e591303,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:39.010035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:39.010890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 60d6329c-72bc-45d2-a32f-0364b10a4974 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:39.035492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:39.069935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9ecbb85a-3a1f-4235-8009-dad51fe073cb None None] Port debc19e7-bb70-466f-ad27-46d5fd5c15bc cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:06:39.124840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=09834853-6b9a-4540-a89e-12fd2e591303,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:39.129900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:39.141443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 60d6329c-72bc-45d2-a32f-0364b10a4974 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:39.148075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 60d6329c-72bc-45d2-a32f-0364b10a4974 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:39.148561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:39.209629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:06:39.220660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1d9e9058-cb4e-402f-beff-1c0c15c5d748 None None] Provisioning complete for port debc19e7-bb70-466f-ad27-46d5fd5c15bc triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:39.221048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1d9e9058-cb4e-402f-beff-1c0c15c5d748 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:39.317247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-1d9e9058-cb4e-402f-beff-1c0c15c5d748 None None] Port debc19e7-bb70-466f-ad27-46d5fd5c15bc cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:06:39.332799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:39.366178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 60d6329c-72bc-45d2-a32f-0364b10a4974, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=60d6329c-72bc-45d2-a32f-0364b10a4974,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:39.370394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:39.372393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2ed2d706-ffe0-4571-b66d-181c48f643de None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:39.419269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:06:39.433829 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/30c9c42c-6f25-4a02-b7c3-4d392c7962d4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3583629 Nov 24 14:06:39.435561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=60d6329c-72bc-45d2-a32f-0364b10a4974,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:39.436327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47008) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:39.438720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:39.571901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa3a48eb-6507-4c79-9e19-6ab5794d4803 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.572513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa3a48eb-6507-4c79-9e19-6ab5794d4803 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.572622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa3a48eb-6507-4c79-9e19-6ab5794d4803 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.572961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa3a48eb-6507-4c79-9e19-6ab5794d4803 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.574565 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fa3a48eb-6507-4c79-9e19-6ab5794d4803 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2885 time: 0.1373372 Nov 24 14:06:39.577385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47012) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:39.643300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdc4a2e5-aca5-4658-b6c5-54631c9b54a5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.643582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdc4a2e5-aca5-4658-b6c5-54631c9b54a5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.643781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdc4a2e5-aca5-4658-b6c5-54631c9b54a5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.644134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdc4a2e5-aca5-4658-b6c5-54631c9b54a5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:39.645721 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fdc4a2e5-aca5-4658-b6c5-54631c9b54a5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2726 time: 0.0674684 Nov 24 14:06:39.648371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47016) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:39.963420 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6abffc75-09ea-4a9a-8df3-dca896be26bb tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1606 time: 0.3139210 Nov 24 14:06:40.250106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47022) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:40.258609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2081290757', 'description': 'tempest-secgroup-smoke-2081290757 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:40.264750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:40.269688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:40.272668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:40.278938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:40.292539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.326793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:40.331166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:40.333909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:40.339639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:40.398320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.402574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.406480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c97b9449-b7ae-447b-9f74-0e29beb2d9a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:40.422338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Sync routers for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:06:40.434320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:40.434938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:40.448948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=250b65d7-bc29-4931-b94c-5c83a59f9bdf,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:40.452054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.456857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2019484 Nov 24 14:06:40.456857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:40.457111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47026) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:40.462404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '250b65d7-bc29-4931-b94c-5c83a59f9bdf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:40.468630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:40.474251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:40.477271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:40.482955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:40.500304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.565063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.569971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.572060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c55b262e-f196-47ce-9fc6-244c781d95f0 tempest-NegativeSecGroupIPv6Test-1861919854 tempest-NegativeSecGroupIPv6Test-1861919854-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:40.594664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=482bced2-348a-433d-ba3a-e035d961fb95,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:40.599277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:40.609726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.610948 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1529999 Nov 24 14:06:40.614192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47030) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:40.620150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '250b65d7-bc29-4931-b94c-5c83a59f9bdf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:40.626278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:40.630033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 09834853-6b9a-4540-a89e-12fd2e591303 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:40.630818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:40.633672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:40.639566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:40.656372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.719454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:40.724859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.728922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.730836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-09e1671d-9d86-4670-be93-d145be25c6cb tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:40.753100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d7d024e9-604c-4581-b361-073f801b1b29,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:40.755387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:40.762579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.764446 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1490297 Nov 24 14:06:40.766936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47034) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:40.772570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '250b65d7-bc29-4931-b94c-5c83a59f9bdf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:40.778329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:40.782286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:40.785176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:40.790811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:40.808191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.846873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 09834853-6b9a-4540-a89e-12fd2e591303 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:40.847260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.871467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.875449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.877883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2673bdbf-1942-4c4a-9fee-90497b8cb0a4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:40.902973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e93d2423-80a3-47e2-bf35-fe44d07823a5,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:40.907802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:40.914272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:40.918118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1475327 Nov 24 14:06:40.918509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47038) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:40.925859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '250b65d7-bc29-4931-b94c-5c83a59f9bdf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:40.931614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:40.935391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:40.938174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:40.944284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:40.963647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.028835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.032597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.040611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3f1a3cba-be66-40be-a2c4-94d63f4e527a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:41.058210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a3b000d5-9bca-476c-8790-cbc54361a5a6,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:41.060644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:41.069989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.073776 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1512849 Nov 24 14:06:41.074050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47042) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:41.080855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '250b65d7-bc29-4931-b94c-5c83a59f9bdf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:41.087227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:41.091223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:41.094036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:41.100175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:41.111509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:06:41.115953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 60d6329c-72bc-45d2-a32f-0364b10a4974 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:41.118060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.184599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.188435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.196266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d986de5-05c8-4c38-afd5-2f6a5b6adddd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:41.201817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:41.210140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Checking router: 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:06:41.210501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Updating router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 port debc19e7-bb70-466f-ad27-46d5fd5c15bc binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:06:41.214239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39bcacf3-1d97-49c1-a3ac-4e6e2df0ffba,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:41.216927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:41.225279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.226561 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1514416 Nov 24 14:06:41.229424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47046) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:41.234245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 60d6329c-72bc-45d2-a32f-0364b10a4974 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:41.234631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.235169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '250b65d7-bc29-4931-b94c-5c83a59f9bdf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:41.241668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:41.245732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:41.248931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:41.255479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:41.266163 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:06:41.274212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.320020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.348798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.352867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.359074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9aec0f8f-9d57-45a0-8061-721a2c4f8970 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:41.380558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35194c40-b179-46c0-8962-9e22c1fbb270,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:41.383592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:41.392077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.394087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1635673 Nov 24 14:06:41.633564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-eecc4847-095b-439c-b258-1487d4b13825 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:41.649049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-eecc4847-095b-439c-b258-1487d4b13825 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:41.650365 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-eecc4847-095b-439c-b258-1487d4b13825 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2081290757&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0598323 Nov 24 14:06:41.720867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.732797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Transition to ACTIVE for port object debc19e7-bb70-466f-ad27-46d5fd5c15bc will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:41.740807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.744298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:41.805946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-25c20ae8-7f75-48c7-9a04-58d3fe31f689 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:41.806574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-25c20ae8-7f75-48c7-9a04-58d3fe31f689 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:41.823098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-25c20ae8-7f75-48c7-9a04-58d3fe31f689 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:41.824710 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-25c20ae8-7f75-48c7-9a04-58d3fe31f689 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 200 len: 796 time: 0.1675005 Nov 24 14:06:41.848332 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-46db777d-46ba-4ff3-a75f-522df40be00d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0155199 Nov 24 14:06:41.877679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6272b7fd-3f59-41ae-ac82-8791203dbec8 None None] Pushing event updated for resources: {'Port': ['ID=debc19e7-bb70-466f-ad27-46d5fd5c15bc,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:41.880497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6272b7fd-3f59-41ae-ac82-8791203dbec8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:41.933486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-5bf07b17-0c7f-4c10-a039-ea8de44bb392 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:41.950610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-5bf07b17-0c7f-4c10-a039-ea8de44bb392 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:41.951980 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-5bf07b17-0c7f-4c10-a039-ea8de44bb392 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1020017 Nov 24 14:06:41.980470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Attempting to bind port debc19e7-bb70-466f-ad27-46d5fd5c15bc on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:06:41.980948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Attempting to bind port debc19e7-bb70-466f-ad27-46d5fd5c15bc by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:06:41.981386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Attempting to bind port debc19e7-bb70-466f-ad27-46d5fd5c15bc on network c1697f17-76bd-420e-a706-2126a4fe54fe {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:06:41.990380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 6, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:06:41.990820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Checking segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:06:41.991234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:41.991636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Bound using segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:06:41.992129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Bound port: debc19e7-bb70-466f-ad27-46d5fd5c15bc, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:06:41.992507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:42.095619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] For port debc19e7-bb70-466f-ad27-46d5fd5c15bc, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:06:42.098065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-89ed7a4d-3055-4385-9487-18c1f099a25f service neutron] 10.222.0.70 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314554 Nov 24 14:06:42.100065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] For port debc19e7-bb70-466f-ad27-46d5fd5c15bc, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=debc19e7-bb70-466f-ad27-46d5fd5c15bc,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:06:42.104002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:42.107487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6272b7fd-3f59-41ae-ac82-8791203dbec8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:42.193384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6272b7fd-3f59-41ae-ac82-8791203dbec8 None None] Pushing event updated for resources: {'Port': ['ID=debc19e7-bb70-466f-ad27-46d5fd5c15bc,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:42.196188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:42.197469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:42.244014 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-90e941e7-28e0-47b0-8979-6e28794b250b service neutron] 10.222.0.70 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1418533 Nov 24 14:06:42.257317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6272b7fd-3f59-41ae-ac82-8791203dbec8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:42.466947 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-19fa1eb6-1fb0-4280-98d8-58305bb7e009 req-56ad19dd-d13e-4dfd-8ec5-0fd8fee8679f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 210 time: 0.0432994 Nov 24 14:06:42.471495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:42.791499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:42Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:42.796180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4b37351-3ce8-48d1-b609-db5a34b133d8 None None] The sync data for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv is: [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:42Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:06:43.548360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-ad697baa-90bd-4ee7-a2dd-9a40e86dcdf1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:43.550898 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-ad697baa-90bd-4ee7-a2dd-9a40e86dcdf1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 200 len: 796 time: 0.1793182 Nov 24 14:06:43.661029 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75d57d77-5002-4a2d-aea5-b16a9e90cfff req-f2700d5e-d835-4541-89fc-cfa5c65df9a3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 210 time: 0.0561388 Nov 24 14:06:43.664367 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-ac2194c4-727f-42cc-a0f4-19e848a9759b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 380 time: 0.1005361 Nov 24 14:06:43.673584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['250b65d7-bc29-4931-b94c-5c83a59f9bdf']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:43.808351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:43.817779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:43.827074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:06:43.830681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:43.994887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.4 (c1697f17-76bd-420e-a706-2126a4fe54fe/9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc/5df0a3c9-f104-41de-b8e8-e286ef9617d4) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:06:44.287865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.303168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 5df0a3c9-f104-41de-b8e8-e286ef9617d4 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:44.324555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.332434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0ba4db2b-b2bc-403b-b566-5017d95ff311 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:44.392168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network c1697f17-76bd-420e-a706-2126a4fe54fe is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:06:44.400127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:44.402573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:06:44.443870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=5df0a3c9-f104-41de-b8e8-e286ef9617d4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:44.446742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:44.475837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:44.476435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.504026 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8343799 Nov 24 14:06:44.516101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Request body: {'port': {'device_id': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:44.636796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device debc19e7-bb70-466f-ad27-46d5fd5c15bc up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:44.643870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.714038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b8b4963-5dbb-4d61-90b6-75f5b7a3372b None None] Provisioning for port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:44.720413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b8b4963-5dbb-4d61-90b6-75f5b7a3372b None None] Provisioning complete for port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:44.721280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b8b4963-5dbb-4d61-90b6-75f5b7a3372b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.748910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port debc19e7-bb70-466f-ad27-46d5fd5c15bc completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:44.763523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port debc19e7-bb70-466f-ad27-46d5fd5c15bc triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:44.763919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.821738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5b8b4963-5dbb-4d61-90b6-75f5b7a3372b None None] Port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:06:44.884697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f385212-cdb8-434f-a522-85d20101717a req-3f02ee64-fb95-4551-9941-5c8db0632002 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:44.886163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8f385212-cdb8-434f-a522-85d20101717a req-3f02ee64-fb95-4551-9941-5c8db0632002 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 931 time: 0.0880792 Nov 24 14:06:44.898236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.934777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port debc19e7-bb70-466f-ad27-46d5fd5c15bc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=debc19e7-bb70-466f-ad27-46d5fd5c15bc,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:44.939867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:44.941082 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8f385212-cdb8-434f-a522-85d20101717a req-aa595d0f-aa47-4680-88dc-eca09264743c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493097 Nov 24 14:06:44.945528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:45.007335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5df0a3c9-f104-41de-b8e8-e286ef9617d4 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:06:45.012889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=debc19e7-bb70-466f-ad27-46d5fd5c15bc,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:45.014427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:45.016127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:45.030907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Transition to ACTIVE for port object 5df0a3c9-f104-41de-b8e8-e286ef9617d4 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:06:45.033980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:45.037533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a3d888e-8d02-4e3f-8753-d87932155f8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:45.163962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Pushing event updated for resources: {'Port': ['ID=5df0a3c9-f104-41de-b8e8-e286ef9617d4,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:45.166875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:45.273147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Attempting to bind port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:06:45.273478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Attempting to bind port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:06:45.273794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Attempting to bind port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 on network c1697f17-76bd-420e-a706-2126a4fe54fe {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:06:45.279452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 on network c1697f17-76bd-420e-a706-2126a4fe54fe not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:06:45.279778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Attempting to bind port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 on network c1697f17-76bd-420e-a706-2126a4fe54fe {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:06:45.286506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 6, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:06:45.286834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Checking segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:06:45.287219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Bound using segment: {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:06:45.287630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Bound port: 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:06:45.287991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:45.378788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] For port 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:06:45.381872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] For port 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:06:45.386096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:45.390497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:45.454031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:45.455442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] 10.222.0.47 "PUT /v2.0/ports/5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 200 len: 1093 time: 0.9438148 Nov 24 14:06:45.455998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:06:45.471854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Pushing event updated for resources: {'Port': ['ID=5df0a3c9-f104-41de-b8e8-e286ef9617d4,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:45.475085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:45.535142 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'status': 'completed', 'code': 200} Nov 24 14:06:45.572590 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-941f690d-637f-4100-ac0b-172701987f40 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1096 time: 0.0739074 Nov 24 14:06:45.644829 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-0c492693-f6bb-4d79-ad09-e03a50b329e4 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 200 len: 217 time: 0.0647719 Nov 24 14:06:45.707601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-23142818-5d15-41c2-bcbf-db77f205d2e7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:45.709033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-23142818-5d15-41c2-bcbf-db77f205d2e7 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc HTTP/1.1" status: 200 len: 833 time: 0.0569980 Nov 24 14:06:45.784060 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-2f6046c5-45f9-4bab-afc1-1709478e98d4 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=c1697f17-76bd-420e-a706-2126a4fe54fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0678461 Nov 24 14:06:45.915548 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-0a3b969f-5bc1-497b-9125-9e74dddc2ae9 service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255505 Nov 24 14:06:46.049140 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16a5ddd3-1acd-4575-80c3-2fe00611b8e2 req-78a1be62-781b-47cc-b8fe-5fe290de68c9 service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271651 Nov 24 14:06:46.140561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b0d493-37d9-4b26-8046-9a4b9e9f5c1a req-b76598c7-1093-47e2-a09b-db0853d6bed0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:46.142622 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f4b0d493-37d9-4b26-8046-9a4b9e9f5c1a req-b76598c7-1093-47e2-a09b-db0853d6bed0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 943 time: 0.0777137 Nov 24 14:06:46.198180 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f4b0d493-37d9-4b26-8046-9a4b9e9f5c1a req-f5d17453-cb6f-46ee-a623-f51355895b98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486984 Nov 24 14:06:46.268943 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-7b7e1285-9333-4590-9250-872f45f5c00e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1096 time: 0.1761103 Nov 24 14:06:46.400740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-196ac709-abe9-4c00-842c-e9d30af24450 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:46.402161 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-196ac709-abe9-4c00-842c-e9d30af24450 service neutron] 10.222.0.47 "GET /v2.0/networks?id=c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 200 len: 897 time: 0.1269279 Nov 24 14:06:46.473296 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-7b7da77d-3b3a-4cae-933a-e830a13ef1b8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 200 len: 217 time: 0.0640757 Nov 24 14:06:46.535700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-e8828067-64a2-4ea1-bcaa-f96029189fa7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:46.537127 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-e8828067-64a2-4ea1-bcaa-f96029189fa7 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc HTTP/1.1" status: 200 len: 833 time: 0.0561035 Nov 24 14:06:46.603902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device debc19e7-bb70-466f-ad27-46d5fd5c15bc up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:46.615023 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-4c9a2285-7f1d-4dac-a77f-42606a01ba8d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=c1697f17-76bd-420e-a706-2126a4fe54fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0703580 Nov 24 14:06:46.671276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port debc19e7-bb70-466f-ad27-46d5fd5c15bc triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:46.671653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:46.746901 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-24ca0924-856c-435f-800e-74734b4c4f3c service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1249845 Nov 24 14:06:46.882563 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d153b2c-aa56-4efd-9335-c4176b3e869b req-aee24366-2abb-408a-a712-0ec98e8350b7 service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1287813 Nov 24 14:06:47.416245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ad5ef-6ede-4abe-a2b1-46c44227ee08 req-2e0c40fb-de00-4b7b-b6fc-b50553fdd548 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:47.416928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d66ad5ef-6ede-4abe-a2b1-46c44227ee08 req-2e0c40fb-de00-4b7b-b6fc-b50553fdd548 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:06:47.433534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d66ad5ef-6ede-4abe-a2b1-46c44227ee08 req-2e0c40fb-de00-4b7b-b6fc-b50553fdd548 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:06:47.434893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d66ad5ef-6ede-4abe-a2b1-46c44227ee08 req-2e0c40fb-de00-4b7b-b6fc-b50553fdd548 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 943 time: 0.1034362 Nov 24 14:06:47.480919 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d66ad5ef-6ede-4abe-a2b1-46c44227ee08 req-8c7d3a81-1bd3-4420-9b03-8d427562b83f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405035 Nov 24 14:06:47.656937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:48.694678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be76725-f44a-4f03-af5d-645647201bd7 req-4343d166-bf00-4663-9db8-751e028690c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:48.696190 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0be76725-f44a-4f03-af5d-645647201bd7 req-4343d166-bf00-4663-9db8-751e028690c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 943 time: 0.0879993 Nov 24 14:06:48.740867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0be76725-f44a-4f03-af5d-645647201bd7 req-4cb22285-ebde-4222-bf7c-a51c96459f0d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391774 Nov 24 14:06:48.938694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5df0a3c9-f104-41de-b8e8-e286ef9617d4 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:06:49.072345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:49.085056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'port_id': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'mac_address': 'fa:16:3e:00:3e:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:06:49.138408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:49.155383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5df0a3c9-f104-41de-b8e8-e286ef9617d4 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:06:49.170040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:49.174924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:49.177516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4385159c-6bb1-4060-b51a-aa2309f9705a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:49.246363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=5df0a3c9-f104-41de-b8e8-e286ef9617d4,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:49.249316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:49.551816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['5df0a3c9-f104-41de-b8e8-e286ef9617d4'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:06:49.938607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae6eef-110b-4ba2-9c8f-64c91e022ca1 req-6fedcdf0-f225-4ff4-8bc7-0239521166b3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:49.940134 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8fae6eef-110b-4ba2-9c8f-64c91e022ca1 req-6fedcdf0-f225-4ff4-8bc7-0239521166b3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 944 time: 0.0777769 Nov 24 14:06:49.989594 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8fae6eef-110b-4ba2-9c8f-64c91e022ca1 req-dd94c0bf-1474-481a-af31-077765731352 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437269 Nov 24 14:06:50.938340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5df0a3c9-f104-41de-b8e8-e286ef9617d4 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:06:51.005691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:06:51.012149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:06:51.012807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:51.188730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:51.211834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffcfa9f7-8396-4723-aa08-84ebc5495f67 req-8efd8bce-2008-4a65-936f-8315c4686bf1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:51.213977 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ffcfa9f7-8396-4723-aa08-84ebc5495f67 req-8efd8bce-2008-4a65-936f-8315c4686bf1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 944 time: 0.0892317 Nov 24 14:06:51.217207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:06:51.227210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:06:51.233494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:51.236222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-84a6a2eb-d741-49db-8802-7c05b79887f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:51.267686 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ffcfa9f7-8396-4723-aa08-84ebc5495f67 req-9af458cd-2818-431f-8326-0695420df83a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469687 Nov 24 14:06:51.288230 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'code': 200} Nov 24 14:06:51.317800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=5df0a3c9-f104-41de-b8e8-e286ef9617d4,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:51.322404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:51.537861 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b34b098-d680-4c3c-b464-3a033763f319 req-ea76ed08-18ca-4345-aee6-fd7e3160e767 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1098 time: 0.0729127 Nov 24 14:06:51.581165 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0b34b098-d680-4c3c-b464-3a033763f319 req-bceacc62-d862-4a53-a688-84cd3e6f26d3 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367994 Nov 24 14:06:52.471162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db73cbd-acd2-4ddd-bfa0-267a2fc9e41a req-8e6f53f1-9609-41d2-9afd-15b41a6e4e2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:52.472545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3db73cbd-acd2-4ddd-bfa0-267a2fc9e41a req-8e6f53f1-9609-41d2-9afd-15b41a6e4e2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 945 time: 0.0821302 Nov 24 14:06:52.517512 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3db73cbd-acd2-4ddd-bfa0-267a2fc9e41a req-8f90cc37-c117-4cf8-a9f4-9820939215fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395224 Nov 24 14:06:53.711645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a26da0f-fe2e-401c-806f-0b86ba43044d req-199b396c-e7ed-4cd2-ae6a-0544768224d8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:53.713113 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1a26da0f-fe2e-401c-806f-0b86ba43044d req-199b396c-e7ed-4cd2-ae6a-0544768224d8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 945 time: 0.0766253 Nov 24 14:06:53.758724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1a26da0f-fe2e-401c-806f-0b86ba43044d req-68a1994a-1411-431c-a5b7-2ca10145eeb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398140 Nov 24 14:06:53.953376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d7c610f-ecbd-4dec-923c-a3394265a1d5 req-3a3073e6-a60e-4cd2-9379-9e78f46082ca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:53.954792 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d7c610f-ecbd-4dec-923c-a3394265a1d5 req-3a3073e6-a60e-4cd2-9379-9e78f46082ca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 945 time: 0.0759578 Nov 24 14:06:53.999324 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d7c610f-ecbd-4dec-923c-a3394265a1d5 req-92ac55d8-fd66-45ff-86cf-43753b8327ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389717 Nov 24 14:06:54.026637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47092) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:54.097676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f5c257e-5d29-4d50-8013-bc1735a23673 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1093 time: 0.0698478 Nov 24 14:06:54.100194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47096) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:54.105929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:06:54.111697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:06:54.115607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:06:54.118760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:06:54.124479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:06:54.135457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:54.270795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:54.409401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.132 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/490941fb-7508-43c7-b799-bd57320ae3e7) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:06:54.653114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:54.680304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:54.683749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-724d65a4-add1-49fc-9f22-9d85f08fba1b tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:54.740267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:06:54.748414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:06:54.752327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:06:54.782609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=490941fb-7508-43c7-b799-bd57320ae3e7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:54.788389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:55.262595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:55.321681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:55.520256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:55.525305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:55.529439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ba92a37b-6a08-4fe5-a3a2-e6f523041d68 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:06:55.628271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=490941fb-7508-43c7-b799-bd57320ae3e7,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:06:55.632179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:06:55.646224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:55.840741 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 3c5a79be-47e9-4349-888b-1583fc9d1e45 associated. External IP: 172.26.4.132, port: 5df0a3c9-f104-41de-b8e8-e286ef9617d4. Nov 24 14:06:56.330952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:06:56.527917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:06:56.537989 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] Sync routers for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:06:56.550280 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:56.550875 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:56.552170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:06:56.606837 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5055830 Nov 24 14:06:56.607462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:06:56.609843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47100) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:56.663376 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'status': 'completed', 'code': 200} Nov 24 14:06:56.722260 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-205b4084-a3fb-4e37-909c-86052ecc30e5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/3c5a79be-47e9-4349-888b-1583fc9d1e45 HTTP/1.1" status: 200 len: 991 time: 0.1106000 Nov 24 14:06:56.731266 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:56.764642 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-7137b1b0-0606-4def-b3a9-1b71fd110702 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1098 time: 0.0787497 Nov 24 14:06:56.910140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-00c01127-e586-42e8-8d2f-0822d9e5b571 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:56.911587 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-00c01127-e586-42e8-8d2f-0822d9e5b571 service neutron] 10.222.0.47 "GET /v2.0/networks?id=c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 200 len: 897 time: 0.1405177 Nov 24 14:06:57.017069 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-e4e24c92-88d3-4a91-bde8-29f750ab161c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 200 len: 999 time: 0.0982728 Nov 24 14:06:57.077384 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '3c5a79be-47e9-4349-888b-1583fc9d1e45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.132', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'port_id': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'mac_address': 'fa:16:3e:00:3e:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:06:55Z', 'updated_at': '2021-11-24T14:06:55Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:44Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:57.078188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-82999ddf-2ff7-4298-b25d-5d893f053b7b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:06:57.079604 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-82999ddf-2ff7-4298-b25d-5d893f053b7b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc HTTP/1.1" status: 200 len: 833 time: 0.0569341 Nov 24 14:06:57.081608 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] Checking router: 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:06:57.092414 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:06:57.092996 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:06:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:57.159651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-af760645-fca4-45b7-9825-8cfdaa132b80 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=c1697f17-76bd-420e-a706-2126a4fe54fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0737967 Nov 24 14:06:57.270772 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:06:57.298742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-f120eb1b-bc5e-4367-8da9-3dd7b2fd301f service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1331134 Nov 24 14:06:57.435300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25bc17dc-9990-43ca-ac9e-1623faf5328f req-a58d5501-40e3-4866-82aa-f38cd95754ca service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295466 Nov 24 14:06:57.639478 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '3c5a79be-47e9-4349-888b-1583fc9d1e45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.132', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'port_id': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'mac_address': 'fa:16:3e:00:3e:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:06:55Z', 'updated_at': '2021-11-24T14:06:55Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:44Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:06:57.643338 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c33e6de8-434d-4526-b2d5-fd6e6acc54a2 None None] The sync data for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv is: [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '3c5a79be-47e9-4349-888b-1583fc9d1e45', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.132', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'port_id': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'mac_address': 'fa:16:3e:00:3e:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:06:55Z', 'updated_at': '2021-11-24T14:06:55Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:44Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:06:57.724971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47106) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:57.928900 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-13def24c-9f90-4bc5-81a0-72fb639adf26 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/3c5a79be-47e9-4349-888b-1583fc9d1e45 HTTP/1.1" status: 200 len: 991 time: 0.2026184 Nov 24 14:06:58.932893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47110) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:06:59.036316 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d68baa25-bab1-49aa-b447-a98224024919 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/3c5a79be-47e9-4349-888b-1583fc9d1e45 HTTP/1.1" status: 200 len: 991 time: 0.1021826 Nov 24 14:06:59.388776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1420698-26e6-4da4-b33d-98d3851e9780 None None] New status for floating IP 3c5a79be-47e9-4349-888b-1583fc9d1e45: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:07:00.040787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47114) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:07:00.147275 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8e5d32ee-a82f-4dff-a8d6-0f5fcaa6948a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/3c5a79be-47e9-4349-888b-1583fc9d1e45 HTTP/1.1" status: 200 len: 993 time: 0.1053581 Nov 24 14:07:03.158610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c1237ef1-53c3-4190-9f0e-b5124d903c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:03.545366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:05.723550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-65a7972e-700e-43ce-b70b-85beaddd211d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:05.799996 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:07:06.694259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:08.379154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:17.648364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:29.002081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-f45b997b-fae6-405e-b634-98b58894ceeb service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0788109 Nov 24 14:07:29.144746 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-2c58d51b-de7d-4082-b608-64e68db88ab7 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1098 time: 0.0732989 Nov 24 14:07:29.295718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-8180747b-155a-4109-af32-6d6313b4ee25 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:07:29.297172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-8180747b-155a-4109-af32-6d6313b4ee25 service neutron] 10.222.0.47 "GET /v2.0/networks?id=c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 200 len: 897 time: 0.1325204 Nov 24 14:07:29.401217 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-821c59f6-1f33-4d8e-aa10-bf4d331e5dd7 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 200 len: 1001 time: 0.0970242 Nov 24 14:07:29.464259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-899a726f-b54a-442d-a65d-67c8a40852ef service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:07:29.465922 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-899a726f-b54a-442d-a65d-67c8a40852ef service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc HTTP/1.1" status: 200 len: 833 time: 0.0587068 Nov 24 14:07:29.638168 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-e1acb967-ad82-443b-a3b5-c03a77f3f96a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=c1697f17-76bd-420e-a706-2126a4fe54fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1657031 Nov 24 14:07:29.767479 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-7efb0316-72f4-4abf-97bb-fbac5a5d6189 service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1212144 Nov 24 14:07:29.896844 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-738356d4-1cb9-43ea-8ae9-77c3d894b89f req-03db877c-881c-434e-bec2-f3f644fdb9f8 service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1222484 Nov 24 14:07:33.160503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5897d041-8e33-40e3-a983-c37333c5c1cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:33.548514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:35.728903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-86b8d5ab-5937-46d5-91f4-15500131d8bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:36.696900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:38.381182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:07:42.800250 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:07:47.648203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:03.162586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-488a864f-89d4-408e-b945-9504a8d80395 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:03.550318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:05.731444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4eef9c46-83e3-4f14-b3d9-c3282b1a50d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:06.699831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:08.390426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:09.415481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47140) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:09.522160 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6e29647-2fc8-4990-8c71-29a971a5f640 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/3c5a79be-47e9-4349-888b-1583fc9d1e45 HTTP/1.1" status: 200 len: 993 time: 0.1054325 Nov 24 14:08:09.802694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47148) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:10.006318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 490941fb-7508-43c7-b799-bd57320ae3e7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:08:10.006649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:10.171653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:10.172027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:10.290308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 490941fb-7508-43c7-b799-bd57320ae3e7 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:08:10.436438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:10.440360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23687518-4080-4e7d-ae2f-c7b75780ed9a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:10.480741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=490941fb-7508-43c7-b799-bd57320ae3e7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:10.520396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.520771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.521135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.521492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.521848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.522200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.522553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.522904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.523251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.523597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.523963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:10.526988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:10.586728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:11.084728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:08:11.287771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:08:11.297647 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] Sync routers for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:08:11.307075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:11.309893 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:11.310535 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:11.363009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/3c5a79be-47e9-4349-888b-1583fc9d1e45 HTTP/1.1" status: 204 len: 168 time: 1.5589111 Nov 24 14:08:11.363647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:08:11.439670 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'status': 'completed', 'code': 200} Nov 24 14:08:11.497749 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:11.535095 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-44bcc1aa-0d0e-470e-b477-0941ae80355e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 1098 time: 0.0740466 Nov 24 14:08:11.679853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-2035e291-9db4-4f58-b028-4defe8d11db3 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:11.681302 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-2035e291-9db4-4f58-b028-4defe8d11db3 service neutron] 10.222.0.47 "GET /v2.0/networks?id=c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 200 len: 897 time: 0.1405907 Nov 24 14:08:11.755378 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-d8914237-0e68-48bb-8ab4-85b125d14be2 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 200 len: 217 time: 0.0658426 Nov 24 14:08:11.769552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-769466f1-5c1e-499f-b058-b185b5782a49 req-ad2a2b12-6cbd-4909-b6f4-a353940f2b28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:11.770309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-769466f1-5c1e-499f-b058-b185b5782a49 req-ad2a2b12-6cbd-4909-b6f4-a353940f2b28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:08:11.787777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-769466f1-5c1e-499f-b058-b185b5782a49 req-ad2a2b12-6cbd-4909-b6f4-a353940f2b28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:08:11.789460 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-769466f1-5c1e-499f-b058-b185b5782a49 req-ad2a2b12-6cbd-4909-b6f4-a353940f2b28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 945 time: 0.1028895 Nov 24 14:08:11.822759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-441353a2-af12-4838-90cb-a8ce5d6cde01 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:11.827276 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-441353a2-af12-4838-90cb-a8ce5d6cde01 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc HTTP/1.1" status: 200 len: 833 time: 0.0614264 Nov 24 14:08:11.844347 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:44Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:11.845238 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-769466f1-5c1e-499f-b058-b185b5782a49 req-a5bf604d-3819-4cdf-9cf3-f48a411ec96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498095 Nov 24 14:08:11.848623 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] Checking router: 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:08:11.859402 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:11.860050 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:11.911545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-9bf365d5-9209-48b0-ac83-0a0f952e8e05 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=c1697f17-76bd-420e-a706-2126a4fe54fe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0788374 Nov 24 14:08:12.037311 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:12.045039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-d0f33ce6-4a3e-4e32-b2bb-de5a91b17a7f service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1252220 Nov 24 14:08:12.179021 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d217e7ee-b21d-43bb-9f6b-fea6aa4faba9 req-3648784d-8b89-47f0-9972-b4e7d5dc6786 service neutron] 10.222.0.47 "GET /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273074 Nov 24 14:08:12.378242 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:44Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:12.382160 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28b6075a-1c94-4047-bd27-88e1c5b643b8 None None] The sync data for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv is: [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:06:37Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'debc19e7-bb70-466f-ad27-46d5fd5c15bc', 'name': '', 'network_id': 'c1697f17-76bd-420e-a706-2126a4fe54fe', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:6c:ae:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:37Z', 'updated_at': '2021-11-24T14:06:44Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:08:12.587191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-495c1e57-4ef7-4d95-a5f5-bd6d51a72892 None None] New status for floating IP 3c5a79be-47e9-4349-888b-1583fc9d1e45: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:08:13.044566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08f03b4a-b02c-4c70-9173-441344178862 req-8a897174-7ff4-458f-8f9b-10c77a09f331 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:13.046565 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-08f03b4a-b02c-4c70-9173-441344178862 req-8a897174-7ff4-458f-8f9b-10c77a09f331 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 945 time: 0.0778999 Nov 24 14:08:13.216691 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-08f03b4a-b02c-4c70-9173-441344178862 req-a273f54a-b883-40f4-b910-7842cffc63a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=250b65d7-bc29-4931-b94c-5c83a59f9bdf&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1636848 Nov 24 14:08:13.358928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-ec54f2b2-e86f-4f65-876a-39c00f8e708f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:13.359892 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-ec54f2b2-e86f-4f65-876a-39c00f8e708f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 945 time: 0.0797131 Nov 24 14:08:13.426511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:08:13.426850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:13.765695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 5df0a3c9-f104-41de-b8e8-e286ef9617d4, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5df0a3c9-f104-41de-b8e8-e286ef9617d4,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:13.766048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:13.885691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 5df0a3c9-f104-41de-b8e8-e286ef9617d4 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:08:14.028373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:14.034965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:14.074973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=5df0a3c9-f104-41de-b8e8-e286ef9617d4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:14.088983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.089376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.089753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.090149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.090745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.091108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.091476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.092034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.092536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.092906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.093267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:14.123724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:14.166924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 5df0a3c9-f104-41de-b8e8-e286ef9617d4 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:08:14.169385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:14.173217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'name': 'network-vif-deleted', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:08:14.189110 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6c10d579-552b-4166-83c9-6d23e8d9c9af req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/5df0a3c9-f104-41de-b8e8-e286ef9617d4 HTTP/1.1" status: 204 len: 173 time: 0.8238547 Nov 24 14:08:14.233994 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f14ab18b-a567-4e15-a4d5-96eee21a5ab7', 'name': 'network-vif-deleted', 'tag': '5df0a3c9-f104-41de-b8e8-e286ef9617d4', 'status': 'completed', 'code': 200} Nov 24 14:08:14.392373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7e683caf-1701-4cb4-9f09-ef621c28d440 req-58809633-2ad8-4404-a758-5e1857948025 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:08:14.408530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7e683caf-1701-4cb4-9f09-ef621c28d440 req-58809633-2ad8-4404-a758-5e1857948025 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:08:14.409821 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7e683caf-1701-4cb4-9f09-ef621c28d440 req-58809633-2ad8-4404-a758-5e1857948025 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=f14ab18b-a567-4e15-a4d5-96eee21a5ab7 HTTP/1.1" status: 200 len: 210 time: 0.0634902 Nov 24 14:08:15.516391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47168) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:15.587102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:15.615441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:15.676951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:15.680794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2607e659-35bc-45fa-9f3a-d56bf57646b9 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:15.696279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=250b65d7-bc29-4931-b94c-5c83a59f9bdf,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:15.699158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:15.706397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:15.707498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/250b65d7-bc29-4931-b94c-5c83a59f9bdf HTTP/1.1" status: 204 len: 168 time: 0.1901472 Nov 24 14:08:15.747558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47174) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:16.151380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:16.748026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port debc19e7-bb70-466f-ad27-46d5fd5c15bc {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:08:16.749204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:17.044615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port debc19e7-bb70-466f-ad27-46d5fd5c15bc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=debc19e7-bb70-466f-ad27-46d5fd5c15bc,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:17.045808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:17.164099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for debc19e7-bb70-466f-ad27-46d5fd5c15bc owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:08:17.304973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5df0a3c9-f104-41de-b8e8-e286ef9617d4 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:08:17.341437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 5df0a3c9-f104-41de-b8e8-e286ef9617d4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:08:17.341867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5df0a3c9-f104-41de-b8e8-e286ef9617d4 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:08:17.358363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:17.362568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-62f7ee48-8fa0-401b-a312-492232cadcd1 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:17.407273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=debc19e7-bb70-466f-ad27-46d5fd5c15bc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:17.411267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:17.662820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:17.712885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:18.290994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:08:18.612941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:08:18.621935 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] Sync routers for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:08:18.632960 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/30c9c42c-6f25-4a02-b7c3-4d392c7962d4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8804235 Nov 24 14:08:18.633183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47178) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:18.634055 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:18.634657 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:18.806864 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:18.830658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet 9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:08:18.833563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:18.887587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:18.976673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.050967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.055198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14178355-f0e5-40a9-9700-e7789eaebac8 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:19.085333 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:08:17Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:19.088959 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] Checking router: 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:08:19.090984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:19.094137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:19.099517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.101061 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] Routers {'30c9c42c-6f25-4a02-b7c3-4d392c7962d4'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:19.101922 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:19.109850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdebbc02-6f09-4157-9eec-6d31546d0d2f None None] Network c1697f17-76bd-420e-a706-2126a4fe54fe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:08:19.110387 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/9378ff15-cfa7-4f62-8b50-c1e7a1ed6fbc HTTP/1.1" status: 204 len: 168 time: 0.4724188 Nov 24 14:08:19.110387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47182) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:19.278950 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] Set router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:19.332798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.385907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] DHCP port deletion for c1697f17-76bd-420e-a706-2126a4fe54fe request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:08:19.391751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Deleting port 60d6329c-72bc-45d2-a32f-0364b10a4974 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:08:19.391751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.538417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.549326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 09834853-6b9a-4540-a89e-12fd2e591303 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:08:19.549879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.569728 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:08:17Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:19.573652 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b41d7be9-9e42-4de7-b771-aba1b0afceaf None None] The sync data for ids ['30c9c42c-6f25-4a02-b7c3-4d392c7962d4'] in dv-neutron-818151-2-hyperv is: [{'id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'name': 'tempest-TestNetworkBasicOps-router-64031876', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166'}], 'enable_snat': True}, 'gw_port_id': '09834853-6b9a-4540-a89e-12fd2e591303', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:06:33Z', 'updated_at': '2021-11-24T14:08:17Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '09834853-6b9a-4540-a89e-12fd2e591303', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:82:cc:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '30c9c42c-6f25-4a02-b7c3-4d392c7962d4', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:06:34Z', 'updated_at': '2021-11-24T14:06:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:08:19.601716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] For port 60d6329c-72bc-45d2-a32f-0364b10a4974, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=60d6329c-72bc-45d2-a32f-0364b10a4974,segment=NetworkSegment(641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1),segment_id=641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:19.602221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.720043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Calling delete_port for 60d6329c-72bc-45d2-a32f-0364b10a4974 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:08:19.735000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 09834853-6b9a-4540-a89e-12fd2e591303, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=09834853-6b9a-4540-a89e-12fd2e591303,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:19.735334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.792380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:19.798364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:19.801689 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:08:19.860063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 09834853-6b9a-4540-a89e-12fd2e591303 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:08:19.878211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Pushing event deleted for resources: {'Port': ['ID=60d6329c-72bc-45d2-a32f-0364b10a4974,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:19.889590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.889935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.890269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.890597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.890925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.891249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.891576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.892002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.892314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.892630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.892946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:19.895448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] No DVR routers for this DVR port 60d6329c-72bc-45d2-a32f-0364b10a4974 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:08:19.896841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:20.046807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:20.050964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1c0fbd23-bca2-4f21-9de1-0a527d0765a2 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:20.099790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=09834853-6b9a-4540-a89e-12fd2e591303,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:20.102562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:20.461686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:20.692285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 60d6329c-72bc-45d2-a32f-0364b10a4974 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:08:20.721758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:20.725811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 60d6329c-72bc-45d2-a32f-0364b10a4974 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:08:20.726155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 60d6329c-72bc-45d2-a32f-0364b10a4974 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:08:20.726306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:20.726569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device debc19e7-bb70-466f-ad27-46d5fd5c15bc no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:08:20.752652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:20.753183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router 30c9c42c-6f25-4a02-b7c3-4d392c7962d4 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:08:20.761281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: debc19e7-bb70-466f-ad27-46d5fd5c15bc {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:08:20.761548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device debc19e7-bb70-466f-ad27-46d5fd5c15bc not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:08:20.768228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:20.769447 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/30c9c42c-6f25-4a02-b7c3-4d392c7962d4 HTTP/1.1" status: 204 len: 168 time: 1.6582344 Nov 24 14:08:20.772220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47186) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:20.890057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.020101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.047672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c1697f17-76bd-420e-a706-2126a4fe54fe']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:21.059388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:21.059686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '641f5dbf-1f81-45fa-8cfc-c0d5dc28afc1') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:21.070642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.089197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.097062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 876 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:08:21.097449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:08:21.111744 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:08:21.193816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.198226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.201849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54a146af-a293-4e4f-b2fb-174c55d1e753 tempest-BulkNetworkOpsTest-529810584 tempest-BulkNetworkOpsTest-529810584-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:21.228138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=c1697f17-76bd-420e-a706-2126a4fe54fe,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:21.229144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:21.238695 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/c1697f17-76bd-420e-a706-2126a4fe54fe HTTP/1.1" status: 204 len: 168 time: 0.4624653 Nov 24 14:08:21.256255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47190) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:21.262235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--850096459', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:21.268608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:21.272868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:21.275618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:21.281432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:21.292394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:08:21.295917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.325074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 870} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:08:21.335793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.336352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment e8ad566f-4db7-42a6-9aec-2fae46f0b747 of type vlan for network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 Nov 24 14:08:21.365298 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.397881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.401683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:21.402251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.405927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-72103143-3b71-428a-9266-38858a114f03 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:21.508382 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2509284 Nov 24 14:08:21.509151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:21.510974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47194) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:21.514219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:21.517415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:21.520579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:08:21.524350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:21.528047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:21.530910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:21.537301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:21.546846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.547750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.566442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.713989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.889559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:21.918883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:22.056063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.209 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/9ebeb42f-dd44-485c-9286-b148e7d16575) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:08:22.333452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:22.362723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:22.366239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:22.433566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:08:22.437324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:22.441482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:08:22.468296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=9ebeb42f-dd44-485c-9286-b148e7d16575,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:22.473077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:22.599318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:22.600038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:22.606267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 09834853-6b9a-4540-a89e-12fd2e591303 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:08:22.642488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 09834853-6b9a-4540-a89e-12fd2e591303 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:08:22.642836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 09834853-6b9a-4540-a89e-12fd2e591303 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:08:22.825370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:08:23.022484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:08:23.032199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:08:23.044012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:23.045554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:23.049255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:23.050832 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 1.5389423 Nov 24 14:08:23.053943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47198) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:23.221508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:23.273782 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-23baba61-af65-429c-a8f1-abe29f4f31dd tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2161777 Nov 24 14:08:23.274057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47204) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:23.408689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a280a4e3-e8dc-4e83-bd17-3c9ec436d2b0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:23.410160 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a280a4e3-e8dc-4e83-bd17-3c9ec436d2b0 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1354175 Nov 24 14:08:23.413018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47208) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:23.453287 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50381685-2209-4492-a84f-7ca82ac65bfe tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0389581 Nov 24 14:08:23.456603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47212) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:23.462000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2027384846', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:23.520775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:22Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:23.524840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:08:23.525129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Updating router f155f28f-7f5e-44ad-b1e9-fce1cdada254 port 9ebeb42f-dd44-485c-9286-b148e7d16575 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:08:23.572932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:23.577717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:23.577909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:23.580781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:23.586994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:23.597282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:08:23.699784 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:23.910961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:23.923636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Transition to ACTIVE for port object 9ebeb42f-dd44-485c-9286-b148e7d16575 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:23.930276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:23.934478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5749ae8c-fa02-49c3-8e9d-8c03a4aa9f73 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:23.938309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:23.942504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b3562a9b-6909-4728-9b30-867023a4804b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:24.013464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4b12f4-ed8a-4365-a7b9-f59e4dfbef2c None None] Pushing event updated for resources: {'Port': ['ID=9ebeb42f-dd44-485c-9286-b148e7d16575,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:24.015845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Attempting to bind port 9ebeb42f-dd44-485c-9286-b148e7d16575 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:08:24.016219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Attempting to bind port 9ebeb42f-dd44-485c-9286-b148e7d16575 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:08:24.016583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Attempting to bind port 9ebeb42f-dd44-485c-9286-b148e7d16575 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:08:24.019295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f4b12f4-ed8a-4365-a7b9-f59e4dfbef2c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:24.020413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=da366766-4af0-4f2e-a6df-a10428a0ffcb,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:24.024104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 8, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:08:24.024477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:08:24.024875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:24.025027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:24.025324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:08:24.025797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Bound port: 9ebeb42f-dd44-485c-9286-b148e7d16575, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:08:24.026203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:24.033089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:08:24.033442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:08:24.055456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:08:24.065949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:24.070091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:24.070682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:24.076453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4612ae09-0331-4ed4-b391-6887ad942dc0 None None] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:08:24.095468 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.6375928 Nov 24 14:08:24.097928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47216) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:24.177323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] For port 9ebeb42f-dd44-485c-9286-b148e7d16575, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:08:24.198802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] For port 9ebeb42f-dd44-485c-9286-b148e7d16575, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9ebeb42f-dd44-485c-9286-b148e7d16575,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:08:24.216201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:24.230057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d1e94c2a-4388-4f88-85df-998620d62484 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:24.390309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f4b12f4-ed8a-4365-a7b9-f59e4dfbef2c None None] Pushing event updated for resources: {'Port': ['ID=9ebeb42f-dd44-485c-9286-b148e7d16575,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:24.398275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f4b12f4-ed8a-4365-a7b9-f59e4dfbef2c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:24.405355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:24.405996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:24.586526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:08:24.587342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:24.701521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:24.953588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Allocated IP 172.20.0.2 (74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2/da366766-4af0-4f2e-a6df-a10428a0ffcb/22690a81-be2e-4767-ad4a-744408ddf760) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:08:25.029991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.205301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:22Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:25.217339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9fd3f0c3-ab48-4a36-a958-ffc4ec96c70f None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:22Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:08:25.252935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.266721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Transition to ACTIVE for port object 22690a81-be2e-4767-ad4a-744408ddf760 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:25.287892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Transition to ACTIVE for port object 22690a81-be2e-4767-ad4a-744408ddf760 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:25.297961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.304998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f4b12f4-ed8a-4365-a7b9-f59e4dfbef2c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:25.372317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:08:25.376486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:25.378919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:08:25.385241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Pushing event updated for resources: {'Port': ['ID=22690a81-be2e-4767-ad4a-744408ddf760,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:25.387793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:25.462537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2/da366766-4af0-4f2e-a6df-a10428a0ffcb/38204ba7-2c57-40cb-b623-d6eebbe48757) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:08:25.498161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Attempting to bind port 22690a81-be2e-4767-ad4a-744408ddf760 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:08:25.498539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Attempting to bind port 22690a81-be2e-4767-ad4a-744408ddf760 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:08:25.498905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Attempting to bind port 22690a81-be2e-4767-ad4a-744408ddf760 on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:08:25.510268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 8, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:08:25.510653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Checking segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:08:25.511193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.511515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Bound using segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:08:25.512017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Bound port: 22690a81-be2e-4767-ad4a-744408ddf760, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:08:25.512391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.610201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:08:25.613773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=22690a81-be2e-4767-ad4a-744408ddf760,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:08:25.618937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.623574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:25.662830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.681896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 38204ba7-2c57-40cb-b623-d6eebbe48757 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:25.710729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.717821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:25.722080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Pushing event updated for resources: {'Port': ['ID=22690a81-be2e-4767-ad4a-744408ddf760,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:25.725673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:25.780084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:08:25.788169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:25.793212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:08:25.828453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=38204ba7-2c57-40cb-b623-d6eebbe48757,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:25.833076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:25.858995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:25.967239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:26.496589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:26.502524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:26.528367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17df2747-d5d7-4063-a20d-7ed08662e9e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:26.620695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=38204ba7-2c57-40cb-b623-d6eebbe48757,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:26.623854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:26.627489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:26.662244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fde1e5b-155e-441a-9c01-2a056d1c52cb None None] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:08:26.737332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 22690a81-be2e-4767-ad4a-744408ddf760 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:26.771256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:08:26.772531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:26.828404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c182f431-797f-41f9-846b-7d7cf45f2f33 None None] Provisioning for port 22690a81-be2e-4767-ad4a-744408ddf760 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:26.896090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 22690a81-be2e-4767-ad4a-744408ddf760 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:26.957290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 22690a81-be2e-4767-ad4a-744408ddf760 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:26.957591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.129470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.166373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:08:27.172615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=22690a81-be2e-4767-ad4a-744408ddf760,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:27.177145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.178168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9ebeb42f-dd44-485c-9286-b148e7d16575 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:27.203616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1837f0ea-61ae-46b6-8730-e264b8cb844e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:27.299816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=22690a81-be2e-4767-ad4a-744408ddf760,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:27.303102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:27.316888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 9ebeb42f-dd44-485c-9286-b148e7d16575 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:27.323432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9ebeb42f-dd44-485c-9286-b148e7d16575 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:27.323982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.396193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:08:27.415820 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/f155f28f-7f5e-44ad-b1e9-fce1cdada254/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3152733 Nov 24 14:08:27.416872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47220) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:27.455330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.479710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 9ebeb42f-dd44-485c-9286-b148e7d16575, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9ebeb42f-dd44-485c-9286-b148e7d16575,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:27.487969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.490385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:27.523044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-97d97479-8415-4c27-bfa9-d3513519e473 None None] Provisioning complete for port 22690a81-be2e-4767-ad4a-744408ddf760 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:27.523527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97d97479-8415-4c27-bfa9-d3513519e473 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.573042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40020bcf-f631-4835-9d28-337c79fe4a8a tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.573555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40020bcf-f631-4835-9d28-337c79fe4a8a tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.573773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40020bcf-f631-4835-9d28-337c79fe4a8a tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.574280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40020bcf-f631-4835-9d28-337c79fe4a8a tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.580681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-40020bcf-f631-4835-9d28-337c79fe4a8a tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2885 time: 0.1578131 Nov 24 14:08:27.580681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47224) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:27.605239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=9ebeb42f-dd44-485c-9286-b148e7d16575,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:27.609010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:27.651797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-236808b0-c70e-4753-b0ed-55dbf1fc849b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.652164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-236808b0-c70e-4753-b0ed-55dbf1fc849b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.652497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-236808b0-c70e-4753-b0ed-55dbf1fc849b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.652856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-236808b0-c70e-4753-b0ed-55dbf1fc849b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:27.654851 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-236808b0-c70e-4753-b0ed-55dbf1fc849b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2728 time: 0.0733359 Nov 24 14:08:27.657539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47228) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:27.689141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-97d97479-8415-4c27-bfa9-d3513519e473 None None] Provisioning for port 38204ba7-2c57-40cb-b623-d6eebbe48757 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:27.694276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-97d97479-8415-4c27-bfa9-d3513519e473 None None] Provisioning complete for port 38204ba7-2c57-40cb-b623-d6eebbe48757 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:27.694792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97d97479-8415-4c27-bfa9-d3513519e473 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.752045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-97d97479-8415-4c27-bfa9-d3513519e473 None None] Port 38204ba7-2c57-40cb-b623-d6eebbe48757 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:08:27.872239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-083ce90c-7de9-41a6-a357-88f86f3a0881 None None] Provisioning complete for port 38204ba7-2c57-40cb-b623-d6eebbe48757 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:27.872668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-083ce90c-7de9-41a6-a357-88f86f3a0881 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:27.927721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-083ce90c-7de9-41a6-a357-88f86f3a0881 None None] Port 38204ba7-2c57-40cb-b623-d6eebbe48757 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:08:27.981001 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5cb47321-4fb8-4ffd-a4e4-93a2ed800660 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1608 time: 0.3222866 Nov 24 14:08:28.300030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47234) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:28.305631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-516468931', 'description': 'tempest-secgroup-smoke-516468931 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:28.311575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:28.315645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:28.318461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:28.324889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:28.335724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.371946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:28.384074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:28.386934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:28.393778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:28.455058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.458839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.464086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e72d6f1b-258a-46a4-a75d-f0385f663da3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:28.504739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=909ca93b-001c-4b07-b757-628b41a89eba,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:28.507808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.508989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.2079461 Nov 24 14:08:28.509858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:28.511872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47238) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:28.517957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '909ca93b-001c-4b07-b757-628b41a89eba', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:28.524704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:28.528595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:28.532224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:28.537920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:28.554653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.620372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.626497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.628797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-353c04fd-6088-4948-89d1-e2ec65fad4cd tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:28.652281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1531ebf7-5e7b-4085-b604-5f28a351af5d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:28.658056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:28.664618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.668712 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1533570 Nov 24 14:08:28.669462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47242) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:28.670172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 22690a81-be2e-4767-ad4a-744408ddf760 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:28.675474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '909ca93b-001c-4b07-b757-628b41a89eba', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:28.681722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:28.686594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:28.690156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:28.696575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:28.715194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.739486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 22690a81-be2e-4767-ad4a-744408ddf760 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:28.740101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.783429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.787299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.789126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:28.811816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f1c45162-742c-401d-967d-cd6b279eb501,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:28.814312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:28.823394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.828263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47246) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:28.828509 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1576326 Nov 24 14:08:28.835001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '909ca93b-001c-4b07-b757-628b41a89eba', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:28.842061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:28.847881 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:08:28.852424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:28.855788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:28.859071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9ebeb42f-dd44-485c-9286-b148e7d16575 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:28.862466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:28.869102 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:28.869706 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:28.880196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.931943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9ebeb42f-dd44-485c-9286-b148e7d16575 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:28.932325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.946171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.951902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.953649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:28.979109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6301a275-5faf-4926-a14a-d751291e323e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:28.984318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:28.992615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:28.994042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1643705 Nov 24 14:08:28.996789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47250) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:29.003362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '909ca93b-001c-4b07-b757-628b41a89eba', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:29.009078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:29.013007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:29.016932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:29.022656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:29.039022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.075417 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:29.103427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.107673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.109662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1f730d80-cc5f-48b7-9093-fd009df8cdb3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:29.131975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=061892a6-1a28-4040-b58c-13bfebde7036,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:29.134583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:29.142959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.144180 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1456251 Nov 24 14:08:29.147014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47254) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:29.152690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '909ca93b-001c-4b07-b757-628b41a89eba', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:29.158675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:29.162474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:29.165344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:29.171679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:29.181962 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:08:29.189668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.257191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.261121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.267550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4a8ff753-ea02-47e5-8600-90217c44a1d7 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:29.281340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0390185a-3a8a-4575-b722-2cb9a93de45a,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:29.284176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:29.301330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.302958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1550906 Nov 24 14:08:29.305657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47258) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:29.311831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '909ca93b-001c-4b07-b757-628b41a89eba', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:29.317632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:29.321425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:29.324260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:29.330616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:29.341580 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:08:29.348398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.400222 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:26Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:29.404232 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:08:29.404596 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Updating router f155f28f-7f5e-44ad-b1e9-fce1cdada254 port 38204ba7-2c57-40cb-b623-d6eebbe48757 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:08:29.421855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.427115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.429356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ef79d4c6-c152-4913-a75b-1e99c22bc687 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:29.452822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=30af89b8-cbb7-4113-89d8-45a983181372,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:29.455391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:29.462624 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.465039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.467521 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1609559 Nov 24 14:08:29.651926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-acddee34-e23f-46ad-9005-f291a7f0a11a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:08:29.668010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-acddee34-e23f-46ad-9005-f291a7f0a11a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:08:29.669152 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-acddee34-e23f-46ad-9005-f291a7f0a11a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-516468931&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0564005 Nov 24 14:08:29.812923 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.825300 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Transition to ACTIVE for port object 38204ba7-2c57-40cb-b623-d6eebbe48757 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:29.833273 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:29.836995 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0bed834e-06e6-402a-9281-69fdfd13e096 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:29.927749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-72ce37de-0983-48b0-a0b6-17fb0eea2a26 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:29.928471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-72ce37de-0983-48b0-a0b6-17fb0eea2a26 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:08:29.947131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-72ce37de-0983-48b0-a0b6-17fb0eea2a26 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:08:29.948371 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-72ce37de-0983-48b0-a0b6-17fb0eea2a26 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 796 time: 0.2709408 Nov 24 14:08:29.968660 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-5227959a-df9c-47cd-a9fd-0825247058f8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0119078 Nov 24 14:08:29.996420 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Pushing event updated for resources: {'Port': ['ID=38204ba7-2c57-40cb-b623-d6eebbe48757,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:30.038739 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.039082 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.039418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.039777 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.040103 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.040432 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.040755 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.041078 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.041395 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.041713 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.042031 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:08:30.050096 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:30.061702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-456441d0-90f1-43e5-a214-80a6549e5741 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0876265 Nov 24 14:08:30.067044 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Attempting to bind port 38204ba7-2c57-40cb-b623-d6eebbe48757 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:08:30.067425 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Attempting to bind port 38204ba7-2c57-40cb-b623-d6eebbe48757 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:08:30.067818 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Attempting to bind port 38204ba7-2c57-40cb-b623-d6eebbe48757 on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:08:30.075009 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 8, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:08:30.075434 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Checking segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:08:30.075866 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:30.076428 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Bound using segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:08:30.076897 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Bound port: 38204ba7-2c57-40cb-b623-d6eebbe48757, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:08:30.077273 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:30.182519 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] For port 38204ba7-2c57-40cb-b623-d6eebbe48757, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:08:30.186108 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] For port 38204ba7-2c57-40cb-b623-d6eebbe48757, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=38204ba7-2c57-40cb-b623-d6eebbe48757,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:08:30.193784 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:30.198312 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d6cc2dfd-8b6d-4edd-8be8-41368b737188 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:30.279184 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:30.279930 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:30.300062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-048bf025-3257-40a8-933f-7f7f3c2e760b service neutron] 10.222.0.70 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2257791 Nov 24 14:08:30.349060 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Pushing event updated for resources: {'Port': ['ID=38204ba7-2c57-40cb-b623-d6eebbe48757,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:30.354121 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:30.451462 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-c8b7cf0b-cbf4-47b5-b394-6cc5b4741eed service neutron] 10.222.0.70 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1502829 Nov 24 14:08:30.483421 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:30.655309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-998ec5a5-40de-4fda-b7e8-6a57123afbbc req-72150935-94d4-4114-887a-b93af2b85df8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:08:30.672124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-998ec5a5-40de-4fda-b7e8-6a57123afbbc req-72150935-94d4-4114-887a-b93af2b85df8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:08:30.673294 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-998ec5a5-40de-4fda-b7e8-6a57123afbbc req-72150935-94d4-4114-887a-b93af2b85df8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 210 time: 0.0656333 Nov 24 14:08:30.838650 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:30Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:30.843421 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-597682a9-371e-4228-9abc-48a4c2a9cda9 None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:30Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:08:31.835614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ee132323-3c1b-4926-9917-02b2624aa2f1 req-2aea0254-d18a-414b-9a8e-32cd4cf236aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 210 time: 0.0412955 Nov 24 14:08:32.670471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 38204ba7-2c57-40cb-b623-d6eebbe48757 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:32.739934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 38204ba7-2c57-40cb-b623-d6eebbe48757 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:32.744588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 38204ba7-2c57-40cb-b623-d6eebbe48757 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:32.744969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:32.887985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:32.925131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 38204ba7-2c57-40cb-b623-d6eebbe48757, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=38204ba7-2c57-40cb-b623-d6eebbe48757,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:32.930533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:32.933776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:32.970321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-1ea8e952-db37-49a5-986b-4e00651a19de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:32.972023 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-1ea8e952-db37-49a5-986b-4e00651a19de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 796 time: 0.1659398 Nov 24 14:08:33.048555 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-83a0c6f1-7b09-443e-b1fa-f43c06ef9f89 req-94326769-afa4-4822-87db-27bef31e87a3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 210 time: 0.0578692 Nov 24 14:08:33.049385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=38204ba7-2c57-40cb-b623-d6eebbe48757,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:33.052609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:33.056367 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-d2174c6f-21c4-4557-a57c-a17687be09cb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 379 time: 0.0706751 Nov 24 14:08:33.069961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['909ca93b-001c-4b07-b757-628b41a89eba']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:33.165165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2ca29506-c94c-4912-96e2-8204fffba60f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.209642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:33.220347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:33.228963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:08:33.232857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.400117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.13 (74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2/da366766-4af0-4f2e-a6df-a10428a0ffcb/ddb9ab40-dedb-40f5-b809-4fcb399c361c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:08:33.553348 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.594578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.610245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object ddb9ab40-dedb-40f5-b809-4fcb399c361c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:33.632065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.637469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b86e193-403c-483d-a0c2-3c5000722889 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:33.699910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:08:33.707374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:33.711737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:08:33.741992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=ddb9ab40-dedb-40f5-b809-4fcb399c361c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:33.748643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:33.777499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:33.778117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.803844 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7383351 Nov 24 14:08:33.815462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Request body: {'port': {'device_id': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:33.928102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.930272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-390552db-a984-4e01-92b8-749eb3881608 None None] Provisioning for port ddb9ab40-dedb-40f5-b809-4fcb399c361c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:33.936261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-390552db-a984-4e01-92b8-749eb3881608 None None] Provisioning complete for port ddb9ab40-dedb-40f5-b809-4fcb399c361c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:33.936512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-390552db-a984-4e01-92b8-749eb3881608 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:33.989038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-390552db-a984-4e01-92b8-749eb3881608 None None] Port ddb9ab40-dedb-40f5-b809-4fcb399c361c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:08:34.422039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f94fd9-ddc1-4066-b24c-9f886c42aea2 req-69d9db8b-2d3e-4203-87bb-4027f310a05e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:34.422727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f4f94fd9-ddc1-4066-b24c-9f886c42aea2 req-69d9db8b-2d3e-4203-87bb-4027f310a05e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:08:34.435154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ddb9ab40-dedb-40f5-b809-4fcb399c361c {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:08:34.445575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:34.455968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f4f94fd9-ddc1-4066-b24c-9f886c42aea2 req-69d9db8b-2d3e-4203-87bb-4027f310a05e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:08:34.457094 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f4f94fd9-ddc1-4066-b24c-9f886c42aea2 req-69d9db8b-2d3e-4203-87bb-4027f310a05e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 932 time: 0.2947216 Nov 24 14:08:34.464383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Transition to ACTIVE for port object ddb9ab40-dedb-40f5-b809-4fcb399c361c will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:08:34.479981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:34.486161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-543e9aa8-6224-4461-be28-15e70bdccd86 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:34.619190 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f4f94fd9-ddc1-4066-b24c-9f886c42aea2 req-7ab1e576-f653-4fdd-a7ab-27d08f51e3da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1565831 Nov 24 14:08:34.634230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Pushing event updated for resources: {'Port': ['ID=ddb9ab40-dedb-40f5-b809-4fcb399c361c,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:34.637195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:34.672293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 38204ba7-2c57-40cb-b623-d6eebbe48757 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:34.746596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 38204ba7-2c57-40cb-b623-d6eebbe48757 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:34.747190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:34.752489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Attempting to bind port ddb9ab40-dedb-40f5-b809-4fcb399c361c on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:08:34.752819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Attempting to bind port ddb9ab40-dedb-40f5-b809-4fcb399c361c by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:08:34.753144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Attempting to bind port ddb9ab40-dedb-40f5-b809-4fcb399c361c on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:08:34.758798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Port ddb9ab40-dedb-40f5-b809-4fcb399c361c on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:08:34.759112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Attempting to bind port ddb9ab40-dedb-40f5-b809-4fcb399c361c on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:08:34.766464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 8, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:08:34.766789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Checking segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:08:34.767166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Bound using segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:08:34.767576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Bound port: ddb9ab40-dedb-40f5-b809-4fcb399c361c, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:08:34.767949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:34.855053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] For port ddb9ab40-dedb-40f5-b809-4fcb399c361c, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:08:34.858704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] For port ddb9ab40-dedb-40f5-b809-4fcb399c361c, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:08:34.863988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:34.869146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a73b8404-3194-4e05-a2d5-9440d5c1ee5f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:34.933221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:34.934587 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] 10.222.0.47 "PUT /v2.0/ports/ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 1094 time: 1.1235480 Nov 24 14:08:34.936284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:08:34.952871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Pushing event updated for resources: {'Port': ['ID=ddb9ab40-dedb-40f5-b809-4fcb399c361c,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:34.955693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:35.014817 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'status': 'completed', 'code': 200} Nov 24 14:08:35.057378 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-b4840cda-e358-4645-a381-7e3fb0f725cf service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1097 time: 0.0740619 Nov 24 14:08:35.130835 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-374846f3-a51f-47cd-8967-e6f76dbe2437 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 217 time: 0.0659423 Nov 24 14:08:35.192663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-1ab69f74-c95e-4a5c-9b42-55f8765d4f2f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:35.194087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-1ab69f74-c95e-4a5c-9b42-55f8765d4f2f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0572164 Nov 24 14:08:35.269038 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-d849caf5-334f-420d-b3d9-33da70a533e6 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0688970 Nov 24 14:08:35.411098 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-583ee66a-30af-4851-8134-b3ca684c83a1 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1358225 Nov 24 14:08:35.550991 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5727e07d-1f83-4fb6-bbf3-8c68cadd10fa req-88df48fe-aae1-4617-88c2-ecc50f143f6e service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334422 Nov 24 14:08:35.675715 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-b6efb541-d206-4342-aac9-0318d2e4a279 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1097 time: 0.0781193 Nov 24 14:08:35.734563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ec071a2-a757-4c0b-ab08-41b7b9a56e0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:35.868585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-e04e57a1-8280-4718-a930-7d91bb33417c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:35.870044 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-e04e57a1-8280-4718-a930-7d91bb33417c service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1876032 Nov 24 14:08:35.975511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd71d5f-1b72-4b46-a23e-690225e13c05 req-0eed4620-5fee-41c4-b364-2f4394455dcd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:35.976897 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-efd71d5f-1b72-4b46-a23e-690225e13c05 req-0eed4620-5fee-41c4-b364-2f4394455dcd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 944 time: 0.2200832 Nov 24 14:08:35.978289 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-7cd0f996-4ba0-423b-a5a4-511b179974a0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 217 time: 0.0980992 Nov 24 14:08:36.167748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-d5564ac7-5655-498b-b165-85b6fe6e7019 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:36.169235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-d5564ac7-5655-498b-b165-85b6fe6e7019 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.1849198 Nov 24 14:08:36.171489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-efd71d5f-1b72-4b46-a23e-690225e13c05 req-521d106d-6ba5-4e08-8637-ed1fa5b8b40a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1889503 Nov 24 14:08:36.249602 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-1d0a9bfb-1803-4d2d-bc7b-a95da884c2a8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0730038 Nov 24 14:08:36.381121 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-80677dbc-2082-4bd4-ad88-6e17fc3f2a47 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255586 Nov 24 14:08:36.512934 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74ab1c0a-1d34-4781-bd26-18f3239a7b28 req-a31e1e7e-90e4-4169-9891-80f2a7c54ad2 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248302 Nov 24 14:08:36.703379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:37.373901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-984f49c9-2729-4b8a-9e05-7787b217d6b7 req-47cef507-cfd0-4217-88b1-b2e8b64c6926 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:37.375368 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-984f49c9-2729-4b8a-9e05-7787b217d6b7 req-47cef507-cfd0-4217-88b1-b2e8b64c6926 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 944 time: 0.0799510 Nov 24 14:08:37.426532 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-984f49c9-2729-4b8a-9e05-7787b217d6b7 req-80f2faaa-f29e-4327-989f-2319f77adefa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455632 Nov 24 14:08:38.387475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:38.627141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961b55aa-b241-4147-8c0f-0073bdbd1167 req-15937292-8355-47f9-b17e-52edb213714f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:38.628608 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-961b55aa-b241-4147-8c0f-0073bdbd1167 req-15937292-8355-47f9-b17e-52edb213714f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 944 time: 0.0765793 Nov 24 14:08:38.677369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-961b55aa-b241-4147-8c0f-0073bdbd1167 req-acde61c6-4264-44d2-8199-cc6f86979958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433254 Nov 24 14:08:39.398063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ddb9ab40-dedb-40f5-b809-4fcb399c361c details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:08:39.531255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port ddb9ab40-dedb-40f5-b809-4fcb399c361c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:39.545511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'port_id': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'mac_address': 'fa:16:3e:4b:f6:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 870, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:08:39.598844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:39.616302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ddb9ab40-dedb-40f5-b809-4fcb399c361c {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:08:39.632478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port ddb9ab40-dedb-40f5-b809-4fcb399c361c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:39.638451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:39.641466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:39.707139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=ddb9ab40-dedb-40f5-b809-4fcb399c361c,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:39.710220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:39.880912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4735c0d0-b544-489d-8d62-430e530cc88f req-d8a73a0e-d274-46b2-8b85-678fd7e139dd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:39.882347 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4735c0d0-b544-489d-8d62-430e530cc88f req-d8a73a0e-d274-46b2-8b85-678fd7e139dd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 945 time: 0.0777683 Nov 24 14:08:39.927568 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4735c0d0-b544-489d-8d62-430e530cc88f req-60b92ce8-c8ae-4b09-ac95-55b94b904c34 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396943 Nov 24 14:08:39.983451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['ddb9ab40-dedb-40f5-b809-4fcb399c361c'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:08:41.128024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5437d661-e022-4657-b04f-1f8d0eb86d17 req-536d5150-6d9a-47f0-8fb7-401bf5884d72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:41.129448 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5437d661-e022-4657-b04f-1f8d0eb86d17 req-536d5150-6d9a-47f0-8fb7-401bf5884d72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 945 time: 0.0780106 Nov 24 14:08:41.174784 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5437d661-e022-4657-b04f-1f8d0eb86d17 req-bb5afb4d-1016-4c06-8d34-f561bc54e8ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398235 Nov 24 14:08:41.444856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ddb9ab40-dedb-40f5-b809-4fcb399c361c up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:08:41.512622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port ddb9ab40-dedb-40f5-b809-4fcb399c361c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:08:41.517435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port ddb9ab40-dedb-40f5-b809-4fcb399c361c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:08:41.517819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:41.632492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:41.659643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:08:41.671436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port ddb9ab40-dedb-40f5-b809-4fcb399c361c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:08:41.675373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:41.677240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:41.745044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=ddb9ab40-dedb-40f5-b809-4fcb399c361c,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:41.748190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:41.831107 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'code': 200} Nov 24 14:08:42.059064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6a19b7cd-ac52-4e39-a4ae-e360c49b7ca3 req-8d64822b-38f6-4dd6-bb9e-8ec31fe604ba service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1099 time: 0.0710347 Nov 24 14:08:42.101309 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6a19b7cd-ac52-4e39-a4ae-e360c49b7ca3 req-365db2d8-7f78-4ed7-b15f-983ee54f3007 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0356255 Nov 24 14:08:42.370345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9f36768-c992-4ded-8bda-0de939fad8c0 req-df6a9b01-d1b4-4215-a1c3-8439fb7ac356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:42.371792 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d9f36768-c992-4ded-8bda-0de939fad8c0 req-df6a9b01-d1b4-4215-a1c3-8439fb7ac356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 946 time: 0.0776329 Nov 24 14:08:42.417007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d9f36768-c992-4ded-8bda-0de939fad8c0 req-0270c31f-688f-479a-9899-003cdd8f9b67 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390518 Nov 24 14:08:43.616789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ea8220-c866-4120-a70d-f7cecf9a7120 req-ae328766-094b-4e9e-93c6-8d4b1f47f145 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:43.618153 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b0ea8220-c866-4120-a70d-f7cecf9a7120 req-ae328766-094b-4e9e-93c6-8d4b1f47f145 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 946 time: 0.0811176 Nov 24 14:08:43.664209 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b0ea8220-c866-4120-a70d-f7cecf9a7120 req-159761f0-fb6c-4d02-98be-db10ce99a3cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404196 Nov 24 14:08:43.862405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63e9594-f88b-449c-a413-2d6cf2e83453 req-350543e0-b996-423f-a61e-09269f791827 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:43.863844 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b63e9594-f88b-449c-a413-2d6cf2e83453 req-350543e0-b996-423f-a61e-09269f791827 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 946 time: 0.0801082 Nov 24 14:08:43.909331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b63e9594-f88b-449c-a413-2d6cf2e83453 req-7de92402-0b8d-40bd-b36a-0ab1c191bcf1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398467 Nov 24 14:08:43.937407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47316) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:44.013685 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e598bd0f-5092-4592-af57-e45820e9978f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1094 time: 0.0744159 Nov 24 14:08:44.016972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47320) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:44.023408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:08:44.029390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:08:44.033219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:08:44.036051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:08:44.041646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:08:44.052284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:44.187551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:44.324998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.69 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/8c26b02d-f8a2-4739-a190-3ab2469a25b8) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:08:44.473104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:44.501160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:44.505526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:44.573771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:08:44.574861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:08:44.579067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:08:44.603893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=8c26b02d-f8a2-4739-a190-3ab2469a25b8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:44.609482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:45.179410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:45.235296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:45.444009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:45.448214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:45.453122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3a473123-9a02-411c-8c2a-410d1ee8e4ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:08:45.546598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=8c26b02d-f8a2-4739-a190-3ab2469a25b8,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:08:45.550445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:08:45.567174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:45.756839 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e associated. External IP: 172.26.4.69, port: ddb9ab40-dedb-40f5-b809-4fcb399c361c. Nov 24 14:08:46.141919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:08:46.336557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:08:46.347612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:08:46.359478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:46.360175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:46.363518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:46.527776 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5095618 Nov 24 14:08:46.529073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:08:46.531351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47324) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:46.544324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:46.582335 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'status': 'completed', 'code': 200} Nov 24 14:08:46.646883 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4eaabaf9-9bd1-4e92-85f4-ed4c1bbdbbe3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 991 time: 0.1140869 Nov 24 14:08:46.679591 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-cdf4b835-6dca-4123-9d43-1dd131c2be48 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1099 time: 0.0747375 Nov 24 14:08:46.811844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-15bab4c9-cf7a-4313-a44d-b97e9629aafa service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:46.813196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-15bab4c9-cf7a-4313-a44d-b97e9629aafa service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1274073 Nov 24 14:08:46.916319 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-4f07cb41-4d4d-4b3b-b860-934bd173c61f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 999 time: 0.0967541 Nov 24 14:08:46.929964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '03e6bf9f-4baf-4f8b-9557-57b9f742a98e', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.69', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'port_id': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'mac_address': 'fa:16:3e:4b:f6:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:08:45Z', 'updated_at': '2021-11-24T14:08:45Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:46.933862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:08:46.944935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:08:46.945555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:08:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:46.978501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-aef47648-941d-4764-853c-f6083ef5508f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:08:46.979943 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-aef47648-941d-4764-853c-f6083ef5508f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0571084 Nov 24 14:08:47.057946 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-0da8e795-061e-44d4-a510-48a2bc9743a6 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0720367 Nov 24 14:08:47.127157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:08:47.190010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-1d0e760e-6818-44ae-8f30-8b4d04ef2838 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1250279 Nov 24 14:08:47.323418 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1a9a6c0-c03b-4d2b-80cb-14a4e9e3b56e req-39d6a199-bb2f-47f2-9501-c749f5255029 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273143 Nov 24 14:08:47.484130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '03e6bf9f-4baf-4f8b-9557-57b9f742a98e', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.69', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'port_id': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'mac_address': 'fa:16:3e:4b:f6:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:08:45Z', 'updated_at': '2021-11-24T14:08:45Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:08:47.488110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7356d344-e81b-4f43-bdec-f26062f14421 None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '03e6bf9f-4baf-4f8b-9557-57b9f742a98e', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.69', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'port_id': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'mac_address': 'fa:16:3e:4b:f6:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:08:45Z', 'updated_at': '2021-11-24T14:08:45Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:08:47.648964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47330) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:47.656793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:08:47.759399 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2060ffcf-e3ce-4a59-9c71-dc4114d7ffbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 991 time: 0.1091571 Nov 24 14:08:47.795335 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-874731a3-4675-4e81-830b-b1c878850f15 None None] New status for floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:08:48.763331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47334) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:08:48.874987 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-97b2a87b-c1bb-4233-935b-411eb9252af5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 993 time: 0.1103621 Nov 24 14:08:56.801382 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:09:03.167309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a940f93-3bd9-43d2-8905-015df5a71ad4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:03.556089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:05.737812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-38b35be8-4413-462b-ac04-d41dcabc48da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:06.705888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:08.390566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:17.662118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:33.169669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6ee854e9-8611-43ec-bc07-fccd32231106 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:33.557527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:33.769319 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-34cecf56-5ebb-43d9-91c9-2c156742913e service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0693045 Nov 24 14:09:33.801015 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:09:33.903432 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-1d7308da-d039-4bed-a180-802841beadf6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1099 time: 0.0674083 Nov 24 14:09:34.048055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-35ea4d16-6e69-4840-ae33-5b931ba01a67 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:09:34.050637 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-35ea4d16-6e69-4840-ae33-5b931ba01a67 service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1281078 Nov 24 14:09:34.154722 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-542c4624-ed1b-45c6-b5b3-52dcac1b1711 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 1001 time: 0.0978203 Nov 24 14:09:34.225404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-e0d887ec-1860-4411-afb9-6d2ca5fda909 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:09:34.226820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-e0d887ec-1860-4411-afb9-6d2ca5fda909 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0647447 Nov 24 14:09:34.304033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-b02e18bb-d37d-4618-8242-4c2210e95d53 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0708754 Nov 24 14:09:34.538469 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-09902057-c383-4b17-bbce-ed0bac5e3f8b service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2279880 Nov 24 14:09:34.669732 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-925d56be-e0b5-4ab7-90c2-0de05dc1f07b req-bdcf5e10-fa3a-4433-ae10-67c70fc7ab0c service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237752 Nov 24 14:09:35.739325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3bcb09ef-8017-43d0-9ac7-f24a592b58e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:36.708255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:38.392858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:47.665810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:09:59.967884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47362) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:00.046409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8fa73756-85b6-44b3-9c4e-06eb6d96b842 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?project_id=8266f75badc14ec9b01ae6b8d8f4370b&network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 3000 time: 0.0773146 Nov 24 14:10:01.477845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47374) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:01.536756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe90f0cb-8f6e-452e-9ac5-c75f9db1c994 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:01.538101 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fe90f0cb-8f6e-452e-9ac5-c75f9db1c994 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd HTTP/1.1" status: 200 len: 814 time: 0.0590887 Nov 24 14:10:02.010584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47382) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:02.016088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'port_id': None}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:02.115625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:02.390253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:02.395638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:02.395971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e disassociated. External IP: 172.26.4.69, port: ddb9ab40-dedb-40f5-b809-4fcb399c361c. Nov 24 14:10:02.909593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:10:03.111049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:10:03.117040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:03.121454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:10:03.134362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:10:03.135023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:09:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:03.170358 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-477e2082-ce30-485f-aa16-ddfbf7eea682 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 689 time: 1.1586018 Nov 24 14:10:03.170905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:10:03.173191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47386) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:03.250370 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'status': 'completed', 'code': 200} Nov 24 14:10:03.259824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4f749acb-657b-41e8-a623-46e8edb34ce3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 689 time: 0.0849192 Nov 24 14:10:03.281828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad56b836-709f-40fc-87dc-e73beb8de8cc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:03.332532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:10:03.344980 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-8b00ec9c-22cd-4a23-ba3f-c93b97bf5f60 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1099 time: 0.0741282 Nov 24 14:10:03.476637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97e7003-4390-468a-9460-08673655b023 req-83818dbd-e3b9-49bd-a6c2-b615569b7326 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:03.477970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-83818dbd-e3b9-49bd-a6c2-b615569b7326 service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1268837 Nov 24 14:10:03.548273 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-a15dc150-8907-400f-9598-4333017eeabb service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 217 time: 0.0630336 Nov 24 14:10:03.588400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:03.610510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97e7003-4390-468a-9460-08673655b023 req-d540e347-c738-4c63-bc10-2b1245f2844f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:03.612510 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-d540e347-c738-4c63-bc10-2b1245f2844f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0585935 Nov 24 14:10:03.660999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:03.664861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:10:03.676019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:10:03.676627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:09:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:03.686373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-46c5ece3-82bf-46ec-b793-3d71223ec4f8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0680733 Nov 24 14:10:03.822999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-5fc27dbb-ff89-4d0e-8151-eb252fe68879 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1296997 Nov 24 14:10:03.899831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:10:03.957404 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a97e7003-4390-468a-9460-08673655b023 req-c73a8c4f-ce99-459d-b65b-f422dcbb0304 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273158 Nov 24 14:10:04.207101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:04.211094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-334d4001-6451-4e3c-a73e-84d5fd684526 None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:10:04.263500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47394) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:04.348381 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f7c29c3d-d38b-49c7-abcc-1d020c1157f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 689 time: 0.0836701 Nov 24 14:10:04.448568 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82984852-b7f3-4ddf-8ea7-ed28bb1a2f7f None None] New status for floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:10:05.352108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47398) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:05.434381 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4add602f-69bc-45df-bd10-33c6e1a2075f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 687 time: 0.0810463 Nov 24 14:10:05.741277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c70ff960-b1dc-4756-a1d2-c885a6d035c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.615051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47404) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:06.620847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2086663234', 'description': 'tempest-secgroup-smoke-2086663234 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:06.626781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:06.636190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:06.646940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.684164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:06.687823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:06.690508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:06.696384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:06.714297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.756616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.760368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.763955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fad065f1-5ce6-47b2-8d13-2643a46efd3f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:06.806432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8e01b3e1-2e2b-4374-85f0-d2113998c2b9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:06.816411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.817571 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2014983 Nov 24 14:10:06.819372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.819784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.820238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.820613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47408) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:06.821117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.821117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.821338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.821668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.822127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.822567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.822926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.823282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.826436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '8e01b3e1-2e2b-4374-85f0-d2113998c2b9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:06.826875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:06.833677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:06.837922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:06.841335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:14. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:06.851662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 14; quota limit: 100; headroom:86 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:06.866908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.928936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.932338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.934177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-26eab620-98bc-47a8-a407-3ca052d52dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:06.956032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=42b111dc-d2b7-44fb-9cdd-ce3bd58d1646,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:06.967276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:06.968482 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1468420 Nov 24 14:10:06.969966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.970353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.970722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.971090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.972085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.972324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47412) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:06.972574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.972845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.973164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.973521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.973926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.974227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:06.977330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:06.979179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '8e01b3e1-2e2b-4374-85f0-d2113998c2b9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:06.985126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:06.990183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:06.992999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:15. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:06.999490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 15; quota limit: 100; headroom:85 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:07.014845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.079548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.084070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.085928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-216b7381-09fe-4dcc-9886-069e638071dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:07.108574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fadebe1e-9349-403a-96cf-e0fb61e82b9c,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:07.111001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:07.119490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.120664 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1472385 Nov 24 14:10:07.123288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47416) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:07.129436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '8e01b3e1-2e2b-4374-85f0-d2113998c2b9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:07.135185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:07.138917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:07.141733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:16. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:07.148542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 16; quota limit: 100; headroom:84 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:07.165020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.228237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.231664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.233480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3e9dda24-95f1-4820-af0a-0ffc387bf2f0 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:07.255546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=592382b7-2f06-47e9-a85b-be77ceb6fed2,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:07.257890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:07.264868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.266145 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1419122 Nov 24 14:10:07.269567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47420) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:07.275362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '8e01b3e1-2e2b-4374-85f0-d2113998c2b9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:07.281440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:07.286256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:07.289221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:07.294830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:07.311384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.374599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.377963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.379810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-24de0da7-f8d2-485b-80fe-92488504aa20 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:07.402219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d68e2dc1-7dbe-4b36-8de9-860a225a8305,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:07.406820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:07.412551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.413866 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1432800 Nov 24 14:10:07.416579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47424) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:07.421967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '8e01b3e1-2e2b-4374-85f0-d2113998c2b9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:07.427923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:07.431610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:07.434429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:18. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:07.440036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 18; quota limit: 100; headroom:82 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:07.450377 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:10:07.457487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.526420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.530360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.532232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dcc0b250-a6b6-4a30-b664-78e3790a80cf tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:07.553461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4d4de486-2133-44c5-b5f3-f8dd45a95786,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:07.555794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:07.562217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.563554 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1460783 Nov 24 14:10:07.566845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47428) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:07.572233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '8e01b3e1-2e2b-4374-85f0-d2113998c2b9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:07.577909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:07.582285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:10:07.585138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:10:07.591226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:07.601347 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:10:07.607648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.672064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.675712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.677521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c56cafff-8ad5-44b1-9e47-36114ca5d663 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:07.699442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50531d08-9598-4856-ae9f-e424a3ec9d47,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:07.701976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:07.710345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:07.711508 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1437428 Nov 24 14:10:07.884769 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-f1ef9604-3eb3-4e18-bcc0-cbaa3cfcfa2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2086663234&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0417116 Nov 24 14:10:08.053436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93247f47-42b4-49f9-b068-4a99e284394d req-4950829b-009e-42dd-84ac-1a7f4a780565 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:08.054718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-93247f47-42b4-49f9-b068-4a99e284394d req-4950829b-009e-42dd-84ac-1a7f4a780565 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:10:08.071196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-93247f47-42b4-49f9-b068-4a99e284394d req-4950829b-009e-42dd-84ac-1a7f4a780565 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:10:08.074912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-4950829b-009e-42dd-84ac-1a7f4a780565 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 796 time: 0.1813843 Nov 24 14:10:08.095836 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-6eeb6592-f0cf-496f-a8ed-e0d24ee24db0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0166931 Nov 24 14:10:08.190235 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-984956a7-ad28-4970-999a-79ae35b50b79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0890729 Nov 24 14:10:08.274708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-5ea689d6-59a9-4e3d-867f-c78047e3a581 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:10:08.275751 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-5ea689d6-59a9-4e3d-867f-c78047e3a581 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0737517 Nov 24 14:10:08.397158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:08.420694 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-6f5f4b04-5dd7-40dd-8443-686741e22f8c service neutron] 10.222.0.70 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1379478 Nov 24 14:10:08.552276 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-2d039ffc-1661-411d-87f2-5ae878be6fe6 service neutron] 10.222.0.70 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246510 Nov 24 14:10:08.744538 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-492e0faa-7e1e-426d-ba49-bee9b076fda5 req-cfc0cef5-7e4f-4dfc-b55f-de1b3d0b1247 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 210 time: 0.0465066 Nov 24 14:10:09.849704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93247f47-42b4-49f9-b068-4a99e284394d req-699011ac-1421-403d-a0eb-7b25b7e8052a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:09.851096 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-699011ac-1421-403d-a0eb-7b25b7e8052a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 796 time: 0.2529099 Nov 24 14:10:09.905297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-93247f47-42b4-49f9-b068-4a99e284394d req-f4f5c2a1-6a7f-4491-aec8-8b7a22739345 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:10:09.913971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4096994d-35e0-4097-8c15-bb9b01fcdc66 req-b3464b86-6761-45f8-a764-036f9aebd728 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 210 time: 0.0429192 Nov 24 14:10:09.922632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-93247f47-42b4-49f9-b068-4a99e284394d req-f4f5c2a1-6a7f-4491-aec8-8b7a22739345 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:10:09.923776 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-f4f5c2a1-6a7f-4491-aec8-8b7a22739345 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 472 time: 0.0586281 Nov 24 14:10:09.937781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['8e01b3e1-2e2b-4374-85f0-d2113998c2b9']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:10.066811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:10:10.075940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:10:10.086089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:10:10.089039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:10.249170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.14 (74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2/da366766-4af0-4f2e-a6df-a10428a0ffcb/0cbfec80-59c2-4888-80ce-8eec8328830f) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:10:10.437416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:10.452613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 0cbfec80-59c2-4888-80ce-8eec8328830f will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:10:10.475054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:10.480377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:10.540967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:10:10.547991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:10:10.552275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:10:10.587244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=0cbfec80-59c2-4888-80ce-8eec8328830f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:10.594136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:10.622818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:10.623410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:10.651358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7226825 Nov 24 14:10:10.664984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Request body: {'port': {'device_id': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:10.777022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:10.800862 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:10:10.837794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b2e707ed-acb7-4a5c-b916-8a0664fe9f38 None None] Provisioning for port 0cbfec80-59c2-4888-80ce-8eec8328830f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:10:10.843599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b2e707ed-acb7-4a5c-b916-8a0664fe9f38 None None] Provisioning complete for port 0cbfec80-59c2-4888-80ce-8eec8328830f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:10:10.844006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b2e707ed-acb7-4a5c-b916-8a0664fe9f38 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:10.894970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b2e707ed-acb7-4a5c-b916-8a0664fe9f38 None None] Port 0cbfec80-59c2-4888-80ce-8eec8328830f cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:10:11.173811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0cbfec80-59c2-4888-80ce-8eec8328830f {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:10:11.183202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:11.197174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c63ee83-d670-4d63-a56c-f40e3551297e req-9fe9d692-210f-44e3-ac74-64719626b511 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:11.197850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0c63ee83-d670-4d63-a56c-f40e3551297e req-9fe9d692-210f-44e3-ac74-64719626b511 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:10:11.213690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Transition to ACTIVE for port object 0cbfec80-59c2-4888-80ce-8eec8328830f will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:10:11.220117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:11.225089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:11.253939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0c63ee83-d670-4d63-a56c-f40e3551297e req-9fe9d692-210f-44e3-ac74-64719626b511 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:10:11.255070 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0c63ee83-d670-4d63-a56c-f40e3551297e req-9fe9d692-210f-44e3-ac74-64719626b511 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 932 time: 0.2154262 Nov 24 14:10:11.393907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Pushing event updated for resources: {'Port': ['ID=0cbfec80-59c2-4888-80ce-8eec8328830f,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:11.401526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:11.414141 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0c63ee83-d670-4d63-a56c-f40e3551297e req-839e881b-4fa0-40ad-8d23-eeaf1bbaa713 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1420894 Nov 24 14:10:11.530881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Attempting to bind port 0cbfec80-59c2-4888-80ce-8eec8328830f on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:10:11.531208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Attempting to bind port 0cbfec80-59c2-4888-80ce-8eec8328830f by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:10:11.531524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Attempting to bind port 0cbfec80-59c2-4888-80ce-8eec8328830f on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:10:11.537842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Port 0cbfec80-59c2-4888-80ce-8eec8328830f on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:10:11.538155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Attempting to bind port 0cbfec80-59c2-4888-80ce-8eec8328830f on network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:10:11.544314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 9, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:10:11.544649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Checking segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:10:11.545020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Bound using segment: {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:10:11.545424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Bound port: 0cbfec80-59c2-4888-80ce-8eec8328830f, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e8ad566f-4db7-42a6-9aec-2fae46f0b747', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:10:11.545758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:11.737590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] For port 0cbfec80-59c2-4888-80ce-8eec8328830f, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:10:11.741789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] For port 0cbfec80-59c2-4888-80ce-8eec8328830f, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0cbfec80-59c2-4888-80ce-8eec8328830f,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:10:11.746237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:11.749917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:11.804444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:11.805788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] 10.222.0.47 "PUT /v2.0/ports/0cbfec80-59c2-4888-80ce-8eec8328830f HTTP/1.1" status: 200 len: 1094 time: 1.1450677 Nov 24 14:10:11.806311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:10:11.831557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Pushing event updated for resources: {'Port': ['ID=0cbfec80-59c2-4888-80ce-8eec8328830f,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:11.834403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:11.882334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'status': 'completed', 'code': 200} Nov 24 14:10:11.925547 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-734da622-415a-492e-8ecd-d3eb6b27ec31 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 1097 time: 0.0770786 Nov 24 14:10:11.995147 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-f2b4dd75-c6dc-4cdd-a0cd-658f4c60a293 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0cbfec80-59c2-4888-80ce-8eec8328830f HTTP/1.1" status: 200 len: 217 time: 0.0623009 Nov 24 14:10:12.059908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93247f47-42b4-49f9-b068-4a99e284394d req-b40ba7e6-b773-44d7-8452-bb610fba78f6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:12.061318 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-b40ba7e6-b773-44d7-8452-bb610fba78f6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0601192 Nov 24 14:10:12.139678 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-d90d7b58-ce76-41c9-b77b-6037c51b4923 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0719612 Nov 24 14:10:12.272347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-61f08dd7-d38b-41df-aa09-c21ff3739905 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257460 Nov 24 14:10:12.404847 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93247f47-42b4-49f9-b068-4a99e284394d req-fe3ef0e2-cb37-4b4a-b890-cc4e2dc4319d service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261535 Nov 24 14:10:12.522108 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-227d6fee-0c3c-47bf-bdb4-393ccd22fa4a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 1097 time: 0.0729005 Nov 24 14:10:12.707477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158b54bd-b838-4317-8f74-f840ad5415ae req-c5eff525-470a-48e4-90fa-29e5a5335c02 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:12.708968 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-c5eff525-470a-48e4-90fa-29e5a5335c02 service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1802864 Nov 24 14:10:12.715163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08b09f2e-4292-434b-a83d-c689b7a0393d req-5529ad91-3af6-4578-87ed-e353edfc007d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:12.716736 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-08b09f2e-4292-434b-a83d-c689b7a0393d req-5529ad91-3af6-4578-87ed-e353edfc007d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 944 time: 0.1681759 Nov 24 14:10:12.796045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-46ccaad8-09eb-4b33-b470-3a8fb54a594b service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0cbfec80-59c2-4888-80ce-8eec8328830f HTTP/1.1" status: 200 len: 217 time: 0.0783348 Nov 24 14:10:12.855804 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-08b09f2e-4292-434b-a83d-c689b7a0393d req-c74d68f9-d440-4bfb-9c20-45872a0de458 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0891790 Nov 24 14:10:12.871339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158b54bd-b838-4317-8f74-f840ad5415ae req-45c33c19-f1bd-4e27-8e91-36f18f73dd42 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:12.872792 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-45c33c19-f1bd-4e27-8e91-36f18f73dd42 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0661666 Nov 24 14:10:12.949546 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-47b1d174-e3cc-4a65-b45e-cf1fb2680ecb service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0705242 Nov 24 14:10:13.078872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-09ba2be9-cfaa-45fe-8bc8-b2c769ed1b2d service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228514 Nov 24 14:10:13.209012 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-158b54bd-b838-4317-8f74-f840ad5415ae req-8087e288-a597-49b8-9195-511d355965ea service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1231380 Nov 24 14:10:14.056442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a3cdb1-ac63-4e78-b11a-08b3bdce246a req-20c94463-fe50-4c2d-9f43-0267754dcdcf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:14.057775 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-24a3cdb1-ac63-4e78-b11a-08b3bdce246a req-20c94463-fe50-4c2d-9f43-0267754dcdcf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 944 time: 0.0793972 Nov 24 14:10:14.107152 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-24a3cdb1-ac63-4e78-b11a-08b3bdce246a req-b013a7ef-a3a2-47ee-8653-34269ec6150d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437765 Nov 24 14:10:15.302985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280defe3-171c-4c94-a91a-6565efbfb1b2 req-66109ec9-f984-49c8-8d5f-6229af1d03f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:15.304438 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-280defe3-171c-4c94-a91a-6565efbfb1b2 req-66109ec9-f984-49c8-8d5f-6229af1d03f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 944 time: 0.0768032 Nov 24 14:10:15.349243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-280defe3-171c-4c94-a91a-6565efbfb1b2 req-f0a07584-63d7-4a2c-8f93-95def7b0ee47 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392096 Nov 24 14:10:15.941393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0cbfec80-59c2-4888-80ce-8eec8328830f details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:10:16.074731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0cbfec80-59c2-4888-80ce-8eec8328830f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0cbfec80-59c2-4888-80ce-8eec8328830f,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:10:16.091540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'port_id': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'mac_address': 'fa:16:3e:75:89:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 870, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:10:16.145206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:16.162645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0cbfec80-59c2-4888-80ce-8eec8328830f {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:10:16.177403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0cbfec80-59c2-4888-80ce-8eec8328830f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0cbfec80-59c2-4888-80ce-8eec8328830f,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:10:16.182508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:16.185199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0f054f2a-d1b1-4c8e-bc87-d182a7bfbf20 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:16.249492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0cbfec80-59c2-4888-80ce-8eec8328830f,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:16.258230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.258571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.258903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.259230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.259554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.259903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.260226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.260542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.260859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.261305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.261841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:10:16.266054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:16.542943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2c9894-d0c3-4e05-b24f-aa24bc85e9c1 req-e208f400-7fe0-4389-95de-9de8ad28fd7e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:16.544329 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cc2c9894-d0c3-4e05-b24f-aa24bc85e9c1 req-e208f400-7fe0-4389-95de-9de8ad28fd7e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 945 time: 0.0765429 Nov 24 14:10:16.577991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['0cbfec80-59c2-4888-80ce-8eec8328830f'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:10:16.590665 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cc2c9894-d0c3-4e05-b24f-aa24bc85e9c1 req-52d28552-f758-4762-b3de-08cc99879150 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408366 Nov 24 14:10:17.674368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:17.892049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88248288-59dc-42c1-bcfd-c350f1013e63 req-fd6d79f1-57b3-4e50-8ffd-f781fefd2faa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:17.894073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88248288-59dc-42c1-bcfd-c350f1013e63 req-fd6d79f1-57b3-4e50-8ffd-f781fefd2faa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 945 time: 0.1797805 Nov 24 14:10:17.938520 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88248288-59dc-42c1-bcfd-c350f1013e63 req-6baf40e6-e509-4206-8d19-0fe743b929bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390358 Nov 24 14:10:17.941035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0cbfec80-59c2-4888-80ce-8eec8328830f up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:10:18.008170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 0cbfec80-59c2-4888-80ce-8eec8328830f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:10:18.012708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 0cbfec80-59c2-4888-80ce-8eec8328830f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:10:18.013091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:18.133640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:18.159933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:10:18.169823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0cbfec80-59c2-4888-80ce-8eec8328830f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0cbfec80-59c2-4888-80ce-8eec8328830f,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:10:18.173786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:18.175995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:10:18.218568 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'code': 200} Nov 24 14:10:18.243646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0cbfec80-59c2-4888-80ce-8eec8328830f,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:10:18.246635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:10:18.447803 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10ac726e-0556-447e-9647-b20c63aabc91 req-74bbb7b6-0151-4c2a-a8ed-a2c1261c14b1 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 1099 time: 0.0703490 Nov 24 14:10:18.489997 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10ac726e-0556-447e-9647-b20c63aabc91 req-a391fc6d-e176-4487-8607-bb106be0bb89 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0357089 Nov 24 14:10:19.132765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a5faef6-322c-4eae-8f41-d49822b348f0 req-d4110fac-8ff9-4f66-849a-b55cf9aa7de0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:19.134276 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a5faef6-322c-4eae-8f41-d49822b348f0 req-d4110fac-8ff9-4f66-849a-b55cf9aa7de0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 946 time: 0.0755501 Nov 24 14:10:19.179016 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a5faef6-322c-4eae-8f41-d49822b348f0 req-9454975a-011f-4842-9751-32c5d5b564b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392897 Nov 24 14:10:20.382094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6ea4ac-f1f6-4f08-a002-77d90c962673 req-1e11a811-c145-4544-a8bb-5df0175e099d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:20.383733 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9b6ea4ac-f1f6-4f08-a002-77d90c962673 req-1e11a811-c145-4544-a8bb-5df0175e099d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 946 time: 0.0824463 Nov 24 14:10:20.434984 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9b6ea4ac-f1f6-4f08-a002-77d90c962673 req-c7aac05a-b05e-4172-8278-f99819188b08 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457728 Nov 24 14:10:20.631293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8947ed7-22df-448f-bd45-b4292e4543c7 req-a8e43d91-219f-4920-925f-acc5b104e2c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:20.632752 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f8947ed7-22df-448f-bd45-b4292e4543c7 req-a8e43d91-219f-4920-925f-acc5b104e2c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 946 time: 0.0789311 Nov 24 14:10:20.680743 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f8947ed7-22df-448f-bd45-b4292e4543c7 req-11516249-7f0b-445d-b548-41ceee144842 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421839 Nov 24 14:10:20.724773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47476) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:20.794577 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-37b34a23-cd9b-444e-8187-9ad1e3b1cdb5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 1094 time: 0.0685775 Nov 24 14:10:20.797103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47480) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:20.802650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'port_id': '0cbfec80-59c2-4888-80ce-8eec8328830f'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:10:20.983386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:21.586156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:21.589877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:21.781023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e associated. External IP: 172.26.4.69, port: 0cbfec80-59c2-4888-80ce-8eec8328830f. Nov 24 14:10:22.181264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:10:22.493281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:10:22.498080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:22.503495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:10:22.515075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:10:22.515695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:10:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:22.553798 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec9dbc90-542f-4e7f-ba63-f829b0efef82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 991 time: 1.7556548 Nov 24 14:10:22.554435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:10:22.556496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47484) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:22.611097 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'status': 'completed', 'code': 200} Nov 24 14:10:22.699260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:10:22.709818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-98d29a1b-d0eb-4275-8c12-4be30c8ba703 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 991 time: 0.1511514 Nov 24 14:10:22.730001 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-630de4c4-1950-4533-a02b-4c8d085f65a2 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 1099 time: 0.0925875 Nov 24 14:10:22.860948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1461a565-9362-4334-86c6-816b89b3ce72 req-e95bf576-95e9-463c-9c89-1bbe00e2fabc service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:22.863047 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-e95bf576-95e9-463c-9c89-1bbe00e2fabc service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1267335 Nov 24 14:10:22.964350 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-7b85a7c3-fffd-4342-b3d3-a8fe22de1613 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0cbfec80-59c2-4888-80ce-8eec8328830f HTTP/1.1" status: 200 len: 999 time: 0.0954309 Nov 24 14:10:23.029895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1461a565-9362-4334-86c6-816b89b3ce72 req-2402e885-ec8e-4577-8d6e-6e6310de502d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:23.031275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-2402e885-ec8e-4577-8d6e-6e6310de502d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0602028 Nov 24 14:10:23.082396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '03e6bf9f-4baf-4f8b-9557-57b9f742a98e', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.69', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'port_id': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'mac_address': 'fa:16:3e:75:89:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:08:45Z', 'updated_at': '2021-11-24T14:10:21Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:23.086272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:10:23.098050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:10:23.098657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:10:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:23.106091 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-c97a4ff5-0a43-4e0d-90f1-a0a83e135f08 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0680113 Nov 24 14:10:23.241905 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-3af785b8-b68a-4826-a509-c14372f087bd service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277843 Nov 24 14:10:23.276921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:10:23.375318 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1461a565-9362-4334-86c6-816b89b3ce72 req-10992942-f43e-4cc9-bdb7-8f98ae59bf33 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1270092 Nov 24 14:10:23.630369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '03e6bf9f-4baf-4f8b-9557-57b9f742a98e', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.69', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'port_id': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'mac_address': 'fa:16:3e:75:89:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:08:45Z', 'updated_at': '2021-11-24T14:10:21Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:10:23.634321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff057681-39ef-4297-ad1b-1cf63c92d6b6 None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '03e6bf9f-4baf-4f8b-9557-57b9f742a98e', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.69', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'port_id': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'mac_address': 'fa:16:3e:75:89:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:08:45Z', 'updated_at': '2021-11-24T14:10:21Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:10:23.712552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47490) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:23.826537 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3472f6c6-7e24-4ea8-851b-6bbc9328ab67 None None] New status for floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:10:23.830891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-188128e2-0b5b-4399-89b5-701ab5a3de92 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 991 time: 0.1167204 Nov 24 14:10:24.835345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47494) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:10:24.945170 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c1c99ecb-0eb2-4f0f-b2a0-b24637b1bb2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 200 len: 993 time: 0.1084363 Nov 24 14:10:33.176604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-738685d0-1d34-45cd-8f98-57a23c0efb36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:33.562060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:34.005611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-0b46bab6-1484-446a-8feb-81125277b195 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0709500 Nov 24 14:10:34.144555 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-cafa9e94-45ac-43e0-81ff-b221cc6aaa49 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 1099 time: 0.0735309 Nov 24 14:10:34.397504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e18c05-7e27-4849-bc14-08770293f39e req-65641327-eef5-401a-bc7e-84ffb35a15fd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:34.398923 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-65641327-eef5-401a-bc7e-84ffb35a15fd service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.2353408 Nov 24 14:10:34.466293 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-eaf85db3-a5f0-4ed3-90ac-6a5c931b059f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 200 len: 217 time: 0.0601809 Nov 24 14:10:34.536035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e18c05-7e27-4849-bc14-08770293f39e req-abca3b83-5202-4040-9580-b70a4a8cc749 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:10:34.537392 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-abca3b83-5202-4040-9580-b70a4a8cc749 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.0600786 Nov 24 14:10:34.613388 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-10823ed2-76fa-4b66-bbc3-0dfb0c2ec29a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0688982 Nov 24 14:10:34.750284 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-17d608e7-3dae-471c-b3a0-81e3693360b9 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1295888 Nov 24 14:10:34.890931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e18c05-7e27-4849-bc14-08770293f39e req-06f8a9b9-d2c5-45e0-9e10-e438d695fd69 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1277061 Nov 24 14:10:35.743550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f98d3b9-079b-449e-abd3-58558fc5d467 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:36.715954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:38.401042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:47.685183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:10:47.801637 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:10:51.942571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-d6529ac4-3abd-43c7-854c-1e89a8677023 req-e821e862-5301-479f-88d9-b94a4ba72f59 service neutron] (83525) timed out ('10.222.0.47', 52464) {{(pid=83525) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} Nov 24 14:11:03.182448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13ca34b3-769b-4cb0-9fdb-b37b681dd0c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:03.565467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:05.745969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b7cb0a02-b73c-466d-8b1a-02f90449f40d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:06.721713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:08.403718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:17.698093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:24.801648 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:11:33.175499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-158f8ece-ae0c-4e9a-a8bd-9dc780aa97b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:33.570192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:35.751696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26706186-10f5-42a5-bf23-62cbf713710b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:36.108042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-79a5bc16-0e47-484f-9b87-a6177a470ab8 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1399157 Nov 24 14:11:36.217087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-d6da1af1-2407-42bf-a55f-69c309b74d02 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 1099 time: 0.0842841 Nov 24 14:11:36.379925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db52578-619b-466e-9140-61331ba3be8f req-8af432e2-19aa-4251-8337-c9e402954574 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:36.382307 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-8af432e2-19aa-4251-8337-c9e402954574 service neutron] 10.222.0.47 "GET /v2.0/networks?id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 200 len: 897 time: 0.1443207 Nov 24 14:11:36.494942 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-b55277a7-ae29-40e9-9bbe-bb130dfd79da service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0cbfec80-59c2-4888-80ce-8eec8328830f HTTP/1.1" status: 200 len: 1001 time: 0.1049409 Nov 24 14:11:36.602752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db52578-619b-466e-9140-61331ba3be8f req-d8977fb8-7df4-4325-a05e-b7f5b9a9a63b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:36.604081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-d8977fb8-7df4-4325-a05e-b7f5b9a9a63b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 200 len: 835 time: 0.1021192 Nov 24 14:11:36.675707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e35d7a8-93f0-4243-9fd7-29ecc8ec1e3e req-7859c0b0-9390-458d-9bf7-b3c83654de9a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:36.677154 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4e35d7a8-93f0-4243-9fd7-29ecc8ec1e3e req-7859c0b0-9390-458d-9bf7-b3c83654de9a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 946 time: 0.2376461 Nov 24 14:11:36.722211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:36.732979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-835db626-eeeb-46de-9133-fe71df920a18 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1218026 Nov 24 14:11:36.740633 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4e35d7a8-93f0-4243-9fd7-29ecc8ec1e3e req-26751b3a-0d5e-4cef-98a3-0fe51402ac33 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566199 Nov 24 14:11:36.866113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-f559e833-048b-4795-9754-df9752afa551 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243017 Nov 24 14:11:37.004442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8db52578-619b-466e-9140-61331ba3be8f req-b68c509b-0f01-4703-be39-d48f674c47c5 service neutron] 10.222.0.47 "GET /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1311414 Nov 24 14:11:38.007110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f66c4cc-b594-4cec-ae09-74d315c97c96 req-b7577c44-34f1-4bf5-a7fc-fa18f8201a85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:38.008260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-376781b5-23f6-4b40-92c2-356d4665a706 req-06b8c6f2-c2c0-4a87-9f0f-10d33b937463 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:38.008671 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4f66c4cc-b594-4cec-ae09-74d315c97c96 req-b7577c44-34f1-4bf5-a7fc-fa18f8201a85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 946 time: 0.1455708 Nov 24 14:11:38.009674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-376781b5-23f6-4b40-92c2-356d4665a706 req-06b8c6f2-c2c0-4a87-9f0f-10d33b937463 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 946 time: 0.0833492 Nov 24 14:11:38.054085 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4f66c4cc-b594-4cec-ae09-74d315c97c96 req-3b62292c-0aa9-4374-ab0c-5ba7357a7539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=8e01b3e1-2e2b-4374-85f0-d2113998c2b9&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396776 Nov 24 14:11:38.079728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 0cbfec80-59c2-4888-80ce-8eec8328830f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:38.080106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:38.405112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:38.433898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 0cbfec80-59c2-4888-80ce-8eec8328830f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0cbfec80-59c2-4888-80ce-8eec8328830f,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:38.434255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:38.718928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:38.719293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:38.719598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e disassociated. External IP: 172.26.4.69, port: 0cbfec80-59c2-4888-80ce-8eec8328830f. Nov 24 14:11:38.719963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 0cbfec80-59c2-4888-80ce-8eec8328830f owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:38.858694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:38.864260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:38.910662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=0cbfec80-59c2-4888-80ce-8eec8328830f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:38.923720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.924123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.924491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.924856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.925225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.925588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.925949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.926291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.926646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.926999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.927362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:38.932224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:39.133559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:11:39.247465 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e913fc01-f235-46fc-8771-097446702439 req-7957c889-a356-4cde-bb78-6fb41e06b5eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2becf0f-228a-43ce-81d5-a30c480ac38e HTTP/1.1" status: 200 len: 210 time: 0.0543926 Nov 24 14:11:39.390381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:11:39.406718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:11:39.421119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:11:39.421859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:39.465497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 0cbfec80-59c2-4888-80ce-8eec8328830f on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:11:39.468375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:39.471024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'name': 'network-vif-deleted', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:11:39.488187 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-376781b5-23f6-4b40-92c2-356d4665a706 req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/0cbfec80-59c2-4888-80ce-8eec8328830f HTTP/1.1" status: 204 len: 173 time: 1.4717932 Nov 24 14:11:39.613106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2becf0f-228a-43ce-81d5-a30c480ac38e', 'name': 'network-vif-deleted', 'tag': '0cbfec80-59c2-4888-80ce-8eec8328830f', 'status': 'completed', 'code': 200} Nov 24 14:11:39.621014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:11:39.983909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:39.987880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:11:39.998380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:11:39.998979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:40.177070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:11:40.357591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47546) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:40.433866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:40.463996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:40.490250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:40.494424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c53e3c03-9eb5-4274-826d-27f3532f0cbe None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:25Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '38204ba7-2c57-40cb-b623-d6eebbe48757', 'name': '', 'network_id': '74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:1c:16:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:25Z', 'updated_at': '2021-11-24T14:08:32Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'da366766-4af0-4f2e-a6df-a10428a0ffcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:11:40.535240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:40.539623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-de0149e0-909a-43f7-8b96-07e4cb1b4bee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:40.555518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e01b3e1-2e2b-4374-85f0-d2113998c2b9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:40.567422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.567841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.568765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.569570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.569570 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.569962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.570326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.570690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.571050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.571406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.571780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:40.575635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:40.578154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:40.581661 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/8e01b3e1-2e2b-4374-85f0-d2113998c2b9 HTTP/1.1" status: 204 len: 168 time: 0.2202415 Nov 24 14:11:40.742000 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ee8fc49-ac3c-4311-865a-a664dfc809be None None] New status for floating IP 03e6bf9f-4baf-4f8b-9557-57b9f742a98e: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:11:41.641779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47554) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:41.798275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 8c26b02d-f8a2-4739-a190-3ab2469a25b8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:41.798632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:41.969325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:41.969592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:42.089035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 8c26b02d-f8a2-4739-a190-3ab2469a25b8 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:42.230209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:42.233771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-828b69f1-c0ea-4f91-a62e-ece3c50c9143 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:42.276417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=8c26b02d-f8a2-4739-a190-3ab2469a25b8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:42.280135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:42.344545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0cbfec80-59c2-4888-80ce-8eec8328830f no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:11:42.369728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:42.382426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 0cbfec80-59c2-4888-80ce-8eec8328830f {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:11:42.382782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0cbfec80-59c2-4888-80ce-8eec8328830f not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:11:42.384782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:42.385921 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/03e6bf9f-4baf-4f8b-9557-57b9f742a98e HTTP/1.1" status: 204 len: 168 time: 0.7431488 Nov 24 14:11:42.768460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-77ed215c-c69e-4557-a0f6-24d532657171 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:42.769141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-77ed215c-c69e-4557-a0f6-24d532657171 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:11:42.785724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-77ed215c-c69e-4557-a0f6-24d532657171 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:11:42.787490 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-77ed215c-c69e-4557-a0f6-24d532657171 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 946 time: 0.0946023 Nov 24 14:11:42.831884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-aa7b1144-781e-4aa2-8bca-0f5ccb89fb73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:11:42.847130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-aa7b1144-781e-4aa2-8bca-0f5ccb89fb73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:11:42.848286 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-22d1fd9b-8b86-47d0-94f4-7c1455652eeb req-aa7b1144-781e-4aa2-8bca-0f5ccb89fb73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0550637 Nov 24 14:11:44.057910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36661536-0281-46b7-8f7c-66704a8c890f req-05ae13cf-4f05-41bb-a666-c593bd276848 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:44.058609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-36661536-0281-46b7-8f7c-66704a8c890f req-05ae13cf-4f05-41bb-a666-c593bd276848 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:11:44.072631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-36661536-0281-46b7-8f7c-66704a8c890f req-05ae13cf-4f05-41bb-a666-c593bd276848 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:11:44.073763 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-36661536-0281-46b7-8f7c-66704a8c890f req-05ae13cf-4f05-41bb-a666-c593bd276848 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 946 time: 0.0932314 Nov 24 14:11:44.120894 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-36661536-0281-46b7-8f7c-66704a8c890f req-2e9b83c6-b979-4eed-ac54-9c8c6d556b6e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=909ca93b-001c-4b07-b757-628b41a89eba&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416496 Nov 24 14:11:44.316255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab0b557-e51a-484d-87bc-75f18c751578 req-5f2b8c72-325d-4551-a009-aa186abbbe8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:44.317676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fab0b557-e51a-484d-87bc-75f18c751578 req-5f2b8c72-325d-4551-a009-aa186abbbe8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 946 time: 0.0884192 Nov 24 14:11:44.386225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port ddb9ab40-dedb-40f5-b809-4fcb399c361c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:44.386561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:44.729660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port ddb9ab40-dedb-40f5-b809-4fcb399c361c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ddb9ab40-dedb-40f5-b809-4fcb399c361c,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:44.730011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:44.849769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for ddb9ab40-dedb-40f5-b809-4fcb399c361c owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:45.001292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:45.007252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:45.049377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=ddb9ab40-dedb-40f5-b809-4fcb399c361c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:45.053361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:45.125274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port ddb9ab40-dedb-40f5-b809-4fcb399c361c on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:11:45.127726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:45.130386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'name': 'network-vif-deleted', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:11:45.145564 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fab0b557-e51a-484d-87bc-75f18c751578 req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/ddb9ab40-dedb-40f5-b809-4fcb399c361c HTTP/1.1" status: 204 len: 173 time: 0.8227522 Nov 24 14:11:45.188646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bed63f32-781e-4ecb-b5e1-79b019268f7d', 'name': 'network-vif-deleted', 'tag': 'ddb9ab40-dedb-40f5-b809-4fcb399c361c', 'status': 'completed', 'code': 200} Nov 24 14:11:45.298717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-c7039a0e-baea-4890-8c40-d50c8ac33a08 req-33229ff5-7a61-48db-be92-a1855de13f9a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:11:45.315103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-c7039a0e-baea-4890-8c40-d50c8ac33a08 req-33229ff5-7a61-48db-be92-a1855de13f9a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:11:45.316254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c7039a0e-baea-4890-8c40-d50c8ac33a08 req-33229ff5-7a61-48db-be92-a1855de13f9a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=bed63f32-781e-4ecb-b5e1-79b019268f7d HTTP/1.1" status: 200 len: 210 time: 0.0593789 Nov 24 14:11:46.425119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47570) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:46.497481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:46.527338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:46.589269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:46.593528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0a5bbc5-38ce-4280-a03b-a2c6d50bf38e tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:46.609562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=909ca93b-001c-4b07-b757-628b41a89eba,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:46.612111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:46.624856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:46.628190 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d12eea46-412d-4cbe-b923-45c3814387e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/909ca93b-001c-4b07-b757-628b41a89eba HTTP/1.1" status: 204 len: 168 time: 0.2020779 Nov 24 14:11:46.665531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47576) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:47.171359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:47.716212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:47.782268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 38204ba7-2c57-40cb-b623-d6eebbe48757 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:47.782859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:47.962226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 38204ba7-2c57-40cb-b623-d6eebbe48757, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=38204ba7-2c57-40cb-b623-d6eebbe48757,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:47.962565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:48.079522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 38204ba7-2c57-40cb-b623-d6eebbe48757 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:48.261973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:48.265469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0d4ed3b-f67b-4f76-adcf-b4afbde46e30 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:48.309470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=38204ba7-2c57-40cb-b623-d6eebbe48757,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:48.313471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:48.391112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ddb9ab40-dedb-40f5-b809-4fcb399c361c no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:11:48.426123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: ddb9ab40-dedb-40f5-b809-4fcb399c361c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:11:48.426563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ddb9ab40-dedb-40f5-b809-4fcb399c361c not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:11:48.721385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:49.308128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router f155f28f-7f5e-44ad-b1e9-fce1cdada254 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:11:49.508501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:11:49.517807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] Sync routers for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:11:49.529426 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/f155f28f-7f5e-44ad-b1e9-fce1cdada254/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8602941 Nov 24 14:11:49.529668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47580) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:49.531868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:11:49.532497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:49.716593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:11:49.719729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet da366766-4af0-4f2e-a6df-a10428a0ffcb {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:11:49.722575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:49.775368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:49.860058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.060925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:11:48Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:50.063159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.065033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] Checking router: f155f28f-7f5e-44ad-b1e9-fce1cdada254 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:11:50.067437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:50.076767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] Routers {'f155f28f-7f5e-44ad-b1e9-fce1cdada254'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:11:50.077439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:50.103870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=da366766-4af0-4f2e-a6df-a10428a0ffcb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:50.106468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:50.109855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.116385 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/da366766-4af0-4f2e-a6df-a10428a0ffcb HTTP/1.1" status: 204 len: 168 time: 0.5857716 Nov 24 14:11:50.119249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47584) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:50.133208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f630810e-cc8d-4c69-b725-702e62c3be1e None None] Network 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:11:50.325150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.408447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] Set router f155f28f-7f5e-44ad-b1e9-fce1cdada254 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:11:50.528137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.537417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 9ebeb42f-dd44-485c-9286-b148e7d16575 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:50.538409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.625508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] DHCP port deletion for 74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:11:50.642020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Deleting port 22690a81-be2e-4767-ad4a-744408ddf760 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:50.642403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.725017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 9ebeb42f-dd44-485c-9286-b148e7d16575, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9ebeb42f-dd44-485c-9286-b148e7d16575,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:50.725489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:50.763523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 22690a81-be2e-4767-ad4a-744408ddf760 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:11:50.850118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 9ebeb42f-dd44-485c-9286-b148e7d16575 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:51.000448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:11:48Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:51.003201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=22690a81-be2e-4767-ad4a-744408ddf760,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:51.003598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.018663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.023263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-21b6c949-f8fe-4002-bca9-34626cb0174d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:51.025373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58062b8-4663-4f7a-8a4a-bb564cb4ba96 None None] The sync data for ids ['f155f28f-7f5e-44ad-b1e9-fce1cdada254'] in dv-neutron-818151-2-hyperv is: [{'id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'name': 'tempest-TestNetworkBasicOps-router-1822461977', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209'}], 'enable_snat': True}, 'gw_port_id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:11:48Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '9ebeb42f-dd44-485c-9286-b148e7d16575', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:04:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f155f28f-7f5e-44ad-b1e9-fce1cdada254', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:08:21Z', 'updated_at': '2021-11-24T14:08:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:11:51.068497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=9ebeb42f-dd44-485c-9286-b148e7d16575,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:51.072566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:51.078699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.149552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Calling delete_port for 22690a81-be2e-4767-ad4a-744408ddf760 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:51.219402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=22690a81-be2e-4767-ad4a-744408ddf760,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:51.230725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.232993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-399c4215-ea72-49cf-8961-67f829760c55 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:51.283110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:11:51.283472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:11:51.296316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.300292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=22690a81-be2e-4767-ad4a-744408ddf760,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:51.310311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.310580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.310911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.311236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.311559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.311903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.312221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.312539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.312854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.313164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.313474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:51.317094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:51.675515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.679604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.704075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.704610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router f155f28f-7f5e-44ad-b1e9-fce1cdada254 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:11:51.719968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.721171 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/f155f28f-7f5e-44ad-b1e9-fce1cdada254 HTTP/1.1" status: 204 len: 168 time: 1.6009533 Nov 24 14:11:51.723722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47588) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:51.784789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Deleting port 22690a81-be2e-4767-ad4a-744408ddf760 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:51.786107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.846071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:51.857890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 22690a81-be2e-4767-ad4a-744408ddf760 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:51.858255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:52.049613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=22690a81-be2e-4767-ad4a-744408ddf760,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:52.049988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:52.058444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 22690a81-be2e-4767-ad4a-744408ddf760, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=22690a81-be2e-4767-ad4a-744408ddf760,segment=NetworkSegment(e8ad566f-4db7-42a6-9aec-2fae46f0b747),segment_id=e8ad566f-4db7-42a6-9aec-2fae46f0b747)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:52.059241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:52.177841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Calling delete_port for 22690a81-be2e-4767-ad4a-744408ddf760 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:52.188474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 22690a81-be2e-4767-ad4a-744408ddf760 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:11:52.257161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:52.262166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:52.266666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:11:52.267037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:11:52.301945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Pushing event deleted for resources: {'Port': ['ID=22690a81-be2e-4767-ad4a-744408ddf760,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:52.304345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:52.307108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] No DVR routers for this DVR port 22690a81-be2e-4767-ad4a-744408ddf760 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:11:52.754149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 38204ba7-2c57-40cb-b623-d6eebbe48757 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:11:52.767848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 22690a81-be2e-4767-ad4a-744408ddf760 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:11:52.768431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:52.795103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 38204ba7-2c57-40cb-b623-d6eebbe48757 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:11:52.795735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 38204ba7-2c57-40cb-b623-d6eebbe48757 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:11:52.795894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9ebeb42f-dd44-485c-9286-b148e7d16575 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:11:52.836965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 9ebeb42f-dd44-485c-9286-b148e7d16575 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:11:52.837340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9ebeb42f-dd44-485c-9286-b148e7d16575 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:11:52.841566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] The port '22690a81-be2e-4767-ad4a-744408ddf760' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:11:52.968349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:52.998856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:53.011970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e8ad566f-4db7-42a6-9aec-2fae46f0b747') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:53.012260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e8ad566f-4db7-42a6-9aec-2fae46f0b747') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:53.024256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.045366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.051657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 870 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:11:53.052059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:11:53.067048 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:11:53.157740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.164881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f37a4d35-2228-4455-a393-10ee2f6ca754 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:53.179986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.191986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:53.196527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:53.205738 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/74ce8b21-fab5-4ff0-9261-b1a9c4d8e1d2 HTTP/1.1" status: 204 len: 168 time: 1.4806848 Nov 24 14:11:53.229958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47592) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:53.235953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--217440353', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:11:53.241788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:11:53.245915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:11:53.248767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:11:53.254989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:11:53.264792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:11:53.267869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.298365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:11:53.308576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.308912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment 37730c91-65d0-4375-ac81-e6b6eb203d58 of type vlan for network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 Nov 24 14:11:53.335302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.366338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.370194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:53.370772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.374401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6734a24a-a2fe-4bc6-8696-01d1b83abd54 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:53.477993 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2469993 Nov 24 14:11:53.481140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47596) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:53.488954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:11:53.495673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=9fbcda65-8ca5-43c4-9092-024c9ff725d4,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:53.500426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:53.501368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:11:53.506749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:11:53.510183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:11:53.511331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:11:53.516106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:11:53.526428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.527365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.553626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.803938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:53.983658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:54.013461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:54.151551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.242 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/1882cff1-41ec-4d3c-b178-86b0077a4fcf) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:11:54.299859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:54.326614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:54.330853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a2d08ca3-e00a-4789-bf92-efead00ad871 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:54.400712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:11:54.404084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:11:54.408101 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:11:54.432575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=1882cff1-41ec-4d3c-b178-86b0077a4fcf,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:54.437338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:54.562386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:54.563106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:54.789013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 2f743baf-7fa6-4942-a887-aad8629510a6 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:11:54.994778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:11:55.004286 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Sync routers for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:11:55.015873 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:11:55.016474 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:55.019896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:55.021752 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 1.5390899 Nov 24 14:11:55.024887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47600) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:55.065292 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f0a33240-696f-4380-9da8-e3e2f700237c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0392547 Nov 24 14:11:55.067780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47604) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:55.189968 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:11:55.197463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a03dbb7-2077-422b-ae57-36e740a54d81 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:55.198942 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8a03dbb7-2077-422b-ae57-36e740a54d81 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1302125 Nov 24 14:11:55.201867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47608) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:55.241632 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-75897f9e-49fa-4269-8af1-8d28f1b68acd tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0385818 Nov 24 14:11:55.244162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47612) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:55.250242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2093849321', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:11:55.484350 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:54Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:55.486081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:11:55.488134 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Checking router: 2f743baf-7fa6-4942-a887-aad8629510a6 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:11:55.488485 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Updating router 2f743baf-7fa6-4942-a887-aad8629510a6 port 1882cff1-41ec-4d3c-b178-86b0077a4fcf binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:11:55.489865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:11:55.492684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:11:55.498310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:11:55.510908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:11:55.541000 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:55.616350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:55.839086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:55.843076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-df636eb9-b058-48f3-a950-a7c65a9a915f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:55.898308 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:55.913574 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Transition to ACTIVE for port object 1882cff1-41ec-4d3c-b178-86b0077a4fcf will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:11:55.920613 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:55.924169 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0bed834e-06e6-402a-9281-69fdfd13e096 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:55.937316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=00d5e01f-ac44-49f6-89fa-1fb1c3199965,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:55.941159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:55.961212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:11:55.961659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: 9fbcda65-8ca5-43c4-9092-024c9ff725d4, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:11:55.991958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:11:56.006125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 9fbcda65-8ca5-43c4-9092-024c9ff725d4) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:11:56.008358 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Attempting to bind port 1882cff1-41ec-4d3c-b178-86b0077a4fcf on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:11:56.009203 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Attempting to bind port 1882cff1-41ec-4d3c-b178-86b0077a4fcf by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:11:56.009530 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Attempting to bind port 1882cff1-41ec-4d3c-b178-86b0077a4fcf on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:11:56.010953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:56.011522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.022065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f86a7a4-85a4-451d-8fa4-32a058369968 None None] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:11:56.023601 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Pushing event updated for resources: {'Port': ['ID=1882cff1-41ec-4d3c-b178-86b0077a4fcf,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:56.031972 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:11:56.032350 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:11:56.032735 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.033135 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:11:56.033606 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Bound port: 1882cff1-41ec-4d3c-b178-86b0077a4fcf, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:11:56.034495 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.038591 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7931912 Nov 24 14:11:56.041539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47616) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:56.068901 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.069240 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.069585 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.069904 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.070227 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.070547 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.070867 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.071187 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.071501 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.071841 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.072150 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:11:56.083598 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:56.122517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] For port 1882cff1-41ec-4d3c-b178-86b0077a4fcf, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:11:56.126678 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] For port 1882cff1-41ec-4d3c-b178-86b0077a4fcf, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1882cff1-41ec-4d3c-b178-86b0077a4fcf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:11:56.131345 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.136284 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-fa77086c-f1ca-4b10-b605-773a49f232c5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:56.222333 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Pushing event updated for resources: {'Port': ['ID=1882cff1-41ec-4d3c-b178-86b0077a4fcf,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:56.227447 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:56.241233 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:11:56.241865 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:56.258941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:11:56.260099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.441798 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:11:56.450647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Allocated IP 172.20.0.2 (9fbcda65-8ca5-43c4-9092-024c9ff725d4/00d5e01f-ac44-49f6-89fa-1fb1c3199965/7133724c-1e92-4361-8f9e-212524d55735) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:11:56.673617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.688465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Transition to ACTIVE for port object 7133724c-1e92-4361-8f9e-212524d55735 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:11:56.711341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Transition to ACTIVE for port object 7133724c-1e92-4361-8f9e-212524d55735 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:11:56.718150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.725447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:56.743172 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:54Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:11:56.747245 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c57bb535-d63f-4305-99fc-fd6811f4c1df None None] The sync data for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv is: [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:54Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:11:56.798376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:11:56.802331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:11:56.804862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:11:56.807353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Pushing event updated for resources: {'Port': ['ID=7133724c-1e92-4361-8f9e-212524d55735,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:56.810066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:56.903736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Attempting to bind port 7133724c-1e92-4361-8f9e-212524d55735 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:11:56.904343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Attempting to bind port 7133724c-1e92-4361-8f9e-212524d55735 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:11:56.904884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Attempting to bind port 7133724c-1e92-4361-8f9e-212524d55735 on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:11:56.912861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:11:56.915908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Checking segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:11:56.915908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.915908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Bound using segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:11:56.917668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Bound port: 7133724c-1e92-4361-8f9e-212524d55735, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:11:56.918616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:56.931220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:57.033065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] For port 7133724c-1e92-4361-8f9e-212524d55735, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:11:57.038257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] For port 7133724c-1e92-4361-8f9e-212524d55735, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7133724c-1e92-4361-8f9e-212524d55735,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:11:57.042644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:57.054045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83cd9197-7151-4f07-8495-d9529b24ab94 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:57.192099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Pushing event updated for resources: {'Port': ['ID=7133724c-1e92-4361-8f9e-212524d55735,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:57.195349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:57.523429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (9fbcda65-8ca5-43c4-9092-024c9ff725d4/00d5e01f-ac44-49f6-89fa-1fb1c3199965/f10c1a07-29a1-4040-954e-9deeb8679030) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:11:57.685056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:57.700772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object f10c1a07-29a1-4040-954e-9deeb8679030 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:11:57.721540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:57.725711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-53a1efea-130c-42e1-86a6-e0fd5d252235 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:57.788350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:11:57.795324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:11:57.797834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:11:57.841750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=f10c1a07-29a1-4040-954e-9deeb8679030,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:57.844769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:57.865451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:57.955671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:58.136477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c66954f8-7e43-4761-997a-7cc99b6409cc None None] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:11:58.246789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-84438961-fec8-47ca-903e-fc3b4034930e None None] Provisioning for port 7133724c-1e92-4361-8f9e-212524d55735 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:11:58.394882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:58.401986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:58.429153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c4a54c6-cb50-41b2-8b36-277da0ad60e4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:58.514929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=f10c1a07-29a1-4040-954e-9deeb8679030,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:58.517205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:58.525630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:58.587914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f2dd7188-0d79-444c-9189-218dfc4571ca None None] Provisioning for port f10c1a07-29a1-4040-954e-9deeb8679030 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:11:58.593826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f2dd7188-0d79-444c-9189-218dfc4571ca None None] Provisioning complete for port f10c1a07-29a1-4040-954e-9deeb8679030 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:11:58.594216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f2dd7188-0d79-444c-9189-218dfc4571ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:58.652274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f2dd7188-0d79-444c-9189-218dfc4571ca None None] Port f10c1a07-29a1-4040-954e-9deeb8679030 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:11:58.663936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:11:58.665401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:11:58.795519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-daca5dae-bdde-42c8-9170-22153a696829 None None] Provisioning complete for port f10c1a07-29a1-4040-954e-9deeb8679030 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:11:58.795941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-daca5dae-bdde-42c8-9170-22153a696829 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:58.836253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7133724c-1e92-4361-8f9e-212524d55735 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:11:58.921561 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-daca5dae-bdde-42c8-9170-22153a696829 None None] Port f10c1a07-29a1-4040-954e-9deeb8679030 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:11:58.940630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 7133724c-1e92-4361-8f9e-212524d55735 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:11:58.946173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7133724c-1e92-4361-8f9e-212524d55735 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:11:58.946681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.074323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.090114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-62d325ab-d185-4caa-8e40-40a74778a2ad None None] Provisioning complete for port f10c1a07-29a1-4040-954e-9deeb8679030 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:11:59.090493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-62d325ab-d185-4caa-8e40-40a74778a2ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.158269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-62d325ab-d185-4caa-8e40-40a74778a2ad None None] Port f10c1a07-29a1-4040-954e-9deeb8679030 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:11:59.162472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7133724c-1e92-4361-8f9e-212524d55735, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7133724c-1e92-4361-8f9e-212524d55735,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:59.166127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.167083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1882cff1-41ec-4d3c-b178-86b0077a4fcf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:11:59.187335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 2f743baf-7fa6-4942-a887-aad8629510a6 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:11:59.193858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:59.284046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7133724c-1e92-4361-8f9e-212524d55735,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:59.288394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:59.297854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1882cff1-41ec-4d3c-b178-86b0077a4fcf completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:11:59.304066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1882cff1-41ec-4d3c-b178-86b0077a4fcf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:11:59.304341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.412838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:11:59.424031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.425992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/2f743baf-7fa6-4942-a887-aad8629510a6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3832991 Nov 24 14:11:59.428522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47620) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:59.441130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1882cff1-41ec-4d3c-b178-86b0077a4fcf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1882cff1-41ec-4d3c-b178-86b0077a4fcf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:11:59.446167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:11:59.448199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9f4b12f4-ed8a-4365-a7b9-f59e4dfbef2c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:11:59.516287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1882cff1-41ec-4d3c-b178-86b0077a4fcf,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:11:59.519231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:11:59.571091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8c86e46-e8f1-48a4-8cde-a9e2796d0d96 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.571700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8c86e46-e8f1-48a4-8cde-a9e2796d0d96 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.571893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8c86e46-e8f1-48a4-8cde-a9e2796d0d96 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.572249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8c86e46-e8f1-48a4-8cde-a9e2796d0d96 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.573840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c8c86e46-e8f1-48a4-8cde-a9e2796d0d96 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2885 time: 0.1443825 Nov 24 14:11:59.576550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47624) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:59.648584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b31f6d02-2031-4f1c-b502-f607c9cca885 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.648947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b31f6d02-2031-4f1c-b502-f607c9cca885 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.649301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b31f6d02-2031-4f1c-b502-f607c9cca885 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.649647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b31f6d02-2031-4f1c-b502-f607c9cca885 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:11:59.651243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b31f6d02-2031-4f1c-b502-f607c9cca885 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2728 time: 0.0738041 Nov 24 14:11:59.653912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47628) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:59.856958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-973eafdf-5f5e-4524-b83f-b576f30e9e58 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1608 time: 0.2017839 Nov 24 14:11:59.859414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47632) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:11:59.865360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'name': 'tempest-TestNetworkBasicOps-1565024414', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:11:59.996836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:00.000862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:port and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:00.003711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for port was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:00.009414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:00.019348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:12:00.022415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:00.045091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] device_id is not set on port 7c44372c-c037-4dee-857c-2cfe4c01ab2a yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:12:00.196898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.10 (9fbcda65-8ca5-43c4-9092-024c9ff725d4/00d5e01f-ac44-49f6-89fa-1fb1c3199965/7c44372c-c037-4dee-857c-2cfe4c01ab2a) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:12:00.361560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Sync routers for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:12:00.374064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:00.374704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:00.411325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:00.427996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 7c44372c-c037-4dee-857c-2cfe4c01ab2a will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:00.453016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:00.459676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35f20f2d-9ced-4636-a01b-a7ebf3adca61 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:00.525280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:12:00.532479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:00.537491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:12:00.564477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:00.573559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:00.577886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:00.605271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:00.605781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:00.636228 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.7727466 Nov 24 14:12:00.786356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7133724c-1e92-4361-8f9e-212524d55735 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:00.877081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-033aec45-9d5d-448e-b952-93da41691c33 None None] Provisioning for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:00.901002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-033aec45-9d5d-448e-b952-93da41691c33 None None] Provisioning complete for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:00.901300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-033aec45-9d5d-448e-b952-93da41691c33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.038193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-033aec45-9d5d-448e-b952-93da41691c33 None None] Port 7c44372c-c037-4dee-857c-2cfe4c01ab2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:12:01.043529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7133724c-1e92-4361-8f9e-212524d55735 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:01.043529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.043739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47638) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:01.049584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-704563164', 'description': 'tempest-secgroup-smoke-704563164 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:01.058244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:01.062492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:01.065444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:01.071853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:01.081818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.118827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:01.122738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:01.123085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:11:58Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:01.125673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:01.132410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:01.154098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Checking router: 2f743baf-7fa6-4942-a887-aad8629510a6 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:12:01.154399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Updating router 2f743baf-7fa6-4942-a887-aad8629510a6 port f10c1a07-29a1-4040-954e-9deeb8679030 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:12:01.192045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.197916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.203068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-43366b30-6da1-4819-8974-9cf62204ba4a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:01.233321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1882cff1-41ec-4d3c-b178-86b0077a4fcf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:01.257782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.354070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:01.356929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:01.357810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.361724 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.3142083 Nov 24 14:12:01.362152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47642) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:01.368098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:01.374401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:01.379290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:01.382693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:01.388564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:01.406148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.432107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1882cff1-41ec-4d3c-b178-86b0077a4fcf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:01.432739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.469606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.473495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.476514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:01.498848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c5f41b2b-d647-4d91-a6eb-06fa1b10b4db,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:01.501302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:01.509366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.510556 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1478002 Nov 24 14:12:01.513403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47646) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:01.519201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:01.525238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:01.529030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:01.531886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:01.538117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:01.555675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.618287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.623601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.625598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c5442105-5042-4dc4-a815-e88fb534707c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:01.650088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d08a247-d828-4e6a-9756-dec1c5f4cc16,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:01.652648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:01.662061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.663442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1490474 Nov 24 14:12:01.666189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47650) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:01.671706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:01.678325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:01.681777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:01.684686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:01.690538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:01.712395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.762452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.774949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.776163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Transition to ACTIVE for port object f10c1a07-29a1-4040-954e-9deeb8679030 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:01.778706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.780577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-302ebcbb-f517-4e85-ad2b-0a680969ce64 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:01.782789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.787350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:01.800771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b5d5d30b-1ce6-4309-81ca-b5cb3e011656,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:01.801877 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:12:01.805202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:01.813404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.814805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1477032 Nov 24 14:12:01.817468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47654) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:01.823196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:01.828974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:01.832646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:01.836402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:01.842239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:01.863533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.915259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d121dfd-a55a-4f90-8452-ccf6fa57e61b None None] Pushing event updated for resources: {'Port': ['ID=f10c1a07-29a1-4040-954e-9deeb8679030,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:01.917961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9d121dfd-a55a-4f90-8452-ccf6fa57e61b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:01.941948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.946943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.949514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-57803294-bbc8-4f08-99a3-2ce620107c88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:01.973493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d5d4da8-3870-4c09-88ef-20885e41022b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:01.976283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:01.986384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:01.988195 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1696074 Nov 24 14:12:01.991630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47658) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:01.997968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:02.004251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:02.009284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:02.012028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Attempting to bind port f10c1a07-29a1-4040-954e-9deeb8679030 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:12:02.012346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:02.012487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Attempting to bind port f10c1a07-29a1-4040-954e-9deeb8679030 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:12:02.012772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Attempting to bind port f10c1a07-29a1-4040-954e-9deeb8679030 on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:02.018383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:02.019488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 11, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:12:02.019897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Checking segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:12:02.020653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.020928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Bound using segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:12:02.021474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Bound port: f10c1a07-29a1-4040-954e-9deeb8679030, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:12:02.021849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.029034 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:12:02.039434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.110121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.113828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.123085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:02.124898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] For port f10c1a07-29a1-4040-954e-9deeb8679030, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:02.128343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] For port f10c1a07-29a1-4040-954e-9deeb8679030, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f10c1a07-29a1-4040-954e-9deeb8679030,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:12:02.137521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.140748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de83075f-bad8-4f65-b0ec-0059ff3bd3c5,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:02.142187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-223f163f-5401-4d0c-ad11-0dd24c4bb33a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:02.143103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:02.154223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.155371 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1625726 Nov 24 14:12:02.158084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47662) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:02.164899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:02.170890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:02.174597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:02.179716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:02.185493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:02.197353 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:12:02.206131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.229009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d121dfd-a55a-4f90-8452-ccf6fa57e61b None None] Pushing event updated for resources: {'Port': ['ID=f10c1a07-29a1-4040-954e-9deeb8679030,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:02.233021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9d121dfd-a55a-4f90-8452-ccf6fa57e61b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:02.235424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:02.236067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:11:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:02.287744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.293479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.300822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c5e5f11-08c8-4c2c-ad34-70bd872a8890 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:02.323854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39c66bd9-a217-4f1c-9815-a5cb4622f28d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:02.326324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:02.335824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:02.337500 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1784689 Nov 24 14:12:02.439968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:02.520414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-82b0de74-a63c-4b60-966b-3f92f4c59a9c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:02.535121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-82b0de74-a63c-4b60-966b-3f92f4c59a9c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:02.537247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-82b0de74-a63c-4b60-966b-3f92f4c59a9c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-704563164&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0563567 Nov 24 14:12:02.616335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-ed87fe13-3c7d-41f7-9134-befd45800a45 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:02.617114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-ed87fe13-3c7d-41f7-9134-befd45800a45 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:02.635594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-ed87fe13-3c7d-41f7-9134-befd45800a45 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:02.637419 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-ed87fe13-3c7d-41f7-9134-befd45800a45 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 931 time: 0.0927308 Nov 24 14:12:02.713265 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-9b193601-268d-41f8-a000-c52a71b9f3b5 service neutron] 10.222.0.70 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request HTTP/1.1" status: 200 len: 311 time: 0.0640817 Nov 24 14:12:02.804926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:02Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:02.808880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21f4cdfb-4230-40e9-b9bf-588931b52efb None None] The sync data for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv is: [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:02Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:12:02.850523 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-83a2e5c8-9c37-418e-8369-5dc1047bf40f service neutron] 10.222.0.70 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311700 Nov 24 14:12:02.993658 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-c75524ee-8c10-4505-9c65-2e25677b9a4a service neutron] 10.222.0.70 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358633 Nov 24 14:12:03.179346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-727c5ac3-b524-4672-baa2-e2f87d05077b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:03.196480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-7733bada-9e6e-402f-933b-d739afcbcd6b req-62f45855-551a-4121-a153-3b67b45565c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:03.209589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-7733bada-9e6e-402f-933b-d739afcbcd6b req-62f45855-551a-4121-a153-3b67b45565c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:03.210645 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7733bada-9e6e-402f-933b-d739afcbcd6b req-62f45855-551a-4121-a153-3b67b45565c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 210 time: 0.0575650 Nov 24 14:12:03.573745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:04.329596 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7fea28a4-a88d-4034-ab26-300e38b1537a req-bb6b1fc5-0818-4902-b90f-5df4b381e4b6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 210 time: 0.0464098 Nov 24 14:12:04.774536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f10c1a07-29a1-4040-954e-9deeb8679030 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:04.843447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f10c1a07-29a1-4040-954e-9deeb8679030 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:04.847834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f10c1a07-29a1-4040-954e-9deeb8679030 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:04.848215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:04.962970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:04.994797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f10c1a07-29a1-4040-954e-9deeb8679030, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f10c1a07-29a1-4040-954e-9deeb8679030,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:04.998357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:05.001229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8df9aaea-cad5-4ce5-b9d4-8ebf4c066ba6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:05.076077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f10c1a07-29a1-4040-954e-9deeb8679030,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:05.079121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:05.500679 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c79fffcc-a279-49a0-b419-32fdfbab0b80 req-afb79bc8-68bb-4443-9e91-df6d1962dd58 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 210 time: 0.0479429 Nov 24 14:12:05.754223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9be7470a-9da4-4911-9b26-9309b25c3fac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:06.127602 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-ee37cfe8-d004-4136-b297-45d8861271d1 service neutron] 10.222.0.47 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1027 time: 0.0606081 Nov 24 14:12:06.278657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e3a78b92-bcc9-424a-94fd-e8e91ed7e779 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:06.280138 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e3a78b92-bcc9-424a-94fd-e8e91ed7e779 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 796 time: 0.1474924 Nov 24 14:12:06.336146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-01dc9e40-0120-4a13-ae55-9f0aafb21af4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 379 time: 0.0424128 Nov 24 14:12:06.347508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Request body: {'port': {'device_id': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:06.455658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:06.715424 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2865044e-ea67-4f23-ad6f-c0cdcc7ced88 req-1ac32a3f-9ef3-49bf-bd74-d26de49cf2a3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 210 time: 0.0925059 Nov 24 14:12:06.728746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:06.770142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f10c1a07-29a1-4040-954e-9deeb8679030 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:06.841837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f10c1a07-29a1-4040-954e-9deeb8679030 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:06.842218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:06.932778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c44372c-c037-4dee-857c-2cfe4c01ab2a {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:12:06.939492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:06.954675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Transition to ACTIVE for port object 7c44372c-c037-4dee-857c-2cfe4c01ab2a will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:06.957815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:06.962886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-804c73ba-2472-4ee1-8e8b-86b71351106f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:07.086375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:07.089390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:07.197739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:12:07.198301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:12:07.198431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:07.204191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:12:07.204509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:07.210775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 11, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:12:07.211052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Checking segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:12:07.211434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Bound using segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:12:07.211882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Bound port: 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:12:07.212229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:07.300029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:07.303691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:12:07.308358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:07.312526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:07.377663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:07.379034 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-e36e9273-f113-4137-874e-18c645292e74 service neutron] 10.222.0.47 "PUT /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1132 time: 1.0356593 Nov 24 14:12:07.379624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:12:07.404488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:07.407503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:07.456692 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'status': 'completed', 'code': 200} Nov 24 14:12:07.500234 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-f251d50d-ed38-4a8b-a1c0-9dec370841df service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 1135 time: 0.0756702 Nov 24 14:12:07.572452 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-10e89390-cd97-439d-95ba-abba3fa74124 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 217 time: 0.0653996 Nov 24 14:12:07.634578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-9d12e749-3224-4929-9272-99d7a0ddd483 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:07.636035 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-9d12e749-3224-4929-9272-99d7a0ddd483 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 200 len: 835 time: 0.0574086 Nov 24 14:12:07.717993 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-6d10280d-6c32-4592-9380-5df34f24fc97 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0754769 Nov 24 14:12:07.853426 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-89b838c7-ff03-4045-a01b-49917f57f512 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278431 Nov 24 14:12:08.041470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1c27e2-dbd2-4e3c-a7c1-d2964a58d796 req-b607dddc-c0aa-41a6-887e-3191b95bd2e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:08.042836 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-db1c27e2-dbd2-4e3c-a7c1-d2964a58d796 req-b607dddc-c0aa-41a6-887e-3191b95bd2e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 982 time: 0.1847658 Nov 24 14:12:08.046036 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4f03a3d-54ef-4bc1-8932-78f14bbf1ef0 req-11b401c1-91b0-45af-9d6c-bde58d038573 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1588373 Nov 24 14:12:08.120942 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-db1c27e2-dbd2-4e3c-a7c1-d2964a58d796 req-9c2ca923-4a29-4669-855f-669d8aa8c685 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723786 Nov 24 14:12:08.164647 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-d6e6c84b-fc16-4375-b49f-3d54b5b156b5 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 1135 time: 0.0758204 Nov 24 14:12:08.296767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-e9194bf7-3970-42f3-830f-bec40b50f56f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:08.298099 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-e9194bf7-3970-42f3-830f-bec40b50f56f service neutron] 10.222.0.47 "GET /v2.0/networks?id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 897 time: 0.1264701 Nov 24 14:12:08.365221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-3858a61f-cc4d-497d-bec3-8508db70af21 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 217 time: 0.0605426 Nov 24 14:12:08.407174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:08.432423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-7c03c09e-74ad-4d51-9d63-8c39acb7b442 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:08.433846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-7c03c09e-74ad-4d51-9d63-8c39acb7b442 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 200 len: 835 time: 0.0624771 Nov 24 14:12:08.514574 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-e530ba91-1fee-4227-b2f0-6ae1abacc859 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0745304 Nov 24 14:12:08.750249 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-c979c588-7994-4993-9e60-2cf9a0f5e4a9 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2293968 Nov 24 14:12:08.882910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1b84e630-a62c-49a1-8b96-e7d77c6eef5f req-f6e7b085-8062-4e8f-b7cf-64775304daf7 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1251743 Nov 24 14:12:09.323085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3bd78d-6521-457e-a2c7-4265331524b8 req-4ea48b85-320c-41e0-bc5d-07ce8f01139b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:09.324553 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5c3bd78d-6521-457e-a2c7-4265331524b8 req-4ea48b85-320c-41e0-bc5d-07ce8f01139b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 982 time: 0.0797768 Nov 24 14:12:09.373134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-5c3bd78d-6521-457e-a2c7-4265331524b8 req-15da8b50-9ed3-4ef2-bca7-c55481b34cc4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:09.385194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-5c3bd78d-6521-457e-a2c7-4265331524b8 req-15da8b50-9ed3-4ef2-bca7-c55481b34cc4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:09.386306 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5c3bd78d-6521-457e-a2c7-4265331524b8 req-15da8b50-9ed3-4ef2-bca7-c55481b34cc4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563390 Nov 24 14:12:10.589020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9074a5-fc4f-445d-97fc-32b8eb7b022a req-beddd065-0b5c-4af6-b94d-887f584f0ee7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:10.590363 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f9074a5-fc4f-445d-97fc-32b8eb7b022a req-beddd065-0b5c-4af6-b94d-887f584f0ee7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 982 time: 0.0803692 Nov 24 14:12:10.636146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f9074a5-fc4f-445d-97fc-32b8eb7b022a req-5ff9adf0-5e90-41b2-a2e5-7b5811f9daac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398872 Nov 24 14:12:11.851986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e1146a-342b-40d1-8fda-81003324c9f2 req-0ade22e7-f10c-4c85-b7d6-aa68048e14cb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:11.853866 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b4e1146a-342b-40d1-8fda-81003324c9f2 req-0ade22e7-f10c-4c85-b7d6-aa68048e14cb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 982 time: 0.0812049 Nov 24 14:12:11.898959 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b4e1146a-342b-40d1-8fda-81003324c9f2 req-4e29fb09-b1db-4416-9dd4-946744bc0101 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396619 Nov 24 14:12:12.562761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:12:12.694865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:12.709050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'port_id': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'mac_address': 'fa:16:3e:06:d3:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 852, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:12:12.765512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:12.782795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c44372c-c037-4dee-857c-2cfe4c01ab2a {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:12:12.797503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:12.801341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:12.804206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:12.868069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:12.871147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:13.093246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de9ff48-ec62-4ada-959c-ac076e2ea658 req-a596baea-7659-442e-8219-4bed7356ea18 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:13.094678 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0de9ff48-ec62-4ada-959c-ac076e2ea658 req-a596baea-7659-442e-8219-4bed7356ea18 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 983 time: 0.0758998 Nov 24 14:12:13.121267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['7c44372c-c037-4dee-857c-2cfe4c01ab2a'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:12:13.144212 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0de9ff48-ec62-4ada-959c-ac076e2ea658 req-3e223e85-fa0b-4e7c-9d9e-36350b18f865 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438924 Nov 24 14:12:14.343168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0908e0f-0eb1-4cf9-ba98-5251da36d300 req-c1571db1-c935-4979-9458-6cceb046a5c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:14.344549 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f0908e0f-0eb1-4cf9-ba98-5251da36d300 req-c1571db1-c935-4979-9458-6cceb046a5c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 983 time: 0.0787425 Nov 24 14:12:14.393018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f0908e0f-0eb1-4cf9-ba98-5251da36d300 req-98764691-2eb8-4fad-88b3-698b5c634f55 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417745 Nov 24 14:12:14.577795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:14.648256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:14.653747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:14.654123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:14.767782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:14.794836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:12:14.806007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:14.810273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:14.813321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:14.854707 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'code': 200} Nov 24 14:12:14.892799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:14.896207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:15.075065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c66d07fa-daee-4d56-8c29-0468edd61430 req-ac32960c-5e19-4d91-99f6-bdf58ba83e54 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 1137 time: 0.0678644 Nov 24 14:12:15.123777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c66d07fa-daee-4d56-8c29-0468edd61430 req-e049b138-5e36-4d19-854f-cd76c54fcf69 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426846 Nov 24 14:12:15.607083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f34a65-96f7-4e5a-bf1d-e86c3227d87a req-d7273745-0dab-401a-8167-5c47736ecbe5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:15.608464 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-61f34a65-96f7-4e5a-bf1d-e86c3227d87a req-d7273745-0dab-401a-8167-5c47736ecbe5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 984 time: 0.0799901 Nov 24 14:12:15.654188 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-61f34a65-96f7-4e5a-bf1d-e86c3227d87a req-f95a228c-23bd-4142-9803-7df8380df65f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402753 Nov 24 14:12:16.859674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a3153a-9f0d-4b8d-9d2d-d747c5691cca req-36cebeb7-1006-4c5f-ad79-1d4c7457d565 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:16.861139 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b1a3153a-9f0d-4b8d-9d2d-d747c5691cca req-36cebeb7-1006-4c5f-ad79-1d4c7457d565 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 984 time: 0.0806875 Nov 24 14:12:16.905290 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b1a3153a-9f0d-4b8d-9d2d-d747c5691cca req-8a0a0090-3fb4-48f9-b3c2-da14f4618b77 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385394 Nov 24 14:12:17.103479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3f17d7-e71d-4373-b63f-31c984975a58 req-d0ae5441-ff7e-433d-957c-61a8d49b28ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:17.104974 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb3f17d7-e71d-4373-b63f-31c984975a58 req-d0ae5441-ff7e-433d-957c-61a8d49b28ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 984 time: 0.0801206 Nov 24 14:12:17.155829 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb3f17d7-e71d-4373-b63f-31c984975a58 req-63591061-eb09-4304-b797-7a89d60bcbb5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451529 Nov 24 14:12:17.183784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47716) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:17.256169 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8438ef76-fa4c-467f-b2dc-52579bf7ae36 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 1132 time: 0.0710442 Nov 24 14:12:17.258618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47720) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:17.263769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.10'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:17.269257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:17.274196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:17.277017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:17.282576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:17.293728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:17.429122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:17.563396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.170 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/bdb70226-dde0-4fed-ae88-153ce9f0efee) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:12:17.710922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:17.739735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:17.742459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:17.745633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:17.808524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:12:17.811551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:17.814219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:12:17.849761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=bdb70226-dde0-4fed-ae88-153ce9f0efee,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:17.855580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:18.430236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:18.483868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:18.684933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:18.689319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:18.693411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:18.793585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=bdb70226-dde0-4fed-ae88-153ce9f0efee,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:18.797472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:18.812672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:19.005500 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 6e7c5144-5e21-4fca-ab01-5d01d9eae9b8 associated. External IP: 172.26.4.170, port: 7c44372c-c037-4dee-857c-2cfe4c01ab2a. Nov 24 14:12:19.387590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 2f743baf-7fa6-4942-a887-aad8629510a6 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:12:19.579576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:12:19.590436 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67771708-5349-4689-97ec-85f69747ae63 None None] Sync routers for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:12:19.604327 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:19.604976 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:19.605211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:19.662927 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 1035 time: 2.4032922 Nov 24 14:12:19.663634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:12:19.665818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47724) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:19.718750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'status': 'completed', 'code': 200} Nov 24 14:12:19.738044 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-241c97eb-39c5-4934-973a-12128be80340 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1&network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 1132 time: 0.0708144 Nov 24 14:12:19.792160 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:19.815012 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-6a2908c4-b06b-4f40-8e92-009729662dd2 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 1137 time: 0.0724263 Nov 24 14:12:20.110014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29d09de8-b742-4078-98dc-514503f5f19a req-592221b7-8574-4a57-ad7d-270ebd8cce94 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:20.111346 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-592221b7-8574-4a57-ad7d-270ebd8cce94 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 897 time: 0.2905204 Nov 24 14:12:20.160197 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '6e7c5144-5e21-4fca-ab01-5d01d9eae9b8', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.170', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'port_id': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1565024414', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'mac_address': 'fa:16:3e:06:d3:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:12:18Z', 'updated_at': '2021-11-24T14:12:18Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:04Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:20.164731 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67771708-5349-4689-97ec-85f69747ae63 None None] Checking router: 2f743baf-7fa6-4942-a887-aad8629510a6 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:12:20.174918 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:20.175508 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:20.243142 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-04f09cd8-5c02-4dcf-9e02-d61db58db12a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1038 time: 0.1219311 Nov 24 14:12:20.252704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e4d7b2-09d7-45ba-9cb5-7992f2f8f885 req-416090e8-2cbe-4d86-831e-56cc9fca32c2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:20.252907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8e4d7b2-09d7-45ba-9cb5-7992f2f8f885 req-416090e8-2cbe-4d86-831e-56cc9fca32c2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 984 time: 0.1810753 Nov 24 14:12:20.341739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29d09de8-b742-4078-98dc-514503f5f19a req-3e4ab8ae-a10d-483f-a62d-9cefc378ff1d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:20.343164 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-3e4ab8ae-a10d-483f-a62d-9cefc378ff1d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 200 len: 835 time: 0.0895643 Nov 24 14:12:20.388768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b8e4d7b2-09d7-45ba-9cb5-7992f2f8f885 req-c9e2e6dc-8e1d-4a8d-9160-3b36aa9c9274 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1009459 Nov 24 14:12:20.394482 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:20.431786 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-27363b31-bb94-4ecc-afed-5e1068fbff97 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0794294 Nov 24 14:12:20.582335 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-4643650b-919f-4099-a7fb-64bc4df5184d service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1429064 Nov 24 14:12:20.750612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29d09de8-b742-4078-98dc-514503f5f19a req-4642e59d-e1cc-48aa-9cc7-c64bc0d94270 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1617291 Nov 24 14:12:20.834008 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-67771708-5349-4689-97ec-85f69747ae63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '6e7c5144-5e21-4fca-ab01-5d01d9eae9b8', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.170', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'port_id': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1565024414', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'mac_address': 'fa:16:3e:06:d3:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:12:18Z', 'updated_at': '2021-11-24T14:12:18Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:04Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:20.840700 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67771708-5349-4689-97ec-85f69747ae63 None None] The sync data for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv is: [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '6e7c5144-5e21-4fca-ab01-5d01d9eae9b8', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.170', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'port_id': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': 'tempest-TestNetworkBasicOps-1565024414', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'mac_address': 'fa:16:3e:06:d3:7b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ce6176b9-619e-45ad-8e37-5126e901a3e1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:12:18Z', 'updated_at': '2021-11-24T14:12:18Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:04Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:12:21.072921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b29147d-aafa-4491-b237-6a233477ef12 None None] New status for floating IP 6e7c5144-5e21-4fca-ab01-5d01d9eae9b8: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:12:21.496136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-94a79835-58d4-40ee-b622-393ee368626c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:21.497602 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-94a79835-58d4-40ee-b622-393ee368626c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 984 time: 0.0789485 Nov 24 14:12:21.569606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-da6585df-2af5-4dce-a6b7-b51e7dce3763 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:21.570909 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-da6585df-2af5-4dce-a6b7-b51e7dce3763 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0680001 Nov 24 14:12:21.630894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7096ab4-1503-4f49-a4d1-d76d53d16a56 req-5072e30c-12b9-46c9-a8df-d0e9c972d43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:21.632473 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e7096ab4-1503-4f49-a4d1-d76d53d16a56 req-5072e30c-12b9-46c9-a8df-d0e9c972d43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 984 time: 0.0883093 Nov 24 14:12:21.696351 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e7096ab4-1503-4f49-a4d1-d76d53d16a56 req-a122ba94-edc6-41b3-b579-8372f3a244e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575747 Nov 24 14:12:21.732269 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-62c34952-f323-4cc4-8c0c-9fbaee7c22a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1560457 Nov 24 14:12:21.742851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:21.861160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:22.080413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:22.113341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:22.170300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] device_id is not set on port 7c44372c-c037-4dee-857c-2cfe4c01ab2a yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:12:22.179636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:22.186390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:22.190674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c51fce25-bcfc-4553-9ff7-dfcec4a3c96d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:22.337225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=6']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:22.340740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:22.422072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] No DVR routers for this DVR port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:12:22.478722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b6db1c46-10ee-4e90-ba9f-55245cc4dc10 None None] Provisioning complete for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:22.479333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b6db1c46-10ee-4e90-ba9f-55245cc4dc10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:22.535309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b6db1c46-10ee-4e90-ba9f-55245cc4dc10 None None] Port 7c44372c-c037-4dee-857c-2cfe4c01ab2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:12:22.824975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] In _notify_port_updated(), no bound segment for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:12:22.826046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:22.827435 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-833e834c-2f58-46c9-b568-cb51a99e82d8 req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] 10.222.0.47 "PUT /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1027 time: 1.0896330 Nov 24 14:12:22.882185 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ad0eb44-465a-41bb-bf2a-c3321cb8ea97 req-590f629a-2957-4e6d-a7ff-ff96ce9306bc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=ce6176b9-619e-45ad-8e37-5126e901a3e1 HTTP/1.1" status: 200 len: 210 time: 0.0436468 Nov 24 14:12:23.989600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47742) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:24.061180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92f5ee3b-9cf4-4db5-afa1-344af91ed5b8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:24.062640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-92f5ee3b-9cf4-4db5-afa1-344af91ed5b8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 926 time: 0.0720119 Nov 24 14:12:24.389692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47748) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:24.395356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-619182824', 'description': 'tempest-secgroup-smoke-619182824 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:24.402311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:24.413855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:24.425139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.463827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:24.467956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:24.471412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:24.477243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:24.536788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.540968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.544978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3173a32d-eab2-4a3d-91e4-db64f6af115d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:24.592581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4875dea2-2b77-4021-ae79-167bd1d851aa,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:24.596073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:24.599659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.601143 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a9b7cbb-5b10-447e-9077-8370014ca34b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.2103202 Nov 24 14:12:24.604370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47752) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:24.609657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '4875dea2-2b77-4021-ae79-167bd1d851aa', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:24.616421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:24.620165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:24.623127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:14. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:24.628948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 14; quota limit: 100; headroom:86 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:24.646452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.708205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.712154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.714104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d2669b1f-5b65-401c-914d-97499d83166f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:24.737473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f7e15c6-85a6-4fc2-b9f3-a67d0d6076c2,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:24.740849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:24.749859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.751107 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1459565 Nov 24 14:12:24.755460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47756) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:24.761356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '4875dea2-2b77-4021-ae79-167bd1d851aa', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:24.767457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:24.772788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:24.777440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:15. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:24.783178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 15; quota limit: 100; headroom:85 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:24.801025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.865087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.868634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.870411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e439e1eb-b285-48f3-801c-56094628424e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:24.893303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4c1d9601-21de-4d6f-9ac0-6844783082be,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:24.896956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:24.904370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:24.905525 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0b6d1902-49ec-44e9-a807-572da677cd1a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1487939 Nov 24 14:12:24.908238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47760) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:24.914306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '4875dea2-2b77-4021-ae79-167bd1d851aa', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:24.920595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:24.924574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:24.928135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:16. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:24.933860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 16; quota limit: 100; headroom:84 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:24.951025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.018291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.022658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.024695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3bbf29b3-cda6-4c50-a8be-fd53b948e743 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:25.046883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c6ec919-ed10-4cd4-814f-720c85b10cc8,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:25.049619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:25.060924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.062107 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1529765 Nov 24 14:12:25.065131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47764) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:25.071307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '4875dea2-2b77-4021-ae79-167bd1d851aa', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:25.077290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:25.081736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:25.084700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:25.090355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:25.108125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.173004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.177218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.183095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d99b354a-f891-4ec9-b530-3fca4395f2af tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:25.204138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=162af817-cd11-4660-8a9f-b07fe9ed678c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:25.210405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:25.217766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.219383 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1533654 Nov 24 14:12:25.222287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47768) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:25.229449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '4875dea2-2b77-4021-ae79-167bd1d851aa', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:25.237020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:25.242165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:25.246052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:18. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:25.253640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 18; quota limit: 100; headroom:82 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:25.267079 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:12:25.275408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.353931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.357972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.359955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64aeef7f-db63-4627-abff-6bd2279a6680 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:25.383870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c0bd87a3-b448-4523-80e2-ecee554e1ee7,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:25.388327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:25.398182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.399901 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1759436 Nov 24 14:12:25.402501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47772) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:25.408307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '4875dea2-2b77-4021-ae79-167bd1d851aa', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:25.415324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:25.419652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:25.422701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:25.429463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:25.440295 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:12:25.447616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.518349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.522260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.524208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2872126a-2754-4592-8c8a-be8bf9665f72 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:25.547048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=219ea2d0-f3fe-4b8e-84c7-d12a60525c8a,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:25.551571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:25.556511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:25.557673 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1540356 Nov 24 14:12:25.736798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-c3f2ae62-5a8a-4a34-92d3-7a633ef8d8dd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:25.752055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-c3f2ae62-5a8a-4a34-92d3-7a633ef8d8dd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:25.753212 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-c3f2ae62-5a8a-4a34-92d3-7a633ef8d8dd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-619182824&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0587323 Nov 24 14:12:25.835568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-23e5fb61-d5cc-49cb-a12b-18a50b29e286 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:25.836894 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-23e5fb61-d5cc-49cb-a12b-18a50b29e286 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 931 time: 0.0764523 Nov 24 14:12:25.912405 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-46d58071-dbbb-4431-b28a-761485f728db service neutron] 10.222.0.70 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request HTTP/1.1" status: 200 len: 311 time: 0.0609930 Nov 24 14:12:26.149321 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-bedb59e2-7ea6-49f2-960a-aa474bf0bb5b service neutron] 10.222.0.70 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2308986 Nov 24 14:12:26.282388 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-d136485a-186b-47d9-83a5-11b7bea3821a service neutron] 10.222.0.70 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272566 Nov 24 14:12:26.468742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9555abf2-c240-4024-a7a5-cd2b98235089 req-b5514642-39bc-4a53-b0ca-2f9743f57f6e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 210 time: 0.0414453 Nov 24 14:12:26.657088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:12:26.715875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:12:27.415878 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-ab1deacd-2030-4c2d-b041-e725508f07df service neutron] 10.222.0.47 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1027 time: 0.0681934 Nov 24 14:12:27.577217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-0b160f5b-8a0c-49be-8727-ae1fac4f7cf0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:27.578651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-0b160f5b-8a0c-49be-8727-ae1fac4f7cf0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 796 time: 0.1575074 Nov 24 14:12:27.646353 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2e5ba107-eb6b-499b-a15f-1362e1fc0322 req-c6b79634-d9c4-423c-8a51-d46cb150e972 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 210 time: 0.0428002 Nov 24 14:12:27.668243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-a5d27130-13ac-4a7e-b6e2-0d762f57cae1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 471 time: 0.0452697 Nov 24 14:12:27.683048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Request body: {'port': {'device_id': 'b5bfcd96-7b5b-4ef2-b994-653cf17c4abb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:27.792225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:28.132593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c44372c-c037-4dee-857c-2cfe4c01ab2a {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:12:28.139865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:28.154537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Transition to ACTIVE for port object 7c44372c-c037-4dee-857c-2cfe4c01ab2a will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:28.158460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:28.162727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:28.294298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=7']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:28.297321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:28.436948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:12:28.437271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:12:28.437533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:28.443492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:12:28.443838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Attempting to bind port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:28.450150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 12, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:12:28.450479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Checking segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:12:28.450855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Bound using segment: {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:12:28.451376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Bound port: 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '37730c91-65d0-4375-ac81-e6b6eb203d58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:12:28.451723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:28.544480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:28.547352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:12:28.552620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:28.556314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-40d4e862-ac27-44b6-a731-9329720040cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:28.613564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:28.615071 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] 10.222.0.47 "PUT /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1132 time: 0.9358826 Nov 24 14:12:28.615425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5bfcd96-7b5b-4ef2-b994-653cf17c4abb', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:12:28.638295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=8']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:28.648155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:28.688182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5bfcd96-7b5b-4ef2-b994-653cf17c4abb', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'status': 'completed', 'code': 200} Nov 24 14:12:28.734464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-4d5223d4-2ab7-401e-8ac6-3ab4dcded9d9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 1135 time: 0.0781372 Nov 24 14:12:28.863043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c335a1-d07c-4667-b5c2-02986a4af940 req-8e425941-52bf-4582-9953-bfcc9d54438d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:28.864611 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-50c335a1-d07c-4667-b5c2-02986a4af940 req-8e425941-52bf-4582-9953-bfcc9d54438d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 982 time: 0.0903692 Nov 24 14:12:28.916158 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-50c335a1-d07c-4667-b5c2-02986a4af940 req-b5434a5c-59a5-4833-badf-33ffe0cb4270 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449474 Nov 24 14:12:28.955473 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-7045be67-672b-41d3-a21f-3fdf7b15daba service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1038 time: 0.2112949 Nov 24 14:12:29.020871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-ce49f26b-cb44-4d44-9363-3cb618e44659 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:29.022310 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-ce49f26b-cb44-4d44-9363-3cb618e44659 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 200 len: 835 time: 0.0600460 Nov 24 14:12:29.098032 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-f1ce58b2-c1de-4a5e-86fa-05064ea3b34c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0684845 Nov 24 14:12:29.229514 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-7883f6d3-f20d-4110-9808-9ea570fb4370 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1250801 Nov 24 14:12:29.361982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42b6cf3f-bc83-48c3-a26b-a1d651d321d5 req-5d3c79c9-2572-4b0b-943f-afdfee8215fb service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261308 Nov 24 14:12:29.482776 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-bb211673-bd6f-4adf-873c-a41232dbfca5 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 1135 time: 0.0749965 Nov 24 14:12:29.619216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-8195fa81-50c6-4aa1-b0ee-e7ef8a23c629 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:29.620696 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-8195fa81-50c6-4aa1-b0ee-e7ef8a23c629 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 897 time: 0.1320834 Nov 24 14:12:29.721944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-36ccdfda-3fa5-481b-940f-e26bed00bebe service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1038 time: 0.0949278 Nov 24 14:12:29.786941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-ea918ff5-0bd9-482e-ad4a-af4d4dfa298f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:29.788340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-ea918ff5-0bd9-482e-ad4a-af4d4dfa298f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 200 len: 835 time: 0.0603876 Nov 24 14:12:29.862872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-c6461d8a-4bba-4280-890e-266e12af3b3d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0677352 Nov 24 14:12:29.997374 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-790039e7-5055-4d21-aec0-dd1b4cd2e082 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1277680 Nov 24 14:12:30.186540 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-911d64f2-3902-4aa3-a4e9-30134ddeaf49 req-fb4d7570-598b-44a5-9b62-512c1c4f7bca service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1827297 Nov 24 14:12:30.208218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366d0019-9ee5-40a7-b466-396f1a7263fc req-6ff3bfd2-acdf-48fb-8685-1fe01be19b69 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:30.209676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-366d0019-9ee5-40a7-b466-396f1a7263fc req-6ff3bfd2-acdf-48fb-8685-1fe01be19b69 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 982 time: 0.1281319 Nov 24 14:12:30.268315 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-366d0019-9ee5-40a7-b466-396f1a7263fc req-887e365d-4b0a-4e94-a549-45f94a299ce2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515826 Nov 24 14:12:31.468123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8afbc47-8e8c-486c-af92-e326015cb4ca req-b2ca1c69-ce9c-48a6-bdd9-dc400d7496f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:31.469571 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8afbc47-8e8c-486c-af92-e326015cb4ca req-b2ca1c69-ce9c-48a6-bdd9-dc400d7496f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 982 time: 0.0788498 Nov 24 14:12:31.522303 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8afbc47-8e8c-486c-af92-e326015cb4ca req-f06ed6c0-c5df-4b3a-bc7c-3ee91c2e7684 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456238 Nov 24 14:12:32.702145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:12:32.721727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bd9e1e-f4f3-4a54-bbbc-8c364a5f49ae req-991a6b10-6dc7-4f4d-8bdf-b98cca26c189 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:32.723156 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-84bd9e1e-f4f3-4a54-bbbc-8c364a5f49ae req-991a6b10-6dc7-4f4d-8bdf-b98cca26c189 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 982 time: 0.0786397 Nov 24 14:12:32.770081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-84bd9e1e-f4f3-4a54-bbbc-8c364a5f49ae req-9661e23e-6660-494c-b3a8-7e00700b0cef tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402086 Nov 24 14:12:32.837769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:32.851583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'port_id': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'mac_address': 'fa:16:3e:06:d3:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 852, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:12:32.907613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:32.924065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c44372c-c037-4dee-857c-2cfe4c01ab2a {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:12:32.939232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:32.943249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:32.946642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c3d5bc52-2055-417a-aa3f-13496898b066 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:33.008335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:33.011296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:33.181515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-acdd94f9-4f16-43ee-9814-6ef1bfdfaea1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:33.234194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['7c44372c-c037-4dee-857c-2cfe4c01ab2a'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:12:33.576679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:33.972384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a6e69d1-163d-4bc3-b6a9-96ecf406e381 req-32680e02-657c-48b3-bfd5-baff2221c470 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:33.973812 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9a6e69d1-163d-4bc3-b6a9-96ecf406e381 req-32680e02-657c-48b3-bfd5-baff2221c470 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 983 time: 0.0772526 Nov 24 14:12:34.019139 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9a6e69d1-163d-4bc3-b6a9-96ecf406e381 req-e7471337-1750-4893-8038-fbb5c2efea33 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393310 Nov 24 14:12:34.701500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:34.770592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:34.775901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:34.776280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:34.886959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:34.913870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5bfcd96-7b5b-4ef2-b994-653cf17c4abb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:12:34.923242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:34.928215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:34.930191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:34.973023 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5bfcd96-7b5b-4ef2-b994-653cf17c4abb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c44372c-c037-4dee-857c-2cfe4c01ab2a', 'code': 200} Nov 24 14:12:34.997905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=10']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:35.000867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:35.254209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be3bc7f-06c9-4b31-9b0c-803704df041b req-520b340d-6bf9-4c0f-92ae-922747929039 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:35.260430 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0be3bc7f-06c9-4b31-9b0c-803704df041b req-520b340d-6bf9-4c0f-92ae-922747929039 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.0911720 Nov 24 14:12:35.261096 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9fc7516e-8125-4055-a513-b689cf7df069 req-d219df51-cb7b-4f26-ae83-63d6e084556b service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 1138 time: 0.0794973 Nov 24 14:12:35.306330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0be3bc7f-06c9-4b31-9b0c-803704df041b req-97cd63ee-d310-4734-95a4-7285d450cda5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435295 Nov 24 14:12:35.307439 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9fc7516e-8125-4055-a513-b689cf7df069 req-8fec58ba-b135-4cff-b754-a46aa59b6a55 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398233 Nov 24 14:12:35.761685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7a3058b1-afef-496c-ab65-2161cce464d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:36.524893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-682a57ba-23e4-4ba3-bf31-d6e649adc4ad req-f5f62c97-7078-481f-93d2-14cbfb3dedca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:36.526394 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-682a57ba-23e4-4ba3-bf31-d6e649adc4ad req-f5f62c97-7078-481f-93d2-14cbfb3dedca tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.0907509 Nov 24 14:12:36.691723 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-682a57ba-23e4-4ba3-bf31-d6e649adc4ad req-ddb70ac9-0fdf-40df-b5b7-92ca23ea41c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1596467 Nov 24 14:12:36.733869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:37.887170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fd7ff1-a072-46e2-8962-24eeda64a28c req-f0eaeef2-c64d-46bd-bae1-3708d83193aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:37.888659 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-19fd7ff1-a072-46e2-8962-24eeda64a28c req-f0eaeef2-c64d-46bd-bae1-3708d83193aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.0767398 Nov 24 14:12:37.934891 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-19fd7ff1-a072-46e2-8962-24eeda64a28c req-56cd65b8-9d1c-404d-8c13-cb00dbb0d73c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408137 Nov 24 14:12:37.988299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-c6572a2b-1464-4960-a0f0-11c3044a5132 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0686541 Nov 24 14:12:38.184558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-6bef675f-f567-4252-a462-e86522dc7c59 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 1138 time: 0.1301739 Nov 24 14:12:38.191551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a379d6df-5992-45c5-a7e2-104f1d282f98 req-65dd1102-5270-4f39-aa2a-3f551c300bea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:38.192931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a379d6df-5992-45c5-a7e2-104f1d282f98 req-65dd1102-5270-4f39-aa2a-3f551c300bea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.1102164 Nov 24 14:12:38.326176 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a379d6df-5992-45c5-a7e2-104f1d282f98 req-e97c4ed2-0710-4997-972e-3e3072800d1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247828 Nov 24 14:12:38.354970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47818) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:38.364206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-aad755e3-1f68-4ff1-accd-a94307e679c8 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:38.365734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-aad755e3-1f68-4ff1-accd-a94307e679c8 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 897 time: 0.1485190 Nov 24 14:12:38.412023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:38.430966 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6a3c67e2-b03e-4f7f-8f58-a619f7cc7a4c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb&network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 200 len: 1133 time: 0.0747209 Nov 24 14:12:38.473053 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-cdb31380-6d8a-4478-8096-a8687588f204 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1040 time: 0.1010447 Nov 24 14:12:38.540782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-960f351f-baab-48be-8ddc-2b4c6a9b9b8f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:38.542147 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-960f351f-baab-48be-8ddc-2b4c6a9b9b8f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 200 len: 835 time: 0.0635436 Nov 24 14:12:38.620270 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-52545cc0-caa9-4fca-b12b-e63f2e57333a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9fbcda65-8ca5-43c4-9092-024c9ff725d4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0713925 Nov 24 14:12:38.797844 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-b98f0a54-06df-4173-ad5a-0f9dd0420472 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1667809 Nov 24 14:12:38.802045 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:12:38.916705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70f79f08-6bab-435d-86c7-a93f71508b85 req-fc251427-3bcc-4a03-863f-b3b4d4ac384c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:38.918131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-70f79f08-6bab-435d-86c7-a93f71508b85 req-fc251427-3bcc-4a03-863f-b3b4d4ac384c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.1773896 Nov 24 14:12:38.972290 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6c26a39-6b0a-4127-8cd6-3ffbbde614b1 req-e73e334c-6a1f-4976-82a8-403ec2830278 service neutron] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1663113 Nov 24 14:12:38.994718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-70f79f08-6bab-435d-86c7-a93f71508b85 req-ba3c318d-dc5e-41e6-b274-6e5fab39f3a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640509 Nov 24 14:12:40.194749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ee6239-c797-49b3-af68-bd9f30ce25fb req-a1826fa2-a12b-4019-b0d4-c4298963e8f2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:40.196211 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-96ee6239-c797-49b3-af68-bd9f30ce25fb req-a1826fa2-a12b-4019-b0d4-c4298963e8f2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.0798702 Nov 24 14:12:40.244021 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-96ee6239-c797-49b3-af68-bd9f30ce25fb req-85d2f074-24b3-4cfb-abbc-79416117ac39 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=d2d9488f-e3f6-4eb6-8124-78344968d3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419636 Nov 24 14:12:40.289111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-64377295-c4a9-49e5-b861-614dd20f210d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:40.290450 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-64377295-c4a9-49e5-b861-614dd20f210d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 985 time: 0.0770607 Nov 24 14:12:40.358341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-005017ec-b138-4882-96d6-c94603b2408d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:40.359651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-005017ec-b138-4882-96d6-c94603b2408d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0630906 Nov 24 14:12:40.502907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-7e782b0e-041c-429a-8dd0-15b8d317ce3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1383734 Nov 24 14:12:40.512747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:40.620504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:40.910218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=7c44372c-c037-4dee-857c-2cfe4c01ab2a,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:40.937347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] For port 7c44372c-c037-4dee-857c-2cfe4c01ab2a, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:40.986732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] device_id is not set on port 7c44372c-c037-4dee-857c-2cfe4c01ab2a yet. {{(pid=83526) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Nov 24 14:12:40.994425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:40.999456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:41.003113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:41.136971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Pushing event updated for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=11']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:41.151196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.151637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.151970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.152335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.152701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.153063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.153425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.153788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.154147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.154506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.154863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:41.166619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:41.207919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] No DVR routers for this DVR port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:12:41.328090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6841d688-3b0d-434f-b568-57bb4cf0e883 None None] Provisioning complete for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:41.328682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6841d688-3b0d-434f-b568-57bb4cf0e883 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:41.389895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6841d688-3b0d-434f-b568-57bb4cf0e883 None None] Port 7c44372c-c037-4dee-857c-2cfe4c01ab2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:12:41.468926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] In _notify_port_updated(), no bound segment for port 7c44372c-c037-4dee-857c-2cfe4c01ab2a on network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 {{(pid=83526) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:843}} Nov 24 14:12:41.469869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:41.471124 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-77016c32-353c-40bb-a234-a1f9ef9f639d req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] 10.222.0.47 "PUT /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 200 len: 1028 time: 0.9621921 Nov 24 14:12:41.561661 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a7a4907-5b5d-47e2-9ce9-174fba817625 req-7cc85d5d-47f3-46ae-8ef5-e2043f68dbd3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=b5bfcd96-7b5b-4ef2-b994-653cf17c4abb HTTP/1.1" status: 200 len: 210 time: 0.0429716 Nov 24 14:12:42.671094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47832) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:42.742439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:42.770465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:42.832632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:42.837288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5fcf2ec5-4e26-465b-a535-395cece75b3b tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:42.853317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4875dea2-2b77-4021-ae79-167bd1d851aa,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:42.865395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.865677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.866147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.866519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.866915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.867280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.867641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.868035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.868394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.868749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.869105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:42.872744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:42.874589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:42.875686 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/4875dea2-2b77-4021-ae79-167bd1d851aa HTTP/1.1" status: 204 len: 168 time: 0.2036324 Nov 24 14:12:42.915590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47838) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:43.113342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port bdb70226-dde0-4fed-ae88-153ce9f0efee {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:12:43.113678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:43.279744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:43.280086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:43.397615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for bdb70226-dde0-4fed-ae88-153ce9f0efee owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:12:43.649100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:43.653284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3041de93-7b12-4900-8b7b-78ddcaa98026 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:43.692776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=bdb70226-dde0-4fed-ae88-153ce9f0efee,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:43.697271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:43.787920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:44.183650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 2f743baf-7fa6-4942-a887-aad8629510a6 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:12:44.403256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:12:44.417767 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] Sync routers for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:12:44.432662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:44.436471 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:44.437414 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:44.522458 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/6e7c5144-5e21-4fca-ab01-5d01d9eae9b8 HTTP/1.1" status: 204 len: 168 time: 1.6045308 Nov 24 14:12:44.662037 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:44.680996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47846) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:44.719142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:12:44.756684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:44.780207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 7c44372c-c037-4dee-857c-2cfe4c01ab2a not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:12:44.786172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:44.851558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:44.855781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-20c16984-c3c0-481a-80bf-2bc1abec1c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:44.871948 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:44.874356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:44.885254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:44.886445 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/7aa9a07e-f94c-4f6c-ad28-6e1b4d1577bf HTTP/1.1" status: 204 len: 168 time: 0.2044704 Nov 24 14:12:44.927993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47852) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:44.989362 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:04Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:44.993780 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] Checking router: 2f743baf-7fa6-4942-a887-aad8629510a6 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:12:44.993990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 7c44372c-c037-4dee-857c-2cfe4c01ab2a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:12:44.994157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:45.006497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:45.007530 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:45.180658 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:45.239697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:45.367534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 7c44372c-c037-4dee-857c-2cfe4c01ab2a owned by {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:12:45.531148 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:04Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:45.534950 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2eecff9-3715-42d8-8ca8-42666ca3b5f4 None None] The sync data for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv is: [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:11:57Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'f10c1a07-29a1-4040-954e-9deeb8679030', 'name': '', 'network_id': '9fbcda65-8ca5-43c4-9092-024c9ff725d4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:20:75:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:57Z', 'updated_at': '2021-11-24T14:12:04Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '00d5e01f-ac44-49f6-89fa-1fb1c3199965', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:12:45.634239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:45.642606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-afd4e635-bea6-45a8-a697-03d340a00d16 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:45.691013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=7c44372c-c037-4dee-857c-2cfe4c01ab2a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:45.694293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:45.765727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2188c745-1245-4438-8124-87a28a3c9361 None None] New status for floating IP 6e7c5144-5e21-4fca-ab01-5d01d9eae9b8: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:12:45.806046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:45.817422 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/ports/7c44372c-c037-4dee-857c-2cfe4c01ab2a HTTP/1.1" status: 204 len: 168 time: 0.8878174 Nov 24 14:12:45.820836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47856) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:46.250965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:46.854524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port f10c1a07-29a1-4040-954e-9deeb8679030 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:12:46.855272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:47.040085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port f10c1a07-29a1-4040-954e-9deeb8679030, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f10c1a07-29a1-4040-954e-9deeb8679030,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:47.040334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:47.271281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for f10c1a07-29a1-4040-954e-9deeb8679030 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:12:47.453903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:47.458174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:47.502264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=f10c1a07-29a1-4040-954e-9deeb8679030,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:47.505680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:47.730156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:47.796580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:48.363055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 2f743baf-7fa6-4942-a887-aad8629510a6 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:12:48.557011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:12:48.566098 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] Sync routers for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:12:48.570183 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/2f743baf-7fa6-4942-a887-aad8629510a6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7482064 Nov 24 14:12:48.572782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:48.579162 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:48.579771 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:48.776438 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:48.883015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet 00d5e01f-ac44-49f6-89fa-1fb1c3199965 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:12:48.886640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:48.939728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.028251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.055806 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:12:47Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:49.059539 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] Checking router: 2f743baf-7fa6-4942-a887-aad8629510a6 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:12:49.070589 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] Routers {'2f743baf-7fa6-4942-a887-aad8629510a6'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:49.071189 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['2f743baf-7fa6-4942-a887-aad8629510a6'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:49.100903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.105284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0adeb2e9-808b-4a80-92af-07afda58a17f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:49.140194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=00d5e01f-ac44-49f6-89fa-1fb1c3199965,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:49.143472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:49.146930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.153333 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/00d5e01f-ac44-49f6-89fa-1fb1c3199965 HTTP/1.1" status: 204 len: 168 time: 0.5795772 Nov 24 14:12:49.155167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1073d4d-845e-4a0a-aeb4-5b62919c65cd None None] Network 9fbcda65-8ca5-43c4-9092-024c9ff725d4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:12:49.156135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47864) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:49.254487 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] Set router 2f743baf-7fa6-4942-a887-aad8629510a6 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:49.362088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.421262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] DHCP port deletion for 9fbcda65-8ca5-43c4-9092-024c9ff725d4 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:12:49.425825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Deleting port 7133724c-1e92-4361-8f9e-212524d55735 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:12:49.426284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.558164 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:12:47Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:49.562148 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6425b28-eff5-460a-8fba-a07ebd95632e None None] The sync data for ids ['2f743baf-7fa6-4942-a887-aad8629510a6'] in dv-neutron-818151-2-hyperv is: [{'id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'name': 'tempest-TestNetworkBasicOps-router-2060793960', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242'}], 'enable_snat': True}, 'gw_port_id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:11:53Z', 'updated_at': '2021-11-24T14:12:47Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1882cff1-41ec-4d3c-b178-86b0077a4fcf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:97:7c:61', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2f743baf-7fa6-4942-a887-aad8629510a6', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:11:54Z', 'updated_at': '2021-11-24T14:11:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:12:49.577170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.587826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 1882cff1-41ec-4d3c-b178-86b0077a4fcf {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:12:49.588194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.671679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] For port 7133724c-1e92-4361-8f9e-212524d55735, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7133724c-1e92-4361-8f9e-212524d55735,segment=NetworkSegment(37730c91-65d0-4375-ac81-e6b6eb203d58),segment_id=37730c91-65d0-4375-ac81-e6b6eb203d58)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:49.671981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.767611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 1882cff1-41ec-4d3c-b178-86b0077a4fcf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1882cff1-41ec-4d3c-b178-86b0077a4fcf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:49.767984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.789181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Calling delete_port for 7133724c-1e92-4361-8f9e-212524d55735 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:12:49.864708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:49.869658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-153423a4-bf85-423c-85a7-e2bbbebffc34 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:49.892786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 1882cff1-41ec-4d3c-b178-86b0077a4fcf owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:12:49.915285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Pushing event deleted for resources: {'Port': ['ID=7133724c-1e92-4361-8f9e-212524d55735,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:49.917636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:49.921081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] No DVR routers for this DVR port 7133724c-1e92-4361-8f9e-212524d55735 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:12:50.169640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.173101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-845ce83b-1c50-4ee9-b7cb-5a59eeb09262 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:50.214546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=1882cff1-41ec-4d3c-b178-86b0077a4fcf,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:50.217237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:50.434017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.681101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.685352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.712667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.713302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router 2f743baf-7fa6-4942-a887-aad8629510a6 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:12:50.729441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.730617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/2f743baf-7fa6-4942-a887-aad8629510a6 HTTP/1.1" status: 204 len: 168 time: 1.5734367 Nov 24 14:12:50.733198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47868) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:50.849803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f10c1a07-29a1-4040-954e-9deeb8679030 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:12:50.851904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:50.882695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f10c1a07-29a1-4040-954e-9deeb8679030 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:12:50.883051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f10c1a07-29a1-4040-954e-9deeb8679030 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:12:50.883473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7133724c-1e92-4361-8f9e-212524d55735 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:12:50.920375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 7133724c-1e92-4361-8f9e-212524d55735 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:12:50.920731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7133724c-1e92-4361-8f9e-212524d55735 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:12:50.985950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.014807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9fbcda65-8ca5-43c4-9092-024c9ff725d4']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:51.027052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '37730c91-65d0-4375-ac81-e6b6eb203d58') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:51.027346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '37730c91-65d0-4375-ac81-e6b6eb203d58') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:51.038779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.054322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.060195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:12:51.060570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:12:51.075188 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:12:51.156024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.159585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-018f7cab-de0c-403a-a0aa-61af5baf1814 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:51.175139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.187222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=9fbcda65-8ca5-43c4-9092-024c9ff725d4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:51.190881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:51.192690 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a0d5a380-ab70-4c95-a9e7-a877c7fd9588 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/9fbcda65-8ca5-43c4-9092-024c9ff725d4 HTTP/1.1" status: 204 len: 168 time: 0.4585848 Nov 24 14:12:51.206755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47872) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:51.223033 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a4d4144d-f61b-45d0-a406-a7f0cceb2d6e tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/agents?agent_type=L3+agent HTTP/1.1" status: 200 len: 838 time: 0.0144620 Nov 24 14:12:51.231853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47876) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:51.237501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--748392461', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:51.243697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:51.247736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:51.254635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:51.261650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:51.278344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:12:51.281922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.311915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 853} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:12:51.324618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.324914 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment b27fafd5-61dd-4571-b89b-44a5b7b322da of type vlan for network 0a901196-f112-4666-aeaf-c953b32f034c Nov 24 14:12:51.351590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.382984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.386893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:51.387471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.391208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0fe38818-9a68-4bc5-8f13-fa4a361efdf9 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:51.493447 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2604105 Nov 24 14:12:51.496001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47880) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:51.503295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-378163214', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:51.509329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=0a901196-f112-4666-aeaf-c953b32f034c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:51.512658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:51.513542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:51.517397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:51.519574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 0a901196-f112-4666-aeaf-c953b32f034c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:12:51.520279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:51.526295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:51.537360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.538914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.565491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.709814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.890533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:51.921013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:52.053852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.128 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/283d401b-b76d-4ebf-9595-4a31170bcccf) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:12:52.199999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:52.229238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:52.232833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:52.296167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:12:52.299213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:52.303523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:12:52.327265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:52.331976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:52.459967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:52.460575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:52.744028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1882cff1-41ec-4d3c-b178-86b0077a4fcf no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:12:52.777335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1882cff1-41ec-4d3c-b178-86b0077a4fcf {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:12:52.777685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1882cff1-41ec-4d3c-b178-86b0077a4fcf not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:12:52.787712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 503af3ce-e0b0-4275-9751-c6b907a71eb9 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:12:52.984953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:12:52.994154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Sync routers for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:12:53.005994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:53.006800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:53.009963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:53.011150 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.5142395 Nov 24 14:12:53.014231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47884) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:53.057066 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-32f20336-c96e-405a-bb4f-379de3bae842 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0416827 Nov 24 14:12:53.059627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47888) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:53.183049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:53.190552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7ab921e-0478-4ca6-b94c-2c717ad152d2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:53.192058 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d7ab921e-0478-4ca6-b94c-2c717ad152d2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1314554 Nov 24 14:12:53.195510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47892) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:53.237724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd5e9db6-eb4a-48cf-a853-83181fc33f02 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0387220 Nov 24 14:12:53.238367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47896) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:53.243241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-147311457', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:53.353774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:53.357475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:53.360211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:53.366135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:53.375884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:12:53.475320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:52Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:53.479332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Checking router: 503af3ce-e0b0-4275-9751-c6b907a71eb9 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:12:53.479693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Updating router 503af3ce-e0b0-4275-9751-c6b907a71eb9 port 283d401b-b76d-4ebf-9595-4a31170bcccf binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:12:53.480849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:53.531252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:53.705752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:53.709995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dfc06298-85a1-4743-9bd1-6d72f6f0885e tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:53.787415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=01a7da11-f654-4c61-8dbe-4770c0c075e3,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:53.791778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:53.802510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:12:53.802868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: 0a901196-f112-4666-aeaf-c953b32f034c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:12:53.825632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 0a901196-f112-4666-aeaf-c953b32f034c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:12:53.835704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 0a901196-f112-4666-aeaf-c953b32f034c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:53.839717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:53.840318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:53.846421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d328891-f0aa-489f-9741-fdcc9ab65ce1 None None] Network 0a901196-f112-4666-aeaf-c953b32f034c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:12:53.865146 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1881dbbe-3e43-4312-a4ce-ab87ef20ca1e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6237257 Nov 24 14:12:53.865400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47900) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:53.985733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.021676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Transition to ACTIVE for port object 283d401b-b76d-4ebf-9595-4a31170bcccf will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:54.038529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.044322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9696bd3d-f4d7-42dc-9cf0-3f8a5f9075a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:54.158890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Pushing event updated for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:54.166901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Attempting to bind port 283d401b-b76d-4ebf-9595-4a31170bcccf on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:12:54.167277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Attempting to bind port 283d401b-b76d-4ebf-9595-4a31170bcccf by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:12:54.167642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Attempting to bind port 283d401b-b76d-4ebf-9595-4a31170bcccf on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:54.208108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:12:54.209022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:12:54.209436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.209827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:12:54.210299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Bound port: 283d401b-b76d-4ebf-9595-4a31170bcccf, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:12:54.210672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.237563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.237909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.238247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.238577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.238904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.239228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.239549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.240537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.241049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.241548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.241876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:12:54.245476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:54.268895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-0a901196-f112-4666-aeaf-c953b32f034c', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:12:54.269911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.378858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] For port 283d401b-b76d-4ebf-9595-4a31170bcccf, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:54.404621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] For port 283d401b-b76d-4ebf-9595-4a31170bcccf, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=283d401b-b76d-4ebf-9595-4a31170bcccf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:12:54.411713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.417773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9d121dfd-a55a-4f90-8452-ccf6fa57e61b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:54.542971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Allocated IP 172.20.0.2 (0a901196-f112-4666-aeaf-c953b32f034c/01a7da11-f654-4c61-8dbe-4770c0c075e3/0f10598d-8469-4f35-b7db-a55c1b146854) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:12:54.553006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Pushing event updated for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:54.561007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:54.567560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:54.568888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:54.796096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:54.931625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:55.118684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.190804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Transition to ACTIVE for port object 0f10598d-8469-4f35-b7db-a55c1b146854 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:55.250238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Transition to ACTIVE for port object 0f10598d-8469-4f35-b7db-a55c1b146854 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:55.293931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.300177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:55.336555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (0a901196-f112-4666-aeaf-c953b32f034c/01a7da11-f654-4c61-8dbe-4770c0c075e3/d446a5c1-6ba5-46f4-8d5f-550cec991522) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:12:55.392102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Pushing event updated for resources: {'Port': ['ID=0f10598d-8469-4f35-b7db-a55c1b146854,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:55.395990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Network 0a901196-f112-4666-aeaf-c953b32f034c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:12:55.397067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:55.399868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:55.402406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:12:55.514316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.531199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object d446a5c1-6ba5-46f4-8d5f-550cec991522 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:12:55.559833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:52Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:55.561971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Attempting to bind port 0f10598d-8469-4f35-b7db-a55c1b146854 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:12:55.562340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Attempting to bind port 0f10598d-8469-4f35-b7db-a55c1b146854 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:12:55.562703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Attempting to bind port 0f10598d-8469-4f35-b7db-a55c1b146854 on network 0a901196-f112-4666-aeaf-c953b32f034c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:12:55.562958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.567435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:55.569619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4735f928-a62f-48cb-a175-eb25ffd12ca3 None None] The sync data for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv is: [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:52Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:12:55.573759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:12:55.573759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Checking segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:12:55.573999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.574224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Bound using segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:12:55.574684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Bound port: 0f10598d-8469-4f35-b7db-a55c1b146854, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:12:55.575056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.648716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 0a901196-f112-4666-aeaf-c953b32f034c is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:12:55.650045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:55.652020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:55.654170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:12:55.671914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] For port 0f10598d-8469-4f35-b7db-a55c1b146854, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:12:55.675176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] For port 0f10598d-8469-4f35-b7db-a55c1b146854, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0f10598d-8469-4f35-b7db-a55c1b146854,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:12:55.679670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:55.686569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.692589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:55.715440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:55.785734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Pushing event updated for resources: {'Port': ['ID=0f10598d-8469-4f35-b7db-a55c1b146854,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:55.789131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:55.837583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:56.436165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:56.449118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:56.477898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f3bf2a45-40e6-4a69-862d-966af31c46a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:56.571170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:56.573548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:56.577460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:56.733456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 0a901196-f112-4666-aeaf-c953b32f034c is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:12:56.735146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:12:56.812983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e8baedd-f520-416f-acc9-31572335132a None None] Network 0a901196-f112-4666-aeaf-c953b32f034c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:12:56.883044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0f10598d-8469-4f35-b7db-a55c1b146854 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:56.988688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e62bd2d0-2c9c-4b31-8fbf-0ee5c1a888d3 None None] Provisioning for port 0f10598d-8469-4f35-b7db-a55c1b146854 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:57.045854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 0f10598d-8469-4f35-b7db-a55c1b146854 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:57.058830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0f10598d-8469-4f35-b7db-a55c1b146854 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:57.059141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.145768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 503af3ce-e0b0-4275-9751-c6b907a71eb9 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:12:57.230408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.265252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 0f10598d-8469-4f35-b7db-a55c1b146854, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0f10598d-8469-4f35-b7db-a55c1b146854,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:57.274104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.275067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:57.306763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-28ccc48f-4b31-4ea0-9470-bd9deb279068 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:57.360127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:12:57.378036 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5091615 Nov 24 14:12:57.378258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47904) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:57.410325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=0f10598d-8469-4f35-b7db-a55c1b146854,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:57.414986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:57.429146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 283d401b-b76d-4ebf-9595-4a31170bcccf completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:57.435230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 283d401b-b76d-4ebf-9595-4a31170bcccf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:57.435678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.534330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05833173-dd94-46a4-aaa3-79f1690469b9 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.534888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05833173-dd94-46a4-aaa3-79f1690469b9 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.535283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05833173-dd94-46a4-aaa3-79f1690469b9 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.535655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05833173-dd94-46a4-aaa3-79f1690469b9 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.538032 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-05833173-dd94-46a4-aaa3-79f1690469b9 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2885 time: 0.1586661 Nov 24 14:12:57.540886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47908) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:57.576357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.590735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c43e0a33-d7a5-4549-9e80-1710ac1bff57 None None] Provisioning complete for port 0f10598d-8469-4f35-b7db-a55c1b146854 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:57.591084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c43e0a33-d7a5-4549-9e80-1710ac1bff57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.619642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab18a9a2-d468-4ded-93b0-6464123ca454 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.620076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab18a9a2-d468-4ded-93b0-6464123ca454 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.620438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab18a9a2-d468-4ded-93b0-6464123ca454 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.620798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab18a9a2-d468-4ded-93b0-6464123ca454 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:57.622443 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ab18a9a2-d468-4ded-93b0-6464123ca454 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2727 time: 0.0806596 Nov 24 14:12:57.625290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47912) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:57.640060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 283d401b-b76d-4ebf-9595-4a31170bcccf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=283d401b-b76d-4ebf-9595-4a31170bcccf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:12:57.651121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.654255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:57.766002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:57.770284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:57.807990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c43e0a33-d7a5-4549-9e80-1710ac1bff57 None None] Provisioning for port d446a5c1-6ba5-46f4-8d5f-550cec991522 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:12:57.818176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c43e0a33-d7a5-4549-9e80-1710ac1bff57 None None] Provisioning complete for port d446a5c1-6ba5-46f4-8d5f-550cec991522 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:57.818841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c43e0a33-d7a5-4549-9e80-1710ac1bff57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:57.858157 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-450a8de5-c6bd-451c-8f2e-336ee38e8771 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1607 time: 0.2293389 Nov 24 14:12:57.875810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c43e0a33-d7a5-4549-9e80-1710ac1bff57 None None] Port d446a5c1-6ba5-46f4-8d5f-550cec991522 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:12:57.996110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3fa24413-a882-4465-aa89-fe9ce98239bf None None] Provisioning complete for port d446a5c1-6ba5-46f4-8d5f-550cec991522 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:57.996401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fa24413-a882-4465-aa89-fe9ce98239bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.050458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3fa24413-a882-4465-aa89-fe9ce98239bf None None] Port d446a5c1-6ba5-46f4-8d5f-550cec991522 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:12:58.121564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47918) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:58.127373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-293889637', 'description': 'tempest-secgroup-smoke-293889637 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:58.134298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:58.138545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:58.141463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:58.148574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:58.157802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.195890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:58.199670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:58.202319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:58.208156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:58.263836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.267938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.273320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8df9b6c3-f1ad-47c7-940f-98b57f7e57fd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:58.312811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ed9351ae-3f66-4926-ada5-bf041f1c2dbd,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:58.315683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.320344 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.1943204 Nov 24 14:12:58.320344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:58.320845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47922) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:58.325854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'ed9351ae-3f66-4926-ada5-bf041f1c2dbd', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:58.331607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:58.335945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:58.338713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:58.344485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:58.360388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.425796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.429947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.435899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-37acc201-7879-4b49-a363-69e048ea5c8a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:58.455803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6eb1e1dd-36e9-431a-8669-45a08ae2826e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:58.461475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:58.466447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.468734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1470706 Nov 24 14:12:58.471187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47926) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:58.477756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'ed9351ae-3f66-4926-ada5-bf041f1c2dbd', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:58.484839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:58.488938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:58.492397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:58.497968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:58.514967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.577329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.581163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.589036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-437ea349-6370-49f8-9840-50dbde83b8c1 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:58.606595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e0be4871-57ce-45b9-b178-55a0328379cb,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:58.609338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:58.617631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.618885 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1467211 Nov 24 14:12:58.621790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47930) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:58.627222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'ed9351ae-3f66-4926-ada5-bf041f1c2dbd', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:58.634134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:58.637949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:58.640822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:58.647419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:58.665716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.734965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.739335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.743478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a360c1ef-29a7-4a01-a5db-f7a8c0e168f0 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:58.795359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0f10598d-8469-4f35-b7db-a55c1b146854 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:58.874274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0f10598d-8469-4f35-b7db-a55c1b146854 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:58.874949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.875238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=00999973-5a33-4fc9-ab2f-02998af44671,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:58.879245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:58.885249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.887855 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.2639101 Nov 24 14:12:58.889709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47934) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:58.897197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'ed9351ae-3f66-4926-ada5-bf041f1c2dbd', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:58.903274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:58.907163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:58.910187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:58.916577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:58.934082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:58.997529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:12:59.003985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.009097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.010891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f1fb4fc-ce99-4cf2-98da-6a0eab4df533 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:59.034464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce53bc60-a68d-4a9b-b81e-4f7f18bd7d02,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:59.039566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:59.045608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.046829 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1561286 Nov 24 14:12:59.049983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47938) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:59.056595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'ed9351ae-3f66-4926-ada5-bf041f1c2dbd', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:59.062567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:59.066842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:59.070768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:59.073155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 283d401b-b76d-4ebf-9595-4a31170bcccf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:12:59.073542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.077546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:59.088389 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:12:59.094788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.144107 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Sync routers for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:12:59.157771 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:12:59.158631 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:59.166976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.171215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.173329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a81e557e-100e-40dc-8142-6a0b3da7eace tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:59.197026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d8bdeee-d3d7-46a1-8776-0e738386d90f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:59.202033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:59.208043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.209338 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1582720 Nov 24 14:12:59.212273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 47942) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:12:59.218305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'ed9351ae-3f66-4926-ada5-bf041f1c2dbd', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:12:59.226510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:12:59.230706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:12:59.233866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:12:59.240770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:12:59.253612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:12:59.260697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.329199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.332882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.335066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:12:59.358145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e827137-17b4-486e-b6d5-0b0cf0e648fa,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:12:59.362504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:12:59.369177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.369780 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1564875 Nov 24 14:12:59.387584 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:12:59.548148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-decab661-4f92-49f2-8dab-85b01538383e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:59.564042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-decab661-4f92-49f2-8dab-85b01538383e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:59.565214 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-decab661-4f92-49f2-8dab-85b01538383e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-293889637&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0639100 Nov 24 14:12:59.701687 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:12:56Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:12:59.705515 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Checking router: 503af3ce-e0b0-4275-9751-c6b907a71eb9 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:12:59.705872 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Updating router 503af3ce-e0b0-4275-9751-c6b907a71eb9 port d446a5c1-6ba5-46f4-8d5f-550cec991522 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:12:59.714163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-b328d9f8-b805-49ba-bca2-47dba667e228 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:12:59.714816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-b328d9f8-b805-49ba-bca2-47dba667e228 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:59.730626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-b328d9f8-b805-49ba-bca2-47dba667e228 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:59.732117 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-b328d9f8-b805-49ba-bca2-47dba667e228 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 796 time: 0.1589210 Nov 24 14:12:59.748196 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-2d57afc3-1cfc-4485-950c-1f5a5f094b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0107014 Nov 24 14:12:59.762018 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:12:59.953503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-02e534cb-35e1-4c09-9c20-7db2bcb3aeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:12:59.968917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-02e534cb-35e1-4c09-9c20-7db2bcb3aeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:12:59.970584 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-02e534cb-35e1-4c09-9c20-7db2bcb3aeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2169104 Nov 24 14:13:00.110318 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:00.113654 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-2d7953e4-b360-49d7-828c-7949ae4b6efb service neutron] 10.222.0.70 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301148 Nov 24 14:13:00.123699 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Transition to ACTIVE for port object d446a5c1-6ba5-46f4-8d5f-550cec991522 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:13:00.130632 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:00.134301 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:00.258353 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-16ed2138-b7ab-4812-9bd4-26f15ecd6a59 service neutron] 10.222.0.70 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1373575 Nov 24 14:13:00.311345 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:00.349544 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.349889 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.350222 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.350534 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.350852 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.351169 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.351483 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.351835 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.352135 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.352443 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.352752 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:13:00.357041 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:00.391072 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Attempting to bind port d446a5c1-6ba5-46f4-8d5f-550cec991522 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:13:00.391513 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Attempting to bind port d446a5c1-6ba5-46f4-8d5f-550cec991522 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:13:00.391974 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Attempting to bind port d446a5c1-6ba5-46f4-8d5f-550cec991522 on network 0a901196-f112-4666-aeaf-c953b32f034c {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:13:00.400297 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 12, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:13:00.400964 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Checking segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:13:00.401902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:00.402527 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Bound using segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:13:00.403197 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Bound port: d446a5c1-6ba5-46f4-8d5f-550cec991522, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:13:00.403918 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:00.491710 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771392c9-1829-46d6-bc86-2ecd6e0a2618 req-3ccfe8b6-4624-4f20-9787-6f2ec6c03c03 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 210 time: 0.0451944 Nov 24 14:13:00.519030 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] For port d446a5c1-6ba5-46f4-8d5f-550cec991522, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:13:00.519030 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] For port d446a5c1-6ba5-46f4-8d5f-550cec991522, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d446a5c1-6ba5-46f4-8d5f-550cec991522,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:13:00.530207 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:00.530207 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:00.618302 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:00.621373 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:00.623136 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:13:00.623739 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:12:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:13:00.817876 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:13:01.156050 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:13:00Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:13:01.159815 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b976202-f76d-4786-ba1d-e4f5b219ee56 None None] The sync data for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv is: [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:13:00Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:13:01.590516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-31e6f269-8d2c-4bb6-8e80-b22ea8099e01 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:01.593054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-31e6f269-8d2c-4bb6-8e80-b22ea8099e01 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:13:01.606754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-31e6f269-8d2c-4bb6-8e80-b22ea8099e01 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:13:01.607951 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-31e6f269-8d2c-4bb6-8e80-b22ea8099e01 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 796 time: 0.2045896 Nov 24 14:13:01.683933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-230c73ae-1a17-4af1-a802-0c7461e77b9c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:13:01.697697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-230c73ae-1a17-4af1-a802-0c7461e77b9c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:13:01.698824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-230c73ae-1a17-4af1-a802-0c7461e77b9c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 379 time: 0.0772324 Nov 24 14:13:01.700611 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aa99262a-027b-41b6-869b-cb9591e5c3ad req-d7abb86e-c33a-4120-a4ae-0f6b5d2a4076 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 210 time: 0.0636499 Nov 24 14:13:01.709058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['ed9351ae-3f66-4926-ada5-bf041f1c2dbd']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:13:01.852258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:13:01.861722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:13:01.872443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:13:01.875601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.059656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.7 (0a901196-f112-4666-aeaf-c953b32f034c/01a7da11-f654-4c61-8dbe-4770c0c075e3/f9fc420f-5baa-4ea4-ac72-258c33ad596c) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:13:02.248219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.264870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object f9fc420f-5baa-4ea4-ac72-258c33ad596c will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:13:02.288097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.293894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:02.359099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 0a901196-f112-4666-aeaf-c953b32f034c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:13:02.362435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:13:02.367461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:13:02.396314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=f9fc420f-5baa-4ea4-ac72-258c33ad596c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:02.401873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:02.435833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:02.436441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.463035 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7586672 Nov 24 14:13:02.476036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Request body: {'port': {'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:13:02.554398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-84b5cfcf-c998-483a-a6b0-a7b9c3f8094c None None] Provisioning for port f9fc420f-5baa-4ea4-ac72-258c33ad596c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:13:02.560314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-84b5cfcf-c998-483a-a6b0-a7b9c3f8094c None None] Provisioning complete for port f9fc420f-5baa-4ea4-ac72-258c33ad596c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:13:02.560970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84b5cfcf-c998-483a-a6b0-a7b9c3f8094c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.591740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.655967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-84b5cfcf-c998-483a-a6b0-a7b9c3f8094c None None] Port f9fc420f-5baa-4ea4-ac72-258c33ad596c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:13:02.826591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:13:02.895036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d446a5c1-6ba5-46f4-8d5f-550cec991522 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:13:02.901444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d446a5c1-6ba5-46f4-8d5f-550cec991522 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:13:02.901821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:02.992075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dff6a72-3a47-449f-90c4-cb2172902ccc req-c499ba91-1124-4bb0-85f3-90cd3c5e177d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:02.992787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9dff6a72-3a47-449f-90c4-cb2172902ccc req-c499ba91-1124-4bb0-85f3-90cd3c5e177d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:13:03.016831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.020449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f9fc420f-5baa-4ea4-ac72-258c33ad596c {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:13:03.025619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9dff6a72-3a47-449f-90c4-cb2172902ccc req-c499ba91-1124-4bb0-85f3-90cd3c5e177d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:13:03.026848 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9dff6a72-3a47-449f-90c4-cb2172902ccc req-c499ba91-1124-4bb0-85f3-90cd3c5e177d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 931 time: 0.1880152 Nov 24 14:13:03.030664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.050468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d446a5c1-6ba5-46f4-8d5f-550cec991522, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d446a5c1-6ba5-46f4-8d5f-550cec991522,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:13:03.054790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.056860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:03.065396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Transition to ACTIVE for port object f9fc420f-5baa-4ea4-ac72-258c33ad596c will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:13:03.076030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.085472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad343060-cb30-4f28-b9fd-44ec5e1fd6f9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:03.124579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:03.127807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:03.184558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-03edcb5a-6907-4d97-af8e-1b65e508a9b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.238244 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9dff6a72-3a47-449f-90c4-cb2172902ccc req-23657d41-2792-4ec0-aa4c-eed77bcc03c7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2050231 Nov 24 14:13:03.307334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Pushing event updated for resources: {'Port': ['ID=f9fc420f-5baa-4ea4-ac72-258c33ad596c,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:03.311821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:03.417626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Attempting to bind port f9fc420f-5baa-4ea4-ac72-258c33ad596c on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:13:03.417958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Attempting to bind port f9fc420f-5baa-4ea4-ac72-258c33ad596c by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:13:03.418276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Attempting to bind port f9fc420f-5baa-4ea4-ac72-258c33ad596c on network 0a901196-f112-4666-aeaf-c953b32f034c {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:13:03.423992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Port f9fc420f-5baa-4ea4-ac72-258c33ad596c on network 0a901196-f112-4666-aeaf-c953b32f034c not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:13:03.424306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Attempting to bind port f9fc420f-5baa-4ea4-ac72-258c33ad596c on network 0a901196-f112-4666-aeaf-c953b32f034c {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:13:03.432192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 12, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:13:03.432519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Checking segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:13:03.432896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Bound using segment: {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:13:03.433304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Bound port: f9fc420f-5baa-4ea4-ac72-258c33ad596c, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b27fafd5-61dd-4571-b89b-44a5b7b322da', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:13:03.433638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.525251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] For port f9fc420f-5baa-4ea4-ac72-258c33ad596c, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:13:03.528053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] For port f9fc420f-5baa-4ea4-ac72-258c33ad596c, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:13:03.532502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.536805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3308a95-8f5e-4412-9a0f-47bb4e49b557 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:03.585113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.597971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:03.601756 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] 10.222.0.47 "PUT /v2.0/ports/f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 1093 time: 1.1311867 Nov 24 14:13:03.602376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:13:03.638264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Pushing event updated for resources: {'Port': ['ID=f9fc420f-5baa-4ea4-ac72-258c33ad596c,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:03.641465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:03.696388 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'status': 'completed', 'code': 200} Nov 24 14:13:03.740959 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-da4ec97a-a87a-4f10-baa5-76f87d468bbc service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1096 time: 0.0801575 Nov 24 14:13:03.811885 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-7f713fe7-8e9d-46cf-a686-0f538337558a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 217 time: 0.0630057 Nov 24 14:13:03.884545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-2d1f4cb5-b56f-4241-8e36-fb49cff7d690 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:03.885975 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-2d1f4cb5-b56f-4241-8e36-fb49cff7d690 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 200 len: 834 time: 0.0686345 Nov 24 14:13:03.975606 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-51aef51d-0c39-4f67-8151-143531645baa service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=0a901196-f112-4666-aeaf-c953b32f034c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0828087 Nov 24 14:13:04.111077 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-54101240-b542-4481-a0d3-fb85a876e457 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1285539 Nov 24 14:13:04.246418 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b372419e-8809-48e7-ac71-ddca3ac1e26a req-b9276570-2a71-464f-9e43-b105374b83f8 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1294699 Nov 24 14:13:04.369930 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-85c2133e-264e-40e5-952a-4302aa85173c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1096 time: 0.0757563 Nov 24 14:13:04.559489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771adf97-9ff0-453c-a448-a9aad15e7969 req-d799651d-d50b-4836-90df-d143f1825e2a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:04.560955 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771adf97-9ff0-453c-a448-a9aad15e7969 req-d799651d-d50b-4836-90df-d143f1825e2a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 943 time: 0.1946213 Nov 24 14:13:04.561789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-839ee6dc-7f2d-4bbf-a3ca-b6f41c773a46 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:04.563089 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-839ee6dc-7f2d-4bbf-a3ca-b6f41c773a46 service neutron] 10.222.0.47 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 897 time: 0.1581378 Nov 24 14:13:04.658560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-d3031248-00f3-4472-b6e2-bea31b7cf907 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 217 time: 0.0762687 Nov 24 14:13:04.702193 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771adf97-9ff0-453c-a448-a9aad15e7969 req-8889e167-417d-43a8-b10d-547dbb075646 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1355944 Nov 24 14:13:04.728610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-e598e4d6-820d-40dd-a606-67e0310daa82 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:04.730010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-e598e4d6-820d-40dd-a606-67e0310daa82 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 200 len: 834 time: 0.0636649 Nov 24 14:13:04.797682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:13:04.820306 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-bf4d1db5-8302-406e-92c6-6e9e93ec980a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=0a901196-f112-4666-aeaf-c953b32f034c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0831273 Nov 24 14:13:04.870544 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d446a5c1-6ba5-46f4-8d5f-550cec991522 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:13:04.870929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:05.060136 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-53f55a62-67d7-4fbf-8679-307e8082b748 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2326491 Nov 24 14:13:05.194970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-560bd5ef-3af0-41a9-9843-1fbf4946e49d req-00188c30-0a6c-47e3-8f5b-4048b81208b1 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1283197 Nov 24 14:13:05.764866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5ae0c623-a425-4e1f-a0a1-5e41a6f735c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:05.920679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fb26dfd-a4d5-4de4-8b53-cc4c3a5d1633 req-99a305c9-bc73-4943-af3f-d8bbc7666b74 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:05.922132 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3fb26dfd-a4d5-4de4-8b53-cc4c3a5d1633 req-99a305c9-bc73-4943-af3f-d8bbc7666b74 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 943 time: 0.0873172 Nov 24 14:13:05.969218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3fb26dfd-a4d5-4de4-8b53-cc4c3a5d1633 req-01d68622-2bf5-40af-b75e-c9a13eb814dc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411696 Nov 24 14:13:06.732342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:07.172375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c527d7-182c-4a44-9f80-348a64f1a8fb req-439cda39-085d-4c1c-befa-03dfa5e457cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:07.173785 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-99c527d7-182c-4a44-9f80-348a64f1a8fb req-439cda39-085d-4c1c-befa-03dfa5e457cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 943 time: 0.0824912 Nov 24 14:13:07.227032 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-99c527d7-182c-4a44-9f80-348a64f1a8fb req-aca5cc3d-e0ae-4303-8ee4-127518004425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446107 Nov 24 14:13:08.415401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:08.426808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e754c9e4-665c-43d2-936f-2f0ede9e8f5e req-a4658f0a-52d5-461b-b04c-c0440aa4068b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:08.429544 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e754c9e4-665c-43d2-936f-2f0ede9e8f5e req-a4658f0a-52d5-461b-b04c-c0440aa4068b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 943 time: 0.0805588 Nov 24 14:13:08.481255 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e754c9e4-665c-43d2-936f-2f0ede9e8f5e req-13bacef2-e567-4ff8-b7a7-d2640428ae96 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461364 Nov 24 14:13:08.766057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f9fc420f-5baa-4ea4-ac72-258c33ad596c details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:13:08.907730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f9fc420f-5baa-4ea4-ac72-258c33ad596c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:13:08.921828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:13:08.975509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:08.992942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f9fc420f-5baa-4ea4-ac72-258c33ad596c {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:13:09.007892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f9fc420f-5baa-4ea4-ac72-258c33ad596c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:13:09.012838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:09.015633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:09.081186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f9fc420f-5baa-4ea4-ac72-258c33ad596c,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:09.084497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:09.321084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f9fc420f-5baa-4ea4-ac72-258c33ad596c'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:13:09.691058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd130a9-724f-4ba5-a444-56acd9d661ff req-9e6ab03d-7f56-47c2-b1ff-59ccb8622c54 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:09.693118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4bd130a9-724f-4ba5-a444-56acd9d661ff req-9e6ab03d-7f56-47c2-b1ff-59ccb8622c54 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 944 time: 0.0854881 Nov 24 14:13:09.742742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4bd130a9-724f-4ba5-a444-56acd9d661ff req-4563c25f-4c9d-4d13-a5d8-a6053d55b339 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440252 Nov 24 14:13:10.791137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f9fc420f-5baa-4ea4-ac72-258c33ad596c up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:13:10.873054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port f9fc420f-5baa-4ea4-ac72-258c33ad596c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:13:10.883963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port f9fc420f-5baa-4ea4-ac72-258c33ad596c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:13:10.884346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:10.965387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c11387-9e5a-4763-a031-72fd8db4ba1a req-0e43274d-f72f-4d37-aa93-f8d60032aba6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:10.967100 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f8c11387-9e5a-4763-a031-72fd8db4ba1a req-0e43274d-f72f-4d37-aa93-f8d60032aba6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 944 time: 0.0912094 Nov 24 14:13:11.012560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:11.013963 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f8c11387-9e5a-4763-a031-72fd8db4ba1a req-a6103efa-15f3-467b-83c3-4fb24c3c828e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407948 Nov 24 14:13:11.042000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:13:11.051465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f9fc420f-5baa-4ea4-ac72-258c33ad596c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:13:11.056314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:11.058124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:11.102563 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'code': 200} Nov 24 14:13:11.129002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f9fc420f-5baa-4ea4-ac72-258c33ad596c,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:11.132736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:11.334555 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f478f2a2-81d1-4730-aca6-e583cab58734 req-337481a2-e65a-4d93-a41b-7258dd29895f service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1098 time: 0.0717611 Nov 24 14:13:11.379415 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f478f2a2-81d1-4730-aca6-e583cab58734 req-fa6a4f4a-118f-4762-8717-450cb43abafb service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394516 Nov 24 14:13:12.215611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b576c1-214b-4605-8baa-432690ad8122 req-315cf13f-2907-4d7d-b439-14cb8919e5bc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:12.217324 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-01b576c1-214b-4605-8baa-432690ad8122 req-315cf13f-2907-4d7d-b439-14cb8919e5bc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 945 time: 0.0814619 Nov 24 14:13:12.350858 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-01b576c1-214b-4605-8baa-432690ad8122 req-4a9f11cd-3e02-405b-a422-5a0fd960dff8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1279895 Nov 24 14:13:13.545957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a2d0c3-b1f4-4d20-9987-51fad03633b4 req-389f588a-12b3-490e-9f1d-aa4c49ccdfed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:13.547270 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-15a2d0c3-b1f4-4d20-9987-51fad03633b4 req-389f588a-12b3-490e-9f1d-aa4c49ccdfed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 945 time: 0.0757923 Nov 24 14:13:13.592384 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-15a2d0c3-b1f4-4d20-9987-51fad03633b4 req-41cac049-f1fe-4499-ad8a-62a1d6046c87 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395133 Nov 24 14:13:13.795310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ad7c7e-9d6d-419f-8a2a-5baf2d228b95 req-9a4faad1-20b2-4dde-bebf-e7861d7a0cd6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:13.796913 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-80ad7c7e-9d6d-419f-8a2a-5baf2d228b95 req-9a4faad1-20b2-4dde-bebf-e7861d7a0cd6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 945 time: 0.0801864 Nov 24 14:13:13.842796 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-80ad7c7e-9d6d-419f-8a2a-5baf2d228b95 req-d771e3cb-3ad9-4ba7-9503-8dc6b848dac8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398872 Nov 24 14:13:13.871040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47992) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:13:13.946250 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-17e4780b-a456-46a6-b22c-e9324ae22625 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1093 time: 0.0739751 Nov 24 14:13:13.948813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 47996) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:13:13.953857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:13:13.959459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:13:13.963226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:13:13.966040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:13:13.971957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:13:13.982420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:14.119821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:14.261186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.114 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/00c0c2a4-55a0-451d-9db3-72b1ca5224e6) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:13:14.413095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:14.440576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:14.445047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a74cb28a-bb09-486b-a226-233fd92ca609 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:14.509071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:13:14.512173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:13:14.516356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:13:14.542045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=00c0c2a4-55a0-451d-9db3-72b1ca5224e6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:14.546901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:15.126611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:15.184538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:15.392144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:15.396866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:15.400357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d7f1b3bb-5bd2-4a33-8efe-b338ee2b0e0f tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:13:15.499621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=00c0c2a4-55a0-451d-9db3-72b1ca5224e6,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:13:15.503519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:13:15.518130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:15.714162 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 7f556e3e-37df-4570-a9d0-6ef30a33f913 associated. External IP: 172.26.4.114, port: f9fc420f-5baa-4ea4-ac72-258c33ad596c. Nov 24 14:13:15.801622 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:13:16.126673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 503af3ce-e0b0-4275-9751-c6b907a71eb9 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:13:16.440950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:13:16.451579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] Sync routers for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:13:16.464310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:13:16.465098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:13:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:13:16.465255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:16.521345 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5713086 Nov 24 14:13:16.522012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:13:16.523670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48000) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:13:16.667324 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'status': 'completed', 'code': 200} Nov 24 14:13:16.721827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:13:16.805430 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-e8324abf-e90d-4538-bb42-10f76d9111a1 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1098 time: 0.1077561 Nov 24 14:13:16.812582 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-02b8cb11-624a-4ad0-87f8-7d5a2f2dd44c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9 HTTP/1.1" status: 200 len: 922 time: 0.2876205 Nov 24 14:13:16.817030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48008) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:13:16.945499 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5bd30d0c-3ffd-4cc4-87ba-6a50949c43a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1267135 Nov 24 14:13:16.953642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-72bdb04f-cbf9-4b7d-a19c-bcf88e7bef10 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:16.954976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-72bdb04f-cbf9-4b7d-a19c-bcf88e7bef10 service neutron] 10.222.0.47 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 897 time: 0.1412675 Nov 24 14:13:17.062419 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-4aedd7bd-27b1-49b1-95bf-4515787c104a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 999 time: 0.1004977 Nov 24 14:13:17.111295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7f556e3e-37df-4570-a9d0-6ef30a33f913', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.114', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:13:14Z', 'updated_at': '2021-11-24T14:13:14Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:13:03Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:13:17.121537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] Checking router: 503af3ce-e0b0-4275-9751-c6b907a71eb9 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:13:17.133737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-7f77a43a-6aa9-4ce2-8d3c-8690b4819612 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:17.134064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:13:17.134580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:13:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:13:17.135329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-7f77a43a-6aa9-4ce2-8d3c-8690b4819612 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 200 len: 834 time: 0.0660658 Nov 24 14:13:17.212809 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-4d6f4de6-c122-43a3-b7dc-62088c662114 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=0a901196-f112-4666-aeaf-c953b32f034c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0712276 Nov 24 14:13:17.319782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:13:17.360369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-dcbb5478-c220-48d6-8e5f-3e0b9e9c85f4 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1409521 Nov 24 14:13:17.500259 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b548510-46f5-4068-b200-61e0a1e3ba2f req-a80c3c7b-b5f9-4d9a-a3bd-7190dc65bb50 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334498 Nov 24 14:13:17.695147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7f556e3e-37df-4570-a9d0-6ef30a33f913', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.114', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:13:14Z', 'updated_at': '2021-11-24T14:13:14Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:13:03Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:13:17.700828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c7291bc-f985-4640-ae77-2e2c59e0ffff None None] The sync data for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv is: [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7f556e3e-37df-4570-a9d0-6ef30a33f913', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.114', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:13:14Z', 'updated_at': '2021-11-24T14:13:14Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:13:03Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:13:17.745580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:17.946908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48012) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:13:18.141169 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e94693f-d433-4dc1-9d39-b7ebdd13ea20 None None] New status for floating IP 7f556e3e-37df-4570-a9d0-6ef30a33f913: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:13:18.169047 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7f9fa8ae-df32-47ba-bea9-e1f1a0479039 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.2208409 Nov 24 14:13:19.171974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48016) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:13:19.283530 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-89a8eccc-310c-41b1-b29a-24aaa5e098f8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 993 time: 0.1100745 Nov 24 14:13:33.187964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-59e5530e-953a-4661-8460-4a4600e635e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:33.578969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:35.769240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b13a044e-b7a1-49b7-a823-c2a02e982fa6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:36.737265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:38.421309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:39.980818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-5b30ecb1-e207-43ef-9482-1525c693f77a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0680394 Nov 24 14:13:40.123718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-b939ae93-4637-43bb-8cbb-ef927dcb5cb0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1098 time: 0.0741284 Nov 24 14:13:40.268317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-cbac2bc5-1464-40a4-857a-e7736db1b9d7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:40.269994 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-cbac2bc5-1464-40a4-857a-e7736db1b9d7 service neutron] 10.222.0.47 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 897 time: 0.1270201 Nov 24 14:13:40.374868 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-0daa8c13-4826-4ade-9493-390769c06f0a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 1001 time: 0.0983984 Nov 24 14:13:40.436691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-d998d08a-0277-475f-a02e-696075ebb033 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:13:40.438105 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-d998d08a-0277-475f-a02e-696075ebb033 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 200 len: 834 time: 0.0576286 Nov 24 14:13:40.519933 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-4b0a6c2a-22bb-4001-874f-bb13035192cb service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=0a901196-f112-4666-aeaf-c953b32f034c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0754030 Nov 24 14:13:40.651116 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-46b55668-ec6c-4a63-af33-cb01cbe9ef61 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1250689 Nov 24 14:13:40.783657 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f38e1062-e0a0-4c6a-affd-eb8f7e941819 req-0730e350-888a-4cc7-b9d1-84fc1114a1db service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259251 Nov 24 14:13:47.741420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:13:52.803031 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:14:03.190612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d200d76-aae5-4764-b793-c1c2ccc02106 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:03.581255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:05.771751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2c61cc25-6b75-4477-b181-0e908a7ba3b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:06.737698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:08.418664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:17.757887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:28.473054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48040) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:28.738297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a4605efb-b316-4aa9-bce9-ac49f0c024cf tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.2639256 Nov 24 14:14:28.740980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48046) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:28.954567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45daa529-785b-4b75-b916-a4b54b9cbcaf tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Notify agent at dv-neutron-818151-2-hyperv the message router_removed_from_agent {{(pid=83526) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 24 14:14:28.957707 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-45daa529-785b-4b75-b916-a4b54b9cbcaf tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "DELETE /v2.0/agents/54d16f2e-10ec-4381-a9f3-6cb331e1841b/l3-routers/503af3ce-e0b0-4275-9751-c6b907a71eb9 HTTP/1.1" status: 204 len: 168 time: 0.2152472 Nov 24 14:14:28.960255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48050) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:29.242794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-688f0d2c-9f0f-4fe4-8cab-54a285a1d929 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9/l3-agents HTTP/1.1" status: 200 len: 207 time: 0.2801666 Nov 24 14:14:29.245667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48054) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:29.348096 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8ba3f014-3b20-4a97-bccb-d8eb3867e907 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 993 time: 0.1012533 Nov 24 14:14:29.713060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6be7b75-574c-4de6-89be-b3152f169cd0 None None] New status for floating IP 7f556e3e-37df-4570-a9d0-6ef30a33f913: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:14:29.803259 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:14:30.352474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48058) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:30.457515 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6c6f13f1-2eea-41b7-9b1d-b53c59143fdb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1038246 Nov 24 14:14:30.828079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:14:30.998842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:31.030967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d446a5c1-6ba5-46f4-8d5f-550cec991522, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d446a5c1-6ba5-46f4-8d5f-550cec991522,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:31.034745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:31.035530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:14:31.058158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-6272b7fd-3f59-41ae-ac82-8791203dbec8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:31.151788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:31.187146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.187487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.187841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.188172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.188499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.188821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.189139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.189458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.189773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.190101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.190398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:31.194281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:31.220597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:31.236864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 283d401b-b76d-4ebf-9595-4a31170bcccf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=283d401b-b76d-4ebf-9595-4a31170bcccf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:31.241948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:31.243785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:31.314608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:31.317778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:31.620131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48064) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:31.826809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc509319-793f-4613-9661-2fe914044cc7 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Router 503af3ce-e0b0-4275-9751-c6b907a71eb9 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:14:31.827149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc509319-793f-4613-9661-2fe914044cc7 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Notify agent at dv-neutron-818151-2-hyperv the message router_added_to_agent {{(pid=83526) _notification_host /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:47}} Nov 24 14:14:31.852908 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dc509319-793f-4613-9661-2fe914044cc7 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "POST /v2.0/agents/54d16f2e-10ec-4381-a9f3-6cb331e1841b/l3-routers HTTP/1.1" status: 201 len: 201 time: 0.2317526 Nov 24 14:14:31.855432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48070) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:31.873488 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] Sync routers for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:14:31.885385 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:31.885990 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:32.032502 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e94dc8cb-2930-4307-94e9-8ed7e9a40cbb tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9/l3-agents HTTP/1.1" status: 200 len: 881 time: 0.1758876 Nov 24 14:14:32.035013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48076) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:32.064130 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:14:32.143505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-df6c20b3-2078-48d3-a51e-a60d785ed826 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1072288 Nov 24 14:14:32.410281 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:31Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7f556e3e-37df-4570-a9d0-6ef30a33f913', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.114', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:13:14Z', 'updated_at': '2021-11-24T14:14:29Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:14:31Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:32.414694 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] Checking router: 503af3ce-e0b0-4275-9751-c6b907a71eb9 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:14:32.424832 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:32.425414 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:32.641750 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:14:32.983278 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:31Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7f556e3e-37df-4570-a9d0-6ef30a33f913', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.114', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:13:14Z', 'updated_at': '2021-11-24T14:14:29Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:14:31Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:32.987267 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d755e41-23d3-46ff-b309-a6d06bd982db None None] The sync data for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv is: [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:12:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:31Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7f556e3e-37df-4570-a9d0-6ef30a33f913', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.114', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'port_id': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'mac_address': 'fa:16:3e:2f:4c:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d486ce1-a356-4c22-b5ec-182e67249776', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:13:14Z', 'updated_at': '2021-11-24T14:14:29Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd446a5c1-6ba5-46f4-8d5f-550cec991522', 'name': '', 'network_id': '0a901196-f112-4666-aeaf-c953b32f034c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9a:46:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:55Z', 'updated_at': '2021-11-24T14:14:31Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '01a7da11-f654-4c61-8dbe-4770c0c075e3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:14:33.148704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48080) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:33.200471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ab17f6a0-7db3-4d93-8294-2ada404be9c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:33.271486 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-55bf2d60-51ad-4f4e-9506-104ecc119518 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1215370 Nov 24 14:14:33.587742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:34.275271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48086) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:34.385722 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e8fface2-d7b8-407d-ab5a-6bbe818ad1ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1092093 Nov 24 14:14:34.868761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:14:34.934922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d446a5c1-6ba5-46f4-8d5f-550cec991522 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:34.935298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:35.057728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:35.090218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d446a5c1-6ba5-46f4-8d5f-550cec991522, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d446a5c1-6ba5-46f4-8d5f-550cec991522,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:35.094204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:35.095046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:14:35.118045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49192c92-4a6e-4575-808d-88a4d049066b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:35.207276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:35.210339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:35.220933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 283d401b-b76d-4ebf-9595-4a31170bcccf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:35.221312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:35.349712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:35.365154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 283d401b-b76d-4ebf-9595-4a31170bcccf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=283d401b-b76d-4ebf-9595-4a31170bcccf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:35.369052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:35.371034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-16f6cfbe-18d3-4a0f-b5d9-36756a0f9fbc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:35.389599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48090) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:35.435378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:35.438349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:35.500907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f637b1d4-9d67-4d4c-9c90-f33f97084f07 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1093259 Nov 24 14:14:35.775097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5d8eafa3-9ba8-4b86-9c11-04e150702b59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:36.504795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48094) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:36.614485 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8ae17d48-54af-4d86-be8a-11f031d6330c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1084704 Nov 24 14:14:36.739849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:36.839745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:14:36.911269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d446a5c1-6ba5-46f4-8d5f-550cec991522 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:36.911657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:37.025861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:14:37.091353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 283d401b-b76d-4ebf-9595-4a31170bcccf triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:37.092022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:37.619405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48098) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:37.728187 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-28b472dc-0ff6-4b0f-83e6-e8bc70cdf522 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1075041 Nov 24 14:14:38.422169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:38.732093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48102) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:38.838564 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50a6b2b4-1204-4a13-9503-e80231d78bb2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.1052649 Nov 24 14:14:39.842680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48106) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:39.943726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b276caea-533e-46b5-802e-38676ec5b306 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 991 time: 0.0997593 Nov 24 14:14:40.121617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ace4584c-b9e5-4594-bb8a-b7bc2ce064d9 None None] New status for floating IP 7f556e3e-37df-4570-a9d0-6ef30a33f913: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:14:40.947647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48110) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:41.168894 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f96d662-bf50-41f3-8879-24e1e9cc10ee tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 200 len: 993 time: 0.2200139 Nov 24 14:14:41.443366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48118) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:41.652070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 00c0c2a4-55a0-451d-9db3-72b1ca5224e6 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:14:41.652411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:41.818433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:41.818683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:41.943063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 00c0c2a4-55a0-451d-9db3-72b1ca5224e6 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:14:42.080113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-ffb7eea4-329f-4835-b8a3-af3f0eb4c03b service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1432753 Nov 24 14:14:42.148434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:42.153334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:42.234101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=00c0c2a4-55a0-451d-9db3-72b1ca5224e6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:42.283999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.284392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.284770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.285145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.285513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.285881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.286248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.286617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.286983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.287349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.288286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:42.319694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:42.362052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:42.417614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-9052e67a-df41-4142-a45f-d48302f83866 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1098 time: 0.2651999 Nov 24 14:14:42.634419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-bb247979-1f9f-4d59-9ff4-0fbc0c7cf26d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:42.635873 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-bb247979-1f9f-4d59-9ff4-0fbc0c7cf26d service neutron] 10.222.0.47 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 897 time: 0.1990609 Nov 24 14:14:42.824893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-19bce99f-3a25-4227-aafe-792ffd15c9ba service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 217 time: 0.1749475 Nov 24 14:14:42.950911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-3628c5ee-90ac-4703-9fa8-be5aa99e8742 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:42.952274 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-3628c5ee-90ac-4703-9fa8-be5aa99e8742 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 200 len: 834 time: 0.1211755 Nov 24 14:14:43.105334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-303e7618-4477-4caf-8b05-46dde1e2edfa service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=0a901196-f112-4666-aeaf-c953b32f034c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1468718 Nov 24 14:14:43.262478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-29418b50-a209-4dbd-b9ae-0ec1db4be2d7 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1500773 Nov 24 14:14:43.271292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 503af3ce-e0b0-4275-9751-c6b907a71eb9 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:14:43.472261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b1f7c70-f68e-4e15-91d1-0fd0003c476a req-20d9dbf7-1b75-44de-8039-9362143d2c75 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2028663 Nov 24 14:14:43.597162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:14:43.617885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:43.676554 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/7f556e3e-37df-4570-a9d0-6ef30a33f913 HTTP/1.1" status: 204 len: 168 time: 2.2313292 Nov 24 14:14:43.677625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:14:43.737061 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'status': 'completed', 'code': 200} Nov 24 14:14:43.827363 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-cdba5f27-6123-421e-8fde-41e67e99ba13 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 1098 time: 0.0696745 Nov 24 14:14:43.971063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-6aa43252-0796-45b1-ae5e-56a970f4cdd8 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:43.972669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-6aa43252-0796-45b1-ae5e-56a970f4cdd8 service neutron] 10.222.0.47 "GET /v2.0/networks?id=0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 200 len: 897 time: 0.1398175 Nov 24 14:14:44.045974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-e947d0f6-f352-4d4e-85da-0807b08adcef service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 200 len: 217 time: 0.0647063 Nov 24 14:14:44.074095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-412597cd-49f4-43f6-9913-b587bc870e2e req-946349be-fec0-4c9b-a26a-777db447a705 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:44.075549 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-412597cd-49f4-43f6-9913-b587bc870e2e req-946349be-fec0-4c9b-a26a-777db447a705 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 945 time: 0.0803721 Nov 24 14:14:44.112772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-ae05534a-49b1-4b85-99c3-ec3cb36429e8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:44.114228 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-ae05534a-49b1-4b85-99c3-ec3cb36429e8 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 200 len: 834 time: 0.0590014 Nov 24 14:14:44.128654 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-412597cd-49f4-43f6-9913-b587bc870e2e req-9199898b-71b0-4917-848d-53d6a02e056c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473840 Nov 24 14:14:44.192176 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-340c2fb0-192c-4df2-8ea0-3acaa180ee41 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=0a901196-f112-4666-aeaf-c953b32f034c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0698807 Nov 24 14:14:44.330640 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-7e5ca45b-f768-4bbe-a2c8-943864c3d0b5 service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313589 Nov 24 14:14:44.581723 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f248e51-9601-4cd2-b79d-ec53d3203888 req-22530a52-be9e-46d0-8b51-b98d06f6d22d service neutron] 10.222.0.47 "GET /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2447045 Nov 24 14:14:45.333555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01401b8-228b-44c2-bbac-b871c991ac90 req-4dc09be7-9f96-4b80-9013-93a3e085adf6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:45.334271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b01401b8-228b-44c2-bbac-b871c991ac90 req-4dc09be7-9f96-4b80-9013-93a3e085adf6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:14:45.351225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b01401b8-228b-44c2-bbac-b871c991ac90 req-4dc09be7-9f96-4b80-9013-93a3e085adf6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:14:45.352492 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b01401b8-228b-44c2-bbac-b871c991ac90 req-4dc09be7-9f96-4b80-9013-93a3e085adf6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 945 time: 0.0990837 Nov 24 14:14:45.405004 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b01401b8-228b-44c2-bbac-b871c991ac90 req-07b73f90-947f-494f-bbba-890c4a38d7c0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=ed9351ae-3f66-4926-ada5-bf041f1c2dbd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470278 Nov 24 14:14:45.524159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-a07df18c-6006-4388-a975-17e2eb12d2a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:45.525566 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-a07df18c-6006-4388-a975-17e2eb12d2a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 945 time: 0.0788562 Nov 24 14:14:45.593141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port f9fc420f-5baa-4ea4-ac72-258c33ad596c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:14:45.593478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:45.843322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port f9fc420f-5baa-4ea4-ac72-258c33ad596c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f9fc420f-5baa-4ea4-ac72-258c33ad596c,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:45.843556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:45.974867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for f9fc420f-5baa-4ea4-ac72-258c33ad596c owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:14:46.119522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:46.125058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e36e9273-f113-4137-874e-18c645292e74 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:46.168701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=f9fc420f-5baa-4ea4-ac72-258c33ad596c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:46.171969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:46.242586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port f9fc420f-5baa-4ea4-ac72-258c33ad596c on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:14:46.245042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:46.247607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'name': 'network-vif-deleted', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:14:46.264804 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6dbc70b-d85a-411f-bd65-48aa1829efca req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/f9fc420f-5baa-4ea4-ac72-258c33ad596c HTTP/1.1" status: 204 len: 173 time: 0.7342427 Nov 24 14:14:46.308045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d486ce1-a356-4c22-b5ec-182e67249776', 'name': 'network-vif-deleted', 'tag': 'f9fc420f-5baa-4ea4-ac72-258c33ad596c', 'status': 'completed', 'code': 200} Nov 24 14:14:46.586517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7d175054-0c48-4dfa-a28b-ae68ea5b4e63 req-5ca70e5a-0372-4ec1-be5a-9b127d87473b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:14:46.602971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7d175054-0c48-4dfa-a28b-ae68ea5b4e63 req-5ca70e5a-0372-4ec1-be5a-9b127d87473b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:14:46.604425 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7d175054-0c48-4dfa-a28b-ae68ea5b4e63 req-5ca70e5a-0372-4ec1-be5a-9b127d87473b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6d486ce1-a356-4c22-b5ec-182e67249776 HTTP/1.1" status: 200 len: 210 time: 0.0599694 Nov 24 14:14:47.710323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48138) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:47.777606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:47.778920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:47.807200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:47.873756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:47.878667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adca76d6-4fe7-4ad2-b12a-0b44472924ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:47.893238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed9351ae-3f66-4926-ada5-bf041f1c2dbd,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:47.896073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:47.901951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:47.905615 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/ed9351ae-3f66-4926-ada5-bf041f1c2dbd HTTP/1.1" status: 204 len: 168 time: 0.1917453 Nov 24 14:14:47.945948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:48.447068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:49.057435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port d446a5c1-6ba5-46f4-8d5f-550cec991522 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:14:49.058101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:49.255955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port d446a5c1-6ba5-46f4-8d5f-550cec991522, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d446a5c1-6ba5-46f4-8d5f-550cec991522,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:49.256835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:49.382279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for d446a5c1-6ba5-46f4-8d5f-550cec991522 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:14:49.415107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f9fc420f-5baa-4ea4-ac72-258c33ad596c no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:14:49.450248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: f9fc420f-5baa-4ea4-ac72-258c33ad596c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:14:49.450697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f9fc420f-5baa-4ea4-ac72-258c33ad596c not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:14:49.570708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:49.574378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-32acf970-96c0-462d-b88a-68ae487c8534 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:49.617557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=d446a5c1-6ba5-46f4-8d5f-550cec991522,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:49.620082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:49.911278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:50.608641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 503af3ce-e0b0-4275-9751-c6b907a71eb9 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:14:50.618687 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] Sync routers for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:14:50.630857 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:50.632202 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:50.809963 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:14:50.817079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:14:50.838683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8886433 Nov 24 14:14:50.838918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48148) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:51.024287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet 01a7da11-f654-4c61-8dbe-4770c0c075e3 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:14:51.027190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.084708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.096602 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:49Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:51.101001 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] Checking router: 503af3ce-e0b0-4275-9751-c6b907a71eb9 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:14:51.111659 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] Routers {'503af3ce-e0b0-4275-9751-c6b907a71eb9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:51.112319 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['503af3ce-e0b0-4275-9751-c6b907a71eb9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:51.173563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.252749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.258076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6fb19aaf-44cd-45ad-aaf8-5c5308e3a9c4 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:51.295099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=01a7da11-f654-4c61-8dbe-4770c0c075e3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:51.298139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:51.301974 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] Set router 503af3ce-e0b0-4275-9751-c6b907a71eb9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:14:51.304590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.310831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c8604e9-bda3-4220-8371-ef39719b37fc None None] Network 0a901196-f112-4666-aeaf-c953b32f034c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:14:51.311584 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/01a7da11-f654-4c61-8dbe-4770c0c075e3 HTTP/1.1" status: 204 len: 168 time: 0.4715564 Nov 24 14:14:51.314091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48152) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:51.519800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.609400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] DHCP port deletion for 0a901196-f112-4666-aeaf-c953b32f034c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:14:51.614403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Deleting port 0f10598d-8469-4f35-b7db-a55c1b146854 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:14:51.614868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.653975 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:49Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:51.659092 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b1b1272-bd6f-46f0-bd85-379816339325 None None] The sync data for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv is: [{'id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'name': 'tempest-TestNetworkBasicOps-router-378163214', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128'}], 'enable_snat': True}, 'gw_port_id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:49Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '283d401b-b76d-4ebf-9595-4a31170bcccf', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b6:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '503af3ce-e0b0-4275-9751-c6b907a71eb9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:12:51Z', 'updated_at': '2021-11-24T14:14:35Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:14:51.830298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] For port 0f10598d-8469-4f35-b7db-a55c1b146854, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0f10598d-8469-4f35-b7db-a55c1b146854,segment=NetworkSegment(b27fafd5-61dd-4571-b89b-44a5b7b322da),segment_id=b27fafd5-61dd-4571-b89b-44a5b7b322da)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:51.830558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.852252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.862041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 283d401b-b76d-4ebf-9595-4a31170bcccf {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:14:51.862476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:51.951004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Calling delete_port for 0f10598d-8469-4f35-b7db-a55c1b146854 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:14:52.032330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.037710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 283d401b-b76d-4ebf-9595-4a31170bcccf, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=283d401b-b76d-4ebf-9595-4a31170bcccf,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:52.038008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:52.038135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.083953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Pushing event deleted for resources: {'Port': ['ID=0f10598d-8469-4f35-b7db-a55c1b146854,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:52.086965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:52.089856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] No DVR routers for this DVR port 0f10598d-8469-4f35-b7db-a55c1b146854 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:14:52.173857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 283d401b-b76d-4ebf-9595-4a31170bcccf owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:14:52.356762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.360639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48f71ae8-1deb-4528-9490-9b67bbd88868 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:52.404637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=283d401b-b76d-4ebf-9595-4a31170bcccf,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:52.407181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:52.632540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.887166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0f10598d-8469-4f35-b7db-a55c1b146854 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:14:52.888080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.892609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.919538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.920067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router 503af3ce-e0b0-4275-9751-c6b907a71eb9 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:14:52.922564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 0f10598d-8469-4f35-b7db-a55c1b146854 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:14:52.922910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0f10598d-8469-4f35-b7db-a55c1b146854 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:14:52.923331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:14:52.934610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:52.935678 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/503af3ce-e0b0-4275-9751-c6b907a71eb9 HTTP/1.1" status: 204 len: 168 time: 1.6207008 Nov 24 14:14:52.938391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48156) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:52.955124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d446a5c1-6ba5-46f4-8d5f-550cec991522 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:14:52.955486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d446a5c1-6ba5-46f4-8d5f-550cec991522 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:14:53.156652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.286317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.311172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a901196-f112-4666-aeaf-c953b32f034c']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:53.324179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b27fafd5-61dd-4571-b89b-44a5b7b322da') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:53.324469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b27fafd5-61dd-4571-b89b-44a5b7b322da') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:53.335664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.351437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.357359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 853 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:14:53.357858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:14:53.375885 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:14:53.451967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.455355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-115ec923-36e6-43f4-8211-00ea4fc614c6 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:53.469593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.482236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=0a901196-f112-4666-aeaf-c953b32f034c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:53.485344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:53.492360 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/0a901196-f112-4666-aeaf-c953b32f034c HTTP/1.1" status: 204 len: 168 time: 0.5529857 Nov 24 14:14:53.513447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48160) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:53.519046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--573487752', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:14:53.524159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:14:53.528197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:14:53.531005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:14:53.536734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:14:53.546863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:14:53.549849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.585128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 887} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:14:53.595338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.595827 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment 27ff091f-9ef8-4d0a-a178-ddbaf3af3465 of type vlan for network ca17fb03-af7e-44ba-b423-f51304effe0f Nov 24 14:14:53.625493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.654928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.658934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:53.659508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.664012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f256afac-b794-46a1-b649-d8cf400ff67b tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:53.768322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=ca17fb03-af7e-44ba-b423-f51304effe0f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:53.770928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:53.773266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2588234 Nov 24 14:14:53.776076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48164) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:53.778785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network ca17fb03-af7e-44ba-b423-f51304effe0f details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:14:53.781365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-456619553', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:14:53.789186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:14:53.793435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:14:53.796486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:14:53.802346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:14:53.813687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.814960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.833404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:53.982729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.160170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.193713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.329820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.118 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/f0b37ad3-cdce-40ad-ab0e-425f267e5296) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:14:54.488759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.517672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.521622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-10dc4e9a-4cef-44e1-b229-f802de3a4f31 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:54.589513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:14:54.593058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:14:54.598350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:14:54.624630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=f0b37ad3-cdce-40ad-ab0e-425f267e5296,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:54.627527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:54.710786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee2519a8-a433-4df9-9ac7-e1db52eb5aed None None] New status for floating IP 7f556e3e-37df-4570-a9d0-6ef30a33f913: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:14:54.786906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.788980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:54.938268 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Sync routers for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:14:54.951533 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Routers set() bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:54.951925 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Router IDs set() for agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 14:14:54.952684 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_agentschedulers_db [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'503af3ce-e0b0-4275-9751-c6b907a71eb9'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent'). {{(pid=83528) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Nov 24 14:14:54.966978 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Routers set() bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:54.967357 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Router IDs set() for agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 14:14:54.967989 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_agentschedulers_db [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'503af3ce-e0b0-4275-9751-c6b907a71eb9'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent'). {{(pid=83528) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Nov 24 14:14:54.968455 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a8a3447-d8da-4037-99af-9aabd0479b78 None None] The sync data for ids ['503af3ce-e0b0-4275-9751-c6b907a71eb9'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:14:55.167242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 3f127823-bfd0-435b-82d9-2295f24cfe85 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:14:55.377990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:14:55.391276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Sync routers for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:14:55.405318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:55.406049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:55.411365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:55.413238 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.6360085 Nov 24 14:14:55.416484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48168) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:55.460840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9f4a3370-e30d-4e5b-aa1c-587815c26b91 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0429947 Nov 24 14:14:55.463256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48172) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:55.588937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:14:55.601124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94222d48-06ed-4000-9b74-c29599808e7b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:55.602227 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-94222d48-06ed-4000-9b74-c29599808e7b tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1380618 Nov 24 14:14:55.605097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48176) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:55.644783 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bb74eefc-78be-443a-ac1a-fb14d03c42fb tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0384340 Nov 24 14:14:55.650613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48180) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:55.659410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-635471185', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28', 'dns_nameservers': ['1.2.3.4']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:14:55.772212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:14:55.776030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:14:55.778827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:14:55.784580 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:14:55.794813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:14:55.898231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:55.917571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:54Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:55.921671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Checking router: 3f127823-bfd0-435b-82d9-2295f24cfe85 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:14:55.922053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Updating router 3f127823-bfd0-435b-82d9-2295f24cfe85 port f0b37ad3-cdce-40ad-ab0e-425f267e5296 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:14:55.974267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.116459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.120159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a71aae0-bce3-4c41-8127-cc0192d2f681 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:56.196897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=22ec26cd-8685-4f04-9fa4-301eba30bdee,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:56.199449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:56.211125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:14:56.211468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: ca17fb03-af7e-44ba-b423-f51304effe0f, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:14:56.235435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network ca17fb03-af7e-44ba-b423-f51304effe0f is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:14:56.247201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, ca17fb03-af7e-44ba-b423-f51304effe0f) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:14:56.251986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:56.252745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.279557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2c80490-82de-420d-a051-71638831a3fd None None] Network ca17fb03-af7e-44ba-b423-f51304effe0f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:14:56.280423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48184) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:56.281056 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4c4d64aa-7846-47be-8ff3-e900692c7dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.6293805 Nov 24 14:14:56.385559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.409678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Transition to ACTIVE for port object f0b37ad3-cdce-40ad-ab0e-425f267e5296 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:14:56.427574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.438417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:56.554843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23005db-de67-4595-9a5d-9ef2e7e9acf8 None None] Pushing event updated for resources: {'Port': ['ID=f0b37ad3-cdce-40ad-ab0e-425f267e5296,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:56.565200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b23005db-de67-4595-9a5d-9ef2e7e9acf8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:56.565898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Attempting to bind port f0b37ad3-cdce-40ad-ab0e-425f267e5296 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:14:56.566264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Attempting to bind port f0b37ad3-cdce-40ad-ab0e-425f267e5296 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:14:56.566626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Attempting to bind port f0b37ad3-cdce-40ad-ab0e-425f267e5296 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:14:56.606261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:14:56.606648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:14:56.607055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.607453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:14:56.607959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Bound port: f0b37ad3-cdce-40ad-ab0e-425f267e5296, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:14:56.608339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.659373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-ca17fb03-af7e-44ba-b423-f51304effe0f', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:14:56.660228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.744651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] For port f0b37ad3-cdce-40ad-ab0e-425f267e5296, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:14:56.763376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] For port f0b37ad3-cdce-40ad-ab0e-425f267e5296, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f0b37ad3-cdce-40ad-ab0e-425f267e5296,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:14:56.771408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:56.779038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:56.819064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:14:56.877662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 283d401b-b76d-4ebf-9595-4a31170bcccf {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:14:56.878010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 283d401b-b76d-4ebf-9595-4a31170bcccf not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:14:56.968134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23005db-de67-4595-9a5d-9ef2e7e9acf8 None None] Pushing event updated for resources: {'Port': ['ID=f0b37ad3-cdce-40ad-ab0e-425f267e5296,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:56.973192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b23005db-de67-4595-9a5d-9ef2e7e9acf8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:56.978383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:14:56.978946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:57.030643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Allocated IP 172.20.0.2 (ca17fb03-af7e-44ba-b423-f51304effe0f/22ec26cd-8685-4f04-9fa4-301eba30bdee/23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:14:57.066516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.270390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:14:57.582031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.607015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Transition to ACTIVE for port object 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:14:57.665490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Transition to ACTIVE for port object 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:14:57.676097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.681615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7fa76043-304b-450a-b00f-51a1f0288bcc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:57.759774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (ca17fb03-af7e-44ba-b423-f51304effe0f/22ec26cd-8685-4f04-9fa4-301eba30bdee/64fb3412-64cc-4f44-b652-8a6db1970dc0) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:14:57.763878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Network ca17fb03-af7e-44ba-b423-f51304effe0f is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:14:57.765473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Pushing event updated for resources: {'Port': ['ID=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:57.767945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:14:57.769679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:57.775635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:14:57.872108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:54Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:14:57.878542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Attempting to bind port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:14:57.878912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Attempting to bind port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:14:57.879283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Attempting to bind port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 on network ca17fb03-af7e-44ba-b423-f51304effe0f {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:14:57.882181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1431f6e9-8336-4c6d-8528-55ac67c13bb1 None None] The sync data for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv is: [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:54Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:14:57.887909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:14:57.888802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Checking segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:14:57.889218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.889611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Bound using segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:14:57.890083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Bound port: 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:14:57.890470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.935462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.952954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 64fb3412-64cc-4f44-b652-8a6db1970dc0 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:14:57.976993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:57.981258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5797ea9a-e2d6-4cf1-a5c6-4b1f5ae52e79 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:57.993479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] For port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:14:57.999106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] For port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:14:58.004358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:58.008883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:58.051681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network ca17fb03-af7e-44ba-b423-f51304effe0f is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:14:58.066487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:14:58.076028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:14:58.112245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Pushing event updated for resources: {'Port': ['ID=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:58.115127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:58.130720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=64fb3412-64cc-4f44-b652-8a6db1970dc0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:58.159276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.159659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.160069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.160440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.160807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.161171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.161535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.161898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.162782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.163164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.163506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:14:58.169595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:58.179202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:58.307130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:58.747504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:58.752413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:58.790810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ea3ce63-d57c-419c-883f-a1a4399920be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:58.883259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=64fb3412-64cc-4f44-b652-8a6db1970dc0,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:58.888445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:58.898193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:58.930009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:14:59.011826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:14:59.017368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f0b37ad3-cdce-40ad-ab0e-425f267e5296 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:14:59.054210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network ca17fb03-af7e-44ba-b423-f51304effe0f is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:14:59.055466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:14:59.099621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f0b37ad3-cdce-40ad-ab0e-425f267e5296 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:14:59.105842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f0b37ad3-cdce-40ad-ab0e-425f267e5296 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:59.106317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.137343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20f09b2a-5c9b-4de8-9a11-6c3aeadd0b18 None None] Network ca17fb03-af7e-44ba-b423-f51304effe0f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:14:59.288825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Provisioning for port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:14:59.338152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Provisioning complete for port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:59.338530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.438945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.483634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f0b37ad3-cdce-40ad-ab0e-425f267e5296, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f0b37ad3-cdce-40ad-ab0e-425f267e5296,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:59.521239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.529518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:59.581854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 3f127823-bfd0-435b-82d9-2295f24cfe85 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:14:59.661238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.687547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f0b37ad3-cdce-40ad-ab0e-425f267e5296,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:59.703253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:59.722031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] For port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:14:59.727070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.728787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b5160f8f-3f90-4c95-96e5-83b9c8ea2a87 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:14:59.799364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:14:59.812992 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/3f127823-bfd0-435b-82d9-2295f24cfe85/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5306776 Nov 24 14:14:59.815569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48188) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:14:59.816306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Pushing event updated for resources: {'Port': ['ID=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:14:59.820570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:14:59.959135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-121ca126-f138-4488-9fc1-dc30471ad099 None None] Provisioning complete for port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:14:59.959522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-121ca126-f138-4488-9fc1-dc30471ad099 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:14:59.961673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12f03013-f761-45a5-853d-3f3ab0710c41 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:59.962047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12f03013-f761-45a5-853d-3f3ab0710c41 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:59.962418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12f03013-f761-45a5-853d-3f3ab0710c41 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:59.962788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12f03013-f761-45a5-853d-3f3ab0710c41 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:14:59.967253 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-12f03013-f761-45a5-853d-3f3ab0710c41 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2885 time: 0.1477594 Nov 24 14:14:59.967564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48192) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:00.042060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fd3cbd-551f-4e0b-b966-79f678329774 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:00.042526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fd3cbd-551f-4e0b-b966-79f678329774 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:00.043141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fd3cbd-551f-4e0b-b966-79f678329774 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:00.043553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8fd3cbd-551f-4e0b-b966-79f678329774 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:00.045462 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a8fd3cbd-551f-4e0b-b966-79f678329774 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2736 time: 0.0768833 Nov 24 14:15:00.048266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48196) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:00.166515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-121ca126-f138-4488-9fc1-dc30471ad099 None None] Provisioning for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:15:00.173712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-121ca126-f138-4488-9fc1-dc30471ad099 None None] Provisioning complete for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:00.174395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-121ca126-f138-4488-9fc1-dc30471ad099 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.234762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-121ca126-f138-4488-9fc1-dc30471ad099 None None] Port 64fb3412-64cc-4f44-b652-8a6db1970dc0 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:15:00.274278 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9a5449a5-fe58-4559-a929-f591624ac277 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1607 time: 0.2247355 Nov 24 14:15:00.357008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9c4a212-5b4d-4268-b54e-d139f862519e None None] Provisioning complete for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:00.357268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9c4a212-5b4d-4268-b54e-d139f862519e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.411680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a9c4a212-5b4d-4268-b54e-d139f862519e None None] Port 64fb3412-64cc-4f44-b652-8a6db1970dc0 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:15:00.630410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48202) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:00.637014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-249929476', 'description': 'tempest-secgroup-smoke-249929476 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:00.642924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:00.647534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:00.651231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:00.656973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:00.667537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.701772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:00.705509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:00.708374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:00.714561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:00.770018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.774616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.778198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b109fd94-b644-4258-b00c-cdde3314c1cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:00.820302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e087af87-6adc-4d4b-89f0-86adf64bb799,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:00.823480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:00.827294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.832342 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.1966784 Nov 24 14:15:00.832342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48206) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:00.837737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'e087af87-6adc-4d4b-89f0-86adf64bb799', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:00.844486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:00.848379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:00.851918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:00.857879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:00.868095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:15:00.880400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.938401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:00.938789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.945165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.949099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.950980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d7b5e113-50a6-43dd-bdf5-c8cdbb506c8f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:00.976213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=138f23f6-a1eb-4566-91d0-32723778678d,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:00.980746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:00.986225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:00.987484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b18f276c-f2df-4da1-89b8-4dceae30060c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1547236 Nov 24 14:15:00.990612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48210) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:00.996205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'e087af87-6adc-4d4b-89f0-86adf64bb799', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:01.002133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:01.006604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:01.009509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:01.015068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:01.032983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.060700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f0b37ad3-cdce-40ad-ab0e-425f267e5296 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:15:01.101702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.106407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.108381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fdf62e40-d8b3-4d12-b7fb-333cf97a2425 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:01.128051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4b13c77f-c99a-4a99-aa6f-1827342e4b54,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:01.131970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f0b37ad3-cdce-40ad-ab0e-425f267e5296 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:01.132180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:01.132320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.142726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.147220 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1523800 Nov 24 14:15:01.147695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48214) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:01.153720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'e087af87-6adc-4d4b-89f0-86adf64bb799', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:01.159997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:01.164534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:01.167374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:01.173052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:01.191315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.266235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.270449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.273335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-dd960bc6-d11c-499f-8f52-17a13368a67f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:01.297311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=196e6aed-76e3-4b7a-ae0c-1032b70f380c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:01.301845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:01.307124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.311061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48218) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:01.311610 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1622474 Nov 24 14:15:01.316888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'e087af87-6adc-4d4b-89f0-86adf64bb799', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:01.323547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:01.327362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:01.330216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:01.336669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:01.354589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.421007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.425899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.428691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f12e47eb-8683-4905-89b7-9e65945e8402 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:01.453283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=000d237f-3d5e-4fba-93ba-02d47af63104,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:01.457124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:01.464779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.465910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1538820 Nov 24 14:15:01.468869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48222) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:01.474138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'e087af87-6adc-4d4b-89f0-86adf64bb799', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:01.479956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:01.485877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:01.486699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:01.493734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:01.505498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:15:01.507707 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Sync routers for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:15:01.513147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.519518 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:15:01.520145 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:01.579858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.584063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.592139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b542b43e-2b35-4b15-98e6-84763765afbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:01.616257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1c5b1a76-9969-4ea0-b897-9c315040f507,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:01.618595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:01.623598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.627532 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1552246 Nov 24 14:15:01.628135 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48226) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:01.635911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': 'e087af87-6adc-4d4b-89f0-86adf64bb799', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:01.642392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:01.646211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:01.649230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:01.656552 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:01.666031 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:15:01.672444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.704746 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:15:01.740000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.744629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.746636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-890794a7-4655-4bd1-aa88-57e65c068486 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:01.767302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c46e675a-6f89-4c5b-b08c-c20a60ac1720,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:01.771288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:01.779816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:01.781002 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1518683 Nov 24 14:15:02.034976 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:02.040232 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Checking router: 3f127823-bfd0-435b-82d9-2295f24cfe85 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:15:02.040591 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Updating router 3f127823-bfd0-435b-82d9-2295f24cfe85 port 64fb3412-64cc-4f44-b652-8a6db1970dc0 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:15:02.094065 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:02.129708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-11c2fd28-757a-41cb-b9c5-16b31807325f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:15:02.145443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-11c2fd28-757a-41cb-b9c5-16b31807325f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:15:02.146711 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-11c2fd28-757a-41cb-b9c5-16b31807325f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-249929476&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.1889303 Nov 24 14:15:02.302439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-98414f24-304d-4761-9a76-bf6589bca4b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:02.303881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-98414f24-304d-4761-9a76-bf6589bca4b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:15:02.330981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-98414f24-304d-4761-9a76-bf6589bca4b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:15:02.333104 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-98414f24-304d-4761-9a76-bf6589bca4b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 796 time: 0.1782990 Nov 24 14:15:02.351691 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-222c1f60-ba47-4fb7-9b2c-72a933f25dbc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0125780 Nov 24 14:15:02.436307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-18adbebb-7c29-4f25-8b04-1c0eebcf19f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:15:02.451655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-18adbebb-7c29-4f25-8b04-1c0eebcf19f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:15:02.452991 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-18adbebb-7c29-4f25-8b04-1c0eebcf19f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0941935 Nov 24 14:15:02.457729 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:02.470924 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Transition to ACTIVE for port object 64fb3412-64cc-4f44-b652-8a6db1970dc0 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:15:02.477885 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:02.481937 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c2715d9c-202b-4e4c-a637-7cf16a99e477 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:02.536383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-6e89c584-a5ca-4afb-af0c-7451de9a06fb service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:15:02.537650 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-6e89c584-a5ca-4afb-af0c-7451de9a06fb service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0719416 Nov 24 14:15:02.680492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Pushing event updated for resources: {'Port': ['ID=64fb3412-64cc-4f44-b652-8a6db1970dc0,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:02.702936 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-2cc3128e-8ec4-420a-8d42-f230ee7f5ae7 service neutron] 10.222.0.70 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1583314 Nov 24 14:15:02.705947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.706282 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.706608 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.706933 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.707258 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.707572 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.707925 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.708241 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.708552 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.709707 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.710479 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:15:02.715293 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:02.717881 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Attempting to bind port 64fb3412-64cc-4f44-b652-8a6db1970dc0 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:15:02.719226 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Attempting to bind port 64fb3412-64cc-4f44-b652-8a6db1970dc0 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:15:02.719808 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Attempting to bind port 64fb3412-64cc-4f44-b652-8a6db1970dc0 on network ca17fb03-af7e-44ba-b423-f51304effe0f {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:15:02.728087 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:15:02.728321 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Checking segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:15:02.728727 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:02.729123 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Bound using segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:15:02.729580 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Bound port: 64fb3412-64cc-4f44-b652-8a6db1970dc0, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:15:02.729971 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:02.817907 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] For port 64fb3412-64cc-4f44-b652-8a6db1970dc0, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:15:02.822428 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] For port 64fb3412-64cc-4f44-b652-8a6db1970dc0, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=64fb3412-64cc-4f44-b652-8a6db1970dc0,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:15:02.827104 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:02.831440 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:02.850505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-c7e31e03-193b-490b-9169-28071fd1e7e6 service neutron] 10.222.0.70 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1362443 Nov 24 14:15:02.937189 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Pushing event updated for resources: {'Port': ['ID=64fb3412-64cc-4f44-b652-8a6db1970dc0,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:02.941289 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:02.949264 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:15:02.949866 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:14:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:03.065435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d3421166-2735-4ed7-abb5-53d196179b89 req-dca4e0a9-acc2-44c6-96b3-ae1a4b5889c9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:15:03.079957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d3421166-2735-4ed7-abb5-53d196179b89 req-dca4e0a9-acc2-44c6-96b3-ae1a4b5889c9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:15:03.081218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d3421166-2735-4ed7-abb5-53d196179b89 req-dca4e0a9-acc2-44c6-96b3-ae1a4b5889c9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 210 time: 0.0734401 Nov 24 14:15:03.150103 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:15:03.194804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a5f5f607-7a7e-49f7-aba7-40bdf4f2eb5c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:03.461938 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:02Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:03.465892 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda2fe31-b666-47da-beeb-24f060ca4524 None None] The sync data for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv is: [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:02Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:15:03.581270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:04.208309 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4bc92c-be53-40b9-a0d6-a1940f4ef049 req-183d4dc4-f432-41c0-a088-9053883df545 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 210 time: 0.0484085 Nov 24 14:15:04.863330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 64fb3412-64cc-4f44-b652-8a6db1970dc0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:15:04.935287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:15:04.939889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:04.940261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:05.066665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:05.101682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 64fb3412-64cc-4f44-b652-8a6db1970dc0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=64fb3412-64cc-4f44-b652-8a6db1970dc0,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:15:05.105591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:05.107434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:05.169880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=64fb3412-64cc-4f44-b652-8a6db1970dc0,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:05.172862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:05.398026 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-988dd522-0f44-4ff6-86e4-6261eaa0b552 req-326d7b67-2889-477a-9444-d64f26273bfd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 210 time: 0.0633154 Nov 24 14:15:05.777380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f869459a-45c1-4449-a132-38c9f9e39c78 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:06.272300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-1939044e-6e4c-41e0-bbcc-3877cd2f3654 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:06.273320 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-1939044e-6e4c-41e0-bbcc-3877cd2f3654 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 796 time: 0.1514745 Nov 24 14:15:06.329604 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-1fd5b438-1e1d-4036-8b70-347d60391088 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 379 time: 0.0431819 Nov 24 14:15:06.338122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['e087af87-6adc-4d4b-89f0-86adf64bb799']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:06.485185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:06.496109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:06.506199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:15:06.509233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:06.565130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-82a4db67-7c22-4dd9-8b98-76964e69dfbd req-1e1c18ea-19ce-4f75-a46c-d19be8d8a43e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 210 time: 0.0462441 Nov 24 14:15:06.707598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.12 (ca17fb03-af7e-44ba-b423-f51304effe0f/22ec26cd-8685-4f04-9fa4-301eba30bdee/472fe614-c67b-4ef9-a0ea-274da0f03fa7) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:15:06.743621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:06.803225 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:15:06.861693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 64fb3412-64cc-4f44-b652-8a6db1970dc0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:15:06.901196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:06.916970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 472fe614-c67b-4ef9-a0ea-274da0f03fa7 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:15:06.931010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:06.931390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:06.939256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:06.946368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-23c28597-50e2-41f3-9605-27b19821fae0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:07.020667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network ca17fb03-af7e-44ba-b423-f51304effe0f is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:15:07.024904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=472fe614-c67b-4ef9-a0ea-274da0f03fa7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:07.027709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:07.028722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:15:07.030715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:15:07.096788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:07.097547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:07.125787 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7914927 Nov 24 14:15:07.137362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Request body: {'port': {'device_id': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:07.222772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63aef070-a42b-45b2-b5b4-4b139cae91c7 None None] Provisioning for port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:15:07.229867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-63aef070-a42b-45b2-b5b4-4b139cae91c7 None None] Provisioning complete for port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:07.230727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-63aef070-a42b-45b2-b5b4-4b139cae91c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:07.250794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:07.289233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-63aef070-a42b-45b2-b5b4-4b139cae91c7 None None] Port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:15:07.696898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 472fe614-c67b-4ef9-a0ea-274da0f03fa7 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:15:07.703590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:07.718613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Transition to ACTIVE for port object 472fe614-c67b-4ef9-a0ea-274da0f03fa7 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:15:07.722731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:07.727649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b8b25b7-2a60-45bb-8b82-5bb17103f9d9 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:07.766654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9664ee5a-3178-46ff-903f-5abf792b59d7 req-f6a785dd-d432-4ee9-a203-c31e92dbd1ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:07.768176 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9664ee5a-3178-46ff-903f-5abf792b59d7 req-f6a785dd-d432-4ee9-a203-c31e92dbd1ff tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 944 time: 0.0820990 Nov 24 14:15:07.818715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9664ee5a-3178-46ff-903f-5abf792b59d7 req-dc9babc6-dc94-4e73-b6e8-cd9e8c81013d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:15:07.832076 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9664ee5a-3178-46ff-903f-5abf792b59d7 req-dc9babc6-dc94-4e73-b6e8-cd9e8c81013d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:15:07.844450 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9664ee5a-3178-46ff-903f-5abf792b59d7 req-dc9babc6-dc94-4e73-b6e8-cd9e8c81013d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0697248 Nov 24 14:15:07.859516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Pushing event updated for resources: {'Port': ['ID=472fe614-c67b-4ef9-a0ea-274da0f03fa7,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:07.862475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:07.972962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Attempting to bind port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:15:07.973305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Attempting to bind port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:15:07.973608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Attempting to bind port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 on network ca17fb03-af7e-44ba-b423-f51304effe0f {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:15:07.979297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 on network ca17fb03-af7e-44ba-b423-f51304effe0f not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:15:07.979620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Attempting to bind port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 on network ca17fb03-af7e-44ba-b423-f51304effe0f {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:15:07.985677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 14, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:15:07.986004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Checking segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:15:07.986377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Bound using segment: {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:15:07.986781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Bound port: 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '27ff091f-9ef8-4d0a-a178-ddbaf3af3465', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 887, 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:15:07.987116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:08.077970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] For port 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:15:08.080885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] For port 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:15:08.086127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:08.089665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8364f455-d6c3-424d-ab92-be5998d58e83 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:08.142876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:08.144363 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] 10.222.0.47 "PUT /v2.0/ports/472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 1094 time: 1.0112019 Nov 24 14:15:08.144878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:15:08.168080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Pushing event updated for resources: {'Port': ['ID=472fe614-c67b-4ef9-a0ea-274da0f03fa7,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:08.171961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:08.228642 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'status': 'completed', 'code': 200} Nov 24 14:15:08.269741 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-5c39af55-7acd-462c-919b-31544006a818 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1097 time: 0.0799117 Nov 24 14:15:08.339831 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-e02e3317-abdc-416d-90a8-a810dec3fd3a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 217 time: 0.0619409 Nov 24 14:15:08.406658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-46219fc1-bfc5-493d-9b5a-4788a5372e92 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:08.407944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-46219fc1-bfc5-493d-9b5a-4788a5372e92 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.0621932 Nov 24 14:15:08.430452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:08.484459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-09229be7-5e57-4bfd-b2e1-379e0654aec3 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0698988 Nov 24 14:15:08.615786 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-d95b6f68-9099-47ce-bdf0-5a0b8a02ab10 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237564 Nov 24 14:15:08.745699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5476713b-5533-4e25-8167-bf8ebf48f48f req-a721b71a-19ce-4464-b573-df25a4f2cf49 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237588 Nov 24 14:15:08.864430 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-8c14d579-4c57-4a31-a27a-8271ad5aa7fc service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1097 time: 0.0730119 Nov 24 14:15:09.015513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da853684-e042-471a-8715-f395088848df req-6d40b3a0-4fda-4aae-a88b-7c6eec1fd503 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:09.018276 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-6d40b3a0-4fda-4aae-a88b-7c6eec1fd503 service neutron] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 897 time: 0.1458952 Nov 24 14:15:09.043713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b0fd570-c51b-4c65-9707-33df1f3d5076 req-6c8a0163-d7fd-4e60-b9c4-263af74db514 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:09.045199 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1b0fd570-c51b-4c65-9707-33df1f3d5076 req-6c8a0163-d7fd-4e60-b9c4-263af74db514 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 944 time: 0.0840166 Nov 24 14:15:09.087627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-1d441269-8dfd-4b0a-967b-f26ebefc72f9 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 217 time: 0.0635085 Nov 24 14:15:09.093366 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1b0fd570-c51b-4c65-9707-33df1f3d5076 req-c221ebe7-3323-4d81-a942-700b0a651049 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425363 Nov 24 14:15:09.258499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da853684-e042-471a-8715-f395088848df req-75af06bd-c659-4f23-abf4-c84acb501715 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:09.259929 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-75af06bd-c659-4f23-abf4-c84acb501715 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.1662483 Nov 24 14:15:09.335465 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-86e4723d-1d66-4235-9859-2e67d7896125 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0693722 Nov 24 14:15:09.475135 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-9e55b499-bfef-450a-9fe5-b0c567d2534b service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319075 Nov 24 14:15:09.610097 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-da853684-e042-471a-8715-f395088848df req-b128bd02-9491-4db1-8a71-445c2f668f8c service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279585 Nov 24 14:15:10.296653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f706e701-c6be-42dd-834c-f0e797d3286f req-f6f6e7aa-4c98-443a-b32e-1098b4209e82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:10.297329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f706e701-c6be-42dd-834c-f0e797d3286f req-f6f6e7aa-4c98-443a-b32e-1098b4209e82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:15:10.313084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f706e701-c6be-42dd-834c-f0e797d3286f req-f6f6e7aa-4c98-443a-b32e-1098b4209e82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:15:10.314403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f706e701-c6be-42dd-834c-f0e797d3286f req-f6f6e7aa-4c98-443a-b32e-1098b4209e82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 944 time: 0.0988023 Nov 24 14:15:10.366900 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f706e701-c6be-42dd-834c-f0e797d3286f req-25c9df52-37e1-4da8-93a9-88ca13d2cfac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423114 Nov 24 14:15:11.483392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 472fe614-c67b-4ef9-a0ea-274da0f03fa7 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:15:11.680407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:15:11.694563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'port_id': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'mac_address': 'fa:16:3e:38:75:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 887, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:15:11.747550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:11.764576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33039ff-9c6a-4752-ac0f-93616bc7db86 req-e372ecf6-4eac-41c7-8888-772379e8bddc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:11.766151 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d33039ff-9c6a-4752-ac0f-93616bc7db86 req-e372ecf6-4eac-41c7-8888-772379e8bddc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 944 time: 0.0793707 Nov 24 14:15:11.769667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 472fe614-c67b-4ef9-a0ea-274da0f03fa7 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:15:11.792375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:15:11.797274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:11.800441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:11.819123 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d33039ff-9c6a-4752-ac0f-93616bc7db86 req-cf064dac-e2e1-45d9-b561-28cb905bd13d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465050 Nov 24 14:15:11.903228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=472fe614-c67b-4ef9-a0ea-274da0f03fa7,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:11.906266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:12.113067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['472fe614-c67b-4ef9-a0ea-274da0f03fa7'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:15:13.013106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb81c119-6846-45fe-8a6f-bf0fb3bfdbbb req-9dc92e82-ae8a-4417-99dd-8074a648d4e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:13.014529 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eb81c119-6846-45fe-8a6f-bf0fb3bfdbbb req-9dc92e82-ae8a-4417-99dd-8074a648d4e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 945 time: 0.0755491 Nov 24 14:15:13.059880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eb81c119-6846-45fe-8a6f-bf0fb3bfdbbb req-a0665e4e-a4bc-44ad-8cf5-636dcdc29b82 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398166 Nov 24 14:15:13.508649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 472fe614-c67b-4ef9-a0ea-274da0f03fa7 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:15:13.579158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:15:13.584096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:15:13.584474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:13.697273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:13.722753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:15:13.732951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:15:13.737742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:13.742596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e12e679-6816-483d-823e-f6bcdf69167a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:13.857123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=472fe614-c67b-4ef9-a0ea-274da0f03fa7,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:13.860457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:13.916689 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'code': 200} Nov 24 14:15:14.148290 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-56da6317-801e-4b7a-994d-e5acc50bcc57 req-3c6fa184-4a34-4ace-9bb7-61717d4819b0 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1099 time: 0.0734670 Nov 24 14:15:14.239528 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-56da6317-801e-4b7a-994d-e5acc50bcc57 req-68d36b5e-22ff-4cc4-8bde-7b4ed022b378 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0836759 Nov 24 14:15:14.277598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7821064-7e11-4ef4-910e-49e7f4ec0f87 req-3379d4c6-3a12-4748-8136-e4df2d512c7f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:14.280303 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7821064-7e11-4ef4-910e-49e7f4ec0f87 req-3379d4c6-3a12-4748-8136-e4df2d512c7f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.0894442 Nov 24 14:15:14.329687 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7821064-7e11-4ef4-910e-49e7f4ec0f87 req-a049c55a-f89e-4feb-a0a1-c70f3493f4c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451140 Nov 24 14:15:15.539233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96c0826-618b-4945-8c31-87244118087c req-75f3453d-5dc8-4c44-ba69-67220727b6d4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:15.540711 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a96c0826-618b-4945-8c31-87244118087c req-75f3453d-5dc8-4c44-ba69-67220727b6d4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.0826023 Nov 24 14:15:15.588893 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a96c0826-618b-4945-8c31-87244118087c req-b01134c0-8139-4b8c-be34-10b3cecd4dea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424993 Nov 24 14:15:16.789045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69920130-dd21-4cab-beca-ca93826bdda4 req-e1df170f-0403-4dc9-8022-2d1ac6d89140 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:16.790489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69920130-dd21-4cab-beca-ca93826bdda4 req-e1df170f-0403-4dc9-8022-2d1ac6d89140 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.0794506 Nov 24 14:15:16.836075 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69920130-dd21-4cab-beca-ca93826bdda4 req-77b9eb3a-f88b-44fd-92ab-2b3005c7d9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401008 Nov 24 14:15:17.037369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1741c9d2-1d2d-4555-95e1-335a04bf26bc req-27bd1682-6920-40a8-bc2b-2516f2c2fc2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:17.038801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1741c9d2-1d2d-4555-95e1-335a04bf26bc req-27bd1682-6920-40a8-bc2b-2516f2c2fc2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.0815005 Nov 24 14:15:17.085312 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1741c9d2-1d2d-4555-95e1-335a04bf26bc req-26af5b53-2806-4e59-9300-be1bd9bf8674 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410762 Nov 24 14:15:17.114601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48296) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:17.184778 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9af2b3e5-88c6-40c3-9623-f3257769394f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1094 time: 0.0681264 Nov 24 14:15:17.187256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48300) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:17.192429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:15:17.197890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:15:17.201745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:15:17.204559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:15:17.210559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:15:17.227241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:17.367355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:17.620059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.117 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/49ec235a-258b-45c9-829e-ba936e221955) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:15:17.765386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:17.769776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:17.797137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:17.801168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9886d2f3-4c7c-41ee-958a-406bd10a0898 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:17.875807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:15:17.879019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:15:17.883988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:15:17.910916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=49ec235a-258b-45c9-829e-ba936e221955,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:17.918099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:18.400945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:18.455473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:18.669362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:18.674075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:18.678283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e2771f77-68d1-44ac-b47d-6dd4b9b0afa3 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:15:18.777788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=49ec235a-258b-45c9-829e-ba936e221955,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:15:18.781647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:15:18.796426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:18.996189 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 093f27f0-53cc-41a2-adfc-8766b0f12f72 associated. External IP: 172.26.4.117, port: 472fe614-c67b-4ef9-a0ea-274da0f03fa7. Nov 24 14:15:19.498826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 3f127823-bfd0-435b-82d9-2295f24cfe85 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:15:19.700069 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:15:19.710433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] Sync routers for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:15:19.722562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:15:19.723291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:15:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:19.727457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:19.786095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.5978045 Nov 24 14:15:19.787487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:15:19.789438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48304) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:19.843339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'status': 'completed', 'code': 200} Nov 24 14:15:19.910286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:15:19.968606 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ea21bce8-568a-481b-9e32-82baa1860edc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/093f27f0-53cc-41a2-adfc-8766b0f12f72 HTTP/1.1" status: 200 len: 992 time: 0.1760104 Nov 24 14:15:19.989638 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-1c880e30-08e0-415b-a114-7005c51deb5d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1099 time: 0.1161399 Nov 24 14:15:20.126416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-e17d15e7-23b7-487d-8629-8911564f7a46 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:20.127897 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-e17d15e7-23b7-487d-8629-8911564f7a46 service neutron] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 897 time: 0.1318879 Nov 24 14:15:20.239007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-111748af-e9ec-4cd1-8629-b5b5fe70053d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 1000 time: 0.1040642 Nov 24 14:15:20.264681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '093f27f0-53cc-41a2-adfc-8766b0f12f72', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.117', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'port_id': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'mac_address': 'fa:16:3e:38:75:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:15:18Z', 'updated_at': '2021-11-24T14:15:18Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:05Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:20.268722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] Checking router: 3f127823-bfd0-435b-82d9-2295f24cfe85 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:15:20.280153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:15:20.280754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:15:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:20.310465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-6f08c84e-ca4a-40f5-9a79-895c68b3592c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:20.311938 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-6f08c84e-ca4a-40f5-9a79-895c68b3592c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.0658045 Nov 24 14:15:20.388122 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-fc7a1d7c-3452-4cf4-a9d4-1c0c362807fc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0702507 Nov 24 14:15:20.462239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:15:20.532076 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-56428ff1-1a3f-47c1-9954-60b3294a9a74 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1371510 Nov 24 14:15:20.773526 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fc1afd4a-8141-497a-8edf-4f2205c51498 req-db63f02c-d0ed-468a-80c4-f340375e290b service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2348304 Nov 24 14:15:20.890424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '093f27f0-53cc-41a2-adfc-8766b0f12f72', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.117', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'port_id': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'mac_address': 'fa:16:3e:38:75:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:15:18Z', 'updated_at': '2021-11-24T14:15:18Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:05Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:15:20.894420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f34f65d-dbbd-4344-aeb7-4161d87a4043 None None] The sync data for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv is: [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '093f27f0-53cc-41a2-adfc-8766b0f12f72', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.117', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'port_id': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'mac_address': 'fa:16:3e:38:75:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:15:18Z', 'updated_at': '2021-11-24T14:15:18Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:05Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['1.2.3.4'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:15:20.971266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48310) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:21.081827 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6b75c355-9871-4d01-9908-3eadd0d68f4b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/093f27f0-53cc-41a2-adfc-8766b0f12f72 HTTP/1.1" status: 200 len: 992 time: 0.1092939 Nov 24 14:15:21.092811 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f903e205-65bd-42a6-9801-712a6fa0027f None None] New status for floating IP 093f27f0-53cc-41a2-adfc-8766b0f12f72: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:15:22.085190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48314) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:15:22.188424 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea241dbc-15c0-44b4-a04c-012c3e0cfa5d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/093f27f0-53cc-41a2-adfc-8766b0f12f72 HTTP/1.1" status: 200 len: 994 time: 0.1020124 Nov 24 14:15:33.197820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ff99fe94-480d-45f6-bb14-a928c4ed785c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:33.584303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:35.782416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5098f42d-d77c-47ee-9451-5968984e5a5f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:36.745289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:38.431493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:15:42.985015 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-7d4eaf5a-a564-4048-a2bd-de7c2b2190a2 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0714366 Nov 24 14:15:43.122369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-6b306fb9-d420-4dbe-a16b-768d9db07e53 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1099 time: 0.0696189 Nov 24 14:15:43.268262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ec7f21-2cf8-404e-b223-482357feef5d req-334c60b8-697b-49c6-b0c6-087a0a8ee049 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:43.269703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-334c60b8-697b-49c6-b0c6-087a0a8ee049 service neutron] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 897 time: 0.1286700 Nov 24 14:15:43.374373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-811cd847-0958-4319-b138-d9ffc963812e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 1002 time: 0.0975442 Nov 24 14:15:43.439994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ec7f21-2cf8-404e-b223-482357feef5d req-6badddcb-1234-418f-bceb-e3201c2b2e96 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:15:43.441412 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-6badddcb-1234-418f-bceb-e3201c2b2e96 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.0609992 Nov 24 14:15:43.518434 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-efaed7fd-9b48-4848-a4c2-57674f6eb208 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0707679 Nov 24 14:15:43.653285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-8035e3b0-c44c-48e4-ae7e-ba7f2cbd56c4 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279440 Nov 24 14:15:43.782610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41ec7f21-2cf8-404e-b223-482357feef5d req-4be35385-42c6-442b-b2ee-4a3f6c86b63e service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229761 Nov 24 14:15:43.805127 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:15:47.774845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:03.201248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d13f4b69-b493-43f1-ae61-a59f92006057 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:03.585422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:05.784422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e545343b-f886-4d14-b129-9a4d4369ec7e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:06.748641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:08.434945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:17.780129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:20.805628 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:16:33.203209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e14adaf1-36ae-40f2-ac00-9330485762e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:33.588066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:35.791014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-777c1f4e-a9ca-4358-aded-5151090fdec9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:36.752247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:38.438457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:45.094716 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-d0baa281-423a-4a49-afb6-fedd17ba1a7c service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1936958 Nov 24 14:16:45.235068 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-b39f7413-5a24-4159-8b8b-8f6a90aaf687 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1099 time: 0.0732563 Nov 24 14:16:45.378613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29dd9951-b950-43a5-b667-6587cb651003 req-b8f1df82-09e0-4a19-8593-20071b5f3ca3 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:16:45.380053 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-b8f1df82-09e0-4a19-8593-20071b5f3ca3 service neutron] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 897 time: 0.1267540 Nov 24 14:16:45.487673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-ed15bdd9-4fc0-40b6-9aa6-0a6de20dc9a8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 1002 time: 0.1017332 Nov 24 14:16:45.548697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29dd9951-b950-43a5-b667-6587cb651003 req-4778f9be-cd26-48d4-b19a-300fe3cee640 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:16:45.550743 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-4778f9be-cd26-48d4-b19a-300fe3cee640 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.0569267 Nov 24 14:16:45.624933 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-c5e1f6bc-3ff5-40bf-ba6c-1ca66f45bf4e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0683303 Nov 24 14:16:45.634597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-32ac11fc-acb1-434e-be84-d413225eb8c8 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:16:45.635408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-32ac11fc-acb1-434e-be84-d413225eb8c8 service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0046055 Nov 24 14:16:45.766119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-7f48bb0b-acd1-430e-8368-775b94b9cdff service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1239281 Nov 24 14:16:46.006642 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29dd9951-b950-43a5-b667-6587cb651003 req-1853eb80-5d6a-4f47-b7b1-865ed0007e4f service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2344007 Nov 24 14:16:47.769025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:16:57.806519 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:17:03.206377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3f03050c-3ce2-4779-a48c-28d497e61a34 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:03.591270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:05.784035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a75dce96-9857-4c11-8d61-710449d6cc68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:06.755874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:08.439518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:17.797856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:33.202532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e41179f2-03d3-4226-a39e-e2083f892863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:33.597990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:34.807262 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:17:35.785742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1f436c1e-10db-427a-99b5-3ce393539c7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:36.757663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:38.443100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:45.972961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-bf65ecfe-6c31-4f1d-9138-6049f99c5e0b service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0729830 Nov 24 14:17:46.107826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-80cd2e54-8096-48cd-804c-e9840ae9a404 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1099 time: 0.0677676 Nov 24 14:17:46.252319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-16a3fdd4-48b0-48e9-8243-6f45fe0fcfdb service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:17:46.254317 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-16a3fdd4-48b0-48e9-8243-6f45fe0fcfdb service neutron] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 897 time: 0.1278458 Nov 24 14:17:46.358370 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-52074395-0e25-45ba-b710-c0c3024caa0e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 1002 time: 0.0978868 Nov 24 14:17:46.424387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-19716e54-87ec-4495-b268-0ed3c39714a5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:17:46.426348 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-19716e54-87ec-4495-b268-0ed3c39714a5 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.0617383 Nov 24 14:17:46.499813 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-18f37ac5-a28a-4526-9146-aefb810c9cfe service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0673487 Nov 24 14:17:46.631457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-dd8a76d1-9369-4435-bd4f-ffb1469a0b25 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247776 Nov 24 14:17:46.767439 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4cb89be7-866b-4c2b-b6e6-5ef88e6dbe10 req-c27941f9-cf67-44fe-971a-f43844185606 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1294713 Nov 24 14:17:47.827697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:54.149418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48366) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:17:54.155338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'dns_nameservers': ['9.8.7.6']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:17:54.403649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8100982'] for subnet, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:54.594250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8771276033028', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-7895437'] for subnet, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:54.598819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-517e38c9-7062-446b-93b6-3614513bba03 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:17:54.655941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:17:54.656408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:54.660513 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/subnets/22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 835 time: 0.5073035 Nov 24 14:17:54.662036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88e0a8fe-1415-4209-9847-b182f36ba1cf None None] Network ca17fb03-af7e-44ba-b423-f51304effe0f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:17:54.667235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=22ec26cd-8685-4f04-9fa4-301eba30bdee,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:17:54.677343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.677724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.678100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.678467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.678835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.679197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.679559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.679947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.680307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.680664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.681023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:17:54.684712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a3c72e6d-6836-45f3-b18e-ecb04ab677d2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:17:55.077592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9efd6d3b-10a5-458f-b4be-dd0f7095c762 None None] Provisioning complete for port 64fb3412-64cc-4f44-b652-8a6db1970dc0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:17:55.077964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9efd6d3b-10a5-458f-b4be-dd0f7095c762 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:55.204083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9efd6d3b-10a5-458f-b4be-dd0f7095c762 None None] Provisioning complete for port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:17:55.204347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9efd6d3b-10a5-458f-b4be-dd0f7095c762 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:17:55.331838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9efd6d3b-10a5-458f-b4be-dd0f7095c762 None None] Provisioning complete for port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:17:55.332215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9efd6d3b-10a5-458f-b4be-dd0f7095c762 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:03.204140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25d4ad9a-36f2-4863-8856-303ac3817d67 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:03.590504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:05.787907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6aecac7a-cba8-47dd-95ee-cbb6a35f7f62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:06.760889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:08.446775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:11.806775 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:18:17.832770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:33.209687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9ef8c38-4434-4840-909c-ad2130315b20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:33.594360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:35.790405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e84e9448-b3cb-46f6-9ba6-6a697e91d433 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:36.764999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:38.424118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48382) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:38.449150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:38.832649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 49ec235a-258b-45c9-829e-ba936e221955 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:18:38.832985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:39.118014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:39.118543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:39.238188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 49ec235a-258b-45c9-829e-ba936e221955 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:18:39.395137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:39.398656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d1cef94-ed47-4b9b-92ac-3ddbd7e80e32 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:39.443565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=49ec235a-258b-45c9-829e-ba936e221955,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:39.447023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:39.536580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:39.939625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 3f127823-bfd0-435b-82d9-2295f24cfe85 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:18:40.146084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:18:40.158546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] Sync routers for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:18:40.167891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:40.172349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:40.172968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:40.246070 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/093f27f0-53cc-41a2-adfc-8766b0f12f72 HTTP/1.1" status: 204 len: 168 time: 1.8203611 Nov 24 14:18:40.247414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:18:40.399786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:40.515742 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'status': 'completed', 'code': 200} Nov 24 14:18:40.635734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-5bbf7817-8018-4521-a016-2cf4c322b011 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 1099 time: 0.0872087 Nov 24 14:18:40.778679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:05Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:40.782875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] Checking router: 3f127823-bfd0-435b-82d9-2295f24cfe85 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:18:40.794855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:40.795135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:40.797278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-dca718bb-244a-45fb-8062-10645d5eb8bc service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:40.798704 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-dca718bb-244a-45fb-8062-10645d5eb8bc service neutron] 10.222.0.47 "GET /v2.0/networks?id=ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 200 len: 897 time: 0.1538441 Nov 24 14:18:40.874872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-f0b978cd-cf58-412a-8bf5-13f80125ed44 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 200 len: 217 time: 0.0679460 Nov 24 14:18:40.904617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61bcc274-d341-48e4-a132-7a924a8382ad req-781c5346-69cf-4047-b34c-510fce71a2e9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:40.905317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-61bcc274-d341-48e4-a132-7a924a8382ad req-781c5346-69cf-4047-b34c-510fce71a2e9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:18:40.923040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-61bcc274-d341-48e4-a132-7a924a8382ad req-781c5346-69cf-4047-b34c-510fce71a2e9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:18:40.924251 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-61bcc274-d341-48e4-a132-7a924a8382ad req-781c5346-69cf-4047-b34c-510fce71a2e9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.1831291 Nov 24 14:18:40.946261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-308d68c6-42f6-45ea-b708-0491ae524b99 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:40.948595 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-308d68c6-42f6-45ea-b708-0491ae524b99 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 200 len: 843 time: 0.0672579 Nov 24 14:18:40.978212 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-61bcc274-d341-48e4-a132-7a924a8382ad req-bf86d4cd-465e-48da-a47a-b3e331fc5b32 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483403 Nov 24 14:18:40.985340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:41.036630 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-1ac6b698-6092-4187-9c5f-337a38db782d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=ca17fb03-af7e-44ba-b423-f51304effe0f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0807748 Nov 24 14:18:41.177153 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-feac781c-f7c8-428d-a2c8-007082032bbd service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1336622 Nov 24 14:18:41.320710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:05Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:41.325195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02928785-2fca-4ddd-8115-5b97de75c450 None None] The sync data for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv is: [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:14:58Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '64fb3412-64cc-4f44-b652-8a6db1970dc0', 'name': '', 'network_id': 'ca17fb03-af7e-44ba-b423-f51304effe0f', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:3b:43:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:57Z', 'updated_at': '2021-11-24T14:15:05Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': '22ec26cd-8685-4f04-9fa4-301eba30bdee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': ['9.8.7.6'], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:18:41.420707 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d286cb46-59b6-4b94-86e0-f1fd642af0ae req-576997b3-006b-443d-aabc-c6aa3fa40081 service neutron] 10.222.0.47 "GET /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2370594 Nov 24 14:18:41.551408 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-49d85d7a-2cd5-402c-b6f7-43182e89ebf2 None None] New status for floating IP 093f27f0-53cc-41a2-adfc-8766b0f12f72: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:18:42.281355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19597512-9a6f-4d1e-afe4-3c41f5865549 req-2c0cd4c7-d86d-43c6-bc02-9f34d456b150 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:42.282805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-19597512-9a6f-4d1e-afe4-3c41f5865549 req-2c0cd4c7-d86d-43c6-bc02-9f34d456b150 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.1660480 Nov 24 14:18:42.374630 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-19597512-9a6f-4d1e-afe4-3c41f5865549 req-0fd5b6f9-b814-41be-a83e-e28ccb117472 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=e087af87-6adc-4d4b-89f0-86adf64bb799&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0856946 Nov 24 14:18:42.409242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-f8544270-66b8-4711-8f68-2ad98e1a6750 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:42.410781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-f8544270-66b8-4711-8f68-2ad98e1a6750 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 946 time: 0.0940504 Nov 24 14:18:42.479075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:18:42.479417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:42.718855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 472fe614-c67b-4ef9-a0ea-274da0f03fa7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=472fe614-c67b-4ef9-a0ea-274da0f03fa7,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:18:42.719205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:42.840757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 472fe614-c67b-4ef9-a0ea-274da0f03fa7 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:18:42.983188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:42.989805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:43.037048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=472fe614-c67b-4ef9-a0ea-274da0f03fa7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:43.076833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.077217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.077595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.077969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.078339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.078704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.079073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.079442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.079829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.080190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.080723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:43.087464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:43.120965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 472fe614-c67b-4ef9-a0ea-274da0f03fa7 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:18:43.123311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:43.125916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'name': 'network-vif-deleted', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:18:43.141548 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e25498d7-64c4-4652-9bb7-91e8dda957c2 req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/472fe614-c67b-4ef9-a0ea-274da0f03fa7 HTTP/1.1" status: 204 len: 173 time: 0.7251499 Nov 24 14:18:43.320674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '03431598-1ddf-4a43-ba5c-ca03dae6c07e', 'name': 'network-vif-deleted', 'tag': '472fe614-c67b-4ef9-a0ea-274da0f03fa7', 'status': 'completed', 'code': 200} Nov 24 14:18:43.562674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-a9c798c8-4c58-4e27-982b-ad1f6d5ec49e req-6bdf80b8-f367-45b8-bacb-174010a838ee tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:18:43.579371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-a9c798c8-4c58-4e27-982b-ad1f6d5ec49e req-6bdf80b8-f367-45b8-bacb-174010a838ee tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:18:43.581491 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a9c798c8-4c58-4e27-982b-ad1f6d5ec49e req-6bdf80b8-f367-45b8-bacb-174010a838ee tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=03431598-1ddf-4a43-ba5c-ca03dae6c07e HTTP/1.1" status: 200 len: 210 time: 0.0652723 Nov 24 14:18:44.689435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48424) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:44.757940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:44.791974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:44.855876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:44.859822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c6e23177-180e-4716-8d86-dbf4f2271602 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:44.874343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e087af87-6adc-4d4b-89f0-86adf64bb799,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:44.877452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:44.886465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:44.887575 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/e087af87-6adc-4d4b-89f0-86adf64bb799 HTTP/1.1" status: 204 len: 168 time: 0.1971519 Nov 24 14:18:44.931612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48430) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:45.344544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:46.060448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 64fb3412-64cc-4f44-b652-8a6db1970dc0 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:18:46.061173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:46.250619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 64fb3412-64cc-4f44-b652-8a6db1970dc0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=64fb3412-64cc-4f44-b652-8a6db1970dc0,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:18:46.250971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:46.371838 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 64fb3412-64cc-4f44-b652-8a6db1970dc0 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:18:46.567663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:46.571485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0f2ae462-6c54-4c83-a2b9-c913b6d19c55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:46.615356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=64fb3412-64cc-4f44-b652-8a6db1970dc0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:46.618703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:46.780427 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 472fe614-c67b-4ef9-a0ea-274da0f03fa7 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:18:46.819839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 472fe614-c67b-4ef9-a0ea-274da0f03fa7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:18:46.820191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 472fe614-c67b-4ef9-a0ea-274da0f03fa7 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:18:46.910615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:47.574057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 3f127823-bfd0-435b-82d9-2295f24cfe85 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:18:47.773148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:18:47.782534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02795575-48a9-4692-892c-38605a26553c None None] Sync routers for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:18:47.790225 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/3f127823-bfd0-435b-82d9-2295f24cfe85/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8572738 Nov 24 14:18:47.792771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48434) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:47.795549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02795575-48a9-4692-892c-38605a26553c None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:47.796194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02795575-48a9-4692-892c-38605a26553c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:47.887225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:47.979249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet 22ec26cd-8685-4f04-9fa4-301eba30bdee {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:18:47.982169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:47.985174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-02795575-48a9-4692-892c-38605a26553c None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:48.041420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.127003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.201752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.206993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-22edad85-0c16-43b7-b05d-3394e1100a83 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:48.248446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=22ec26cd-8685-4f04-9fa4-301eba30bdee,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:48.250873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:48.254102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.263216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48438) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:48.263776 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/22ec26cd-8685-4f04-9fa4-301eba30bdee HTTP/1.1" status: 204 len: 168 time: 0.4694982 Nov 24 14:18:48.289859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8621d68d-ee35-4ea7-bfe9-5ddf9547896b None None] Network ca17fb03-af7e-44ba-b423-f51304effe0f requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:18:48.482237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02795575-48a9-4692-892c-38605a26553c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:18:46Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:48.488905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02795575-48a9-4692-892c-38605a26553c None None] Checking router: 3f127823-bfd0-435b-82d9-2295f24cfe85 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:18:48.517080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02795575-48a9-4692-892c-38605a26553c None None] Routers {'3f127823-bfd0-435b-82d9-2295f24cfe85'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:48.518331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02795575-48a9-4692-892c-38605a26553c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['3f127823-bfd0-435b-82d9-2295f24cfe85'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:48.604631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.650259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] DHCP port deletion for ca17fb03-af7e-44ba-b423-f51304effe0f request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:18:48.663910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Deleting port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:18:48.664284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.782022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-02795575-48a9-4692-892c-38605a26553c None None] Set router 3f127823-bfd0-435b-82d9-2295f24cfe85 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:48.806489 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:18:48.809711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.821290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port f0b37ad3-cdce-40ad-ab0e-425f267e5296 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:18:48.821652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:48.983033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:18:49.004999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port f0b37ad3-cdce-40ad-ab0e-425f267e5296, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f0b37ad3-cdce-40ad-ab0e-425f267e5296,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:18:49.005353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.123573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] For port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,segment=NetworkSegment(27ff091f-9ef8-4d0a-a178-ddbaf3af3465),segment_id=27ff091f-9ef8-4d0a-a178-ddbaf3af3465)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:18:49.124005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.131987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for f0b37ad3-cdce-40ad-ab0e-425f267e5296 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:18:49.272657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Calling delete_port for 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:18:49.305744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.310398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8483a68-7f6a-4a09-9e49-2420d0057d81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:49.353366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=f0b37ad3-cdce-40ad-ab0e-425f267e5296,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:49.355879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:49.425603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.443465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.448047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9d121dfd-a55a-4f90-8452-ccf6fa57e61b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:49.503292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Pushing event deleted for resources: {'Port': ['ID=23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:49.543355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] No DVR routers for this DVR port 23aeb5d2-a7d3-4cb7-a17e-f00bf86166f0 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:18:49.591624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.607276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.607922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.608039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.608396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.608584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.608905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.609223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.609554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.609853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.610423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.610530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:49.615122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:49.617477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-02795575-48a9-4692-892c-38605a26553c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:18:46Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:49.621808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02795575-48a9-4692-892c-38605a26553c None None] The sync data for ids ['3f127823-bfd0-435b-82d9-2295f24cfe85'] in dv-neutron-818151-2-hyperv is: [{'id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'name': 'tempest-TestNetworkBasicOps-router-456619553', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118'}], 'enable_snat': True}, 'gw_port_id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:14:53Z', 'updated_at': '2021-11-24T14:18:46Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'f0b37ad3-cdce-40ad-ab0e-425f267e5296', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:89:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3f127823-bfd0-435b-82d9-2295f24cfe85', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.118', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:14:54Z', 'updated_at': '2021-11-24T14:14:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:18:49.982735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:49.986966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.015539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.016169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router 3f127823-bfd0-435b-82d9-2295f24cfe85 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:18:50.031736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.032859 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/3f127823-bfd0-435b-82d9-2295f24cfe85 HTTP/1.1" status: 204 len: 168 time: 1.7678494 Nov 24 14:18:50.036482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48446) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:50.154652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.291361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.316747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca17fb03-af7e-44ba-b423-f51304effe0f']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:50.328400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '27ff091f-9ef8-4d0a-a178-ddbaf3af3465') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:50.328687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '27ff091f-9ef8-4d0a-a178-ddbaf3af3465') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:50.340092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.355673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.362477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 887 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:18:50.362907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:18:50.376642 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:18:50.457380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.461569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e0be57bb-5724-4276-a502-887addc8bb16 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:50.479226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.490351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=ca17fb03-af7e-44ba-b423-f51304effe0f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:50.493488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:50.499258 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9ba0f149-33ad-42d6-acfe-839bc96924d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/ca17fb03-af7e-44ba-b423-f51304effe0f HTTP/1.1" status: 204 len: 168 time: 0.4618216 Nov 24 14:18:50.511491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48450) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:50.517155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--1156903912', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:50.522846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:50.526921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:50.529768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:50.536478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:50.545745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:18:50.548725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.579600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 872} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:18:50.590654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.590986 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment c7026dc6-4457-4131-9ad4-61f1a2043d04 of type vlan for network f41807e1-87e1-4c03-827e-f7ae1d8e456d Nov 24 14:18:50.625874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.655618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.660473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:50.661043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.664504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0d6a0de4-c8b8-476b-b895-83aa6cbc73be tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:50.771441 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2588203 Nov 24 14:18:50.772361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=f41807e1-87e1-4c03-827e-f7ae1d8e456d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:50.774438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48454) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:50.777510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:50.780922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:50.784236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:18:50.788185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:50.792018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:50.794832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:50.801226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:50.813939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.815585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.835092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.956872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 64fb3412-64cc-4f44-b652-8a6db1970dc0 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:18:50.982975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:50.993118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 64fb3412-64cc-4f44-b652-8a6db1970dc0 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:18:50.993596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 64fb3412-64cc-4f44-b652-8a6db1970dc0 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:18:50.994150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f0b37ad3-cdce-40ad-ab0e-425f267e5296 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:18:51.028828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f0b37ad3-cdce-40ad-ab0e-425f267e5296 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:18:51.029189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f0b37ad3-cdce-40ad-ab0e-425f267e5296 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:18:51.179706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:51.208662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:51.347366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.68 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/cb6629e0-9038-4ede-ad35-2ff9d9ec815b) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:18:51.506320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:51.532404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:51.537302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ebeb5ea1-d429-4765-a802-2c854a3f3abe tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:51.607112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:18:51.610223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:18:51.613129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:18:51.642861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:51.649825 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:51.776714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:51.777339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:52.121363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:18:52.323272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:18:52.335829 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:18:52.347693 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:52.348321 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:52.350995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:52.352679 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 886 time: 1.5770955 Nov 24 14:18:52.355875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48458) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:52.395534 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5034bb98-5d39-4396-b3b4-9347769a8b7c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0383723 Nov 24 14:18:52.398067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48462) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:52.523396 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:52.544823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50d790fc-f81f-4c55-b51d-6e5131594f95 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:52.546335 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50d790fc-f81f-4c55-b51d-6e5131594f95 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1473739 Nov 24 14:18:52.549904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48466) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:52.595793 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea61c40b-0a36-4410-b70c-1ab54f23e8cc tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0439951 Nov 24 14:18:52.598843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48470) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:52.604156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-373874135', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:52.716037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:52.719992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:52.723569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:52.729465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:52.739789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:18:52.805850 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:51Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:52.810154 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:18:52.810508 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Updating router c3c35b6e-3277-4fe1-af68-19d25b2aac64 port cb6629e0-9038-4ede-ad35-2ff9d9ec815b binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:18:52.853716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:52.867782 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.084303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.087894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e5d38e7-1146-4215-955b-ebdf75982070 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:53.154341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=e98c7e13-8f92-46dd-a437-43e327feab51,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:53.165108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:53.178743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:18:53.179102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: f41807e1-87e1-4c03-827e-f7ae1d8e456d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:18:53.199733 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.201312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:18:53.212714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, f41807e1-87e1-4c03-827e-f7ae1d8e456d) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:18:53.213855 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Transition to ACTIVE for port object cb6629e0-9038-4ede-ad35-2ff9d9ec815b will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:18:53.216843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:53.217772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.224848 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.226157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3336b6e2-7f24-4d82-b685-787b0dc2b65b None None] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:18:53.229163 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:53.250531 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ddd96e6c-9266-4926-98e2-ce610247533b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6505144 Nov 24 14:18:53.250976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:53.306270 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Attempting to bind port cb6629e0-9038-4ede-ad35-2ff9d9ec815b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:18:53.306641 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Attempting to bind port cb6629e0-9038-4ede-ad35-2ff9d9ec815b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:18:53.307002 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Attempting to bind port cb6629e0-9038-4ede-ad35-2ff9d9ec815b on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:18:53.324793 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Pushing event updated for resources: {'Port': ['ID=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:53.327095 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 18, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:18:53.327462 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:18:53.327878 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.328265 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:18:53.328719 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Bound port: cb6629e0-9038-4ede-ad35-2ff9d9ec815b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:18:53.329086 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.369131 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.369843 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.369843 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.370088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.370408 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.370742 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.371046 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.371359 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.371669 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.372006 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.372314 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:18:53.376345 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:53.416863 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] For port cb6629e0-9038-4ede-ad35-2ff9d9ec815b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:18:53.420610 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] For port cb6629e0-9038-4ede-ad35-2ff9d9ec815b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:18:53.426331 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.431075 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8481617e-5296-42e4-b408-2734ab15d328 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:53.485638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:18:53.486041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.522491 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Pushing event updated for resources: {'Port': ['ID=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:53.526123 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:53.530703 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:53.531322 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:53.662978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Allocated IP 172.20.0.2 (f41807e1-87e1-4c03-827e-f7ae1d8e456d/e98c7e13-8f92-46dd-a437-43e327feab51/aec98070-b402-4994-8739-f1235254092f) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:18:53.729851 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:53.878282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.889145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Transition to ACTIVE for port object aec98070-b402-4994-8739-f1235254092f will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:18:53.907911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Transition to ACTIVE for port object aec98070-b402-4994-8739-f1235254092f will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:18:53.913498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:53.924103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:53.973332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:18:53.976378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:18:53.980424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:18:54.031645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Pushing event updated for resources: {'Port': ['ID=aec98070-b402-4994-8739-f1235254092f,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:54.058687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:54.066261 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:51Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:54.070607 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-431cbe49-a0fb-41ef-85b9-abcad760d3fb None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:51Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:18:54.085629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Attempting to bind port aec98070-b402-4994-8739-f1235254092f on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:18:54.086011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Attempting to bind port aec98070-b402-4994-8739-f1235254092f by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:18:54.086516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Attempting to bind port aec98070-b402-4994-8739-f1235254092f on network f41807e1-87e1-4c03-827e-f7ae1d8e456d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:18:54.098281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 18, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:18:54.098750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Checking segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:18:54.099280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:54.099780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Bound using segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:18:54.100366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Bound port: aec98070-b402-4994-8739-f1235254092f, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:18:54.100811 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:54.200709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:54.202670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] For port aec98070-b402-4994-8739-f1235254092f, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:18:54.206562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] For port aec98070-b402-4994-8739-f1235254092f, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=aec98070-b402-4994-8739-f1235254092f,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:18:54.211807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:54.215466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:54.303008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Pushing event updated for resources: {'Port': ['ID=aec98070-b402-4994-8739-f1235254092f,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:54.308417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:54.692742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (f41807e1-87e1-4c03-827e-f7ae1d8e456d/e98c7e13-8f92-46dd-a437-43e327feab51/e2a6f785-4940-4709-8f69-8b852fe07375) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:18:54.865939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:54.885733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object e2a6f785-4940-4709-8f69-8b852fe07375 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:18:54.909791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:54.914924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5eb6edd9-70af-4b51-ba64-95a8e829f4e4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:54.992545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:18:54.996158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:18:55.000557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:18:55.026901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=e2a6f785-4940-4709-8f69-8b852fe07375,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:55.029180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cb6629e0-9038-4ede-ad35-2ff9d9ec815b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:18:55.033860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:55.066334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.113738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port cb6629e0-9038-4ede-ad35-2ff9d9ec815b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:18:55.119693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port cb6629e0-9038-4ede-ad35-2ff9d9ec815b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:55.119960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.164061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.267074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.288423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port cb6629e0-9038-4ede-ad35-2ff9d9ec815b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:18:55.293423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.294591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device aec98070-b402-4994-8739-f1235254092f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:18:55.334891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:55.428716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-274d826e-389b-419e-99f8-5003b2c96b85 None None] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:18:55.529780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:55.533894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:55.581391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-164c76da-16bf-40f6-b00e-b9cda5983b9a None None] Provisioning for port aec98070-b402-4994-8739-f1235254092f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:18:55.598939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port aec98070-b402-4994-8739-f1235254092f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:18:55.609309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-164c76da-16bf-40f6-b00e-b9cda5983b9a None None] Provisioning complete for port aec98070-b402-4994-8739-f1235254092f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:55.609905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-164c76da-16bf-40f6-b00e-b9cda5983b9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.693368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port aec98070-b402-4994-8739-f1235254092f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:55.693645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.737730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.744685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.773715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0c24250b-cba0-4868-9dc4-51834a52da85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:55.864917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:55.870507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=e2a6f785-4940-4709-8f69-8b852fe07375,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:55.874313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:56.019948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:18:56.021232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:18:56.031689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:56.042714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-164c76da-16bf-40f6-b00e-b9cda5983b9a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:56.114721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port aec98070-b402-4994-8739-f1235254092f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=aec98070-b402-4994-8739-f1235254092f,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:18:56.123275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:56.126089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:56.263640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=aec98070-b402-4994-8739-f1235254092f,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:56.270414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:56.277823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-164c76da-16bf-40f6-b00e-b9cda5983b9a None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:18:56.277823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-164c76da-16bf-40f6-b00e-b9cda5983b9a None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:18:56.471288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:18:56.697844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:18:56.712480 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/c3c35b6e-3277-4fe1-af68-19d25b2aac64/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4578869 Nov 24 14:18:56.716349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:56.858987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d39dcff0-b6dc-423f-88f9-0b90696939ea tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.859667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d39dcff0-b6dc-423f-88f9-0b90696939ea tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.859667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d39dcff0-b6dc-423f-88f9-0b90696939ea tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.860055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d39dcff0-b6dc-423f-88f9-0b90696939ea tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.862406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d39dcff0-b6dc-423f-88f9-0b90696939ea tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2886 time: 0.1448202 Nov 24 14:18:56.865036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48482) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:56.935159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b86f2e46-9507-4831-bdf0-8b5350f61621 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.935527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b86f2e46-9507-4831-bdf0-8b5350f61621 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.935935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b86f2e46-9507-4831-bdf0-8b5350f61621 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.936283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b86f2e46-9507-4831-bdf0-8b5350f61621 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:56.937891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b86f2e46-9507-4831-bdf0-8b5350f61621 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2727 time: 0.0719862 Nov 24 14:18:56.940646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48486) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:56.958271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-558df351-1f15-4fd3-9419-efa1ac635785 None None] Provisioning for port e2a6f785-4940-4709-8f69-8b852fe07375 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:18:56.963176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-558df351-1f15-4fd3-9419-efa1ac635785 None None] Provisioning complete for port e2a6f785-4940-4709-8f69-8b852fe07375 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:56.963554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-558df351-1f15-4fd3-9419-efa1ac635785 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:56.989394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cb6629e0-9038-4ede-ad35-2ff9d9ec815b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:18:57.065657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-558df351-1f15-4fd3-9419-efa1ac635785 None None] Port e2a6f785-4940-4709-8f69-8b852fe07375 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:18:57.091265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-558df351-1f15-4fd3-9419-efa1ac635785 None None] Provisioning complete for port aec98070-b402-4994-8739-f1235254092f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:57.091554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-558df351-1f15-4fd3-9419-efa1ac635785 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.122217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port cb6629e0-9038-4ede-ad35-2ff9d9ec815b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:57.122613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.153881 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1502040-4558-4cb2-aea9-de4b3837a51f tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1607 time: 0.2119300 Nov 24 14:18:57.322043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device aec98070-b402-4994-8739-f1235254092f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:18:57.386250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48492) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:57.392107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-295033975', 'description': 'tempest-secgroup-smoke-295033975 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:57.398977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:57.403617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:57.407080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:57.410963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port aec98070-b402-4994-8739-f1235254092f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:18:57.411350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.414096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:57.425554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.467331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:57.471542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:57.474394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:57.480098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:57.661233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.665037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.668475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36da996f-8f7f-47d5-aebc-197368c23e79 tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:57.705644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:18:57.711941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=45776ee9-1b42-4a72-a0c8-51f7270bc04c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:57.715163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:57.716340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.718023 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.3306923 Nov 24 14:18:57.720843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48496) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:57.722848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:57.723470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:57.727354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '45776ee9-1b42-4a72-a0c8-51f7270bc04c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:57.733326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:57.737339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:57.740175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:57.746100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:57.762440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.826569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.831044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.832981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ecbe929-5260-4ff9-a40c-9c340c516381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:57.856292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=83066bf6-fc3f-4922-954b-46b91df48490,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:57.861793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:57.866665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.869696 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1461439 Nov 24 14:18:57.870816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48500) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:57.876763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '45776ee9-1b42-4a72-a0c8-51f7270bc04c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:57.883211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:57.886978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:57.889818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:57.896471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:57.913076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.915205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:57.979184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.983872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:57.985679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4f434c4-b8d7-49b8-900c-0d2d5efdee4c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:58.007995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c4ef59c1-3505-4d47-a9be-be6b6d9c5e03,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:58.013273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:58.016683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.019337 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1474721 Nov 24 14:18:58.022641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48504) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:58.028811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '45776ee9-1b42-4a72-a0c8-51f7270bc04c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:58.035653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:58.039661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:58.042510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:58.048434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:58.066302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.129607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.133876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.135711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-67959fb3-ec94-4b8c-a4c7-652a73ad1b71 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:58.160763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a0dd9c04-afe6-424a-8fb0-1cdc5e19d73d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:58.163353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:58.172210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.173415 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1497643 Nov 24 14:18:58.176545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48508) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:58.190527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '45776ee9-1b42-4a72-a0c8-51f7270bc04c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:58.196732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:58.200815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:58.203750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:58.210476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:58.232022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.298422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.301314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:58.302996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.304863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2c17e929-a39c-4404-8217-801b8b65041f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:58.305549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:18:58.305908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Updating router c3c35b6e-3277-4fe1-af68-19d25b2aac64 port e2a6f785-4940-4709-8f69-8b852fe07375 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:18:58.329290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c25f5ba6-48df-47f4-bc3e-04f5b8b82e5e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:58.332665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:58.340447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.341688 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1641774 Nov 24 14:18:58.344857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48512) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:58.350388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '45776ee9-1b42-4a72-a0c8-51f7270bc04c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:58.356177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:58.358672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.359965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:58.362822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:58.368585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:58.380106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:18:58.386802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.451856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.455473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.457291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a267451b-9220-48b5-ab33-5e2e132fcb97 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:58.479262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9f408c5-2036-4cab-b5e1-4fefa4253c47,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:58.481699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:58.489652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.490846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1449809 Nov 24 14:18:58.493713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48516) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:18:58.499185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '45776ee9-1b42-4a72-a0c8-51f7270bc04c', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:18:58.505275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:18:58.509087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:18:58.511970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:18:58.517839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:18:58.528292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:18:58.535620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.601360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.605062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.612597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e725dce9-987f-4323-b934-75dcbd61ab29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:58.633323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4d5a8ca0-f232-44f6-9649-f42a41cef0f1,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:58.636300 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:58.641355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.643334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1486704 Nov 24 14:18:58.708423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.720322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Transition to ACTIVE for port object e2a6f785-4940-4709-8f69-8b852fe07375 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:18:58.728376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.731893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:58.824484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-88af499c-6262-4b68-9877-0be77ab26ff4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:18:58.843791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-88af499c-6262-4b68-9877-0be77ab26ff4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:18:58.845157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-88af499c-6262-4b68-9877-0be77ab26ff4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-295033975&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0673285 Nov 24 14:18:58.856451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a202f939-1e31-4bc0-a851-d753979ba179 None None] Pushing event updated for resources: {'Port': ['ID=e2a6f785-4940-4709-8f69-8b852fe07375,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:58.859366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a202f939-1e31-4bc0-a851-d753979ba179 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:58.949382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Attempting to bind port e2a6f785-4940-4709-8f69-8b852fe07375 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:18:58.949956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Attempting to bind port e2a6f785-4940-4709-8f69-8b852fe07375 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:18:58.950324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Attempting to bind port e2a6f785-4940-4709-8f69-8b852fe07375 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:18:58.958071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 18, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:18:58.958513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Checking segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:18:58.958847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:58.959238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Bound using segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:18:58.959706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Bound port: e2a6f785-4940-4709-8f69-8b852fe07375, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:18:58.960114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:59.010809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-b10e2f3a-0710-498a-b1e3-004ba863fb08 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:18:59.012250 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-b10e2f3a-0710-498a-b1e3-004ba863fb08 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 797 time: 0.1597333 Nov 24 14:18:59.028627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-bebf1244-428e-452e-a3e8-08f8a22e3f04 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0110314 Nov 24 14:18:59.048643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] For port e2a6f785-4940-4709-8f69-8b852fe07375, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:18:59.051993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] For port e2a6f785-4940-4709-8f69-8b852fe07375, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e2a6f785-4940-4709-8f69-8b852fe07375,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:18:59.056657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:18:59.060064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:18:59.111724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-db9aa2e0-35bf-4fd3-9ca2-55cad39009b0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:18:59.130168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-db9aa2e0-35bf-4fd3-9ca2-55cad39009b0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:18:59.131991 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-db9aa2e0-35bf-4fd3-9ca2-55cad39009b0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0974514 Nov 24 14:18:59.153986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a202f939-1e31-4bc0-a851-d753979ba179 None None] Pushing event updated for resources: {'Port': ['ID=e2a6f785-4940-4709-8f69-8b852fe07375,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:18:59.157728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a202f939-1e31-4bc0-a851-d753979ba179 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:18:59.162829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:18:59.163345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:18:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:59.299695 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-e1978c3e-fc1a-49b3-b24e-1c5fdafe17ec service neutron] 10.222.0.70 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1524396 Nov 24 14:18:59.374342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:18:59.457724 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-16882f1e-3b81-4c41-aca4-f37862e106b5 service neutron] 10.222.0.70 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1509631 Nov 24 14:18:59.663045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7f7c5fc3-de28-4b65-bf76-43e05a965bbc req-685572ec-b067-4511-a1eb-6fac42a99e23 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 210 time: 0.0456655 Nov 24 14:18:59.751195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:18:59Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:18:59.756219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1f2a52c-9dcf-4479-867d-48e6e6644527 None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:18:59Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:19:00.761172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-4f2edc2e-07f6-4848-8148-6f807afd6af6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:00.762566 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-4f2edc2e-07f6-4848-8148-6f807afd6af6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 797 time: 0.1558321 Nov 24 14:19:00.864866 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1d3308d1-bb4c-4506-827c-693fdcbb8950 req-71301d38-d30c-4a59-a853-bf8e6633c6ce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 210 time: 0.0583656 Nov 24 14:19:00.868060 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-f16c413d-3b11-4df9-ae13-963dd3575e96 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 379 time: 0.0921919 Nov 24 14:19:00.876661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['45776ee9-1b42-4a72-a0c8-51f7270bc04c']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:00.985852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e2a6f785-4940-4709-8f69-8b852fe07375 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:19:01.020132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:01.029476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:01.040286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:19:01.043443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.058292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port e2a6f785-4940-4709-8f69-8b852fe07375 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:19:01.063071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e2a6f785-4940-4709-8f69-8b852fe07375 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:19:01.063447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.209537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.7 (f41807e1-87e1-4c03-827e-f7ae1d8e456d/e98c7e13-8f92-46dd-a437-43e327feab51/6c54e6dc-2927-4d18-98b0-6e0933cc9a88) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:19:01.228340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.261847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port e2a6f785-4940-4709-8f69-8b852fe07375, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e2a6f785-4940-4709-8f69-8b852fe07375,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:01.269185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.271222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:01.343485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=e2a6f785-4940-4709-8f69-8b852fe07375,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:01.347063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:01.507318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.523782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:19:01.544680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.550948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-120ab513-3e30-458e-8367-1563d226bfa6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:01.609908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:19:01.618057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:19:01.622241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:19:01.659269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:01.663775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:01.690397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:01.690998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.718339 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8451536 Nov 24 14:19:01.729911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Request body: {'port': {'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:01.846905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.885552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-30c7de10-4d52-46ca-8c7e-b7124a2d3803 None None] Provisioning for port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:19:01.890619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-30c7de10-4d52-46ca-8c7e-b7124a2d3803 None None] Provisioning complete for port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:19:01.890932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-30c7de10-4d52-46ca-8c7e-b7124a2d3803 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:01.945911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-30c7de10-4d52-46ca-8c7e-b7124a2d3803 None None] Port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:19:02.068622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea24c7a2-9eab-4999-97ee-d247b079379a req-5b9bceed-9669-48a8-9706-ed78c8b0132d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:02.069972 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ea24c7a2-9eab-4999-97ee-d247b079379a req-5b9bceed-9669-48a8-9706-ed78c8b0132d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 931 time: 0.0776341 Nov 24 14:19:02.116853 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ea24c7a2-9eab-4999-97ee-d247b079379a req-ec173ea9-2a7d-429d-8a66-f20a0cef04df tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410910 Nov 24 14:19:02.210277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:19:02.217359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:02.233011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Transition to ACTIVE for port object 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:19:02.237479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:02.241305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:02.370860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:02.397810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:02.477635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Attempting to bind port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:19:02.477959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Attempting to bind port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:19:02.478276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Attempting to bind port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:19:02.483948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:19:02.484265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Attempting to bind port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:19:02.490721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 18, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:19:02.491043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Checking segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:19:02.491419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Bound using segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:19:02.491859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Bound port: 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:19:02.492196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:02.577743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:19:02.581387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:19:02.586092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:02.590317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1cac34c6-fea6-40a3-9487-edb7ea02abcb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:02.646754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:02.648138 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] 10.222.0.47 "PUT /v2.0/ports/6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 1093 time: 0.9224870 Nov 24 14:19:02.648697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:19:02.672579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:02.676236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:02.724564 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'status': 'completed', 'code': 200} Nov 24 14:19:02.762398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-810e97d5-a5fd-4f0c-ae27-30e855f97e1c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1096 time: 0.0771446 Nov 24 14:19:02.835928 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-11b5a615-b062-4cad-9196-16f0a7b36fbc service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 217 time: 0.0652475 Nov 24 14:19:02.901711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-6f07a9cc-74a4-4221-9aec-162e8a0a6d64 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:02.903131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-6f07a9cc-74a4-4221-9aec-162e8a0a6d64 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0600173 Nov 24 14:19:02.966145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e2a6f785-4940-4709-8f69-8b852fe07375 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:19:02.981386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-62048bea-1e70-44fa-a9a0-e6dc39962133 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0718632 Nov 24 14:19:03.035186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e2a6f785-4940-4709-8f69-8b852fe07375 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:19:03.035563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:03.116179 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-eaba260c-d1c7-464c-8e60-7db8ca841ec2 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280825 Nov 24 14:19:03.222054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-33c51000-b9f9-44ae-812f-d30a095fca9a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:03.257259 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4a8b4129-1838-4b92-8c97-0bbb8d0710e7 req-baa91db3-c860-4f10-8405-d7c0ee6ced69 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1350834 Nov 24 14:19:03.331655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2214297b-7b69-4194-b1d1-78503acdad29 req-f74fbe02-5493-4882-a50b-1c886efb0e00 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:03.333225 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2214297b-7b69-4194-b1d1-78503acdad29 req-f74fbe02-5493-4882-a50b-1c886efb0e00 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 943 time: 0.0868793 Nov 24 14:19:03.384216 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2214297b-7b69-4194-b1d1-78503acdad29 req-d2eddcef-f50a-458e-88a7-96637af9a89b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453398 Nov 24 14:19:03.477914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-201800af-c470-43a0-a5c3-88028c1236d9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1096 time: 0.1763330 Nov 24 14:19:03.598247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:03.611579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-b85de8ad-e031-4bf9-a7e6-a89527881d42 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:03.613037 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-b85de8ad-e031-4bf9-a7e6-a89527881d42 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1292472 Nov 24 14:19:03.684876 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-714b6d01-9e28-4080-9bbb-72bb21b67be7 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 217 time: 0.0655813 Nov 24 14:19:03.747995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-f1ec046e-5c3d-44d7-99d6-55b618af0217 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:03.749311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-f1ec046e-5c3d-44d7-99d6-55b618af0217 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0583770 Nov 24 14:19:03.825237 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-7c93c546-8d8f-45d5-bcec-b0f521c9008a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0695333 Nov 24 14:19:03.958629 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-67813f83-bb98-46eb-babc-03cee50ac52b service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256113 Nov 24 14:19:04.092313 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3aa31af2-f306-4845-87a9-71c4a749f6a2 req-89eb0ce2-8f28-40dd-9d32-1fd923984322 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260090 Nov 24 14:19:04.584188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd6d475-bcaf-4114-a223-df0a512a39da req-57335b8f-d883-47d1-a358-76be1cdc055b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:04.584909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-efd6d475-bcaf-4114-a223-df0a512a39da req-57335b8f-d883-47d1-a358-76be1cdc055b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:19:04.601284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-efd6d475-bcaf-4114-a223-df0a512a39da req-57335b8f-d883-47d1-a358-76be1cdc055b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:19:04.602457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-efd6d475-bcaf-4114-a223-df0a512a39da req-57335b8f-d883-47d1-a358-76be1cdc055b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 943 time: 0.0934217 Nov 24 14:19:04.647464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-efd6d475-bcaf-4114-a223-df0a512a39da req-f644023e-61af-48f0-8b69-28b911a1fc6d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394917 Nov 24 14:19:05.794135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-02ca3ef7-9e6a-47a0-8e0b-273758c963b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:05.841238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa495f9-cbe3-4f67-b8ee-623f598154d6 req-de8add6e-8cc2-404e-ba09-073f7590c8b6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:05.842922 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6fa495f9-cbe3-4f67-b8ee-623f598154d6 req-de8add6e-8cc2-404e-ba09-073f7590c8b6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 943 time: 0.0766757 Nov 24 14:19:05.891745 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6fa495f9-cbe3-4f67-b8ee-623f598154d6 req-e581116d-94c0-4e05-b753-e1beeb03ec80 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426896 Nov 24 14:19:06.769371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:06.867064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:19:06.998564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:07.012988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 872, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:19:07.070733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:07.088100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:19:07.092607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f4101b-273e-4c75-ae37-6f1b680665ba req-aa6c3b79-2180-4774-a4a4-f1816dd98fd6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:07.094031 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-32f4101b-273e-4c75-ae37-6f1b680665ba req-aa6c3b79-2180-4774-a4a4-f1816dd98fd6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 943 time: 0.0809388 Nov 24 14:19:07.104077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:07.109424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:07.112989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b23005db-de67-4595-9a5d-9ef2e7e9acf8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:07.143358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-32f4101b-273e-4c75-ae37-6f1b680665ba req-f66e4007-9591-401e-8deb-5c05128f1ee5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433793 Nov 24 14:19:07.189725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:07.192886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:07.479772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['6c54e6dc-2927-4d18-98b0-6e0933cc9a88'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:19:08.343609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4433192-c718-442c-baed-a979a9c02175 req-59340010-4a3f-4487-bad1-71e8f836f7d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:08.345135 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b4433192-c718-442c-baed-a979a9c02175 req-59340010-4a3f-4487-bad1-71e8f836f7d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 944 time: 0.0810480 Nov 24 14:19:08.396660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b4433192-c718-442c-baed-a979a9c02175 req-7a6453ec-ec27-42ce-904a-82c7b8cc16f7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431666 Nov 24 14:19:08.450905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:08.873347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:19:08.946573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:19:08.952451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:19:08.952854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:09.069402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:09.096887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:19:09.106644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:09.111367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:09.113384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ad04c8db-9a41-439e-bee9-b0066636f830 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:09.157195 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'code': 200} Nov 24 14:19:09.182731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:09.185927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:09.389826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5913abd4-4a44-49db-bb1f-d9d192140a37 req-aa30e719-b145-405e-9f24-5704154c06e5 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1098 time: 0.0688257 Nov 24 14:19:09.433752 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5913abd4-4a44-49db-bb1f-d9d192140a37 req-343964f3-da49-4f5f-8c49-7922415c0979 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375655 Nov 24 14:19:09.714571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b974be-6328-4308-9810-5883b51f180e req-0c88bae5-c378-4f07-b5ec-04ace86f24ec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:09.715939 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-84b974be-6328-4308-9810-5883b51f180e req-0c88bae5-c378-4f07-b5ec-04ace86f24ec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 945 time: 0.1861677 Nov 24 14:19:09.761407 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-84b974be-6328-4308-9810-5883b51f180e req-a6585812-3645-43e9-9b6c-d38b6db4179b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390313 Nov 24 14:19:10.966201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05fd265b-b6c3-4977-8ce4-26e92d0af947 req-af308d66-c6ea-4394-959e-2cfc1c157741 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:10.967920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05fd265b-b6c3-4977-8ce4-26e92d0af947 req-af308d66-c6ea-4394-959e-2cfc1c157741 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 945 time: 0.0840225 Nov 24 14:19:11.018770 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05fd265b-b6c3-4977-8ce4-26e92d0af947 req-db8dd220-7db8-44af-b044-a8725306c960 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446701 Nov 24 14:19:11.215133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d46b9f4-c40d-444f-8a40-86167ad9e05e req-85a1f781-143e-457e-ab08-87ad94beacba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:11.216621 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5d46b9f4-c40d-444f-8a40-86167ad9e05e req-85a1f781-143e-457e-ab08-87ad94beacba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 945 time: 0.0806634 Nov 24 14:19:11.264622 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5d46b9f4-c40d-444f-8a40-86167ad9e05e req-af794806-ead1-4cb8-b177-8d265dd8ccb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415819 Nov 24 14:19:11.294239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48566) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:11.363271 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d1f365d1-1f16-49b7-b4cc-66053a4c9640 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1093 time: 0.0676930 Nov 24 14:19:11.365718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48570) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:11.371020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:11.377203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:11.381114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:11.384007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:11.389775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:11.399866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:11.533699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:11.671058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.144 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/f4b52aae-dfc6-4e9d-a181-1ed403c80e67) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:19:11.819555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:11.847470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:11.851599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1131edec-2aa0-4ead-8dea-244fdb3f979d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:12.018826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:19:12.022228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:19:12.024254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=f4b52aae-dfc6-4e9d-a181-1ed403c80e67,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:12.026280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:19:12.054133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:12.539313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:12.594019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:12.797143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:12.802395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:12.806811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:12.907366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=f4b52aae-dfc6-4e9d-a181-1ed403c80e67,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:12.911550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:12.926294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:13.125927 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 099b690a-4e53-4172-b4d2-596d314033e1 associated. External IP: 172.26.4.144, port: 6c54e6dc-2927-4d18-98b0-6e0933cc9a88. Nov 24 14:19:13.639484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:19:13.842598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:19:13.853985 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:19:13.868505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:13.868786 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:19:13.869406 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:19:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:13.928637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48574) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:13.929228 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5620184 Nov 24 14:19:13.929532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:19:13.993966 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'status': 'completed', 'code': 200} Nov 24 14:19:14.018557 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9b48899e-453d-4d2f-9be7-6491ab4b2afc tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1093 time: 0.0867295 Nov 24 14:19:14.072748 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:19:14.107456 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-06bc725b-70d1-44bb-a2c0-918810888269 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1098 time: 0.0857792 Nov 24 14:19:14.258489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-33cda836-c11a-4bce-884c-464345988c4b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:14.261362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-33cda836-c11a-4bce-884c-464345988c4b service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1473594 Nov 24 14:19:14.413328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:14.416747 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-b27f5b3e-d520-49f3-b8de-03a3b71b8bf3 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 999 time: 0.1454461 Nov 24 14:19:14.422274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-140488020', 'description': 'tempest-secgroup-smoke-140488020 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:14.429720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:14.441071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:14.452952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.496190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-a7e6bb0e-0fbd-4217-a857-9a38a303dcb8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:14.498055 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-a7e6bb0e-0fbd-4217-a857-9a38a303dcb8 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0749593 Nov 24 14:19:14.502586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:14.507576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:14.510941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:12. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:14.517715 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:12Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:14.518311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 12; quota limit: 100; headroom:88 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:14.521864 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:19:14.534801 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:19:14.535790 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:19:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:14.587348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.593703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.597668 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-5706d284-f479-4646-a640-4a10545b49a3 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0923212 Nov 24 14:19:14.598850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f07aeffb-a42e-4469-86ab-01a9418f0507 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:14.640001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5e3d99d0-440f-4a2b-8642-ba05ce24d08f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:14.652655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.653038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.653419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.653792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.654161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.654530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.654895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.655262 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.655625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.656013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.656440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:19:14.661503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:14.666957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.671732 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.2546041 Nov 24 14:19:14.672595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48586) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:14.683722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '5e3d99d0-440f-4a2b-8642-ba05ce24d08f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:14.690983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:14.694911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:14.698232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:14. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:14.704219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 14; quota limit: 100; headroom:86 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:14.724404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.755118 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:19:14.756814 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-80187e1d-6a16-449f-8336-0376b60c3395 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1525116 Nov 24 14:19:14.791646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.796456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.798386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-922df4f2-4c19-4a8a-856a-af4d18ffc8f0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:14.820873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f1ef3514-d3fb-4707-9f32-0a31bea87956,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:14.823342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:14.832493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.836420 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1627378 Nov 24 14:19:14.836985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48590) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:14.842993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '5e3d99d0-440f-4a2b-8642-ba05ce24d08f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:14.849489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:14.853610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:14.856479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:15. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:14.862283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 15; quota limit: 100; headroom:85 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:14.880595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.903731 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed36e959-a6bd-4798-b73d-2b131437a981 req-47f90598-abd9-48ed-b7ed-c8eb4959ab5a service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1403370 Nov 24 14:19:14.950629 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.955874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.958299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8382bf21-7b36-4735-abfe-d6eea3791d2e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:14.981856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4797a649-49b2-4059-aa81-ac460a33d793,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:14.986614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:14.991423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:14.995473 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1547954 Nov 24 14:19:14.995641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:15.001667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '5e3d99d0-440f-4a2b-8642-ba05ce24d08f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:15.007877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:15.011603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:15.014449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:16. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:15.021556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 16; quota limit: 100; headroom:84 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:15.039641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.108996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.114350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.116179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:15.141603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58c70177-195c-4fec-9968-9f5ebc1fbd03,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:15.144461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:15.152872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.154068 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1575286 Nov 24 14:19:15.156761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:15.162434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '5e3d99d0-440f-4a2b-8642-ba05ce24d08f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:15.165740 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:12Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:15.168889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:15.170044 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b5148-3ab6-4c2b-8613-7ef6c64f299f None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:12Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:19:15.172886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:15.176536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:17. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:15.182282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 17; quota limit: 100; headroom:83 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:15.203327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.275093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.279530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.286167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:15.306252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=231197ac-8427-4756-8b3a-2e4e57566604,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:15.312118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:15.317859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.321745 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1613784 Nov 24 14:19:15.321925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48602) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:15.327491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '5e3d99d0-440f-4a2b-8642-ba05ce24d08f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:15.334010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:15.337988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:15.341184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:18. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:15.347596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 18; quota limit: 100; headroom:82 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:15.358566 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:19:15.367032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.390541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ef8e59-5622-400a-8c5f-28ac652e07d5 None None] New status for floating IP 099b690a-4e53-4172-b4d2-596d314033e1: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:19:15.437214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.442866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.444895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c407b180-5ec2-4077-a2ef-5503c4586aeb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:15.468935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=11917c1f-5d32-4724-bb2b-2015ab08e207,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:15.472053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:15.479499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.483588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1579287 Nov 24 14:19:15.483796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48606) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:15.489501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '5e3d99d0-440f-4a2b-8642-ba05ce24d08f', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:15.495422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:15.499193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:15.502828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:19. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:15.508730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 19; quota limit: 100; headroom:81 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:15.520767 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:19:15.527334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.600828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.604995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.606864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a299a0fa-9cc2-43ae-80af-4de78bee5b04 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:15.630279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44e9a121-3b31-4177-a0d7-cb0048b53c5c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:15.632847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:15.641205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:15.643279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1584837 Nov 24 14:19:15.826910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-c4a66296-a828-4b74-8740-8768d73122fc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-140488020&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.0483618 Nov 24 14:19:15.974074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-b0198cf9-c7b4-4e41-8ad9-c75844cbdfaf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:15.975495 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-b0198cf9-c7b4-4e41-8ad9-c75844cbdfaf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 797 time: 0.1422005 Nov 24 14:19:15.992620 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-bbc51095-6fde-42cd-8d7f-880fa4e4f03e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0117443 Nov 24 14:19:16.078762 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a252dbe2-6880-49bb-880c-9dbe4620b624 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0794711 Nov 24 14:19:16.213811 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-663b181d-1695-4cee-87bb-3af478078332 service neutron] 10.222.0.70 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1234658 Nov 24 14:19:16.347315 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-db384881-befd-4a5c-b55b-3cb3d40604af service neutron] 10.222.0.70 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273668 Nov 24 14:19:16.537588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cde5fe91-33a6-43b9-ab66-61cc6b2b9a18 req-e1ac9d4a-d4bf-497c-b13a-45edd8dd3599 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 210 time: 0.0428226 Nov 24 14:19:17.723135 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad99e6dd-eff2-430c-bfd1-6c5a8d836fae req-1b95a4f0-39a1-4bda-83d0-83d68c9e8e29 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 210 time: 0.0549765 Nov 24 14:19:17.764448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-642560a8-d4ea-4bee-b8ef-c2fef8e895e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:17.765832 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-642560a8-d4ea-4bee-b8ef-c2fef8e895e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 797 time: 0.3163745 Nov 24 14:19:17.824157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-0fe8522a-2ebc-4161-b321-c4c1ae588384 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 471 time: 0.0417876 Nov 24 14:19:17.833264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['5e3d99d0-440f-4a2b-8642-ba05ce24d08f']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:17.839242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:17.966865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:17.976441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:17.985918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:19:17.989305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:18.155218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.13 (f41807e1-87e1-4c03-827e-f7ae1d8e456d/e98c7e13-8f92-46dd-a437-43e327feab51/a47adea2-b1e8-4918-b308-f90ee2d02e83) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:19:18.347228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:18.363481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object a47adea2-b1e8-4918-b308-f90ee2d02e83 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:19:18.384940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:18.391346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a91bd02-4fc2-47a2-8915-10b64bbcba66 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:18.465342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:19:18.468942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:19:18.472455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:19:18.498037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=a47adea2-b1e8-4918-b308-f90ee2d02e83,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:18.503827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:18.536691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:18.537411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:18.565354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7364242 Nov 24 14:19:18.576822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Request body: {'port': {'device_id': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:18.689171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:18.714700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ed67afd0-b371-4964-8610-d2707bdee682 None None] Provisioning for port a47adea2-b1e8-4918-b308-f90ee2d02e83 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:19:18.720701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ed67afd0-b371-4964-8610-d2707bdee682 None None] Provisioning complete for port a47adea2-b1e8-4918-b308-f90ee2d02e83 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:19:18.721139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ed67afd0-b371-4964-8610-d2707bdee682 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:18.776355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ed67afd0-b371-4964-8610-d2707bdee682 None None] Port a47adea2-b1e8-4918-b308-f90ee2d02e83 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:19:18.928568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03af6844-0403-466f-86fe-3c65c8b058c7 req-789a104d-ea5a-4389-9c04-0ec7541d808e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:18.930044 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-03af6844-0403-466f-86fe-3c65c8b058c7 req-789a104d-ea5a-4389-9c04-0ec7541d808e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 932 time: 0.0772521 Nov 24 14:19:18.980602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-03af6844-0403-466f-86fe-3c65c8b058c7 req-ad677133-a78c-44fb-8062-85f83ff2a687 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:19:18.995965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-03af6844-0403-466f-86fe-3c65c8b058c7 req-ad677133-a78c-44fb-8062-85f83ff2a687 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:19:18.997174 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-03af6844-0403-466f-86fe-3c65c8b058c7 req-ad677133-a78c-44fb-8062-85f83ff2a687 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0612674 Nov 24 14:19:19.033742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a47adea2-b1e8-4918-b308-f90ee2d02e83 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:19:19.040780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:19.055748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Transition to ACTIVE for port object a47adea2-b1e8-4918-b308-f90ee2d02e83 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:19:19.059394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:19.063680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16c56f11-05d5-4f45-b758-983914f16990 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:19.189317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Pushing event updated for resources: {'Port': ['ID=a47adea2-b1e8-4918-b308-f90ee2d02e83,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:19.193596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:19.307332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Attempting to bind port a47adea2-b1e8-4918-b308-f90ee2d02e83 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:19:19.307667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Attempting to bind port a47adea2-b1e8-4918-b308-f90ee2d02e83 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:19:19.308023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Attempting to bind port a47adea2-b1e8-4918-b308-f90ee2d02e83 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:19:19.314368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Port a47adea2-b1e8-4918-b308-f90ee2d02e83 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:19:19.314691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Attempting to bind port a47adea2-b1e8-4918-b308-f90ee2d02e83 on network f41807e1-87e1-4c03-827e-f7ae1d8e456d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:19:19.320910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 19, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:19:19.321234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Checking segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:19:19.321614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Bound using segment: {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:19:19.322035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Bound port: a47adea2-b1e8-4918-b308-f90ee2d02e83, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c7026dc6-4457-4131-9ad4-61f1a2043d04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:19:19.322376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:19.409173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] For port a47adea2-b1e8-4918-b308-f90ee2d02e83, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:19:19.412124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] For port a47adea2-b1e8-4918-b308-f90ee2d02e83, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:19:19.416642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:19.420759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ea74cf30-fb00-4155-aa1d-af1e8c64a761 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:19.581987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:19.583376 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] 10.222.0.47 "PUT /v2.0/ports/a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 200 len: 1094 time: 1.0108404 Nov 24 14:19:19.583920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:19:19.611126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Pushing event updated for resources: {'Port': ['ID=a47adea2-b1e8-4918-b308-f90ee2d02e83,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:19.614165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:19.668984 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'status': 'completed', 'code': 200} Nov 24 14:19:19.713694 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-2608b7a8-eee9-439f-8e96-396ab6bfe40b service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1097 time: 0.0819921 Nov 24 14:19:19.785496 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-3fd6cad6-e1bc-4d1d-9501-8cde2719fbda service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 200 len: 217 time: 0.0637875 Nov 24 14:19:19.851138 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-b452967b-fdef-43bc-8536-d8eb95bababb service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:19.852470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-b452967b-fdef-43bc-8536-d8eb95bababb service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0610447 Nov 24 14:19:19.936499 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-133e1410-ad34-47ff-b916-498d347cdfef service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0711777 Nov 24 14:19:20.073057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-ebb00bd5-2d68-47c6-802f-2dcbeaabb42f service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272047 Nov 24 14:19:20.201588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bc2bec3-f924-4c7f-95c9-bff71db16eb2 req-843a97c8-3aa5-46a1-86b2-e1bd786fe0ee tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:20.203135 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8bc2bec3-f924-4c7f-95c9-bff71db16eb2 req-843a97c8-3aa5-46a1-86b2-e1bd786fe0ee tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 944 time: 0.0817225 Nov 24 14:19:20.221286 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9364be4a-1fa5-40e8-a61d-3f68666c47ec req-c87b76cf-85f3-4417-ab0e-3290dfd824dd service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1315875 Nov 24 14:19:20.253921 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8bc2bec3-f924-4c7f-95c9-bff71db16eb2 req-e5b0f55f-226c-4f56-bd78-336256f75991 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443950 Nov 24 14:19:20.334585 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-acd482bb-ba76-473a-b61a-f7ef85095b51 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1097 time: 0.0708513 Nov 24 14:19:20.466690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-14d3dc41-138b-490a-9c2c-47736c5590bd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:20.468413 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-14d3dc41-138b-490a-9c2c-47736c5590bd service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1275465 Nov 24 14:19:20.552902 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-fd6b9f24-a5d3-4444-89aa-2aab0bc76f4f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 200 len: 217 time: 0.0636711 Nov 24 14:19:20.625524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-8b890edd-9747-471b-b832-d1418350211d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:20.627649 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-8b890edd-9747-471b-b832-d1418350211d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0580819 Nov 24 14:19:20.707162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-3c77d75f-6722-4906-8de2-7238c5c871fc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0707316 Nov 24 14:19:20.848240 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-f53b2550-bcfc-47ff-ab37-287fb50f6b55 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261652 Nov 24 14:19:20.985773 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1758df9-2eb8-4db4-9d60-66931a397f93 req-2b29daf1-d158-4aae-b7c0-1ce446ec86dd service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256933 Nov 24 14:19:21.455858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29cc07d-220d-438a-b7c7-98105f01ad0f req-1794bf8c-19da-41ea-bac6-e2bb913c9962 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:21.456558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d29cc07d-220d-438a-b7c7-98105f01ad0f req-1794bf8c-19da-41ea-bac6-e2bb913c9962 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:19:21.473592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d29cc07d-220d-438a-b7c7-98105f01ad0f req-1794bf8c-19da-41ea-bac6-e2bb913c9962 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:19:21.474761 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d29cc07d-220d-438a-b7c7-98105f01ad0f req-1794bf8c-19da-41ea-bac6-e2bb913c9962 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 944 time: 0.0950780 Nov 24 14:19:21.521889 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d29cc07d-220d-438a-b7c7-98105f01ad0f req-69ad8bc7-13ab-4e1b-9789-22d3de1c6650 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414362 Nov 24 14:19:22.722791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21976500-58bf-4083-82f1-6132f4b17473 req-e3c3fc6b-0003-4ae9-8a60-7b0d3c76acd0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:22.724257 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-21976500-58bf-4083-82f1-6132f4b17473 req-e3c3fc6b-0003-4ae9-8a60-7b0d3c76acd0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 944 time: 0.0812314 Nov 24 14:19:22.771040 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-21976500-58bf-4083-82f1-6132f4b17473 req-16cedecc-964b-42cf-a924-cee252c6d09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410817 Nov 24 14:19:22.952969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a47adea2-b1e8-4918-b308-f90ee2d02e83 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:19:23.085044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a47adea2-b1e8-4918-b308-f90ee2d02e83, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:23.098757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'port_id': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'mac_address': 'fa:16:3e:31:ea:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 872, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:19:23.151832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:23.172368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a47adea2-b1e8-4918-b308-f90ee2d02e83 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:19:23.188122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a47adea2-b1e8-4918-b308-f90ee2d02e83, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:23.192213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:23.195222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:23.263032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a47adea2-b1e8-4918-b308-f90ee2d02e83,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:23.266211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:23.518462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['a47adea2-b1e8-4918-b308-f90ee2d02e83'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:19:23.971100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c685f3-f26c-4db7-be2c-f80b666257fc req-147f3a81-41ed-417d-957a-b33608f6e318 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:23.972548 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c0c685f3-f26c-4db7-be2c-f80b666257fc req-147f3a81-41ed-417d-957a-b33608f6e318 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 945 time: 0.0805154 Nov 24 14:19:24.018088 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c0c685f3-f26c-4db7-be2c-f80b666257fc req-478a0ee0-f6f2-4545-b1a0-4abe9c489515 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398245 Nov 24 14:19:24.997785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a47adea2-b1e8-4918-b308-f90ee2d02e83 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:19:25.068500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port a47adea2-b1e8-4918-b308-f90ee2d02e83 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:19:25.073957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port a47adea2-b1e8-4918-b308-f90ee2d02e83 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:19:25.074315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:25.201658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:25.223201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67370f5d-bdb5-4d15-ae34-c52e0d158925 req-fe3daf3b-f97e-4adf-83ad-01fc435cacad tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:25.228281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-67370f5d-bdb5-4d15-ae34-c52e0d158925 req-fe3daf3b-f97e-4adf-83ad-01fc435cacad tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 945 time: 0.0875955 Nov 24 14:19:25.242229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:19:25.252756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a47adea2-b1e8-4918-b308-f90ee2d02e83, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:19:25.258420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:25.260319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-dd78f71d-c684-4573-bc15-b2ff5599f866 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:25.289026 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-67370f5d-bdb5-4d15-ae34-c52e0d158925 req-d0caa337-c06c-4a50-ba87-6536ae352ef0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587230 Nov 24 14:19:25.313704 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'code': 200} Nov 24 14:19:25.347803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a47adea2-b1e8-4918-b308-f90ee2d02e83,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:25.350579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:25.541252 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4fdd041-5227-414a-b904-01ac82ffde4f req-cbf15ece-2403-4582-840b-b34b7b167222 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1099 time: 0.0682878 Nov 24 14:19:25.589970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4fdd041-5227-414a-b904-01ac82ffde4f req-0a4b4f0b-bd63-4a99-9109-fb5ee8088cee service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430808 Nov 24 14:19:25.806391 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:19:26.487584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a1ee675-0d53-4cd5-954d-1752cfad9c61 req-b6b17f95-55de-43ad-9e6d-bc78f81b814f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:26.489091 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2a1ee675-0d53-4cd5-954d-1752cfad9c61 req-b6b17f95-55de-43ad-9e6d-bc78f81b814f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 946 time: 0.0860426 Nov 24 14:19:26.534985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2a1ee675-0d53-4cd5-954d-1752cfad9c61 req-90fc5bfc-2c56-477e-bb7c-ebd9fe11204d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401258 Nov 24 14:19:27.837299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b32695-d4be-43bb-ac7c-08380c3c9868 req-42bfd723-d043-4137-ba39-92618539de65 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:27.838664 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b32695-d4be-43bb-ac7c-08380c3c9868 req-42bfd723-d043-4137-ba39-92618539de65 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 946 time: 0.1775136 Nov 24 14:19:27.883698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b32695-d4be-43bb-ac7c-08380c3c9868 req-4f2d9159-99f6-4ee2-ab34-5da8b3626758 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392153 Nov 24 14:19:28.091642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3c9e90-7524-403f-9ecb-164fcf75169a req-ccebb66f-7687-4f69-97dc-4e9cff98ae43 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:28.093276 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0a3c9e90-7524-403f-9ecb-164fcf75169a req-ccebb66f-7687-4f69-97dc-4e9cff98ae43 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 946 time: 0.0788555 Nov 24 14:19:28.143128 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0a3c9e90-7524-403f-9ecb-164fcf75169a req-ff9ef9b3-97ae-43cf-afb0-a722b960ba88 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436747 Nov 24 14:19:28.170121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48652) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:28.241843 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fcd95506-8c2d-4ec6-b24c-4cc71978f48a tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1094 time: 0.0704172 Nov 24 14:19:28.244436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48656) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:19:28.249581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:19:28.256421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:19:28.260289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:19:28.263130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:19:28.272309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:19:28.284274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:28.424403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:28.570881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.238 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/c2adc485-0f2a-45f6-9603-a2c2a07c6e5e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:19:28.728638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:28.759016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:28.763307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:28.835292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:19:28.838756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:19:28.841333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:19:28.877715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=c2adc485-0f2a-45f6-9603-a2c2a07c6e5e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:28.880502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:29.466779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:29.527724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:29.734595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:29.739224 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:29.742864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f02d7472-f891-4011-bbf0-93e6655385b2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:19:29.843488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=c2adc485-0f2a-45f6-9603-a2c2a07c6e5e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:19:29.847779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:19:29.861951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:30.050834 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP e75ea865-001f-46fa-b718-11fc76814985 associated. External IP: 172.26.4.238, port: a47adea2-b1e8-4918-b308-f90ee2d02e83. Nov 24 14:19:30.449160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:19:30.771783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:19:30.781368 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:19:30.795694 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:19:30.796339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:30.796633 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:19:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:30.854228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.6087909 Nov 24 14:19:30.854875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:19:30.911048 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'status': 'completed', 'code': 200} Nov 24 14:19:30.980704 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:19:31.003737 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-f2d4cd62-6179-4e8a-a619-9c8bb516b740 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1099 time: 0.0702167 Nov 24 14:19:31.134663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-ca4e0987-a54a-423b-95d0-16799a0e116a service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:31.136224 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-ca4e0987-a54a-423b-95d0-16799a0e116a service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1264207 Nov 24 14:19:31.243129 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-76b3aa44-9ed4-419e-85f3-0b59d1448ee6 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 200 len: 1000 time: 0.1000171 Nov 24 14:19:31.311550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-9dccb17f-32c2-4d64-80fe-be883a54855c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:31.313505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-9dccb17f-32c2-4d64-80fe-be883a54855c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0635979 Nov 24 14:19:31.337619 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:15Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}, {'id': 'e75ea865-001f-46fa-b718-11fc76814985', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.238', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:31:ea:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:29Z', 'updated_at': '2021-11-24T14:19:29Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:31.341583 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:19:31.353126 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:19:31.353730 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:19:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:31.389996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-8a474ac1-74d9-42d4-a964-abef6d214e28 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0703719 Nov 24 14:19:31.523983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-cc992861-bf21-4a62-b71e-348999921e2d service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266594 Nov 24 14:19:31.528906 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:19:31.660545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40ccee56-91cb-494a-803d-b96d508e8f87 req-441fb97f-7084-4d1d-ba74-f55d53b0ef1c service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293235 Nov 24 14:19:31.902741 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:15Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}, {'id': 'e75ea865-001f-46fa-b718-11fc76814985', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.238', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:31:ea:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:29Z', 'updated_at': '2021-11-24T14:19:29Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:19:31.906612 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe1dcb00-a213-4cb6-b981-74887682e367 None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:15Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}, {'id': 'e75ea865-001f-46fa-b718-11fc76814985', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.238', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:31:ea:58', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:29Z', 'updated_at': '2021-11-24T14:19:29Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:19:32.120553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-113b3cbf-ec25-4781-886a-f3ab3d787475 None None] New status for floating IP e75ea865-001f-46fa-b718-11fc76814985: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:19:33.215432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-41e1493e-63ea-4324-a58b-079eb19ee95b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:33.603238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:35.798435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-191d0192-6745-4034-9ada-b01fff65e7ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:36.771466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:38.454784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:47.836873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:19:49.967966 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-6bcc5cc8-f44f-4409-99d0-3613c86e2638 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0681758 Nov 24 14:19:50.110045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-1e1acbaa-22b6-4ebc-aa84-85fa277835f9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1098 time: 0.0733678 Nov 24 14:19:50.256000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-6d8501db-35a9-4c2e-a099-8335e3ea5b07 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:50.257329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-6d8501db-35a9-4c2e-a099-8335e3ea5b07 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1282594 Nov 24 14:19:50.361545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-28579e4d-7132-43c5-be0c-1fece1640b27 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 1001 time: 0.0973110 Nov 24 14:19:50.424770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-77c6c648-8616-4e84-b29f-28366bbea221 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:19:50.426188 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-77c6c648-8616-4e84-b29f-28366bbea221 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0586419 Nov 24 14:19:50.501694 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-d7f3f8a7-a66b-4461-ab0b-018d6eb18f5d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0685670 Nov 24 14:19:50.631510 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-c81a64c1-a51e-48cf-a732-85dc451d8fc7 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1234250 Nov 24 14:19:50.764726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e41cbefa-c75d-434b-b4f5-6e991ddfe9a1 req-617da724-0916-4988-801e-d020a467b33d service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1270082 Nov 24 14:20:02.806161 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:20:03.218764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54a41b94-db64-4739-99de-21da16a94579 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:03.605164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:05.792985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66a051c3-7e12-409d-8817-5f89a9ee31e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:06.771981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:08.457293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:17.847497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:29.556728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-e9892f49-a099-4455-9c10-49a85f6389a2 req-0b8a4823-b87b-433d-8717-f81c0df14599 service neutron] (83526) timed out ('10.222.0.47', 52478) {{(pid=83526) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} Nov 24 14:20:33.222286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b0e1d17-90ab-48d4-ba58-ea54c5efdcaa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:33.607446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:35.794480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2685ca67-bc19-4f98-8a26-aef458476269 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:36.776988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:38.461450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:39.808039 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:20:46.382963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48686) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:20:46.489326 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b491328f-998f-44c3-9efc-3afa46d97769 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/099b690a-4e53-4172-b4d2-596d314033e1 HTTP/1.1" status: 200 len: 993 time: 0.1051500 Nov 24 14:20:47.601757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48698) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:20:47.607675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'admin_state_up': False}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:20:47.725431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:47.868346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:47.948149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:20:47.974296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:47.978787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:47.982450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-078f367c-042c-4bad-a586-b128de93d205 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:20:48.057430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:48.058177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:48.059699 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/ports/6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 938 time: 0.4570005 Nov 24 14:20:48.060397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:20:48.079808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=6']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:20:48.089750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.090139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.090514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.090884 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.091258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.091615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.092265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.092677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.093326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.093641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.093985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:20:48.098334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:20:48.140364 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'status': 'completed', 'code': 200} Nov 24 14:20:48.261957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2c8b3761-7f98-4315-b11e-6ddc7dd95e42 None None] Provisioning complete for port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:20:48.262339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2c8b3761-7f98-4315-b11e-6ddc7dd95e42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:48.322877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-2c8b3761-7f98-4315-b11e-6ddc7dd95e42 None None] Port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 is administratively disabled so it will not transition to active. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:325}} Nov 24 14:20:48.348009 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-abac6721-3e41-4bdd-9660-e98bc528a51f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1099 time: 0.1827133 Nov 24 14:20:48.480959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-d6965950-8b5d-4246-aace-b22dfce3a2b4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:48.482310 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-d6965950-8b5d-4246-aace-b22dfce3a2b4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1260550 Nov 24 14:20:48.584559 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-e62d508a-934e-4133-8b44-9ad6c742ab14 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 1002 time: 0.0945957 Nov 24 14:20:48.646095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-7d488549-c925-4dcb-8fe0-d50a2e070dbb service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:48.647499 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-7d488549-c925-4dcb-8fe0-d50a2e070dbb service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0566194 Nov 24 14:20:48.725758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-6bfcbaa0-4f75-4944-8b18-67ef4c880158 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0709074 Nov 24 14:20:48.854815 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-4e56cdfd-5730-4bfe-8d83-6866c0af52fa service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1212723 Nov 24 14:20:48.986232 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7faf4864-7962-4f8d-9b6d-7a58a8308fa7 req-72d26995-af7b-4b4c-87b7-cc334988baae service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1233549 Nov 24 14:20:51.578353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48708) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:20:51.584110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'admin_state_up': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:20:51.696130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:51.909375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:20:51.935592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:51.941653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:51.945789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:20:52.011953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:52.012568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:52.013922 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/ports/6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 937 time: 0.4352973 Nov 24 14:20:52.014546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:20:52.018509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-24f9086e-9d65-4595-82c2-404c3daa01be service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0729685 Nov 24 14:20:52.019051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48712) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:20:52.090760 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'status': 'completed', 'code': 200} Nov 24 14:20:52.112657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=7']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:20:52.117148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.47', 52603) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:20:52.122079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:20:52.129871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-aea2fb34-e581-4a60-a1f1-aa99d0681b2c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1099 time: 0.0883694 Nov 24 14:20:52.197076 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-217ea25a-63c4-4ada-8bac-8ff50c5dae68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/099b690a-4e53-4172-b4d2-596d314033e1 HTTP/1.1" status: 200 len: 993 time: 0.1667991 Nov 24 14:20:52.229677 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-781e7c22-d004-47e7-b214-6479df057987 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1098 time: 0.1108994 Nov 24 14:20:52.269025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fd638b63-ac8d-4a95-9f14-ca48537ffd5f None None] Provisioning complete for port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:20:52.270131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd638b63-ac8d-4a95-9f14-ca48537ffd5f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:52.301954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-a9e97c09-5cb8-48d0-964a-9971918e7383 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:52.303470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-a9e97c09-5cb8-48d0-964a-9971918e7383 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1507049 Nov 24 14:20:52.365466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['6c54e6dc-2927-4d18-98b0-6e0933cc9a88'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:20:52.369767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-87deecb4-4c2a-4f93-9483-d92303ecaf32 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:52.371168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-87deecb4-4c2a-4f93-9483-d92303ecaf32 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1350484 Nov 24 14:20:52.414558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-30f31a11-a93b-4ebe-b995-d67aa7abbae4 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 200 len: 1002 time: 0.1033106 Nov 24 14:20:52.485494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-8a7e38c7-0050-4368-9178-6bef63eed69f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:52.486355 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-8a7e38c7-0050-4368-9178-6bef63eed69f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0640316 Nov 24 14:20:52.566309 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-d4d1334e-5cb1-41e5-b528-f97fa9983d40 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0727382 Nov 24 14:20:52.601752 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-0c4917db-33ed-4195-9dfd-2f2369d9901f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 1001 time: 0.2227147 Nov 24 14:20:52.666498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-d7336ca8-b09f-4d17-8e1f-c3405b7b01e1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:52.668052 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-d7336ca8-b09f-4d17-8e1f-c3405b7b01e1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0606320 Nov 24 14:20:52.705676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-48814fa9-574e-4a1e-adc4-bb362856c18b service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1316600 Nov 24 14:20:52.743264 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-155405b4-a5da-439a-80bb-12bc6a52a314 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0691590 Nov 24 14:20:52.841704 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6a51fe1-5ab7-4993-b7c1-36c2794580a5 req-13b12d31-fabd-4a74-bdf9-72b58f5b7130 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293027 Nov 24 14:20:52.881387 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-e81e3203-8497-4df4-8371-c69da2cd85f7 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313043 Nov 24 14:20:53.014147 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a24771f-a231-4d6d-9cb2-7371a8b9cb83 req-f05848e7-b2cc-4da9-a24a-bb719053fd6a service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245902 Nov 24 14:20:54.767555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48726) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:20:54.966810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port c2adc485-0f2a-45f6-9603-a2c2a07c6e5e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:20:54.967399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:55.134000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:55.134326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:55.258047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for c2adc485-0f2a-45f6-9603-a2c2a07c6e5e owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:20:55.409430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:55.412836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f6577f34-d65c-4ed3-ba6c-e7436f3c6013 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:20:55.458245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=c2adc485-0f2a-45f6-9603-a2c2a07c6e5e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:20:55.461574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:20:55.546764 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:56.049253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:20:56.253507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:20:56.263943 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:20:56.278513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:56.279492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:20:56.280202 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:20:56.340654 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/e75ea865-001f-46fa-b718-11fc76814985 HTTP/1.1" status: 204 len: 168 time: 1.5693202 Nov 24 14:20:56.340654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:20:56.398126 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'status': 'completed', 'code': 200} Nov 24 14:20:56.473082 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:20:56.495022 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-37685807-f2a4-4387-a927-3ebc6a16151b service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 1099 time: 0.0747473 Nov 24 14:20:56.633006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212b5927-effc-422e-ab17-89914d834460 req-1f90ab90-215b-4c36-b3e3-8c1561d2d83f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:56.635068 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-1f90ab90-215b-4c36-b3e3-8c1561d2d83f service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1333249 Nov 24 14:20:56.739064 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-30341a7e-062c-4e7a-819b-de5d5e59e085 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 200 len: 217 time: 0.0967810 Nov 24 14:20:56.820286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212b5927-effc-422e-ab17-89914d834460 req-c8bba675-7443-44f5-a35d-8cb85121e3ed service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:56.821703 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-c8bba675-7443-44f5-a35d-8cb85121e3ed service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0749805 Nov 24 14:20:56.828111 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:15Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:20:56.832038 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:20:56.833049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df42dca6-97ea-4d37-a736-f240304fee6a req-7f2b31ee-b97f-4948-975d-f7cec050a1a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:56.833748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-df42dca6-97ea-4d37-a736-f240304fee6a req-7f2b31ee-b97f-4948-975d-f7cec050a1a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:20:56.842676 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:20:56.843268 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:20:56.895297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-df42dca6-97ea-4d37-a736-f240304fee6a req-7f2b31ee-b97f-4948-975d-f7cec050a1a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:20:56.896387 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-df42dca6-97ea-4d37-a736-f240304fee6a req-7f2b31ee-b97f-4948-975d-f7cec050a1a1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 946 time: 0.2072849 Nov 24 14:20:56.952877 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-5131f558-4f5b-4121-a4ed-312c92509325 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1162233 Nov 24 14:20:56.961060 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-df42dca6-97ea-4d37-a736-f240304fee6a req-a86a5939-2d9d-49a9-83fe-49d59dd20eea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0573926 Nov 24 14:20:57.025694 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:20:57.093356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-41129975-b7be-4812-8737-e00ad292c586 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313293 Nov 24 14:20:57.231945 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-212b5927-effc-422e-ab17-89914d834460 req-b4c87c3a-5b2b-4767-b2d9-75f937fff1d2 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1314633 Nov 24 14:20:57.373487 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:15Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:20:57.378416 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78dbd423-adb1-45c2-8b4a-3f926534ea21 None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '099b690a-4e53-4172-b4d2-596d314033e1', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.144', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'port_id': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'fixed_ip_address': '172.20.0.7', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'mac_address': 'fa:16:3e:66:8b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:19:12Z', 'updated_at': '2021-11-24T14:19:15Z', 'revision_number': 1, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:20:57.611061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0649def4-ddee-4c2c-a9a2-294310fb834a None None] New status for floating IP e75ea865-001f-46fa-b718-11fc76814985: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:20:58.275141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a0f881-c731-4dd9-aa0e-e5c0b25d0513 req-5ccada54-7f3e-4cd7-8699-3258a5ebce51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:58.276552 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a2a0f881-c731-4dd9-aa0e-e5c0b25d0513 req-5ccada54-7f3e-4cd7-8699-3258a5ebce51 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 946 time: 0.1833706 Nov 24 14:20:58.325551 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a2a0f881-c731-4dd9-aa0e-e5c0b25d0513 req-17b47f27-69ea-4d40-a60f-4f035ebc116f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=5e3d99d0-440f-4a2b-8642-ba05ce24d08f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419199 Nov 24 14:20:58.341502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-c7e51ed5-a9c8-4366-989a-d17e82761217 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:20:58.343112 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-c7e51ed5-a9c8-4366-989a-d17e82761217 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 946 time: 0.0823050 Nov 24 14:20:58.419729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port a47adea2-b1e8-4918-b308-f90ee2d02e83 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:20:58.420152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:58.800816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port a47adea2-b1e8-4918-b308-f90ee2d02e83, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a47adea2-b1e8-4918-b308-f90ee2d02e83,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:20:58.801160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:58.937444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for a47adea2-b1e8-4918-b308-f90ee2d02e83 owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:20:59.085278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:59.091049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d1b5a94b-3c57-4fcf-b072-9acbc9fcfd99 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:20:59.136967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=a47adea2-b1e8-4918-b308-f90ee2d02e83,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:20:59.140125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:20:59.223167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port a47adea2-b1e8-4918-b308-f90ee2d02e83 on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:20:59.225572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:20:59.228326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'name': 'network-vif-deleted', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:20:59.244856 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b8d46a2b-2140-49a5-9ef0-6734275794aa req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/a47adea2-b1e8-4918-b308-f90ee2d02e83 HTTP/1.1" status: 204 len: 173 time: 0.8963346 Nov 24 14:20:59.286933 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6f47f8b2-9070-4fff-bbbd-43f7579fd06a', 'name': 'network-vif-deleted', 'tag': 'a47adea2-b1e8-4918-b308-f90ee2d02e83', 'status': 'completed', 'code': 200} Nov 24 14:20:59.513358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fa7c5099-ce7c-41b3-8558-79a1104cd341 req-9e457d4f-1a70-4b33-b4fa-34b697ca46b5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=6f47f8b2-9070-4fff-bbbd-43f7579fd06a HTTP/1.1" status: 200 len: 210 time: 0.0427306 Nov 24 14:21:00.618853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48744) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:00.687428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:00.716577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:00.778353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:00.782300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-45435463-001f-494f-a2d8-dddb79a3ff30 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:00.796077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e3d99d0-440f-4a2b-8642-ba05ce24d08f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:00.799785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:00.808917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:00.813314 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/5e3d99d0-440f-4a2b-8642-ba05ce24d08f HTTP/1.1" status: 204 len: 168 time: 0.1901264 Nov 24 14:21:00.850178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48750) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:01.052602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port f4b52aae-dfc6-4e9d-a181-1ed403c80e67 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:21:01.052935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:01.218042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:01.218366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:01.351677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for f4b52aae-dfc6-4e9d-a181-1ed403c80e67 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:21:01.416664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a47adea2-b1e8-4918-b308-f90ee2d02e83 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:21:01.451006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: a47adea2-b1e8-4918-b308-f90ee2d02e83 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:21:01.451369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a47adea2-b1e8-4918-b308-f90ee2d02e83 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:21:01.510525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:01.514218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-11a9ea95-bab0-4c3f-9b6c-1f694fa7bae2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:01.559275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=f4b52aae-dfc6-4e9d-a181-1ed403c80e67,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:01.561771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:01.652682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:02.164922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:21:02.371515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:21:02.381541 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:21:02.389216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:02.398657 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:02.399333 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:02.443541 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/099b690a-4e53-4172-b4d2-596d314033e1 HTTP/1.1" status: 204 len: 168 time: 1.5921278 Nov 24 14:21:02.444276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:21:02.500349 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'status': 'completed', 'code': 200} Nov 24 14:21:02.587214 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:02.602775 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-3e842615-b935-48c4-93b3-2fcc04c51816 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 1098 time: 0.0808077 Nov 24 14:21:02.752717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-4a61ceca-3377-4dff-9352-60a5c9275b5f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:02.754187 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-4a61ceca-3377-4dff-9352-60a5c9275b5f service neutron] 10.222.0.47 "GET /v2.0/networks?id=f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 200 len: 898 time: 0.1456099 Nov 24 14:21:02.823887 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-c2b1d54c-d6fa-453c-b255-6981695bc57e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 200 len: 217 time: 0.0619068 Nov 24 14:21:02.851257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b3c9ac-8300-464c-b034-813827f00ba4 req-3ade1e86-9b72-499a-bd36-184f1672f4d8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:02.853161 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c0b3c9ac-8300-464c-b034-813827f00ba4 req-3ade1e86-9b72-499a-bd36-184f1672f4d8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 945 time: 0.0850167 Nov 24 14:21:02.889872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-b2d43883-3c74-4882-9735-9ff314fe41d8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:02.891934 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-b2d43883-3c74-4882-9735-9ff314fe41d8 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 200 len: 834 time: 0.0610580 Nov 24 14:21:02.901379 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c0b3c9ac-8300-464c-b034-813827f00ba4 req-dd058632-0724-496c-acba-d5da7308e9b6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424666 Nov 24 14:21:02.965644 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:02.970004 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:21:02.972553 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-9fd9960b-c79c-46fd-8eea-f9d437b0daf6 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f41807e1-87e1-4c03-827e-f7ae1d8e456d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0741944 Nov 24 14:21:02.980583 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:02.981242 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:03.106762 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-90260401-372b-4215-b2eb-7d021d39eca0 service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266789 Nov 24 14:21:03.156433 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:03.227066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-04c02ebd-e133-4180-95b8-fdecd9816f1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:03.244351 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8c8efec0-4d16-43cb-bea3-23008fe8ec4f req-a4e2cbf8-1db2-434c-aa0f-ed214238a3bc service neutron] 10.222.0.47 "GET /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1305959 Nov 24 14:21:03.464914 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:03.469564 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-148d19dc-20ed-49fd-a7e1-1146db954106 None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'e2a6f785-4940-4709-8f69-8b852fe07375', 'name': '', 'network_id': 'f41807e1-87e1-4c03-827e-f7ae1d8e456d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:00:77:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:54Z', 'updated_at': '2021-11-24T14:19:01Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'e98c7e13-8f92-46dd-a437-43e327feab51', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:21:03.610921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:03.684815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d9c5a07-ea61-4887-924e-1595c716a000 None None] New status for floating IP 099b690a-4e53-4172-b4d2-596d314033e1: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:21:04.106464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3683292-2057-4849-8494-f070959fe144 req-35675a3b-f4fb-49f6-8031-72c0aa624d73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:04.107161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d3683292-2057-4849-8494-f070959fe144 req-35675a3b-f4fb-49f6-8031-72c0aa624d73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:04.125873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d3683292-2057-4849-8494-f070959fe144 req-35675a3b-f4fb-49f6-8031-72c0aa624d73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:04.127126 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d3683292-2057-4849-8494-f070959fe144 req-35675a3b-f4fb-49f6-8031-72c0aa624d73 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 945 time: 0.1002054 Nov 24 14:21:04.172397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d3683292-2057-4849-8494-f070959fe144 req-8df4063e-9e4c-4693-a5dd-b69de152fe28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:04.187218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-d3683292-2057-4849-8494-f070959fe144 req-8df4063e-9e4c-4693-a5dd-b69de152fe28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:04.188894 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d3683292-2057-4849-8494-f070959fe144 req-8df4063e-9e4c-4693-a5dd-b69de152fe28 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=45776ee9-1b42-4a72-a0c8-51f7270bc04c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0562413 Nov 24 14:21:04.516904 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-f73baf7c-8f3d-4a84-868f-cd4e752c2526 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:04.518312 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-f73baf7c-8f3d-4a84-868f-cd4e752c2526 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 945 time: 0.0757773 Nov 24 14:21:04.694927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:21:04.695265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:04.935183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:04.935532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:05.055156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:21:05.194841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:05.200491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-34e51c09-2655-409c-91df-20a1405ff0bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:05.246582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=6c54e6dc-2927-4d18-98b0-6e0933cc9a88,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:05.250057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:05.327742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:21:05.330838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:05.333481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'name': 'network-vif-deleted', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:21:05.350950 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6e57e81e-079f-4420-822d-7ac7965fa566 req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/6c54e6dc-2927-4d18-98b0-6e0933cc9a88 HTTP/1.1" status: 204 len: 173 time: 0.8274751 Nov 24 14:21:05.366724 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ebe45a98-2703-484c-883e-3133469e6aca req-d0c4b734-e754-4fb8-9802-31012651a521 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=edd5a3c8-c07b-4f3a-8689-9259f444c68c HTTP/1.1" status: 200 len: 210 time: 0.0450802 Nov 24 14:21:05.401040 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'edd5a3c8-c07b-4f3a-8689-9259f444c68c', 'name': 'network-vif-deleted', 'tag': '6c54e6dc-2927-4d18-98b0-6e0933cc9a88', 'status': 'completed', 'code': 200} Nov 24 14:21:05.796148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0e68aed4-2219-4a03-92d5-94dbb7a6930c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:06.474107 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48770) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:06.546193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:06.574960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:06.637218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:06.641353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3376111a-ab8e-40d6-bd97-d81f5b59d0c9 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:06.655227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=45776ee9-1b42-4a72-a0c8-51f7270bc04c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:06.658229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:06.670509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:06.671629 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/45776ee9-1b42-4a72-a0c8-51f7270bc04c HTTP/1.1" status: 204 len: 168 time: 0.1965404 Nov 24 14:21:06.714533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48776) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:06.778823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:07.110918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:07.421899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:21:07.457935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:21:07.458292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 6c54e6dc-2927-4d18-98b0-6e0933cc9a88 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:21:07.716462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port e2a6f785-4940-4709-8f69-8b852fe07375 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:21:07.717366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:07.899991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port e2a6f785-4940-4709-8f69-8b852fe07375, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e2a6f785-4940-4709-8f69-8b852fe07375,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:07.900338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:08.128465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for e2a6f785-4940-4709-8f69-8b852fe07375 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:21:08.313535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:08.317699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:08.360016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=e2a6f785-4940-4709-8f69-8b852fe07375,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:08.399583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.399991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.400375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.400749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.401126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.401495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.401863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.402227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.402586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.402945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.403302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:08.411213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:08.471790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:08.677446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:09.254153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router c3c35b6e-3277-4fe1-af68-19d25b2aac64 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:21:09.454590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:21:09.465473 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] Sync routers for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:21:09.470621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48782) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:09.471101 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/c3c35b6e-3277-4fe1-af68-19d25b2aac64/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7549753 Nov 24 14:21:09.477998 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:09.478607 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:09.657431 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:09.663836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet e98c7e13-8f92-46dd-a437-43e327feab51 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:21:09.667140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:09.725674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:09.808358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:09.883170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:09.887407 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c59ed28d-db8f-4876-9868-56bc208bb660 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:09.923713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=e98c7e13-8f92-46dd-a437-43e327feab51,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:09.926818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:09.930925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:09.936750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cec27993-23a5-46e9-8760-090e56df445b None None] Network f41807e1-87e1-4c03-827e-f7ae1d8e456d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:21:09.939081 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:21:08Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:09.942999 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-54691e9c-01e8-44c6-bf38-31215096592d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/e98c7e13-8f92-46dd-a437-43e327feab51 HTTP/1.1" status: 204 len: 168 time: 0.4704754 Nov 24 14:21:09.944871 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] Checking router: c3c35b6e-3277-4fe1-af68-19d25b2aac64 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:21:09.945946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48786) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:09.956208 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] Routers {'c3c35b6e-3277-4fe1-af68-19d25b2aac64'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:09.956816 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:10.169677 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] Set router c3c35b6e-3277-4fe1-af68-19d25b2aac64 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:10.212433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] DHCP port deletion for f41807e1-87e1-4c03-827e-f7ae1d8e456d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:21:10.219247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Deleting port aec98070-b402-4994-8739-f1235254092f {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:21:10.220041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.307886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.448723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] For port aec98070-b402-4994-8739-f1235254092f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=aec98070-b402-4994-8739-f1235254092f,segment=NetworkSegment(c7026dc6-4457-4131-9ad4-61f1a2043d04),segment_id=c7026dc6-4457-4131-9ad4-61f1a2043d04)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:10.449118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.462997 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:21:08Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:10.466960 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68b33c9e-a2b4-45d2-a4af-781e68abec6b None None] The sync data for ids ['c3c35b6e-3277-4fe1-af68-19d25b2aac64'] in dv-neutron-818151-2-hyperv is: [{'id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'name': 'tempest-TestNetworkBasicOps-router-1355673707', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68'}], 'enable_snat': True}, 'gw_port_id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:18:50Z', 'updated_at': '2021-11-24T14:21:08Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': 'cb6629e0-9038-4ede-ad35-2ff9d9ec815b', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:c0:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3c35b6e-3277-4fe1-af68-19d25b2aac64', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.68', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:18:51Z', 'updated_at': '2021-11-24T14:18:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:21:10.527497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.540798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port cb6629e0-9038-4ede-ad35-2ff9d9ec815b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:21:10.541144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.576373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Calling delete_port for aec98070-b402-4994-8739-f1235254092f owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:21:10.649082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.652645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a202f939-1e31-4bc0-a851-d753979ba179 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:10.715929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port cb6629e0-9038-4ede-ad35-2ff9d9ec815b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:10.716183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:10.736635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Pushing event deleted for resources: {'Port': ['ID=aec98070-b402-4994-8739-f1235254092f,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:10.746599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] No DVR routers for this DVR port aec98070-b402-4994-8739-f1235254092f on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:21:10.753717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.753987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.754314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.754896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.755016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.755253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.755572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.755916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.756230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.756539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.756846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:10.759740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:10.842647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for cb6629e0-9038-4ede-ad35-2ff9d9ec815b owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:21:11.027210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.030826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a300f0ad-1837-4781-9981-5855e84e6154 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:11.037764 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device aec98070-b402-4994-8739-f1235254092f no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:21:11.070055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: aec98070-b402-4994-8739-f1235254092f {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:21:11.070407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device aec98070-b402-4994-8739-f1235254092f not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:21:11.070824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e2a6f785-4940-4709-8f69-8b852fe07375 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:21:11.071925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=cb6629e0-9038-4ede-ad35-2ff9d9ec815b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:11.075457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:11.103142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: e2a6f785-4940-4709-8f69-8b852fe07375 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:21:11.103496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e2a6f785-4940-4709-8f69-8b852fe07375 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:21:11.294292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.659475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.663820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.695696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.696301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router c3c35b6e-3277-4fe1-af68-19d25b2aac64 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:21:11.711800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.715303 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/c3c35b6e-3277-4fe1-af68-19d25b2aac64 HTTP/1.1" status: 204 len: 168 time: 1.7657564 Nov 24 14:21:11.715531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48790) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:11.832868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.961406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:11.988385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f41807e1-87e1-4c03-827e-f7ae1d8e456d']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:12.000539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c7026dc6-4457-4131-9ad4-61f1a2043d04') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:12.000835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c7026dc6-4457-4131-9ad4-61f1a2043d04') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:12.011628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.030848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.037677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 872 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:21:12.038105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:21:12.053673 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:21:12.137115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.140559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1bc6e05e-df04-4d3d-ad8a-424a30ea29c2 tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:12.154475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.165191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=f41807e1-87e1-4c03-827e-f7ae1d8e456d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:12.168702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:12.170442 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bd3d7661-017c-4dea-bafa-be74d83e535d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/f41807e1-87e1-4c03-827e-f7ae1d8e456d HTTP/1.1" status: 204 len: 168 time: 0.4539518 Nov 24 14:21:12.198642 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48794) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:12.205214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'network': {'name': 'tempest-network-smoke--1412351218', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:12.210306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:12.214444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:network and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:12.217473 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:12.223474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:12.233633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:21:12.237341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.267971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:21:12.276604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.276988 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Added segment 0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00 of type vlan for network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 Nov 24 14:21:12.303229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.333633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.337811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:12.338413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.342442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-66e41812-f051-4158-a615-6b6fa207e8df tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:12.452840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Network': ['ID=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:12.456654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:12.462330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b447f8bb-6cb4-4ec1-96be-6a8ab72a3e5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2571011 Nov 24 14:21:12.462788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48798) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:12.463738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:21:12.468204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-288820440', 'admin_state_up': True, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:12.475952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:12.479700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:router and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:12.482911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:12.489660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:12.500095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.501181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.519384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.665797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.940630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:12.971227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:13.033409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cb6629e0-9038-4ede-ad35-2ff9d9ec815b no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:21:13.066706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: cb6629e0-9038-4ede-ad35-2ff9d9ec815b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:21:13.067144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device cb6629e0-9038-4ede-ad35-2ff9d9ec815b not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:21:13.110179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.88 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/1c3ad437-4be4-40ae-9752-ea19afb4b0fe) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:21:13.257663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:13.286178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:13.289905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0a7f4bcf-0bd5-4774-aafb-a336ae1b8986 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:13.358758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:21:13.363052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:13.368066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:21:13.391611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:13.396365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:13.525010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:13.525636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:13.752482 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:21:13.962029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:21:13.973818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Sync routers for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:21:13.986629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:13.987238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:13.994146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:13.998584 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 1.5319345 Nov 24 14:21:13.998848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48802) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:14.196738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:14.204761 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-edc3b46d-1b02-45d8-91fa-1ab10337ede7 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=8266f75badc14ec9b01ae6b8d8f4370b&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2035227 Nov 24 14:21:14.207195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48808) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:14.355439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc1f30e5-2d0b-4f2c-88a3-1947ef0976c5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:14.357243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc1f30e5-2d0b-4f2c-88a3-1947ef0976c5 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1490009 Nov 24 14:21:14.360989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48812) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:14.420110 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3a7bb386-8321-451b-b9e2-93cfdfa9db99 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0576627 Nov 24 14:21:14.422936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48816) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:14.429846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2140900010', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:14.499303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:13Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:14.503492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Checking router: 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:21:14.503880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Updating router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:21:14.543322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:14.547052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:subnet and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:14.549822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:14.555462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:14.557455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:14.565601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:21:14.668056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:14.883598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:14.884866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:14.887387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-94580cc5-cc9b-48a7-86a2-82845c38d70d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:14.897768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Transition to ACTIVE for port object 1c3ad437-4be4-40ae-9752-ea19afb4b0fe will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:14.903722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:14.907792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b23005db-de67-4595-9a5d-9ef2e7e9acf8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:14.989983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Attempting to bind port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:21:14.990642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Attempting to bind port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:21:14.990790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Attempting to bind port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:21:14.992809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595d1475-a373-422e-8753-02c250aed8af None None] Pushing event updated for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:14.997022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-595d1475-a373-422e-8753-02c250aed8af None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:15.001421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 21, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:21:15.001685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:21:15.002096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:15.002490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:21:15.002961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Bound port: 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:21:15.003340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:15.074270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] For port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:21:15.077238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] For port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:21:15.080899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Subnet': ['ID=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:15.082685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:15.084637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:15.085959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:15.098735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Checking segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:21:15.099090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network hostable DHCP agents. Network: de1a0035-d57c-4f9c-a372-1cb3a4c92dc4, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:21:15.122485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:21:15.133700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, de1a0035-d57c-4f9c-a372-1cb3a4c92dc4) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:15.138288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:15.138880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:15.149123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beafdc92-5824-4d46-83a5-f8453df2297d None None] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:21:15.162269 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.7381730 Nov 24 14:21:15.165005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48820) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:15.184662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595d1475-a373-422e-8753-02c250aed8af None None] Pushing event updated for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:15.228380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-595d1475-a373-422e-8753-02c250aed8af None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:15.243023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:15.243650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:15.573711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:15.613347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:21:15.614164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:15.940415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:15.966467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Allocated IP 172.20.0.2 (de1a0035-d57c-4f9c-a372-1cb3a4c92dc4/a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2/c3bdd633-98c5-492b-9fe1-9c7be661c164) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:21:16.076617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:13Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:16.085650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6178c3ef-365c-4542-991c-4111c426c01a None None] The sync data for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv is: [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:13Z', 'revision_number': 3, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:21:16.195746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.207552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Transition to ACTIVE for port object c3bdd633-98c5-492b-9fe1-9c7be661c164 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:16.229034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Transition to ACTIVE for port object c3bdd633-98c5-492b-9fe1-9c7be661c164 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:16.235569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.240474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:16.322658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:21:16.326619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:16.329231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Pushing event updated for resources: {'Port': ['ID=c3bdd633-98c5-492b-9fe1-9c7be661c164,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:16.331384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:21:16.333697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:16.411660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.1 (de1a0035-d57c-4f9c-a372-1cb3a4c92dc4/a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2/7c25d742-d396-4cc8-b367-41237e438525) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:21:16.427715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Attempting to bind port c3bdd633-98c5-492b-9fe1-9c7be661c164 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:21:16.428170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Attempting to bind port c3bdd633-98c5-492b-9fe1-9c7be661c164 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:21:16.428617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Attempting to bind port c3bdd633-98c5-492b-9fe1-9c7be661c164 on network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:21:16.436140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 21, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:21:16.436529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Checking segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:21:16.437006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.437530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Bound using segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:21:16.437991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Bound port: c3bdd633-98c5-492b-9fe1-9c7be661c164, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:21:16.439312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.539994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] For port c3bdd633-98c5-492b-9fe1-9c7be661c164, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:21:16.544065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] For port c3bdd633-98c5-492b-9fe1-9c7be661c164, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c3bdd633-98c5-492b-9fe1-9c7be661c164,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:21:16.548713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.554421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:16.600031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.618697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 7c25d742-d396-4cc8-b367-41237e438525 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:16.635658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Pushing event updated for resources: {'Port': ['ID=c3bdd633-98c5-492b-9fe1-9c7be661c164,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:16.638685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:16.645796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:16.650252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-52c21d24-790c-46eb-82be-9c86936c825b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:16.723566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:21:16.727335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:16.730390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:21:16.783148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:16.788938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:16.823947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:21:16.961933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.062616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.098078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:17.176069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:17.181451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:17.181830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.299193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.316183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:17.321585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.322434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c3bdd633-98c5-492b-9fe1-9c7be661c164 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:17.353366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:17.495301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:17.498520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:17.510732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c3bdd633-98c5-492b-9fe1-9c7be661c164 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:17.526108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.530644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.560346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e9558977-3261-45c6-a86a-13fee6fbb4f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:17.618443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f94a33f6-6d46-4a5a-b49e-1900889d8aa1 None None] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:21:17.644836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:17.649015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:17.649910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.724311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Provisioning for port c3bdd633-98c5-492b-9fe1-9c7be661c164 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:17.739581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Provisioning complete for port c3bdd633-98c5-492b-9fe1-9c7be661c164 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:17.739990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.787693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:21:17.788903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:17.937879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:17.956815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:18.004073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] For port c3bdd633-98c5-492b-9fe1-9c7be661c164, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c3bdd633-98c5-492b-9fe1-9c7be661c164,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:18.009242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:18.011064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-100141e5-9bcf-43ae-a8cb-80f8d6ef80f3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:18.079168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Pushing event updated for resources: {'Port': ['ID=c3bdd633-98c5-492b-9fe1-9c7be661c164,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:18.082652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:18.190344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:21:18.231266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cff56cd9-b7ee-4857-a842-1d64e2d7e1c3 None None] Provisioning complete for port c3bdd633-98c5-492b-9fe1-9c7be661c164 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:18.232308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cff56cd9-b7ee-4857-a842-1d64e2d7e1c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:18.381501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cff56cd9-b7ee-4857-a842-1d64e2d7e1c3 None None] Provisioning for port 7c25d742-d396-4cc8-b367-41237e438525 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:18.386525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cff56cd9-b7ee-4857-a842-1d64e2d7e1c3 None None] Provisioning complete for port 7c25d742-d396-4cc8-b367-41237e438525 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:18.386901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cff56cd9-b7ee-4857-a842-1d64e2d7e1c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:18.416688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:21:18.437682 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/9f2a9a04-826b-45b8-bdc5-2871fb2161e8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2716351 Nov 24 14:21:18.440494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48824) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:18.453802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cff56cd9-b7ee-4857-a842-1d64e2d7e1c3 None None] Port 7c25d742-d396-4cc8-b367-41237e438525 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:21:18.573851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-27ebb1ed-5a4a-4f0a-b0f9-07114cafc9fe None None] Provisioning complete for port 7c25d742-d396-4cc8-b367-41237e438525 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:18.574311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27ebb1ed-5a4a-4f0a-b0f9-07114cafc9fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:18.585241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbe1441-1265-4723-b3ee-8b8851d57f9c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.585609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbe1441-1265-4723-b3ee-8b8851d57f9c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.585967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbe1441-1265-4723-b3ee-8b8851d57f9c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.586316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dbe1441-1265-4723-b3ee-8b8851d57f9c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.587958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8dbe1441-1265-4723-b3ee-8b8851d57f9c tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2886 time: 0.1464639 Nov 24 14:21:18.590536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48828) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:18.626686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-27ebb1ed-5a4a-4f0a-b0f9-07114cafc9fe None None] Port 7c25d742-d396-4cc8-b367-41237e438525 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:21:18.658954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f686358-f731-4913-8942-a429f831d5e2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.659237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f686358-f731-4913-8942-a429f831d5e2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.659592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f686358-f731-4913-8942-a429f831d5e2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.659969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f686358-f731-4913-8942-a429f831d5e2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:18.661772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1f686358-f731-4913-8942-a429f831d5e2 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2728 time: 0.0703378 Nov 24 14:21:18.664436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48832) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:18.860820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7accef03-b027-4076-b286-1124b03dbabd tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/routers HTTP/1.1" status: 200 len: 1606 time: 0.1951101 Nov 24 14:21:19.044728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:19.051354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48838) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:19.057386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-686212190', 'description': 'tempest-secgroup-smoke-686212190 description', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:19.063969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.067980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.070771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.076454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.088128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.119828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:19.124086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.124926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.129401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.132255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.137917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.205468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.210097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.218232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-60301983-4592-4c40-8f95-1d6e7069caac tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:19.253428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c3bdd633-98c5-492b-9fe1-9c7be661c164 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:19.261569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroup': ['ID=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:19.269323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:19.270491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.274633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-36bfc934-90e0-4e81-bd4b-12fe166029d5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.2195151 Nov 24 14:21:19.275146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48842) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:19.282048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '289c740d-e7e9-40bd-ab3a-5db3ad49c2e9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:19.289988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.293770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.296796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.304295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.322629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.329564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c3bdd633-98c5-492b-9fe1-9c7be661c164 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:19.329943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.391731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.395504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.403394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-253d56b8-d2df-4159-87a4-7a13e91bf8b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:19.424758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44a31cd1-b554-440e-86cf-a9acbacf9702,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:19.428334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:19.429643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.430947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1543369 Nov 24 14:21:19.433776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48846) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:19.440146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '289c740d-e7e9-40bd-ab3a-5db3ad49c2e9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:19.445936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.449869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.453344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.461076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.478142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.541365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.544688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.546932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72560ec2-dabb-423b-bab9-a845058f9832 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:19.568480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4a00288a-d877-4863-b672-f9648693ae1c,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:19.570808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:19.578457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.583091 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1450348 Nov 24 14:21:19.583302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48850) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:19.589095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '289c740d-e7e9-40bd-ab3a-5db3ad49c2e9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:19.596079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.600347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.603587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.610904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.629128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.693102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.696786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.698567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f393d18e-8738-4145-b98f-ed359455ae85 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:19.720670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=24a01d65-15c6-464c-bcd9-6f25974cf8ca,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:19.723028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:19.729840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.730989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1467299 Nov 24 14:21:19.733610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48854) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:19.739668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '289c740d-e7e9-40bd-ab3a-5db3ad49c2e9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:19.745735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.750199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.753317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.759096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.778899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.842631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.848171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.848891 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Sync routers for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:21:19.849991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:19.861746 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:19.862433 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:19.878554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c6052262-0347-4132-b603-88bcb9bd497d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:19.882452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:19.889473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:19.890852 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1557050 Nov 24 14:21:19.893543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48858) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:19.899281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '289c740d-e7e9-40bd-ab3a-5db3ad49c2e9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:19.905123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:19.909934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:19.912832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:19.918439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:19.931853 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:21:19.938725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.050260 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:20.106743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.110966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.112791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd8d5dad-1e88-40c2-b5f8-c3c1310024bd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:20.134831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b717d65e-572c-4fbb-87cb-e96b28b16b74,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:20.139172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:20.144164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.145331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.2507205 Nov 24 14:21:20.148092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48862) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:20.153509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'security_group_rule': {'security_group_id': '289c740d-e7e9-40bd-ab3a-5db3ad49c2e9', 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:20.160438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:20.164086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:security_group_rule and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:20.166876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:20.173460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:20.183764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Project 8266f75badc14ec9b01ae6b8d8f4370b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:21:20.190147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.276401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.283146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.290042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2a54b16a-c019-4b27-ad54-2df22c611786 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:20.317133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd16140f-b489-4a36-93e6-fcc491fc304a,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:20.319707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:20.325500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.326723 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1777263 Nov 24 14:21:20.373243 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:16Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:20.377864 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Checking router: 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:21:20.378223 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Updating router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 port 7c25d742-d396-4cc8-b367-41237e438525 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:21:20.428690 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.623198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-711dd383-36ef-4d9c-a7d2-41c8821edb27 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:20.642225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-711dd383-36ef-4d9c-a7d2-41c8821edb27 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:20.643551 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-711dd383-36ef-4d9c-a7d2-41c8821edb27 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-686212190&fields=id&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 267 time: 0.1788828 Nov 24 14:21:20.773096 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.785036 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Transition to ACTIVE for port object 7c25d742-d396-4cc8-b367-41237e438525 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:20.791088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-121042d0-b4af-416c-b048-3845df7fccdf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:20.791564 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:20.791786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-121042d0-b4af-416c-b048-3845df7fccdf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:20.795511 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-b8cdf25f-d7b4-45e0-bff6-451d3d16d3e8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:20.807361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-121042d0-b4af-416c-b048-3845df7fccdf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:20.808594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-121042d0-b4af-416c-b048-3845df7fccdf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 797 time: 0.1583748 Nov 24 14:21:20.825793 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-22114215-0aa9-4834-9a54-e0225aa81da4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/quotas/8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 375 time: 0.0112624 Nov 24 14:21:20.913991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-dece418d-f87e-4df0-9e61-5d66fd9010f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:20.931869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-dece418d-f87e-4df0-9e61-5d66fd9010f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:20.933362 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-dece418d-f87e-4df0-9e61-5d66fd9010f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1014037 Nov 24 14:21:20.970923 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:21.027114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-463a8189-6235-49d0-b40c-da81db5ba51d service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:21:21.028361 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-463a8189-6235-49d0-b40c-da81db5ba51d service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0774598 Nov 24 14:21:21.042740 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.043088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.043423 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.043774 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.044107 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.044434 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.045189 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.045495 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.046004 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.046571 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.046896 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:21:21.054270 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:21.070158 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Attempting to bind port 7c25d742-d396-4cc8-b367-41237e438525 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:21:21.070812 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Attempting to bind port 7c25d742-d396-4cc8-b367-41237e438525 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:21:21.071181 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Attempting to bind port 7c25d742-d396-4cc8-b367-41237e438525 on network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:21:21.078622 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 21, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:21:21.079001 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Checking segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:21:21.079410 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:21.079839 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Bound using segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:21:21.080308 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Bound port: 7c25d742-d396-4cc8-b367-41237e438525, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:21:21.080686 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:21.169396 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-70a0588b-2c66-4a35-994c-10a5ab4a190e service neutron] 10.222.0.70 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1334369 Nov 24 14:21:21.170624 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] For port 7c25d742-d396-4cc8-b367-41237e438525, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:21:21.174772 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] For port 7c25d742-d396-4cc8-b367-41237e438525, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7c25d742-d396-4cc8-b367-41237e438525,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:21:21.179509 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:21.183068 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:21.259594 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:21.263575 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:21.264947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:21.265744 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:21.315247 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-14dc9cf6-f968-4cf5-aa7a-813ac1368bc4 service neutron] 10.222.0.70 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1387928 Nov 24 14:21:21.474953 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:21.526283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-aabcb793-1708-4018-a39b-2becbd7b247c req-49110897-9115-4941-aa37-089455489a2b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:21.542002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-aabcb793-1708-4018-a39b-2becbd7b247c req-49110897-9115-4941-aa37-089455489a2b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:21.544229 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aabcb793-1708-4018-a39b-2becbd7b247c req-49110897-9115-4941-aa37-089455489a2b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 210 time: 0.0633399 Nov 24 14:21:21.802602 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:16Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:21:21Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:21.806588 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad7ea9ed-b23a-43b8-a50c-5157a6914731 None None] The sync data for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv is: [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:16Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:21:21Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:21:22.749054 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ccef3e03-7b9c-4762-b69a-2356f417ee46 req-c3886f65-d82e-49cc-93fc-25b47059cbf9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 210 time: 0.0574191 Nov 24 14:21:22.810506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-6cbe41d4-c165-48d9-9eee-d889769a1297 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:22.812624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-6cbe41d4-c165-48d9-9eee-d889769a1297 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 797 time: 0.2085960 Nov 24 14:21:22.867446 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-504a03f8-e251-42eb-ab35-904c5511fe8d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8266f75badc14ec9b01ae6b8d8f4370b HTTP/1.1" status: 200 len: 379 time: 0.0417140 Nov 24 14:21:22.876560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'port': {'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'admin_state_up': True, 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'security_groups': ['289c740d-e7e9-40bd-ab3a-5db3ad49c2e9']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:23.011038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:23.022597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:23.033326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Made reservation on behalf of 8266f75badc14ec9b01ae6b8d8f4370b for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:21:23.036534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.059963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:23.136855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 7c25d742-d396-4cc8-b367-41237e438525 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:23.142118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7c25d742-d396-4cc8-b367-41237e438525 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:23.142496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.213577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.20.0.10 (de1a0035-d57c-4f9c-a372-1cb3a4c92dc4/a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2/005116c0-72bb-41e9-9cd1-f4f3ad20fd1c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:21:23.258795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.292289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7c25d742-d396-4cc8-b367-41237e438525, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7c25d742-d396-4cc8-b367-41237e438525,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:23.297587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.299701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-324e39d9-2051-4a47-9e04-032370f5b408 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:23.368336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:23.371348 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:23.413486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.430008 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Transition to ACTIVE for port object 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:23.451684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.457925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:23.522092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:21:23.529334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:23.534342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:21:23.564953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:23.571606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:23.601628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:23.602235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.629234 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7562511 Nov 24 14:21:23.642362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Request body: {'port': {'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:23.732063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-39eff7f6-02a3-4009-9629-52659e942b02 None None] Provisioning for port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:23.737008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-39eff7f6-02a3-4009-9629-52659e942b02 None None] Provisioning complete for port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:23.737441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39eff7f6-02a3-4009-9629-52659e942b02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.755569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:23.792927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-39eff7f6-02a3-4009-9629-52659e942b02 None None] Port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:21:23.960662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8535c63a-9cc2-4114-a2c1-173522357c7f req-96c7aab9-16dd-4fd3-b3db-79663efec9e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:23.962072 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8535c63a-9cc2-4114-a2c1-173522357c7f req-96c7aab9-16dd-4fd3-b3db-79663efec9e7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 932 time: 0.0807781 Nov 24 14:21:24.010476 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8535c63a-9cc2-4114-a2c1-173522357c7f req-f59cfcd4-9d96-4f96-8247-7c33176acfd6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425072 Nov 24 14:21:24.217611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:21:24.224783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:24.244850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Transition to ACTIVE for port object 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:21:24.251601 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:24.258926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-632e8469-12a2-4cec-b3ca-e48a026d9f21 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:24.416340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Pushing event updated for resources: {'Port': ['ID=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:24.420426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:24.530480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Attempting to bind port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:21:24.530878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Attempting to bind port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:21:24.531214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Attempting to bind port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c on network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:21:24.537100 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c on network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:21:24.537418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Attempting to bind port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c on network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:21:24.544086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 21, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:21:24.544411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Checking segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:21:24.544780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Bound using segment: {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:21:24.545197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Bound port: 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:21:24.545535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:24.634917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] For port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:21:24.637846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] For port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:21:24.643113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:24.647317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:24.710333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:24.711737 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] 10.222.0.47 "PUT /v2.0/ports/005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 1094 time: 1.0749943 Nov 24 14:21:24.712286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:21:24.729239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Pushing event updated for resources: {'Port': ['ID=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:24.732702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:24.784874 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'status': 'completed', 'code': 200} Nov 24 14:21:24.827850 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-fc27302d-3495-4185-a4fe-d1adf390ed15 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1097 time: 0.0757329 Nov 24 14:21:24.899818 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-ca901001-45a2-4f76-b87c-e781de7f79db service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 217 time: 0.0654190 Nov 24 14:21:24.962846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-145c7691-6e33-4847-9e72-beb78098f0ce service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:24.964288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-145c7691-6e33-4847-9e72-beb78098f0ce service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 200 len: 835 time: 0.0581481 Nov 24 14:21:25.042741 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-7a491ff2-2b7c-494a-9e8c-fe0a7d90e71d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0724227 Nov 24 14:21:25.043442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:25.114563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7c25d742-d396-4cc8-b367-41237e438525 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:25.114941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:25.180556 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-41b90187-d0e4-40be-99c7-de8156897453 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1316266 Nov 24 14:21:25.223078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-477aedb7-2b59-47d7-87e0-b3245c43af60 req-a6a4560c-1394-4320-8370-d08ae30992cd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:25.225962 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-477aedb7-2b59-47d7-87e0-b3245c43af60 req-a6a4560c-1394-4320-8370-d08ae30992cd tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 944 time: 0.0918150 Nov 24 14:21:25.300470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-477aedb7-2b59-47d7-87e0-b3245c43af60 req-6196f015-a234-422f-a39a-028f4ca78820 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0687091 Nov 24 14:21:25.329274 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2147e6f-878e-4757-8286-1f2cbc5a5398 req-88aa2250-47c8-4fe6-9d85-0abbdbf132da service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1417100 Nov 24 14:21:25.447973 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-46e72ff5-2c10-4e2a-ab37-209a861521b0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1097 time: 0.0708001 Nov 24 14:21:25.577878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0fd4673-2680-4d35-808f-797a90654f55 req-609a8df6-64b2-45eb-aea9-5219d7933bb7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:25.579238 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-609a8df6-64b2-45eb-aea9-5219d7933bb7 service neutron] 10.222.0.47 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 898 time: 0.1249504 Nov 24 14:21:25.648998 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-c731fe72-1dfa-4c46-844e-47f614d03011 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 217 time: 0.0637712 Nov 24 14:21:25.709624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0fd4673-2680-4d35-808f-797a90654f55 req-c8304f57-5eee-4046-9242-97c6f7e63237 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:25.710979 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-c8304f57-5eee-4046-9242-97c6f7e63237 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 200 len: 835 time: 0.0554240 Nov 24 14:21:25.786909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-28a1b2a7-2d50-49fa-b021-3bde4667720c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0697377 Nov 24 14:21:26.020188 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-5c1ad32e-9947-48d2-9fae-f4f703e69146 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2259476 Nov 24 14:21:26.155470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d0fd4673-2680-4d35-808f-797a90654f55 req-c9cc24a0-e87c-4b0e-aa81-59809ee7b9f8 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284220 Nov 24 14:21:26.495271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12fe6342-c96f-421f-a172-7002c9749a16 req-abdf10f9-9eca-40ec-be46-facba26f7c05 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:26.495985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-12fe6342-c96f-421f-a172-7002c9749a16 req-abdf10f9-9eca-40ec-be46-facba26f7c05 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:21:26.513550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-12fe6342-c96f-421f-a172-7002c9749a16 req-abdf10f9-9eca-40ec-be46-facba26f7c05 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:21:26.515080 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-12fe6342-c96f-421f-a172-7002c9749a16 req-abdf10f9-9eca-40ec-be46-facba26f7c05 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 944 time: 0.0976880 Nov 24 14:21:26.560807 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-12fe6342-c96f-421f-a172-7002c9749a16 req-f00bea1d-bf0c-4969-9f44-fcff5c80a884 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400958 Nov 24 14:21:27.532291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:21:27.669591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:27.683521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 852, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:21:27.741282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:27.758119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:21:27.760452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f2e3039-f5ec-4b4e-97fb-42c5b6d76b10 req-8a8b5e4a-b0aa-428d-afc4-fdeddec462e6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:27.761913 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8f2e3039-f5ec-4b4e-97fb-42c5b6d76b10 req-8a8b5e4a-b0aa-428d-afc4-fdeddec462e6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 944 time: 0.0754638 Nov 24 14:21:27.773452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:27.777720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:27.781250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:27.811680 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8f2e3039-f5ec-4b4e-97fb-42c5b6d76b10 req-d32a8a2e-2d90-400c-841d-711aa11d6302 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434446 Nov 24 14:21:27.852824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:27.855937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:28.079012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['005116c0-72bb-41e9-9cd1-f4f3ad20fd1c'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:21:29.012798 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d2c35b-f74b-4e36-893d-de4907e9fa15 req-8d874828-1fbd-4134-993d-62852a1086a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:29.014224 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d1d2c35b-f74b-4e36-893d-de4907e9fa15 req-8d874828-1fbd-4134-993d-62852a1086a7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 945 time: 0.0802722 Nov 24 14:21:29.059030 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d1d2c35b-f74b-4e36-893d-de4907e9fa15 req-ed881975-8e4c-45f9-9ac0-c1883411248a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385060 Nov 24 14:21:29.539574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:21:29.620093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:21:29.625202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:21:29.625574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:29.736910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:29.765277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:21:29.774814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:21:29.778933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:29.782040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:29.848465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:29.851551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:29.901165 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'code': 200} Nov 24 14:21:30.125566 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-13f7dfd5-a05c-4c18-94a9-e517320c22c8 req-6b703428-4e9c-4c0d-983e-8a94498944e1 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1099 time: 0.0706103 Nov 24 14:21:30.172518 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-13f7dfd5-a05c-4c18-94a9-e517320c22c8 req-50e0576f-5926-4ea7-8ca6-1bbf77951e92 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409589 Nov 24 14:21:30.258956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a386fb9e-e93e-4f13-92f8-ef1ffef421dd req-864b502b-6245-4a5e-8797-bbe9e08f1a14 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:30.260465 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a386fb9e-e93e-4f13-92f8-ef1ffef421dd req-864b502b-6245-4a5e-8797-bbe9e08f1a14 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.0758088 Nov 24 14:21:30.306663 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a386fb9e-e93e-4f13-92f8-ef1ffef421dd req-40f5ab18-3972-485c-9374-5b577a33b381 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398650 Nov 24 14:21:31.517614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b77f8401-772b-4c08-894d-ecd6c282f9e1 req-5fe31f4c-08ff-42eb-8c44-c271dabc91d4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:31.519046 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b77f8401-772b-4c08-894d-ecd6c282f9e1 req-5fe31f4c-08ff-42eb-8c44-c271dabc91d4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.0830998 Nov 24 14:21:31.564852 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b77f8401-772b-4c08-894d-ecd6c282f9e1 req-3cf744bf-911e-4fca-bb10-802116a2b33b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402610 Nov 24 14:21:32.765817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e559eda8-d254-452b-8964-7eef63fca7af req-45bcd8f2-e694-4a8c-b5db-d3c4f8d29673 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:32.767239 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e559eda8-d254-452b-8964-7eef63fca7af req-45bcd8f2-e694-4a8c-b5db-d3c4f8d29673 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.0813346 Nov 24 14:21:32.810984 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e559eda8-d254-452b-8964-7eef63fca7af req-e3638ac0-d0c2-4b44-aef7-f96e303e07a2 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382028 Nov 24 14:21:33.009147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc7656e-de72-47e7-a08f-8e715a2fbdb9 req-55cf9d6c-3dcd-4c4c-bf05-3d7fdbccd706 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:33.010557 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3dc7656e-de72-47e7-a08f-8e715a2fbdb9 req-55cf9d6c-3dcd-4c4c-bf05-3d7fdbccd706 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.0809700 Nov 24 14:21:33.055185 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3dc7656e-de72-47e7-a08f-8e715a2fbdb9 req-1ee10efa-c5da-4c86-a3dd-725dada74149 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389044 Nov 24 14:21:33.083284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48916) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:33.151632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8169d0ff-c615-44a3-b11d-40318bdffee6 tempest-TestNetworkBasicOps-623088574 tempest-TestNetworkBasicOps-623088574-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1094 time: 0.0671196 Nov 24 14:21:33.154181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48920) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:33.159403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address': '172.20.0.10'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:21:33.164767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:21:33.168483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Usage tracker for resource:floatingip and tenant:8266f75badc14ec9b01ae6b8d8f4370b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:21:33.171199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:21:33.177639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:21:33.188361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:33.231724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef439fe3-d1c0-4a47-b7ef-a6bac067acff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:33.324801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:33.464628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Allocated IP 172.26.4.96 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/d7adadd7-524e-400d-bfae-ce51d8b37503) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:21:33.611697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:33.614629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:33.639587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:33.643942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54ea642d-38ec-4805-a69f-46d46612d8bb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:33.706103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:21:33.709185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:21:33.711681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:21:33.745551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=d7adadd7-524e-400d-bfae-ce51d8b37503,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:33.748189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:34.337399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:34.391375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:34.597784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:34.602151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:34.606490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15ae0330-40f4-4f60-bcf7-7283e3985978 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:21:34.706604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event updated for resources: {'Port': ['ID=d7adadd7-524e-400d-bfae-ce51d8b37503,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:21:34.710452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:21:34.725835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:34.919197 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Floating IP 57732280-c230-4432-bd72-aa2fea29995d associated. External IP: 172.26.4.96, port: 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c. Nov 24 14:21:35.305855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:21:35.506009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:21:35.516250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] Sync routers for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:21:35.527981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:35.528603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:35.530428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:35.590718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4330611 Nov 24 14:21:35.590718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:21:35.591077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48924) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:35.653354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'status': 'completed', 'code': 200} Nov 24 14:21:35.721373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:35.738596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-df995ed3-e26d-4cb4-b77e-ae77d0c52d5f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1462591 Nov 24 14:21:35.767596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-3c86da42-8ea8-436e-a824-28719743b99c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1099 time: 0.0841486 Nov 24 14:21:35.875245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-815c84f5-0d9b-4d88-a4f7-c409355fc0a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:35.898526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3486b62b-2657-4663-b346-756b82721323 req-7b5221f7-9deb-495f-a0b2-7e0d778a8cc5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:35.899977 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-7b5221f7-9deb-495f-a0b2-7e0d778a8cc5 service neutron] 10.222.0.47 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 898 time: 0.1266851 Nov 24 14:21:36.004134 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-68cf92d8-422a-4a2b-9a0f-7cc7e6bca815 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 999 time: 0.0971682 Nov 24 14:21:36.067930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3486b62b-2657-4663-b346-756b82721323 req-80cfa47d-92c3-43ad-8cc9-b0dd4454b6b9 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:36.069339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-80cfa47d-92c3-43ad-8cc9-b0dd4454b6b9 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 200 len: 835 time: 0.0595670 Nov 24 14:21:36.085357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:16Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '57732280-c230-4432-bd72-aa2fea29995d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.96', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:21:34Z', 'updated_at': '2021-11-24T14:21:34Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:21:23Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:36.089284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] Checking router: 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:21:36.100217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:21:36.100812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:21:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:36.151906 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-c12a7628-70d6-4739-a305-ea4967086999 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0754161 Nov 24 14:21:36.288509 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-0fd911c7-a3d8-417f-ae89-262dca058440 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1300406 Nov 24 14:21:36.318094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:21:36.540043 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3486b62b-2657-4663-b346-756b82721323 req-a841b44a-2b1d-4991-8bd8-517542c8e7a0 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2450581 Nov 24 14:21:36.667782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:16Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '57732280-c230-4432-bd72-aa2fea29995d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.96', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:21:34Z', 'updated_at': '2021-11-24T14:21:34Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:21:23Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:21:36.672453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59448fb5-3aa5-414d-86f1-89f4b604a1c8 None None] The sync data for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv is: [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:21:16Z', 'revision_number': 4, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:21:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '57732280-c230-4432-bd72-aa2fea29995d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.96', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:21:34Z', 'updated_at': '2021-11-24T14:21:34Z', 'revision_number': 0, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:21:23Z', 'revision_number': 5, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:21:36.741541 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48930) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:36.781559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:36.845838 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-36349386-4b33-485d-98ca-0f4b76167ec3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1029248 Nov 24 14:21:37.849666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48934) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:37.950774 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-80990d84-9761-4808-a1b3-6f4bd2f3252a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.0997906 Nov 24 14:21:38.468569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:38.774733 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9b7f062-8bc1-480d-8d1e-4a701aafed68 None None] New status for floating IP 57732280-c230-4432-bd72-aa2fea29995d: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:21:38.955015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48938) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:21:39.060088 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3632e37d-ffd9-4d19-bd72-988d9d15db8c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 993 time: 0.1039166 Nov 24 14:21:47.914376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:21:53.813499 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:21:54.040092 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-7f69cb70-ab1a-4cae-8d6e-157b58ccd365 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1341960 Nov 24 14:21:54.177687 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-f2b85269-c2a4-4296-b9d9-aa1bfb0c02d1 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1099 time: 0.0696347 Nov 24 14:21:54.327635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-3e99c0eb-9af9-4ffc-ba32-5b04bccda287 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:54.329704 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-3e99c0eb-9af9-4ffc-ba32-5b04bccda287 service neutron] 10.222.0.47 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 898 time: 0.1300111 Nov 24 14:21:54.434750 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-341ea95f-d5ee-459c-a80b-ea18c36130af service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 1001 time: 0.0988574 Nov 24 14:21:54.512140 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-38982cf7-185a-479d-8e6c-c50c1782b70e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:21:54.513591 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-38982cf7-185a-479d-8e6c-c50c1782b70e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 200 len: 835 time: 0.0733507 Nov 24 14:21:54.590359 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-ed7f3514-7c98-4940-bbdf-bc2368f90d06 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0707731 Nov 24 14:21:54.721566 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-185d5c66-05f1-4849-9dd4-25ae327048d7 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244133 Nov 24 14:21:54.850781 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3605ebf6-f437-4b9d-9a1b-9a4448185a32 req-af466893-722f-4dbc-b4b6-beb7b713a569 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1234658 Nov 24 14:22:03.235095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b49e4e3-a63d-45ec-8b03-475530170c00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:03.616454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:05.796943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b98b5332-8ecc-45a5-a90a-2e2d2ee7bb02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:06.785864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:08.473175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:17.912062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:30.813066 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:22:33.241629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e10292c-e130-4f87-ac51-457a9faec310 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:33.618518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:35.801280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-927942aa-6fb1-410a-9978-4797ff3f36e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:36.789087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:38.476071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:47.903633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:48.022703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48972) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:48.028178 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:22:48.689590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:48.700196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:48.900602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:22:49.099956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:22:49.105932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:49.108080 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-21e0abf7-5f0b-4b0d-aab5-ea64ee4444a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/9f2a9a04-826b-45b8-bdc5-2871fb2161e8 HTTP/1.1" status: 200 len: 887 time: 1.0834537 Nov 24 14:22:49.110404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa848b22-189e-434b-b4db-74479237410c None None] Sync routers for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:22:49.124270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa848b22-189e-434b-b4db-74479237410c None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:22:49.124877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa848b22-189e-434b-b4db-74479237410c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:22:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:49.184309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa848b22-189e-434b-b4db-74479237410c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:49.195060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa848b22-189e-434b-b4db-74479237410c None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:22:49.195657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa848b22-189e-434b-b4db-74479237410c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:22:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:49.256635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-fa848b22-189e-434b-b4db-74479237410c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:49.257048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa848b22-189e-434b-b4db-74479237410c None None] The sync data for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv is: [] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:22:49.999150 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28e033f8-1a15-4955-8e48-3edd00b782ab None None] New status for floating IP 57732280-c230-4432-bd72-aa2fea29995d: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:22:51.082669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:22:51.197405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:51.230538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7c25d742-d396-4cc8-b367-41237e438525, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7c25d742-d396-4cc8-b367-41237e438525,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:22:51.235034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:51.235780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:22:51.258746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8f5a2785-dada-47b1-b180-720d62a2c8a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:22:51.271358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48978) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:51.277272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Request body: {'router': {'admin_state_up': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:22:51.353965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:22:51.391840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.392187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.392517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.392975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.393175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.393525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.395256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.395256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.395548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.395912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.396241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:22:51.405139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:22:51.425225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:51.441336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:22:51.445050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:51.446763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:22:51.511253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:22:51.514242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:22:51.977042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:51.987098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1005885', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1005860', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1003178'] for router, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:52.190040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:22:52.392809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:22:52.399166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:52.400334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8d41e95a-783b-478d-90f8-9386d9d3382b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/9f2a9a04-826b-45b8-bdc5-2871fb2161e8 HTTP/1.1" status: 200 len: 886 time: 1.1276591 Nov 24 14:22:52.402839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] Sync routers for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:22:52.403303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48982) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:52.416055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:22:52.416670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:22:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:52.511467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5af0ba0b-79be-4e8c-a6f4-5db8f850ffbf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1070223 Nov 24 14:22:52.596173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:22:52.973175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '57732280-c230-4432-bd72-aa2fea29995d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.96', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:21:34Z', 'updated_at': '2021-11-24T14:22:50Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:52.977021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] Checking router: 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:22:52.988020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:22:52.988629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:22:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:53.166011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:22:53.506233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '57732280-c230-4432-bd72-aa2fea29995d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.96', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:21:34Z', 'updated_at': '2021-11-24T14:22:50Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:22:53.510299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c988b858-9922-4194-91bf-647acf6c4551 None None] The sync data for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv is: [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 5, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '57732280-c230-4432-bd72-aa2fea29995d', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'floating_ip_address': '172.26.4.96', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'port_id': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'mac_address': 'fa:16:3e:f8:0a:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:21:34Z', 'updated_at': '2021-11-24T14:22:50Z', 'revision_number': 2, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7c25d742-d396-4cc8-b367-41237e438525', 'name': '', 'network_id': 'de1a0035-d57c-4f9c-a372-1cb3a4c92dc4', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'mac_address': 'fa:16:3e:9f:a3:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:16Z', 'updated_at': '2021-11-24T14:22:51Z', 'revision_number': 6, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'subnets': [{'id': 'a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:22:53.515063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48986) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:53.623554 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ef8d8146-c4cd-4ada-9b71-fa7e09259aa0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1072838 Nov 24 14:22:54.627242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48990) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:54.732796 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d6c21f66-c6eb-44c7-bee4-92a47842a66a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1042438 Nov 24 14:22:55.122604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:22:55.193759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7c25d742-d396-4cc8-b367-41237e438525 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:22:55.194134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:55.306000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:55.337352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 7c25d742-d396-4cc8-b367-41237e438525, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7c25d742-d396-4cc8-b367-41237e438525,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:22:55.340605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:55.341543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:22:55.368047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f908332a-6e59-4b13-b734-0b98d109e47a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:22:55.454096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:22:55.458846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:22:55.483019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:22:55.483394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:55.595232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:55.610864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:22:55.615569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:55.617289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:22:55.682006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:22:55.684920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:22:55.736591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 48994) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:55.854392 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6f43dcfe-930d-46a3-bd95-a1b74075ee34 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1154943 Nov 24 14:22:56.022861 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-a2b1d9ee-167b-431c-a47d-80e45f86f399 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0720122 Nov 24 14:22:56.180163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-34f73375-60f8-4dfb-85b2-333c63280c1f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1099 time: 0.0695105 Nov 24 14:22:56.428330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-5bdb4461-96a7-4b8f-a4fb-5859fa6f9f48 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:22:56.429750 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-5bdb4461-96a7-4b8f-a4fb-5859fa6f9f48 service neutron] 10.222.0.47 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 898 time: 0.2313983 Nov 24 14:22:56.533769 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-15563d80-8c2d-4ca1-a720-dacf5cbd5278 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 999 time: 0.0974357 Nov 24 14:22:56.598091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-c17e70d1-cc76-465c-84a6-6131b696a008 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:22:56.599491 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-c17e70d1-cc76-465c-84a6-6131b696a008 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 200 len: 835 time: 0.0597897 Nov 24 14:22:56.672270 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-c4df9d5e-d181-475e-8167-ae6db99c99d0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0664952 Nov 24 14:22:56.803438 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-8ac9ae2f-828a-4d7d-baaf-4fc2796cf438 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248696 Nov 24 14:22:56.857792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 48998) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:56.937163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1cbfe9b-d9ee-44ac-96f5-9ba5aa38d3a5 req-02763723-0220-4423-a080-1cbda5c2085c service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269548 Nov 24 14:22:56.973396 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a7c2afa2-d1f8-4a69-8551-7e5f748f0586 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1143095 Nov 24 14:22:57.089957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:22:57.157531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 7c25d742-d396-4cc8-b367-41237e438525 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:22:57.157906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:57.274211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:22:57.339568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:22:57.339899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:22:57.977217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49002) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:58.076577 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2368093a-a306-49a9-aa7c-c0e47e49023b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.0981598 Nov 24 14:22:59.080424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 49006) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:22:59.188302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6f1e9763-0a17-42b9-acee-4078c55fe0f7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1066163 Nov 24 14:23:00.192443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49010) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:00.307398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ab808ebc-ce25-453a-8956-481c4728f20c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 991 time: 0.1136994 Nov 24 14:23:00.605142 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfbc2a71-7bc1-4e43-bfe1-ca00ccc640cd None None] New status for floating IP 57732280-c230-4432-bd72-aa2fea29995d: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:23:01.311243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49014) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:01.419184 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-61cf671b-a0cf-403d-941e-dec7f4ac34a6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 200 len: 993 time: 0.1066971 Nov 24 14:23:01.709754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49024) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:01.910228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port d7adadd7-524e-400d-bfae-ce51d8b37503 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:23:01.910813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:02.217562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:02.217794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:02.338122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for d7adadd7-524e-400d-bfae-ce51d8b37503 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:23:02.488626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:02.492191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbc2-d354-4f4b-b187-90899225eef2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:02.538967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=d7adadd7-524e-400d-bfae-ce51d8b37503,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:02.579264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.579642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.580042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.580411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.581270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.582214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.582214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.582417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.582790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.583162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.583530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:02.590503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:02.644334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:03.028630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:23:03.239586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:23:03.250294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aa18bdea-eed3-4909-a648-bc9c8cc46419 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:03.260206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:03.320239 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/floatingips/57732280-c230-4432-bd72-aa2fea29995d HTTP/1.1" status: 204 len: 168 time: 1.6093876 Nov 24 14:23:03.320883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:23:03.377618 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'status': 'completed', 'code': 200} Nov 24 14:23:03.475991 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-3ed98cd9-1afe-446b-8ced-5d3e465a90d6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 1099 time: 0.0744417 Nov 24 14:23:03.610706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-86047cf7-c342-471c-818c-8969e69e524c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:03.612206 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-86047cf7-c342-471c-818c-8969e69e524c service neutron] 10.222.0.47 "GET /v2.0/networks?id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 200 len: 898 time: 0.1304815 Nov 24 14:23:03.621950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:03.686452 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-55595402-cd5c-4f47-b47b-3a530a66a4a8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 200 len: 217 time: 0.0672245 Nov 24 14:23:03.722932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60a67ad-118e-43d9-b479-d25f0103a56b req-07a4c455-8889-47ae-850c-f610ed127fa0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:03.723633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-c60a67ad-118e-43d9-b479-d25f0103a56b req-07a4c455-8889-47ae-850c-f610ed127fa0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Synchronizing usage tracker for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:23:03.741346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-c60a67ad-118e-43d9-b479-d25f0103a56b req-07a4c455-8889-47ae-850c-f610ed127fa0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Unset dirty status for tenant:8266f75badc14ec9b01ae6b8d8f4370b on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:23:03.744439 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c60a67ad-118e-43d9-b479-d25f0103a56b req-07a4c455-8889-47ae-850c-f610ed127fa0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.0994444 Nov 24 14:23:03.754878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-cd889145-d805-4bc1-aa10-f71073149769 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:03.756335 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-cd889145-d805-4bc1-aa10-f71073149769 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 200 len: 835 time: 0.0628021 Nov 24 14:23:03.791651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c60a67ad-118e-43d9-b479-d25f0103a56b req-ca67f385-eb1d-465f-a79e-5696cee52e23 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426767 Nov 24 14:23:03.842354 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-0e60f83a-d4eb-4286-8b77-6e3489200c37 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0784426 Nov 24 14:23:03.976262 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-87911c15-26b6-4630-98bb-a79d89f584d0 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269400 Nov 24 14:23:04.107041 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-116fd2f9-58cd-402c-a621-f40f016e3c96 req-ea395ab3-81a4-4098-84f8-a0b9e9250473 service neutron] 10.222.0.47 "GET /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238098 Nov 24 14:23:05.005155 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce5fb9d-3ed2-4d0b-b5a1-e3e0aaab7b64 req-f8bf52de-63b1-4a6a-a70f-8af7ec0be6c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:05.006519 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0ce5fb9d-3ed2-4d0b-b5a1-e3e0aaab7b64 req-f8bf52de-63b1-4a6a-a70f-8af7ec0be6c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.0845742 Nov 24 14:23:05.051968 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0ce5fb9d-3ed2-4d0b-b5a1-e3e0aaab7b64 req-7f901028-c060-4b74-bf11-417232036a55 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/security-groups?id=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399396 Nov 24 14:23:05.389218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-50336d05-a8af-4582-89fa-3792357afa31 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:05.390616 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-50336d05-a8af-4582-89fa-3792357afa31 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 946 time: 0.1853132 Nov 24 14:23:05.458340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:23:05.458674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:05.697467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:05.697821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:05.803641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3c2090fc-3af4-4863-92df-cdfeabaacd80 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:05.819921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:23:05.961122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:05.966725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d5d768c7-82a0-4015-b045-cedf8b360131 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:06.012088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=005116c0-72bb-41e9-9cd1-f4f3ad20fd1c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:06.047839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.048225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.048605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.048975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.049977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.050461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.050817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.051181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.051538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.051919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.052276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:06.059183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:06.097878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] No DVR routers for this DVR port 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:23:06.100384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:06.103043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'name': 'network-vif-deleted', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:23:06.120281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e20d24e0-a59a-43ae-817f-7c4cbe13c29d req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.47 "DELETE /v2.0/ports/005116c0-72bb-41e9-9cd1-f4f3ad20fd1c HTTP/1.1" status: 204 len: 173 time: 0.7235904 Nov 24 14:23:06.163906 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd1ae9865-9708-4751-a378-6486b9cc2bbe', 'name': 'network-vif-deleted', 'tag': '005116c0-72bb-41e9-9cd1-f4f3ad20fd1c', 'status': 'completed', 'code': 200} Nov 24 14:23:06.225672 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cadf5c41-c48a-49fa-a1b8-5434db6d65b0 req-90b74cfd-c8fb-44a1-b641-486281e5664e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "GET /v2.0/ports?device_id=d1ae9865-9708-4751-a378-6486b9cc2bbe HTTP/1.1" status: 200 len: 210 time: 0.0438147 Nov 24 14:23:06.791563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:07.351550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49042) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:07.422436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:07.451717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:07.514098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:07.518162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c9524155-3929-44e3-bac6-99c03ec57214 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:07.532374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=289c740d-e7e9-40bd-ab3a-5db3ad49c2e9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:07.536026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:07.544991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:07.546099 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/security-groups/289c740d-e7e9-40bd-ab3a-5db3ad49c2e9 HTTP/1.1" status: 204 len: 168 time: 0.1935413 Nov 24 14:23:07.585858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49048) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:07.813185 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:23:07.976151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:23:08.009823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:23:08.010177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 005116c0-72bb-41e9-9cd1-f4f3ad20fd1c not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:23:08.086083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:08.478860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:08.694789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 7c25d742-d396-4cc8-b367-41237e438525 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:23:08.695423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:08.878735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 7c25d742-d396-4cc8-b367-41237e438525, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=7c25d742-d396-4cc8-b367-41237e438525,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:08.879295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:08.997289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 7c25d742-d396-4cc8-b367-41237e438525 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:23:09.178479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:09.182919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:09.340532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=7c25d742-d396-4cc8-b367-41237e438525,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:09.344032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:09.637702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:10.203973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:23:10.401427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:23:10.416054 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "PUT /v2.0/routers/9f2a9a04-826b-45b8-bdc5-2871fb2161e8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8291030 Nov 24 14:23:10.418852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49052) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:10.603124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting subnet a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:23:10.605821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:10.659357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:10.737559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:10.924043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:10.928515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3ec02cc3-50ec-458b-abcf-ca10dd6beb0a tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:10.965535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Subnet': ['ID=a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:10.968801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:10.969777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:10.976043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbdac5a2-d98a-442c-85cc-1a07398daba3 None None] Network de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:23:10.977189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/subnets/a2fe1d6b-2b07-4cf5-81c9-c970a62e2fd2 HTTP/1.1" status: 204 len: 168 time: 0.5573249 Nov 24 14:23:10.979709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49056) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:11.041596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] Sync routers for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:23:11.112216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:11.112845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:11.183282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.338783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:11.397223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.408333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Deleting port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:23:11.409032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.447729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] DHCP port deletion for de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:23:11.476525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Deleting port c3bdd633-98c5-492b-9fe1-9c7be661c164 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:23:11.476898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.583114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] For port 1c3ad437-4be4-40ae-9752-ea19afb4b0fe, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:11.583479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.703090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Calling delete_port for 1c3ad437-4be4-40ae-9752-ea19afb4b0fe owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:23:11.806127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] For port c3bdd633-98c5-492b-9fe1-9c7be661c164, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c3bdd633-98c5-492b-9fe1-9c7be661c164,segment=NetworkSegment(0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00),segment_id=0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:11.806531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.867411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:11.871453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48c31fa8-fdda-41bd-aced-1b4d5f35d347 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:11.918016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Port': ['ID=1c3ad437-4be4-40ae-9752-ea19afb4b0fe,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:11.920612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:11.988334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Calling delete_port for c3bdd633-98c5-492b-9fe1-9c7be661c164 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:23:12.046959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88'}], 'enable_snat': True}, 'gw_port_id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:23:09Z', 'revision_number': 7, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port': {'id': '1c3ad437-4be4-40ae-9752-ea19afb4b0fe', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:77:66:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.88', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:21:13Z', 'updated_at': '2021-11-24T14:22:55Z', 'revision_number': 6, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:12.053393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] Checking router: 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:23:12.077701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] Routers {'9f2a9a04-826b-45b8-bdc5-2871fb2161e8'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:12.078415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:12.130463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.139666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.187912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-207c1ab5-6d8d-482e-8d84-1cc3e2bf721b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:12.241779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Pushing event deleted for resources: {'Port': ['ID=c3bdd633-98c5-492b-9fe1-9c7be661c164,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:12.246824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:12.253078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] No DVR routers for this DVR port c3bdd633-98c5-492b-9fe1-9c7be661c164 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:23:12.258422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] Set router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:12.370582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:23:11Z', 'revision_number': 9, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:12.374720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-178def3c-ba38-4fad-aa26-ae8050e47b54 None None] The sync data for ids ['9f2a9a04-826b-45b8-bdc5-2871fb2161e8'] in dv-neutron-818151-2-hyperv is: [{'id': '9f2a9a04-826b-45b8-bdc5-2871fb2161e8', 'name': 'tempest-TestNetworkBasicOps-router-288820440', 'tenant_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:21:12Z', 'updated_at': '2021-11-24T14:23:11Z', 'revision_number': 9, 'project_id': '8266f75badc14ec9b01ae6b8d8f4370b', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:23:12.521276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.525461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.557381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.557970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Fanout notify agent at l3_agent the message router_deleted on router 9f2a9a04-826b-45b8-bdc5-2871fb2161e8 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:23:12.572525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.573583 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/routers/9f2a9a04-826b-45b8-bdc5-2871fb2161e8 HTTP/1.1" status: 204 len: 168 time: 1.5928600 Nov 24 14:23:12.576325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49060) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:12.684718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.816381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.843198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['de1a0035-d57c-4f9c-a372-1cb3a4c92dc4']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:12.856591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:12.856879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0af1f153-c2ed-4de9-8a3d-c4c5cf0e9a00') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:12.869172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.885701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.891452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:23:12.891846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:23:12.906728 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:23:12.944497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f81fadb6-7261-4b10-afa5-9bb1d1299441 None None] New status for floating IP 57732280-c230-4432-bd72-aa2fea29995d: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:23:12.990502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:12.994046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c3b0566e-e875-4371-be6c-14e79e66e920 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:13.011042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:13.017235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Pushing event deleted for resources: {'Network': ['ID=de1a0035-d57c-4f9c-a372-1cb3a4c92dc4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:13.022215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:13.030487 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-792c082d-2799-40e9-b63d-3a42843b2356 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] 10.222.0.70 "DELETE /v2.0/networks/de1a0035-d57c-4f9c-a372-1cb3a4c92dc4 HTTP/1.1" status: 204 len: 168 time: 0.4532032 Nov 24 14:23:13.096193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:23:13.130436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 7c25d742-d396-4cc8-b367-41237e438525 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:23:13.130796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 7c25d742-d396-4cc8-b367-41237e438525 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:23:13.131221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:23:13.164571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1c3ad437-4be4-40ae-9752-ea19afb4b0fe {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:23:13.165124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1c3ad437-4be4-40ae-9752-ea19afb4b0fe not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:23:13.165548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c3bdd633-98c5-492b-9fe1-9c7be661c164 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:23:13.199302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c3bdd633-98c5-492b-9fe1-9c7be661c164 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:23:13.200750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c3bdd633-98c5-492b-9fe1-9c7be661c164 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:23:13.423736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49068) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:13.602795 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0da84a6f-e605-43de-bc94-b550d1c738aa admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=8266f75badc14ec9b01ae6b8d8f4370b&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1776497 Nov 24 14:23:13.606341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49074) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:13.666114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:13.691595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:13.745241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:13.748909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b4a13e9-cede-4be4-b853-1dd1a39082a0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:13.761643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2d9488f-e3f6-4eb6-8124-78344968d3de,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:13.764125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:13.773984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:13.775082 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/d2d9488f-e3f6-4eb6-8124-78344968d3de HTTP/1.1" status: 204 len: 168 time: 0.1678748 Nov 24 14:23:14.119320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49082) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:14.138423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.169959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:14.173661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Usage tracker for resource:security_group_rule and tenant:7c4aeb001f0d449abad0580bdf7ea75b is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:14.177221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:14.182807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:14.261183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.266043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.274706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afad7f44-6115-4415-a2e8-656069270273 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:14.314636 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=7c4aeb001f0d449abad0580bdf7ea75b&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1941597 Nov 24 14:23:14.317577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49086) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:14.328853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4c674fd-9d23-4236-8063-192e43677930,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:14.333406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-26542f1c-4a91-44f0-b21b-b83b0c61adba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:14.389793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.419216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.473999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.477792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a8783105-9bb6-47e5-9e32-cf4c46db162b tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:14.488885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4c674fd-9d23-4236-8063-192e43677930,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:14.492414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:14.495562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:14.497138 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/a4c674fd-9d23-4236-8063-192e43677930 HTTP/1.1" status: 204 len: 168 time: 0.1786406 Nov 24 14:23:15.385294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49108) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:15.513507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-287562138-network', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:15.518401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:15.522297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Usage tracker for resource:network and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:15.525175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:15.531102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:15.542078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Made reservation on behalf of d44584538fcc4f2284b467ff03a0cb46 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:23:15.544511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.557280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.588919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:15.592957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:15.595683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:15.601822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:15.684433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.688103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.691339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1608a0ec-2871-4e7f-8136-90004de888f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:15.718735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 863} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:23:15.727677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=693b946e-dea4-4fc7-a982-4053a3bbb228,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:15.731097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:15.733730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.734146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Added segment bb5981d0-fea0-4acc-85f4-2063eb49fd05 of type vlan for network f5e04962-eb4f-4396-aa25-69add7c3142b Nov 24 14:23:15.760905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.793842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.794842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:15.795489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:15.800767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-341ac877-ea5e-493c-b4b6-bebcdcf6090e tempest-PortsTestJSON-1743175439 tempest-PortsTestJSON-1743175439-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:15.896096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Pushing event updated for resources: {'Network': ['ID=f5e04962-eb4f-4396-aa25-69add7c3142b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:15.898967 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5126786 Nov 24 14:23:15.899857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:15.902169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49114) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:15.906920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network f5e04962-eb4f-4396-aa25-69add7c3142b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:23:15.907434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Request body: {'subnet': {'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-287562138-subnet', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:15.913344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:15.917228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Usage tracker for resource:subnet and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:15.920216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:15.926710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:15.940552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Made reservation on behalf of d44584538fcc4f2284b467ff03a0cb46 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:23:15.942799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.151033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.155260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7f191db3-282f-46b0-a530-55d7b21d07b6 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:16.224498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aaf4b47d-96c4-4601-9724-7a1db6954596,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:16.227189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:16.235766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Checking segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:16.236135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Network hostable DHCP agents. Network: f5e04962-eb4f-4396-aa25-69add7c3142b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:23:16.257848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Network f5e04962-eb4f-4396-aa25-69add7c3142b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:23:16.267247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, f5e04962-eb4f-4396-aa25-69add7c3142b) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:16.272401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:16.273139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.280199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-438065b9-7993-4e90-9034-e63ace8b9b4e None None] Network f5e04962-eb4f-4396-aa25-69add7c3142b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:23:16.295119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3919327 Nov 24 14:23:16.298152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 49118) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:16.303435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:16.308159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:16.312083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Usage tracker for resource:router and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:16.315156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:16.321542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:16.336120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.337179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.358257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.508757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.512634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-f5e04962-eb4f-4396-aa25-69add7c3142b', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:23:16.513758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.676608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Allocated IP 172.20.0.2 (f5e04962-eb4f-4396-aa25-69add7c3142b/aaf4b47d-96c4-4601-9724-7a1db6954596/3f021257-d1a4-4a32-8030-3c1f8d2cf1ce) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:16.700703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.730647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.865365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Allocated IP 172.26.4.5 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/33243d45-348c-4d38-aad5-1c1278d8431c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:16.888518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.899658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Transition to ACTIVE for port object 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:16.918953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Transition to ACTIVE for port object 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:16.925330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:16.929543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:16.996774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Network f5e04962-eb4f-4396-aa25-69add7c3142b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:16.997933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:17.001935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:17.009294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Pushing event updated for resources: {'Port': ['ID=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:17.016979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:17.022283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.059192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.063063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-306d1092-a1ea-4c11-9350-de43f08d7031 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:17.108069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Attempting to bind port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:17.108437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Attempting to bind port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:17.108803 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Attempting to bind port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:17.116492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:17.116795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Checking segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:17.117199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.117590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Bound using segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:17.118054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Bound port: 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:17.118425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.253520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:17.257039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:17.259019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Pushing event updated for resources: {'Port': ['ID=33243d45-348c-4d38-aad5-1c1278d8431c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:17.261085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:17.266667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] For port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:17.271919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] For port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:17.277288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.281069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-595d1475-a373-422e-8753-02c250aed8af None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:17.288554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:17.361376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Pushing event updated for resources: {'Port': ['ID=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:17.364878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:17.443509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.444282 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.700595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Router cc599847-0d0e-4030-af50-b6c10474b537 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:23:17.904967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:23:17.916252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:23:17.926049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.930514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:17.934740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:17.934909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.6330931 Nov 24 14:23:17.934992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:17.935090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49122) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:18.129624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:18.311595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ff20f41-d1f0-4bcc-b3ba-2cf6e1c2d035 None None] Network f5e04962-eb4f-4396-aa25-69add7c3142b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:23:18.431947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-10f65df9-d3c4-4f57-8907-702d1fe38275 None None] Provisioning for port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:18.628787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:17Z', 'revision_number': 3, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:18.635045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:23:18.635403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Updating router cc599847-0d0e-4030-af50-b6c10474b537 port 33243d45-348c-4d38-aad5-1c1278d8431c binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:23:18.701930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:18.822402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.034847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Allocated IP 172.20.0.1 (f5e04962-eb4f-4396-aa25-69add7c3142b/aaf4b47d-96c4-4601-9724-7a1db6954596/110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:19.061294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.076743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Transition to ACTIVE for port object 33243d45-348c-4d38-aad5-1c1278d8431c will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:19.086893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.091621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:19.139201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:19.222186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901809fc-10aa-472f-9302-b37c29cfa6d2 None None] Pushing event updated for resources: {'Port': ['ID=33243d45-348c-4d38-aad5-1c1278d8431c,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:19.226774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.226982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-901809fc-10aa-472f-9302-b37c29cfa6d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:19.229016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Attempting to bind port 33243d45-348c-4d38-aad5-1c1278d8431c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:19.229390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Attempting to bind port 33243d45-348c-4d38-aad5-1c1278d8431c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:19.229738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Attempting to bind port 33243d45-348c-4d38-aad5-1c1278d8431c on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:19.240238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:19.240618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:19.241028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.241424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:19.241893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Bound port: 33243d45-348c-4d38-aad5-1c1278d8431c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:19.242277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.243382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Transition to ACTIVE for port object 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:19.266978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.272304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a863c492-a519-4f7a-b690-a7c6ddf3bd5b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:19.298333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:19.315673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:19.316081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.343677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Network f5e04962-eb4f-4396-aa25-69add7c3142b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:19.353077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:19.353077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:19.363694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] For port 33243d45-348c-4d38-aad5-1c1278d8431c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:19.386930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Pushing event updated for resources: {'Port': ['ID=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:19.388538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] For port 33243d45-348c-4d38-aad5-1c1278d8431c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33243d45-348c-4d38-aad5-1c1278d8431c,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:19.390031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:19.400501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.406042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:19.420353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.514852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.586604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.599592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901809fc-10aa-472f-9302-b37c29cfa6d2 None None] Pushing event updated for resources: {'Port': ['ID=33243d45-348c-4d38-aad5-1c1278d8431c,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:19.606903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-901809fc-10aa-472f-9302-b37c29cfa6d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:19.613468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:19.614096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:19.689262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-763445db-cab7-4559-8ab0-902547938aa8 None None] Provisioning for port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:19.700049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-763445db-cab7-4559-8ab0-902547938aa8 None None] Provisioning complete for port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:19.700430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-763445db-cab7-4559-8ab0-902547938aa8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.730945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:19.743863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.747519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.748828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.753617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:19.776107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-79d3435f-19cf-448b-9aad-640960c787c3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:19.854700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:19.858267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Pushing event updated for resources: {'Port': ['ID=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:19.861382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:19.872518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-763445db-cab7-4559-8ab0-902547938aa8 None None] Port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:23:19.915785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:19.919223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:19.924684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:20.103774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Network f5e04962-eb4f-4396-aa25-69add7c3142b is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:20.105435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:20.253152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:20.257964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189ac2f7-d56d-4c9a-96f2-0f5e4b280134 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:23:20.415732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-54a6be87-64f8-42b4-9f03-c8dce2e4311c None None] Provisioning complete for port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:20.416637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-54a6be87-64f8-42b4-9f03-c8dce2e4311c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:20.496587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-54a6be87-64f8-42b4-9f03-c8dce2e4311c None None] Port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:23:20.553976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:23:20.770533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:23:20.779703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] 10.222.0.70 "PUT /v2.0/routers/cc599847-0d0e-4030-af50-b6c10474b537/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8435342 Nov 24 14:23:21.173504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33243d45-348c-4d38-aad5-1c1278d8431c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:21.262144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 33243d45-348c-4d38-aad5-1c1278d8431c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:21.270917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 33243d45-348c-4d38-aad5-1c1278d8431c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:21.271431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.414105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.431833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 33243d45-348c-4d38-aad5-1c1278d8431c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33243d45-348c-4d38-aad5-1c1278d8431c,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:21.436375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.437226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:21.461346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-595d1475-a373-422e-8753-02c250aed8af None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:21.551626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=33243d45-348c-4d38-aad5-1c1278d8431c,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:21.554986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:21.566386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:21.566767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.704303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:21.710565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-717437595-network', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:21.715306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:21.719546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Usage tracker for resource:network and tenant:f8c98204728f42a9a3f20285ef92099f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:21.722652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:21.728550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:21.739535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Made reservation on behalf of f8c98204728f42a9a3f20285ef92099f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:23:21.741781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.755098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.785754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:21.789483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Usage tracker for resource:security_group_rule and tenant:f8c98204728f42a9a3f20285ef92099f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:21.792189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:21.797972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:21.867995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.871486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.874307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-29449dad-e9f8-49a9-97d6-9d12b8f2a455 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:21.902696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:23:21.911254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d51cc03-a8ef-4666-ba1b-1e54d8314ffb,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:21.914659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:21.917076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.917409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Added segment cc7b312a-96d9-4d1c-a21c-7c99e6819124 of type vlan for network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 Nov 24 14:23:21.944568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.973855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.974666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:21.975226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:21.978430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-69778034-cb74-41dc-acf0-5656d4430f64 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:22.081015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Pushing event updated for resources: {'Network': ['ID=9e520458-3d0a-44fe-8213-a30cdc4c6bc1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:22.084273 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3782094 Nov 24 14:23:22.085149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:22.087110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 49148) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:22.090875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:23:22.094599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Request body: {'subnet': {'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-717437595-subnet', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:22.100210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:22.104451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Usage tracker for resource:subnet and tenant:f8c98204728f42a9a3f20285ef92099f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:22.108500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:22.114752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:22.124687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Made reservation on behalf of f8c98204728f42a9a3f20285ef92099f for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:23:22.127918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.329430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.333290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-00cf7c2f-3404-4b26-9b82-513f0a6d49fb tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:22.407260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2bec22e6-af44-48de-a291-105f8a8a45e2,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:22.411821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:22.419655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Checking segment: {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:22.420152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Network hostable DHCP agents. Network: 9e520458-3d0a-44fe-8213-a30cdc4c6bc1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:23:22.442666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:23:22.451879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 9e520458-3d0a-44fe-8213-a30cdc4c6bc1) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:22.456701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:22.457277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.464976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f3e7a2c-57eb-4e55-b88f-45a75e9d5d43 None None] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:23:22.480171 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3918762 Nov 24 14:23:22.482630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 49152) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:22.488802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:22.493325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:22.497118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Usage tracker for resource:router and tenant:f8c98204728f42a9a3f20285ef92099f is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:22.499908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:22.506153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:22.516571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.518477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.540792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.687728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.729091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-9e520458-3d0a-44fe-8213-a30cdc4c6bc1', 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'fixed_ips': [{'subnet_id': '2bec22e6-af44-48de-a291-105f8a8a45e2'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:23:22.730110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.874575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:22.886112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Allocated IP 172.20.0.2 (9e520458-3d0a-44fe-8213-a30cdc4c6bc1/2bec22e6-af44-48de-a291-105f8a8a45e2/76ce773c-855f-49ee-86d8-e17ca7629858) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:22.912550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.046041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Allocated IP 172.26.4.252 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/06268286-8864-4a19-a687-f4567ffce48c) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:23.106873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.111329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33243d45-348c-4d38-aad5-1c1278d8431c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:23.155738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Transition to ACTIVE for port object 76ce773c-855f-49ee-86d8-e17ca7629858 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:23.192124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Transition to ACTIVE for port object 76ce773c-855f-49ee-86d8-e17ca7629858 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:23.199428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.200088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.204112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a202f939-1e31-4bc0-a851-d753979ba179 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:23.229788 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.233808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d94f78ec-a14b-4888-b7d0-af6af2420c3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:23.279795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:23.283715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:23.286768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:23.293580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 33243d45-348c-4d38-aad5-1c1278d8431c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:23.293887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.319890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Pushing event updated for resources: {'Port': ['ID=76ce773c-855f-49ee-86d8-e17ca7629858,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:23.322869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:23.418395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:23.421716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:23.426054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:23.443115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Attempting to bind port 76ce773c-855f-49ee-86d8-e17ca7629858 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:23.443498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Attempting to bind port 76ce773c-855f-49ee-86d8-e17ca7629858 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:23.443969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Attempting to bind port 76ce773c-855f-49ee-86d8-e17ca7629858 on network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:23.453057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Pushing event updated for resources: {'Port': ['ID=06268286-8864-4a19-a687-f4567ffce48c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:23.462891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:23.477750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:23.478292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Checking segment: {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:23.478528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.478932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Bound using segment: {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:23.479418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Bound port: 76ce773c-855f-49ee-86d8-e17ca7629858, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:23.479821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.595197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.596032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.596389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] For port 76ce773c-855f-49ee-86d8-e17ca7629858, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:23.599632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] For port 76ce773c-855f-49ee-86d8-e17ca7629858, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=76ce773c-855f-49ee-86d8-e17ca7629858,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:23.604170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:23.607714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:23.693212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Pushing event updated for resources: {'Port': ['ID=76ce773c-855f-49ee-86d8-e17ca7629858,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:23.695218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:23.858952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:23:24.069361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:23:24.078341 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Sync routers for ids ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:23:24.092301 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Routers {'6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:24.092906 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:24.093113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:24.094285 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.6106632 Nov 24 14:23:24.097838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 49156) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:24.272538 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Set router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:24.577473 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:23Z', 'revision_number': 3, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:24.582857 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Checking router: 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:23:24.583214 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Updating router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a port 06268286-8864-4a19-a687-f4567ffce48c binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:23:24.629660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa7fc85d-469c-4e83-a257-3f9b97145e69 None None] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:23:24.637173 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:24.728252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-491cad03-640b-47c1-b21c-879b4f5e3d96 None None] Provisioning for port 76ce773c-855f-49ee-86d8-e17ca7629858 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:24.875272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.001221 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.013807 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Transition to ACTIVE for port object 06268286-8864-4a19-a687-f4567ffce48c will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:25.022236 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.026172 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-ba10501c-b399-46a8-8915-8f50ceb59627 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:25.090956 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Attempting to bind port 06268286-8864-4a19-a687-f4567ffce48c on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:25.092352 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Attempting to bind port 06268286-8864-4a19-a687-f4567ffce48c by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:25.092916 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Attempting to bind port 06268286-8864-4a19-a687-f4567ffce48c on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:25.108634 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:25.109017 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:25.109423 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.109862 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:25.110348 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Bound port: 06268286-8864-4a19-a687-f4567ffce48c, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:25.110726 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.168935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 76ce773c-855f-49ee-86d8-e17ca7629858 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:25.194303 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] For port 06268286-8864-4a19-a687-f4567ffce48c, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:25.207226 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Pushing event updated for resources: {'Port': ['ID=06268286-8864-4a19-a687-f4567ffce48c,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:25.212411 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] For port 06268286-8864-4a19-a687-f4567ffce48c, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=06268286-8864-4a19-a687-f4567ffce48c,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:25.218105 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.218669 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.219140 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.219604 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.220089 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.220700 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.221237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Allocated IP 172.20.0.1 (9e520458-3d0a-44fe-8213-a30cdc4c6bc1/2bec22e6-af44-48de-a291-105f8a8a45e2/30cbe484-4a1d-49d2-bdd0-7ff090143a91) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:25.221350 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.221824 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.222315 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.222843 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.223172 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:23:25.227123 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.231022 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:25.231484 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:25.280487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 76ce773c-855f-49ee-86d8-e17ca7629858 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:25.286898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 76ce773c-855f-49ee-86d8-e17ca7629858 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:25.287523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.309275 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Pushing event updated for resources: {'Port': ['ID=06268286-8864-4a19-a687-f4567ffce48c,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:25.312719 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:25.317181 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Routers {'6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:25.317995 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:25.401758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.417291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Transition to ACTIVE for port object 30cbe484-4a1d-49d2-bdd0-7ff090143a91 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:25.426837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.442871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.447574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:25.463451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 76ce773c-855f-49ee-86d8-e17ca7629858, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=76ce773c-855f-49ee-86d8-e17ca7629858,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:25.469472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.474416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:25.503078 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] Set router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:25.512842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:25.520290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:25.522872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:25.549272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=76ce773c-855f-49ee-86d8-e17ca7629858,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:25.552907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:25.560687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Pushing event updated for resources: {'Port': ['ID=30cbe484-4a1d-49d2-bdd0-7ff090143a91,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:25.563673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:25.588131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.674439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.761939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fdbcea24-b493-4925-9237-fae02d72b8ea None None] Provisioning for port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:25.767660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fdbcea24-b493-4925-9237-fae02d72b8ea None None] Provisioning complete for port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:25.768263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fdbcea24-b493-4925-9237-fae02d72b8ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.811035 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:23Z', 'revision_number': 3, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:25.816033 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1193ea1-0ee3-4bc3-af8d-ba7599108700 None None] The sync data for ids ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'] in dv-neutron-818151-2-hyperv is: [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:23Z', 'revision_number': 3, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:23:25.822566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-fdbcea24-b493-4925-9237-fae02d72b8ea None None] Port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:23:25.904228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.909102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:25.933308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b95fb585-3b13-401a-9335-8aa3075e570b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:26.013136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Pushing event updated for resources: {'Port': ['ID=30cbe484-4a1d-49d2-bdd0-7ff090143a91,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:26.015398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:26.018955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:26.150882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:26.152025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:26.447724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ea3c5da4-68c7-4a9e-bb35-26bfb23ac951 None None] Provisioning complete for port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:26.448056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ea3c5da4-68c7-4a9e-bb35-26bfb23ac951 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:26.538940 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ea3c5da4-68c7-4a9e-bb35-26bfb23ac951 None None] Port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:23:26.570429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:23:26.903236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:23:26.913401 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] 10.222.0.70 "PUT /v2.0/routers/6c8663f7-95cc-45dd-af4f-b6f55dcfb64a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8144915 Nov 24 14:23:27.101603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 76ce773c-855f-49ee-86d8-e17ca7629858 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:27.168485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 76ce773c-855f-49ee-86d8-e17ca7629858 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:27.168869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.384436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49166) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:27.390251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1931190936', 'description': 'tempest-secgroup-smoke-1931190936 description', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:27.396980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:27.400679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:27.403440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:27.411265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:27.421977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.461209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:27.465109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:27.468228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:27.475484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:27.537030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.541023 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.545799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-06eac41d-b916-4424-bf97-1eae2bcb241e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:27.582909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroup': ['ID=23943074-ed1c-426f-84f1-4be54a041ead,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:27.585611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.589469 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2013464 Nov 24 14:23:27.589469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:27.589768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49170) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:27.595111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group_rule': {'security_group_id': '23943074-ed1c-426f-84f1-4be54a041ead', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:27.601355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:27.605093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:27.607954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:27.613889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:27.631621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.692307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.695920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.698255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c648d98-9ea9-44a6-9c67-008c52fd9f44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:27.719863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ea6e7090-3b43-4138-9191-8dbfd2b168ed,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:27.724339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:27.728741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.729971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1394615 Nov 24 14:23:27.732651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49174) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:27.738583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group_rule': {'security_group_id': '23943074-ed1c-426f-84f1-4be54a041ead', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:27.744407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:27.748134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:27.750908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:27.757253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:27.773747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.838725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.842606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.848629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4f7934a-7c08-4368-8d3b-a53519e9bde1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:27.866953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39031ea3-3542-4180-b40d-bfb36b472ba8,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:27.870135 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:27.878939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.880415 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1467345 Nov 24 14:23:27.882854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49178) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:27.888488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group_rule': {'security_group_id': '23943074-ed1c-426f-84f1-4be54a041ead', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:27.895289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:27.899108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:27.902061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:27.907728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:27.924481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.990431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.994570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:27.996372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b0fce71-2dfe-483a-9240-4f655574e2aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:28.019825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4969f5c7-18b8-4446-9851-ddfe6a9384c5,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:28.024235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:28.028800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.029956 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1461356 Nov 24 14:23:28.033517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49182) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:28.039894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group_rule': {'security_group_id': '23943074-ed1c-426f-84f1-4be54a041ead', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:28.045820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:28.050146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:28.053032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:28.058655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:28.076095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.141317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.145615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.147441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d3f8bb51-a985-4729-bf61-e89bdd1d7419 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:28.168977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=86010545-e1aa-407a-9597-ad181aaa517b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:28.171480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:28.178106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.179333 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1442342 Nov 24 14:23:28.182120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49186) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:28.187591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group_rule': {'security_group_id': '23943074-ed1c-426f-84f1-4be54a041ead', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:28.194148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:28.197942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:28.200870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:28.207630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:28.220956 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Project d44584538fcc4f2284b467ff03a0cb46 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:23:28.227084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.291136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.294667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.296609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6ef057c9-c1f6-42f8-89b4-bee21da58cf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:28.318747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c1aa30f5-148d-4829-b8ad-d16b25c30008,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:28.323071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:28.327415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.328613 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1455872 Nov 24 14:23:28.332852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49190) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:23:28.338297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'security_group_rule': {'security_group_id': '23943074-ed1c-426f-84f1-4be54a041ead', 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:28.344433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:28.348381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:security_group_rule and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:23:28.351202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:23:28.356816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:28.367091 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Project d44584538fcc4f2284b467ff03a0cb46 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:23:28.374939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.442338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.446099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.447967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3fc805b0-b0f1-40db-bd43-9ba51e7d2965 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:28.470058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c7a0620c-43a7-4913-8d03-f0f401310c52,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:28.474566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:28.478665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:28.479847 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1460502 Nov 24 14:23:31.144659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 06268286-8864-4a19-a687-f4567ffce48c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:31.233668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 06268286-8864-4a19-a687-f4567ffce48c completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:31.239206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 06268286-8864-4a19-a687-f4567ffce48c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:31.239792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:31.365051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:31.381958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 06268286-8864-4a19-a687-f4567ffce48c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=06268286-8864-4a19-a687-f4567ffce48c,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:31.386405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:31.388312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:31.461746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=06268286-8864-4a19-a687-f4567ffce48c,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:31.465136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:33.105655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 06268286-8864-4a19-a687-f4567ffce48c up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:33.176413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 06268286-8864-4a19-a687-f4567ffce48c triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:33.176790 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:33.253779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-388705d9-9a7a-45e8-9880-a3dbafeabe83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:33.627787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:35.027983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:23:35.041469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:35.042090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:35.224389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:35.550691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 2, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:35.555326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:23:35.555691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Updating router cc599847-0d0e-4030-af50-b6c10474b537 port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:23:35.614234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:35.852619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ca0b7269-97cf-4784-b23c-f03da77005d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:36.024186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:36.037168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Transition to ACTIVE for port object 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:36.044272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:36.048018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:36.172073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a182ad4-1947-4a30-bb04-2d85933cba11 None None] Pushing event updated for resources: {'Port': ['ID=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:36.175868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2a182ad4-1947-4a30-bb04-2d85933cba11 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:36.280550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Attempting to bind port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:36.281033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Attempting to bind port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:36.281261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Attempting to bind port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:36.289017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:36.289388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Checking segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:36.289800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:36.290201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Bound using segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:36.290668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Bound port: 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:36.291049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:36.398599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] For port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:36.401719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] For port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:36.407219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:36.411422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:36.498403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:36.499046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:36.572291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a182ad4-1947-4a30-bb04-2d85933cba11 None None] Pushing event updated for resources: {'Port': ['ID=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:36.576052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2a182ad4-1947-4a30-bb04-2d85933cba11 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:36.701160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:36.774709 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Sync routers for ids ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:23:36.789760 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Routers {'6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:36.790632 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:36.937942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.004808 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Set router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:37.085498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:36Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:37.090166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbcfec2-6608-4d5c-ad15-95ad67b94330 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:36Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:23:37.180726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:37.293719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:37.299807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:37.300216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.340463 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:25Z', 'revision_number': 4, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '30cbe484-4a1d-49d2-bdd0-7ff090143a91', 'name': '', 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'mac_address': 'fa:16:3e:b7:84:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '2bec22e6-af44-48de-a291-105f8a8a45e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:24Z', 'updated_at': '2021-11-24T14:23:25Z', 'revision_number': 2, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'subnets': [{'id': '2bec22e6-af44-48de-a291-105f8a8a45e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:37.346217 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Checking router: 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:23:37.346580 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Updating router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:23:37.447129 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.478011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.524516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:37.534857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.536836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:37.618734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:37.621896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:37.858554 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.871377 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Transition to ACTIVE for port object 30cbe484-4a1d-49d2-bdd0-7ff090143a91 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:37.879097 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:37.882841 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d9cba2de-48ba-4831-97c5-656b236d9432 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:38.011224 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a0a409-dce6-4b5c-931a-62000f918d6b None None] Pushing event updated for resources: {'Port': ['ID=30cbe484-4a1d-49d2-bdd0-7ff090143a91,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:38.014604 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-54a0a409-dce6-4b5c-931a-62000f918d6b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:38.105492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Attempting to bind port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:38.105998 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Attempting to bind port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:38.106634 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Attempting to bind port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 on network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:38.119654 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:38.120230 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Checking segment: {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:38.120634 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:38.121020 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Bound using segment: {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:38.121503 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Bound port: 30cbe484-4a1d-49d2-bdd0-7ff090143a91, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cc7b312a-96d9-4d1c-a21c-7c99e6819124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:38.121873 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:38.214914 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] For port 30cbe484-4a1d-49d2-bdd0-7ff090143a91, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:38.218768 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] For port 30cbe484-4a1d-49d2-bdd0-7ff090143a91, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30cbe484-4a1d-49d2-bdd0-7ff090143a91,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:38.224501 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:38.228154 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-0c39d95d-bc09-4cd8-bc1f-8f5c8759dfed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:38.308974 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Routers {'6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:23:38.309606 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:23:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:38.357969 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a0a409-dce6-4b5c-931a-62000f918d6b None None] Pushing event updated for resources: {'Port': ['ID=30cbe484-4a1d-49d2-bdd0-7ff090143a91,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:38.365896 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-54a0a409-dce6-4b5c-931a-62000f918d6b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:38.489802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:38.510129 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] Set router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:23:38.843527 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:25Z', 'revision_number': 4, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '30cbe484-4a1d-49d2-bdd0-7ff090143a91', 'name': '', 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'mac_address': 'fa:16:3e:b7:84:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '2bec22e6-af44-48de-a291-105f8a8a45e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:24Z', 'updated_at': '2021-11-24T14:23:38Z', 'revision_number': 4, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'subnets': [{'id': '2bec22e6-af44-48de-a291-105f8a8a45e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:23:38.848253 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b15eeb5-c5fb-4e91-9315-37a3dde81e19 None None] The sync data for ids ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'] in dv-neutron-818151-2-hyperv is: [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:25Z', 'revision_number': 4, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '30cbe484-4a1d-49d2-bdd0-7ff090143a91', 'name': '', 'network_id': '9e520458-3d0a-44fe-8213-a30cdc4c6bc1', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'mac_address': 'fa:16:3e:b7:84:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '2bec22e6-af44-48de-a291-105f8a8a45e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:24Z', 'updated_at': '2021-11-24T14:23:38Z', 'revision_number': 4, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'subnets': [{'id': '2bec22e6-af44-48de-a291-105f8a8a45e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:23:39.192334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30cbe484-4a1d-49d2-bdd0-7ff090143a91 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:39.274485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:39.279809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:39.280183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:39.416055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:39.456104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 30cbe484-4a1d-49d2-bdd0-7ff090143a91, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30cbe484-4a1d-49d2-bdd0-7ff090143a91,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:23:39.460111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:39.461227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:39.486819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-901809fc-10aa-472f-9302-b37c29cfa6d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:39.614138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=30cbe484-4a1d-49d2-bdd0-7ff090143a91,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:39.617978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:39.630698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:39.631076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:41.107745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30cbe484-4a1d-49d2-bdd0-7ff090143a91 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:23:41.176988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:41.177358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:44.813018 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:23:45.278436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4e1074a1-10c7-4fc1-b437-928b9e95ff45 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:23:45.295388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4e1074a1-10c7-4fc1-b437-928b9e95ff45 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:23:45.296533 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4e1074a1-10c7-4fc1-b437-928b9e95ff45 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1931190936&fields=id&tenant_id=d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 267 time: 0.0591500 Nov 24 14:23:45.442836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-26a4986d-9a53-45f1-938a-67d2cd44f480 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:45.443518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-26a4986d-9a53-45f1-938a-67d2cd44f480 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:23:45.460285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-26a4986d-9a53-45f1-938a-67d2cd44f480 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:23:45.461324 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-26a4986d-9a53-45f1-938a-67d2cd44f480 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 811 time: 0.1578631 Nov 24 14:23:45.477862 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-8a5883e5-3ac2-4a19-9f64-c9d61f761e80 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/quotas/d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 375 time: 0.0112345 Nov 24 14:23:45.656340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-ba333b61-ac8a-4903-bb9a-7c18b4710d20 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:23:45.673216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-ba333b61-ac8a-4903-bb9a-7c18b4710d20 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:23:45.675180 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-ba333b61-ac8a-4903-bb9a-7c18b4710d20 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1926720 Nov 24 14:23:45.932028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-eb8cc0d1-2db1-4642-8fd6-f7c0c8a0e90d service neutron] 10.222.0.70 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2456079 Nov 24 14:23:46.061004 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-2331a6e6-dc09-4c25-93a2-cac6242d2e44 service neutron] 10.222.0.70 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232593 Nov 24 14:23:46.534869 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c8658b5f-cf50-4551-bd63-41d5cfb41f6f req-436cff6f-ac47-4b82-a1cb-5323771d0b1c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 210 time: 0.1171653 Nov 24 14:23:47.473972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-e36fb70a-68f7-4298-82d1-0becd03d5b0d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:47.475376 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-e36fb70a-68f7-4298-82d1-0becd03d5b0d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 811 time: 0.1466887 Nov 24 14:23:47.558836 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-44437c11-a8a5-49b0-b760-c0b1ddaaa2a5 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 380 time: 0.0411773 Nov 24 14:23:47.567879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'port': {'device_id': '74fe0219-7948-4bbb-83a3-236d527900c0', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'admin_state_up': True, 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'security_groups': ['23943074-ed1c-426f-84f1-4be54a041ead']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:47.706754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:23:47.714247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2b6b27bf-967e-40ee-94e4-26380da8ffa8 req-a90339f7-7e1e-4e99-890e-359cd0525af8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 210 time: 0.0442772 Nov 24 14:23:47.716442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:23:47.728834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Made reservation on behalf of d44584538fcc4f2284b467ff03a0cb46 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:23:47.732035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:47.902536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Allocated IP 172.20.0.7 (f5e04962-eb4f-4396-aa25-69add7c3142b/aaf4b47d-96c4-4601-9724-7a1db6954596/f632c2ea-592b-4e33-a9aa-a5111f4a184e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:23:47.924494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.100033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.115559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Transition to ACTIVE for port object f632c2ea-592b-4e33-a9aa-a5111f4a184e will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:48.139576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.145758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2b42c8de-1ca4-4030-a21f-092587ee9687 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:48.220153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Network f5e04962-eb4f-4396-aa25-69add7c3142b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:23:48.223957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:23:48.226041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=f632c2ea-592b-4e33-a9aa-a5111f4a184e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:48.228213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:23:48.255727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:48.304248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:48.304248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.333582 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7694216 Nov 24 14:23:48.346862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Request body: {'port': {'device_id': '74fe0219-7948-4bbb-83a3-236d527900c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:23:48.464647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.530057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b37fcecb-4240-488e-9509-2d17bc610b4d None None] Provisioning for port f632c2ea-592b-4e33-a9aa-a5111f4a184e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:23:48.536357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b37fcecb-4240-488e-9509-2d17bc610b4d None None] Provisioning complete for port f632c2ea-592b-4e33-a9aa-a5111f4a184e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:23:48.536734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b37fcecb-4240-488e-9509-2d17bc610b4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.589773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b37fcecb-4240-488e-9509-2d17bc610b4d None None] Port f632c2ea-592b-4e33-a9aa-a5111f4a184e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:23:48.834165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f632c2ea-592b-4e33-a9aa-a5111f4a184e {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:23:48.841726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.898196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Transition to ACTIVE for port object f632c2ea-592b-4e33-a9aa-a5111f4a184e will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:23:48.903484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:48.908425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f900f3d0-7223-4e89-9d99-5384ea236958 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:49.062828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Pushing event updated for resources: {'Port': ['ID=f632c2ea-592b-4e33-a9aa-a5111f4a184e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:49.067890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:49.077648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b17f66-4dfb-437d-b99f-3eb110bfb684 req-6f5b3773-fa79-480b-b951-ef0fc98366e3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:49.078333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-c7b17f66-4dfb-437d-b99f-3eb110bfb684 req-6f5b3773-fa79-480b-b951-ef0fc98366e3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:23:49.126358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-c7b17f66-4dfb-437d-b99f-3eb110bfb684 req-6f5b3773-fa79-480b-b951-ef0fc98366e3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:23:49.128261 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c7b17f66-4dfb-437d-b99f-3eb110bfb684 req-6f5b3773-fa79-480b-b951-ef0fc98366e3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 931 time: 0.2837389 Nov 24 14:23:49.239469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c7b17f66-4dfb-437d-b99f-3eb110bfb684 req-58695439-79e4-4f90-8377-269ffff7c816 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1054456 Nov 24 14:23:49.254969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Attempting to bind port f632c2ea-592b-4e33-a9aa-a5111f4a184e on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:23:49.254969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Attempting to bind port f632c2ea-592b-4e33-a9aa-a5111f4a184e by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:23:49.254969 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Attempting to bind port f632c2ea-592b-4e33-a9aa-a5111f4a184e on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:49.259688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Port f632c2ea-592b-4e33-a9aa-a5111f4a184e on network f5e04962-eb4f-4396-aa25-69add7c3142b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:23:49.260128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Attempting to bind port f632c2ea-592b-4e33-a9aa-a5111f4a184e on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:23:49.266846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 23, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:23:49.267314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Checking segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:23:49.267984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Bound using segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:23:49.268505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Bound port: f632c2ea-592b-4e33-a9aa-a5111f4a184e, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:23:49.268960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:49.481396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] For port f632c2ea-592b-4e33-a9aa-a5111f4a184e, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:23:49.484673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] For port f632c2ea-592b-4e33-a9aa-a5111f4a184e, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:23:49.489553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:49.500097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ec905d0-0cb4-4300-9928-97ab1e1bca74 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:23:49.549352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:23:49.551145 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] 10.222.0.47 "PUT /v2.0/ports/f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 200 len: 1093 time: 1.2098844 Nov 24 14:23:49.553944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:23:49.654065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Pushing event updated for resources: {'Port': ['ID=f632c2ea-592b-4e33-a9aa-a5111f4a184e,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:23:49.670094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:23:49.701352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-ed990e73-04e8-4db8-9ed0-d7ee693da5cf service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1096 time: 0.1005666 Nov 24 14:23:49.769519 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'status': 'completed', 'code': 200} Nov 24 14:23:49.786200 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-c7cfd02f-3856-4cb4-9426-dde09551ff3c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 200 len: 217 time: 0.0764484 Nov 24 14:23:49.851290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-b9a522fb-4a1b-4e67-a687-1b006c732356 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:49.852776 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-b9a522fb-4a1b-4e67-a687-1b006c732356 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0603397 Nov 24 14:23:49.930491 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-f705bb7f-333a-420e-bafa-90c038850ddd service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0711715 Nov 24 14:23:50.067946 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-907752d5-bd4a-4947-8fc8-0972c0d835ac service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1300154 Nov 24 14:23:50.204867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f9c42b6-af80-422e-ba94-cb8f96d02194 req-3e86222c-0786-4fee-b44a-e863d446c2b4 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300652 Nov 24 14:23:50.327465 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-0cd12c7a-e5b1-42e6-804f-27902a4930a9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1096 time: 0.0762563 Nov 24 14:23:50.526603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7769d19c-7809-4369-9fe2-88c014a87143 req-99794f3c-8e4e-41dd-8351-80b8b3690c74 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:50.528069 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-99794f3c-8e4e-41dd-8351-80b8b3690c74 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1934466 Nov 24 14:23:50.538230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-932d7b90-fdc2-4475-9cdf-bd71da5460fc req-673a7121-03d6-493f-8289-73479291e898 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:50.539584 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-932d7b90-fdc2-4475-9cdf-bd71da5460fc req-673a7121-03d6-493f-8289-73479291e898 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.1745961 Nov 24 14:23:50.619195 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-899a8f80-7b01-4614-8367-7bf3f0520ce0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 200 len: 217 time: 0.0786262 Nov 24 14:23:50.698034 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-932d7b90-fdc2-4475-9cdf-bd71da5460fc req-ce692e81-e282-417c-9ac2-c73a3631e2b0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1098740 Nov 24 14:23:50.708000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7769d19c-7809-4369-9fe2-88c014a87143 req-d3634188-48a2-4f31-93e2-c96f48537434 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:50.709393 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-d3634188-48a2-4f31-93e2-c96f48537434 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0792217 Nov 24 14:23:50.783792 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-3d7bc788-0167-4399-91ce-237a0bcf5c96 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0680315 Nov 24 14:23:50.916074 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-2d7e3a22-4185-403f-b66f-5bcb7d2eb7df service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256759 Nov 24 14:23:51.070310 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7769d19c-7809-4369-9fe2-88c014a87143 req-ad059034-4ff8-473e-82ce-c71f002d190b service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1478829 Nov 24 14:23:51.896591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01cd4d00-95c8-4738-8efc-abee2cec3882 req-81e6dec5-cf41-4b7f-9a8a-f9a1621980ab tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:51.898027 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-01cd4d00-95c8-4738-8efc-abee2cec3882 req-81e6dec5-cf41-4b7f-9a8a-f9a1621980ab tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0787482 Nov 24 14:23:51.944473 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-01cd4d00-95c8-4738-8efc-abee2cec3882 req-08046b14-7847-4caa-aa67-833bca8657ec tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399914 Nov 24 14:23:53.143283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76c4134-d669-4a73-b503-150590cda139 req-8ada9a30-ba47-4ed7-aab8-0d49cce080c9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:53.144723 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b76c4134-d669-4a73-b503-150590cda139 req-8ada9a30-ba47-4ed7-aab8-0d49cce080c9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0791099 Nov 24 14:23:53.288731 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b76c4134-d669-4a73-b503-150590cda139 req-496fe4fb-d8ef-4b79-9e67-2b181c9bffb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1386318 Nov 24 14:23:54.482228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35def0fb-e38a-4304-8880-ca760899ef5d req-203efeb3-627d-464a-b5d1-3857c17b9310 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:54.483662 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-35def0fb-e38a-4304-8880-ca760899ef5d req-203efeb3-627d-464a-b5d1-3857c17b9310 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0769956 Nov 24 14:23:54.531079 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-35def0fb-e38a-4304-8880-ca760899ef5d req-cb34ecfe-991f-4528-bfbd-f8dbe88d589a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412691 Nov 24 14:23:55.727023 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9695f6f-80f7-44be-8699-55c9f77b6bef req-171c880f-8230-4352-9a92-d5029e3ae080 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:55.728445 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b9695f6f-80f7-44be-8699-55c9f77b6bef req-171c880f-8230-4352-9a92-d5029e3ae080 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0759523 Nov 24 14:23:55.772893 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b9695f6f-80f7-44be-8699-55c9f77b6bef req-9cc43f10-940a-4115-8524-a5ce5682ef5e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390666 Nov 24 14:23:56.976970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f134fa-0b2e-4fe3-9ee3-0229443e24ca req-5a0d413c-6bf8-49f7-9cd8-f36c879993e1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:56.976970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-89f134fa-0b2e-4fe3-9ee3-0229443e24ca req-5a0d413c-6bf8-49f7-9cd8-f36c879993e1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0847268 Nov 24 14:23:57.021874 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-89f134fa-0b2e-4fe3-9ee3-0229443e24ca req-357fed8d-fc6e-43d4-9b23-bd45299e0654 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400503 Nov 24 14:23:58.214555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399af967-d22c-4ecb-a9d4-ed1b94569e28 req-bf2286ba-5434-4561-ac0b-73531b8303e4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:58.216069 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-399af967-d22c-4ecb-a9d4-ed1b94569e28 req-bf2286ba-5434-4561-ac0b-73531b8303e4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0785868 Nov 24 14:23:58.260717 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-399af967-d22c-4ecb-a9d4-ed1b94569e28 req-e18925c0-1b3c-4e00-988f-076607ed5ae5 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388284 Nov 24 14:23:59.462449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccbb2cf-bfd7-4ad4-b1fb-8aa42011941b req-273a081c-7446-4b6b-b841-180b866326df tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:23:59.463932 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2ccbb2cf-bfd7-4ad4-b1fb-8aa42011941b req-273a081c-7446-4b6b-b841-180b866326df tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 943 time: 0.0797060 Nov 24 14:23:59.509977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2ccbb2cf-bfd7-4ad4-b1fb-8aa42011941b req-e60db6c7-bcad-4ff9-a14a-32fda9c68532 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403268 Nov 24 14:24:00.252419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f632c2ea-592b-4e33-a9aa-a5111f4a184e details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:24:00.393576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f632c2ea-592b-4e33-a9aa-a5111f4a184e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:24:00.407172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'port_id': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'mac_address': 'fa:16:3e:fb:18:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 863, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:24:00.475905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:00.494863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f632c2ea-592b-4e33-a9aa-a5111f4a184e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:24:00.513139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f632c2ea-592b-4e33-a9aa-a5111f4a184e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:24:00.516908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:00.520391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:24:00.591647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f632c2ea-592b-4e33-a9aa-a5111f4a184e,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:24:00.601351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.601691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.602022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.602350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.602675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.603077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.603299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.603618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.603961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.604360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.604675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:00.608584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:24:00.726188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e3c95d-3876-4b1e-8e2c-c2f5597d3c4b req-981c0533-c258-414c-82b9-3c0a5a10ac90 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:00.727641 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-50e3c95d-3876-4b1e-8e2c-c2f5597d3c4b req-981c0533-c258-414c-82b9-3c0a5a10ac90 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 944 time: 0.0865836 Nov 24 14:24:00.784114 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-50e3c95d-3876-4b1e-8e2c-c2f5597d3c4b req-e8075db6-b497-4690-bae2-6e99b83f7082 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506327 Nov 24 14:24:00.891032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f632c2ea-592b-4e33-a9aa-a5111f4a184e'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:24:01.981740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444cea55-226d-4e32-b4d4-729a45beab6c req-5fa567f5-8425-4cbc-9df5-6dd49ebcfe4a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:01.983169 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-444cea55-226d-4e32-b4d4-729a45beab6c req-5fa567f5-8425-4cbc-9df5-6dd49ebcfe4a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 944 time: 0.0764372 Nov 24 14:24:02.034141 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-444cea55-226d-4e32-b4d4-729a45beab6c req-922a142b-be26-458d-afec-48c88d4c1ac9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451691 Nov 24 14:24:02.267266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f632c2ea-592b-4e33-a9aa-a5111f4a184e up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:24:02.336552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port f632c2ea-592b-4e33-a9aa-a5111f4a184e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:24:02.341595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port f632c2ea-592b-4e33-a9aa-a5111f4a184e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:24:02.342223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:02.454357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:02.485254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:24:02.495697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f632c2ea-592b-4e33-a9aa-a5111f4a184e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:24:02.499510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:02.501693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:24:02.543013 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'code': 200} Nov 24 14:24:02.566083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f632c2ea-592b-4e33-a9aa-a5111f4a184e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:24:02.568884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:24:02.750539 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aba580a6-babc-4c82-b542-d7cacf2a5c0c req-aaeec7d3-1981-4893-8898-dcbb5f23089d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1098 time: 0.0711939 Nov 24 14:24:02.791918 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aba580a6-babc-4c82-b542-d7cacf2a5c0c req-bdb5098d-e03f-4ab3-8945-9f27ca5a2da5 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0348830 Nov 24 14:24:03.230201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0822adc9-ac0a-4606-bf0c-29c1be05d7d4 req-1bae2ee1-ce52-46e5-aa05-bd08804ef90f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:03.231629 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0822adc9-ac0a-4606-bf0c-29c1be05d7d4 req-1bae2ee1-ce52-46e5-aa05-bd08804ef90f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 945 time: 0.0793076 Nov 24 14:24:03.249093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-980ad4c4-17ad-4c66-ad8c-95d4336abff7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:03.279891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0822adc9-ac0a-4606-bf0c-29c1be05d7d4 req-91272c5f-f339-4811-a0ac-a01bafdf2841 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412459 Nov 24 14:24:03.631940 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:04.495553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29770d43-d965-4e3b-9051-cdb9378514c9 req-ed920e50-7cf3-4998-b322-52daa238f09b tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:04.496909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-29770d43-d965-4e3b-9051-cdb9378514c9 req-ed920e50-7cf3-4998-b322-52daa238f09b tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 945 time: 0.0820401 Nov 24 14:24:04.540808 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-29770d43-d965-4e3b-9051-cdb9378514c9 req-d707aa9b-d830-4fda-87b2-b6708a52f6e0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384736 Nov 24 14:24:04.736678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b009a25-f0ff-45d4-97e8-797e887a61e7 req-5a4d09d4-d8c5-4ab6-9cb4-dcf5a37eeda8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:04.738235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b009a25-f0ff-45d4-97e8-797e887a61e7 req-5a4d09d4-d8c5-4ab6-9cb4-dcf5a37eeda8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 945 time: 0.0775990 Nov 24 14:24:04.783062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b009a25-f0ff-45d4-97e8-797e887a61e7 req-0d5f674c-286f-4f5c-adbb-ffa85e9141da tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392783 Nov 24 14:24:04.810265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49370) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:24:04.946538 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7915e394-9e1d-4306-9b2b-494d3f9568a9 tempest-TestVolumeBootPattern-330482699 tempest-TestVolumeBootPattern-330482699-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1093 time: 0.1350510 Nov 24 14:24:04.949115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49376) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:24:04.954217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address': '172.20.0.7'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:24:04.960307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:24:04.964024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:floatingip and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:24:04.966764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:24:04.972638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:24:04.982893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:05.118021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:05.253864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Allocated IP 172.26.4.136 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/7fa40d08-2073-47c7-9950-d8796599f7c9) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:24:05.399349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:05.424584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:05.428982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-34affa23-355b-46f0-b526-ae38f4cfdeb1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:24:05.484565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:24:05.492161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:24:05.496045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:24:05.523591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=7fa40d08-2073-47c7-9950-d8796599f7c9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:24:05.547985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.548360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.548730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.549094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.549456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.549833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.550739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.551104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.551462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.551836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.552190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:24:05.556929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:24:05.806322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a6fd1378-bc1d-47be-a46f-7484ffc5718f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:06.104857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:06.160687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:06.365799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:06.370185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:06.374318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:24:06.472991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=7fa40d08-2073-47c7-9950-d8796599f7c9,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:24:06.476811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:24:06.492751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:06.692060 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Floating IP 50c1b853-40ff-4945-8588-651710a56dd5 associated. External IP: 172.26.4.136, port: f632c2ea-592b-4e33-a9aa-a5111f4a184e. Nov 24 14:24:06.800407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:07.075721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:24:07.374115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:24:07.383578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:24:07.395990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:24:07.396610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:24:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:24:07.399188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:07.467334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5068719 Nov 24 14:24:07.467334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:24:07.580662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:24:07.596102 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'status': 'completed', 'code': 200} Nov 24 14:24:07.688023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-e5f425aa-6d19-43ad-b394-3fb325e2b685 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1098 time: 0.0705426 Nov 24 14:24:07.821293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-4f4c13e6-dac5-4a75-828a-13904b4cff35 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:07.822703 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-4f4c13e6-dac5-4a75-828a-13904b4cff35 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1286068 Nov 24 14:24:07.929392 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-fbc682b9-bf8f-41e9-bff6-cb400c6d69ce service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 200 len: 999 time: 0.0996089 Nov 24 14:24:07.960542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '50c1b853-40ff-4945-8588-651710a56dd5', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.136', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:fb:18:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74fe0219-7948-4bbb-83a3-236d527900c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:24:05Z', 'updated_at': '2021-11-24T14:24:05Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:24:07.964313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:24:07.975048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:24:07.975645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:24:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:24:07.992488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-3e1453e7-7bbb-42c9-998e-665f71ce2dca service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:07.993894 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-3e1453e7-7bbb-42c9-998e-665f71ce2dca service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0585451 Nov 24 14:24:08.072116 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-9f6b207c-e612-4a46-afc1-2361441dab9d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0719881 Nov 24 14:24:08.150747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:24:08.205154 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-d992ba63-89f0-4296-9272-ec899c014e47 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266668 Nov 24 14:24:08.339706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-791943a2-4594-48fd-a3ad-4d81da5ba566 req-69d7c412-72ef-4751-91f9-210b7e68d388 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281538 Nov 24 14:24:08.494112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:08.518286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '50c1b853-40ff-4945-8588-651710a56dd5', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.136', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:fb:18:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74fe0219-7948-4bbb-83a3-236d527900c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:24:05Z', 'updated_at': '2021-11-24T14:24:05Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:24:08.522897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55310a4d-fe88-4ebf-a16e-ead1d1451ea9 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '50c1b853-40ff-4945-8588-651710a56dd5', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.136', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:fb:18:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74fe0219-7948-4bbb-83a3-236d527900c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:24:05Z', 'updated_at': '2021-11-24T14:24:05Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:24:08.715497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b682994-b0ca-4b91-b7f9-2e6fdeb7961c None None] New status for floating IP 50c1b853-40ff-4945-8588-651710a56dd5: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:24:17.942217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:21.820220 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:24:33.258573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b90a770a-4821-4dea-b9c1-2031e71a325a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:33.635501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:35.808426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b47a5fb2-c473-470b-b32d-aaeeaa80cf59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:36.801130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:38.496070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:47.966789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:24:56.998429 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-f5bd8d3d-c630-4d27-8372-ca52779a82b3 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0664124 Nov 24 14:24:57.139854 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-db8aa9c1-58df-4470-bc11-87423d493b3d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1098 time: 0.0738101 Nov 24 14:24:57.282126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-aeaba9f4-ed6c-4fe7-8d46-9e8245075732 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:57.283006 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-aeaba9f4-ed6c-4fe7-8d46-9e8245075732 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1248600 Nov 24 14:24:57.384051 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-d0d90133-e8a1-4ab6-98c2-c5afba86ccf6 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 200 len: 1001 time: 0.0946314 Nov 24 14:24:57.553418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-782aeafc-bbaf-449f-b9ba-be13c8b1c68b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:24:57.554738 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-782aeafc-bbaf-449f-b9ba-be13c8b1c68b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.1649377 Nov 24 14:24:57.630779 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-da2f6ba5-59e5-4a06-8a25-4018a110a747 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0697351 Nov 24 14:24:57.758404 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-843e014b-57b5-4af3-bbf8-77695aef5941 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213782 Nov 24 14:24:57.887399 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0683ca6a-d1d3-48ff-a528-443ddc2f95f9 req-533a1939-f979-44ab-9c5f-ea6a92b6cc07 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1215184 Nov 24 14:24:58.815091 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:25:03.248433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-146d7007-8416-4066-8dfd-2b5846a06e15 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:03.638181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:05.810296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d0c5610-a7bf-42a5-bea6-42a577fd94e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:06.804575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:08.494992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:17.978439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:33.250982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b4013aa1-fde9-4c07-af5b-27cc31afedb0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:33.639520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:35.812278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e11697b2-f80b-4b44-b330-c9aa9be8d036 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:35.816405 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:25:36.807895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:38.498901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:47.964029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:25:58.944660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-e8a3c3d2-91fe-4c4d-becd-15b410b618f5 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0665939 Nov 24 14:25:59.083851 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-def462cf-a8ce-4030-bc0d-7ed634d7c55a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 1098 time: 0.0715563 Nov 24 14:25:59.226040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3245119e-94ae-41f4-abdf-09f08c844725 req-c9843d00-8257-4568-80c5-349104a20bac service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:25:59.227534 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-c9843d00-8257-4568-80c5-349104a20bac service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1251607 Nov 24 14:25:59.329384 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-fc3bf1db-ff86-48a4-aaf0-9e42b94aeaf4 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 200 len: 1001 time: 0.0959747 Nov 24 14:25:59.393800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3245119e-94ae-41f4-abdf-09f08c844725 req-bff94dc6-6d05-46c6-a3be-cb09bef914a8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:25:59.395165 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-bff94dc6-6d05-46c6-a3be-cb09bef914a8 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0595031 Nov 24 14:25:59.467267 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-2280f45a-14d6-4f35-b835-24648be7b3da service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0658939 Nov 24 14:25:59.598727 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-135497b9-9a6a-45b7-8a48-6c97f8429fca service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245606 Nov 24 14:25:59.728764 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3245119e-94ae-41f4-abdf-09f08c844725 req-bf409fa6-a3a8-4cbc-91bd-40a376a623d7 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242597 Nov 24 14:26:03.253467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-236e2235-84b3-4bc0-9501-ad52a669754a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:03.641900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:05.740285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20316bb8-f24d-4d26-b0f9-addf0aa4c337 req-c1be5ce6-9c95-43b8-81b8-061f4b312334 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:05.741640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-20316bb8-f24d-4d26-b0f9-addf0aa4c337 req-c1be5ce6-9c95-43b8-81b8-061f4b312334 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 945 time: 0.0809333 Nov 24 14:26:05.787456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-20316bb8-f24d-4d26-b0f9-addf0aa4c337 req-ea6e9607-44a9-4563-9c69-f8fbded8280c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398231 Nov 24 14:26:05.814454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-abcf1e7d-9543-475f-9587-1f4a337da9dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:06.812384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:07.005923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26b9fb0c-471e-4815-8f3e-0bc751509121 req-fd609393-678a-42bb-a723-25594358155e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:07.007886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-26b9fb0c-471e-4815-8f3e-0bc751509121 req-fd609393-678a-42bb-a723-25594358155e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 945 time: 0.0762639 Nov 24 14:26:07.055101 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-26b9fb0c-471e-4815-8f3e-0bc751509121 req-6bda462f-fdd7-43b0-be55-4a83f8faba75 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417948 Nov 24 14:26:07.377645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-2744565c-1026-42c4-a500-6f308bb8b5c8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:07.379037 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-2744565c-1026-42c4-a500-6f308bb8b5c8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 945 time: 0.0851839 Nov 24 14:26:07.450443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Deleting port f632c2ea-592b-4e33-a9aa-a5111f4a184e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:26:07.450776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:07.795978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] For port f632c2ea-592b-4e33-a9aa-a5111f4a184e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f632c2ea-592b-4e33-a9aa-a5111f4a184e,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:26:07.796235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:08.076580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:08.076912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:08.077161 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Floating IP 50c1b853-40ff-4945-8588-651710a56dd5 disassociated. External IP: 172.26.4.136, port: f632c2ea-592b-4e33-a9aa-a5111f4a184e. Nov 24 14:26:08.077491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Calling delete_port for f632c2ea-592b-4e33-a9aa-a5111f4a184e owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:26:08.266450 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:08.272879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0290a237-4f27-46c5-81ae-e0c05ed7a8e1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:08.323197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'Port': ['ID=f632c2ea-592b-4e33-a9aa-a5111f4a184e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:08.352929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cba7036-9ff2-493d-86ac-e2c4e8927efc req-f7819d25-ea8c-425b-85cc-715a78438378 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:08.354008 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7cba7036-9ff2-493d-86ac-e2c4e8927efc req-f7819d25-ea8c-425b-85cc-715a78438378 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 867 time: 0.1595237 Nov 24 14:26:08.355365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.355740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.356136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.356500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.356863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.357223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.357580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.357939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.358294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.358647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.359000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:08.364983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:08.469830 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7cba7036-9ff2-493d-86ac-e2c4e8927efc req-fd5ca8d2-bf1c-48b9-884c-fca00a38cd32 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1070721 Nov 24 14:26:08.501842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:08.603911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:26:08.810415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:26:08.821700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:26:08.833757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:26:08.834582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:26:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:08.889426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] No DVR routers for this DVR port f632c2ea-592b-4e33-a9aa-a5111f4a184e on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:26:08.891933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:08.894648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'name': 'network-vif-deleted', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:26:08.914812 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f37f7854-20fe-4438-9917-db855d84b5a5 req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "DELETE /v2.0/ports/f632c2ea-592b-4e33-a9aa-a5111f4a184e HTTP/1.1" status: 204 len: 173 time: 1.5289125 Nov 24 14:26:08.956984 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '74fe0219-7948-4bbb-83a3-236d527900c0', 'name': 'network-vif-deleted', 'tag': 'f632c2ea-592b-4e33-a9aa-a5111f4a184e', 'status': 'completed', 'code': 200} Nov 24 14:26:09.018049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:26:09.392707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:09.396698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:26:09.408123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:26:09.408761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:26:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:09.594641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:26:09.659236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-a9a4a444-7cd6-444d-9feb-5a7176c36739 req-ff60c028-fb71-4369-bff6-0834870821e8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:26:09.675491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-a9a4a444-7cd6-444d-9feb-5a7176c36739 req-ff60c028-fb71-4369-bff6-0834870821e8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:26:09.676724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a9a4a444-7cd6-444d-9feb-5a7176c36739 req-ff60c028-fb71-4369-bff6-0834870821e8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=74fe0219-7948-4bbb-83a3-236d527900c0 HTTP/1.1" status: 200 len: 210 time: 0.0586367 Nov 24 14:26:09.910276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:09.915123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f955bb74-7430-4835-9195-03a3935b70a1 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:26:10.126953 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b0bb4cf-19b4-41be-b2d5-53744b6c66fe None None] New status for floating IP 50c1b853-40ff-4945-8588-651710a56dd5: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:26:10.778424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f632c2ea-592b-4e33-a9aa-a5111f4a184e no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:26:10.811961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: f632c2ea-592b-4e33-a9aa-a5111f4a184e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:26:10.812408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f632c2ea-592b-4e33-a9aa-a5111f4a184e not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:26:11.034871 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-a8c627dc-ca3b-4e69-bdc3-6ea61514a4ac tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1931190936&fields=id&tenant_id=d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 267 time: 0.0397704 Nov 24 14:26:11.182079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb08f59d-df44-47ec-a015-7606598656a5 req-eeadbc70-68b0-473a-bd8c-81b0990a18b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:11.183494 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-eeadbc70-68b0-473a-bd8c-81b0990a18b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 811 time: 0.1415663 Nov 24 14:26:11.200334 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-9b87b9fd-ed95-4f0a-8395-6ccb24eca95e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/quotas/d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 375 time: 0.0114956 Nov 24 14:26:11.284538 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-c3b55e2a-c767-4837-ba7f-fa28cc806f69 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0793033 Nov 24 14:26:11.527077 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-eb920ba2-efe9-482b-8444-47ef524edd4b service neutron] 10.222.0.70 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2315106 Nov 24 14:26:11.661898 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-e7688978-fa83-4e80-ad15-2a8689cc1e17 service neutron] 10.222.0.70 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1292641 Nov 24 14:26:12.078941 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0a679710-42f7-49fe-95de-0868f5590dbe req-218034bc-a758-46f8-b1b9-8d2b39970cb9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 210 time: 0.0433187 Nov 24 14:26:12.816532 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:26:13.074264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb08f59d-df44-47ec-a015-7606598656a5 req-a1233640-248e-4b1b-b0cb-fe0566e3e671 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:13.075640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-a1233640-248e-4b1b-b0cb-fe0566e3e671 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 811 time: 0.1494565 Nov 24 14:26:13.130594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-52297389-e475-4034-910e-635db79955da tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 380 time: 0.0417295 Nov 24 14:26:13.143846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'port': {'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'admin_state_up': True, 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'security_groups': ['23943074-ed1c-426f-84f1-4be54a041ead']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:26:13.271132 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-03f5bc2b-0350-40d2-9ad3-ce4897c825fa req-17ae856e-cc80-43a1-8ce0-562d4090dd7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 210 time: 0.0520356 Nov 24 14:26:13.331302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:26:13.341221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:26:13.351259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Made reservation on behalf of d44584538fcc4f2284b467ff03a0cb46 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:26:13.354652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:13.518749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Allocated IP 172.20.0.4 (f5e04962-eb4f-4396-aa25-69add7c3142b/aaf4b47d-96c4-4601-9724-7a1db6954596/f23b449d-b6a8-4b92-82db-7e7c81d3225f) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:26:13.713615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:13.729919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Transition to ACTIVE for port object f23b449d-b6a8-4b92-82db-7e7c81d3225f will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:26:13.752415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:13.758037 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:13.829237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Network f5e04962-eb4f-4396-aa25-69add7c3142b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:26:13.832695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:26:13.834627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=f23b449d-b6a8-4b92-82db-7e7c81d3225f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:13.836717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:26:13.863308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:13.900622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:13.901431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:13.933814 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7953777 Nov 24 14:26:13.947723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Request body: {'port': {'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:26:14.077915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:14.152755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c0f0e4bf-c487-4de3-a8a2-30b55a878a34 None None] Provisioning for port f23b449d-b6a8-4b92-82db-7e7c81d3225f completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:26:14.159089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c0f0e4bf-c487-4de3-a8a2-30b55a878a34 None None] Provisioning complete for port f23b449d-b6a8-4b92-82db-7e7c81d3225f triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:26:14.160360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c0f0e4bf-c487-4de3-a8a2-30b55a878a34 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:14.247134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c0f0e4bf-c487-4de3-a8a2-30b55a878a34 None None] Port f23b449d-b6a8-4b92-82db-7e7c81d3225f cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:26:14.458874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f23b449d-b6a8-4b92-82db-7e7c81d3225f {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:26:14.469086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:14.490664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4243068e-5587-45e6-b845-7bc33ed28d12 req-6fc8950e-a251-4c29-8d42-c3e1ad0ae9c3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:14.492024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4243068e-5587-45e6-b845-7bc33ed28d12 req-6fc8950e-a251-4c29-8d42-c3e1ad0ae9c3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 931 time: 0.0860167 Nov 24 14:26:14.492539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Transition to ACTIVE for port object f23b449d-b6a8-4b92-82db-7e7c81d3225f will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:26:14.501038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:14.505369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-43d842d7-5cb1-44bf-bedf-59f72a98b727 tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:14.550250 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4243068e-5587-45e6-b845-7bc33ed28d12 req-3f1ad1f4-42d3-49ac-8836-8138c7a4072b tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521345 Nov 24 14:26:14.762723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Pushing event updated for resources: {'Port': ['ID=f23b449d-b6a8-4b92-82db-7e7c81d3225f,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:14.765584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:14.885999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Attempting to bind port f23b449d-b6a8-4b92-82db-7e7c81d3225f on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:26:14.885999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Attempting to bind port f23b449d-b6a8-4b92-82db-7e7c81d3225f by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:26:14.886162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Attempting to bind port f23b449d-b6a8-4b92-82db-7e7c81d3225f on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:26:14.891990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Port f23b449d-b6a8-4b92-82db-7e7c81d3225f on network f5e04962-eb4f-4396-aa25-69add7c3142b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:26:14.892391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Attempting to bind port f23b449d-b6a8-4b92-82db-7e7c81d3225f on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:26:14.898734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 25, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:26:14.899056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Checking segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:26:14.899425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Bound using segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:26:14.900192 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Bound port: f23b449d-b6a8-4b92-82db-7e7c81d3225f, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:26:14.900624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:14.988550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] For port f23b449d-b6a8-4b92-82db-7e7c81d3225f, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:26:14.991822 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] For port f23b449d-b6a8-4b92-82db-7e7c81d3225f, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:26:14.996648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:15.000805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a5e6a523-01bc-4a72-8db2-55f091a57977 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:15.050248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:15.051594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] 10.222.0.47 "PUT /v2.0/ports/f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 1093 time: 1.1092885 Nov 24 14:26:15.054515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:26:15.089857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Pushing event updated for resources: {'Port': ['ID=f23b449d-b6a8-4b92-82db-7e7c81d3225f,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:15.125139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:15.130613 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'status': 'completed', 'code': 200} Nov 24 14:26:15.167470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-860abdbc-ab4a-4830-80fa-6d8b6158bb9a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1096 time: 0.0735490 Nov 24 14:26:15.245555 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-bc273b69-d453-4f6e-91e8-52631382100a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 217 time: 0.0710649 Nov 24 14:26:15.317264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb08f59d-df44-47ec-a015-7606598656a5 req-cda247e8-6395-441a-a999-63794887d7ff service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:15.318641 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-cda247e8-6395-441a-a999-63794887d7ff service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0669096 Nov 24 14:26:15.398445 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-743a0bbb-86df-447e-9c06-8ff968119751 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0731459 Nov 24 14:26:15.543045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-4aa3c8ad-70f2-4948-8cf1-5851f0ee9368 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1383448 Nov 24 14:26:15.707324 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb08f59d-df44-47ec-a015-7606598656a5 req-51089a58-25c3-4443-a4ac-aa96fd6ace06 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1583474 Nov 24 14:26:15.780369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb82ad2-4fa5-4899-8a3f-30f89658ef2a req-710d135f-27a6-44e0-8ab2-6b4e2c781c4e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:15.781843 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-feb82ad2-4fa5-4899-8a3f-30f89658ef2a req-710d135f-27a6-44e0-8ab2-6b4e2c781c4e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 943 time: 0.0955403 Nov 24 14:26:15.830311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-feb82ad2-4fa5-4899-8a3f-30f89658ef2a req-e05f05c9-e006-433e-982b-19eeecdedc6d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418665 Nov 24 14:26:15.837058 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-6dcf8ab0-07eb-4e1d-a5ff-8728d16e063a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1096 time: 0.0823371 Nov 24 14:26:15.970712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-5dab0f22-dde8-4449-a6ce-52c3d6fa55df service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:15.972158 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-5dab0f22-dde8-4449-a6ce-52c3d6fa55df service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1291385 Nov 24 14:26:16.041716 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-f0e56fa2-b299-4c61-bbec-a1d3da030a93 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 217 time: 0.0625606 Nov 24 14:26:16.102211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-32d87a2a-174c-4ebc-b641-9b08ab3c4e1a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:16.104189 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-32d87a2a-174c-4ebc-b641-9b08ab3c4e1a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0568771 Nov 24 14:26:16.178800 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-68f49a35-f098-4c43-949b-b9aa7e85ac5f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0685699 Nov 24 14:26:16.336372 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-dde7fd30-b9f6-4469-9c98-6d78e32dc054 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1507621 Nov 24 14:26:16.574820 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95820bde-616c-49ed-97c3-7622d91b4f67 req-2c30971e-b965-4850-9c84-645165e7d8c8 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2315848 Nov 24 14:26:17.038154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-098b360a-6e64-4277-9c8e-1249de417f5c req-98e06226-c6a6-42bc-85dc-5d44731c7bf3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:17.038835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-098b360a-6e64-4277-9c8e-1249de417f5c req-98e06226-c6a6-42bc-85dc-5d44731c7bf3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:26:17.054521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-098b360a-6e64-4277-9c8e-1249de417f5c req-98e06226-c6a6-42bc-85dc-5d44731c7bf3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:26:17.055720 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-098b360a-6e64-4277-9c8e-1249de417f5c req-98e06226-c6a6-42bc-85dc-5d44731c7bf3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 943 time: 0.0956435 Nov 24 14:26:17.100696 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-098b360a-6e64-4277-9c8e-1249de417f5c req-8d6e6e42-bb82-416b-a4c0-d8f3f6859bbf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393572 Nov 24 14:26:17.974023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:18.294914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec04d126-9873-4e6e-91f0-9c93466cc917 req-a8bdc7b6-a530-4e84-9bb8-e9983200eae3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:18.296387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ec04d126-9873-4e6e-91f0-9c93466cc917 req-a8bdc7b6-a530-4e84-9bb8-e9983200eae3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 943 time: 0.0785244 Nov 24 14:26:18.345651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ec04d126-9873-4e6e-91f0-9c93466cc917 req-98cf3cdb-56fd-4417-8ccf-4440db87fe01 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436490 Nov 24 14:26:19.557534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be7864b-6aee-4326-bfae-f3c3f9157e1c req-869fdb28-1a44-41cb-8ba7-ee3b02209fd9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:19.558951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2be7864b-6aee-4326-bfae-f3c3f9157e1c req-869fdb28-1a44-41cb-8ba7-ee3b02209fd9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 943 time: 0.0763762 Nov 24 14:26:19.607798 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2be7864b-6aee-4326-bfae-f3c3f9157e1c req-767769b4-d510-40c1-84e5-cdd243a28342 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433917 Nov 24 14:26:20.799693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a9d6c4-1b30-4cae-b1fa-d6dbaa2a4e71 req-83f24216-67b7-4565-a561-243cff8c4fb1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:20.801136 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-35a9d6c4-1b30-4cae-b1fa-d6dbaa2a4e71 req-83f24216-67b7-4565-a561-243cff8c4fb1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 943 time: 0.0764086 Nov 24 14:26:20.846572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-35a9d6c4-1b30-4cae-b1fa-d6dbaa2a4e71 req-8a988f80-0beb-4b6b-a520-5ae43ccb6f86 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400283 Nov 24 14:26:22.044403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b24811-65e5-46ab-881d-efd861427a9e req-971ba76b-ab05-4868-85d3-39fa1fdee250 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:22.045826 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a6b24811-65e5-46ab-881d-efd861427a9e req-971ba76b-ab05-4868-85d3-39fa1fdee250 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 943 time: 0.0753269 Nov 24 14:26:22.092139 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a6b24811-65e5-46ab-881d-efd861427a9e req-6a835905-afbe-4570-b347-d35e5c1a52d4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405109 Nov 24 14:26:22.840644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f23b449d-b6a8-4b92-82db-7e7c81d3225f details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:26:22.974397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f23b449d-b6a8-4b92-82db-7e7c81d3225f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:26:22.987778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 863, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:26:23.039060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:23.056156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f23b449d-b6a8-4b92-82db-7e7c81d3225f {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:26:23.070680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f23b449d-b6a8-4b92-82db-7e7c81d3225f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:26:23.074749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:23.076461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-901809fc-10aa-472f-9302-b37c29cfa6d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:23.142026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f23b449d-b6a8-4b92-82db-7e7c81d3225f,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:23.151177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.151402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.151711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.152069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.152398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.152721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.153048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.153367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.153686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.154001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.154318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:23.158142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:23.292836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aef8ccb-2cb2-4e19-bfda-2588f07743b2 req-83258bf5-e9e0-4e67-8e22-6663238c6526 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:23.294290 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7aef8ccb-2cb2-4e19-bfda-2588f07743b2 req-83258bf5-e9e0-4e67-8e22-6663238c6526 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 944 time: 0.0798836 Nov 24 14:26:23.339162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7aef8ccb-2cb2-4e19-bfda-2588f07743b2 req-ebe74c44-f807-45ce-a739-833a07307ca9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393600 Nov 24 14:26:23.427173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f23b449d-b6a8-4b92-82db-7e7c81d3225f'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:26:24.538740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c737933f-f450-46c9-974f-d9ced0ca8fdb req-ef9142e1-36d9-436f-99d0-ebbce6228525 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:24.540221 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c737933f-f450-46c9-974f-d9ced0ca8fdb req-ef9142e1-36d9-436f-99d0-ebbce6228525 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 944 time: 0.0821495 Nov 24 14:26:24.593168 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c737933f-f450-46c9-974f-d9ced0ca8fdb req-3e341f00-3bdb-4749-ad68-2c9958535cb4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466139 Nov 24 14:26:24.852085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f23b449d-b6a8-4b92-82db-7e7c81d3225f up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:26:24.925978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port f23b449d-b6a8-4b92-82db-7e7c81d3225f completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:26:24.931525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port f23b449d-b6a8-4b92-82db-7e7c81d3225f triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:26:24.932214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:25.061304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:25.090347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:26:25.100728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f23b449d-b6a8-4b92-82db-7e7c81d3225f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:26:25.104889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:25.106938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0e67624b-f816-44a6-8058-b91b67755ace None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:25.154067 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'code': 200} Nov 24 14:26:25.183261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f23b449d-b6a8-4b92-82db-7e7c81d3225f,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:25.186218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:25.489702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-441b33ec-8730-424f-a03e-3c71c25626ca req-e5257e0f-35af-4238-81c9-c197a1b669d5 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1098 time: 0.1002545 Nov 24 14:26:25.533265 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-441b33ec-8730-424f-a03e-3c71c25626ca req-d04670f4-e0c9-4f7b-8f9b-3cdfcd867862 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371959 Nov 24 14:26:25.812191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad840d5-4899-4609-93a3-f79e72ead94f req-d4ef51ed-9410-4f68-8c4b-de19838a0b13 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:25.813625 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aad840d5-4899-4609-93a3-f79e72ead94f req-d4ef51ed-9410-4f68-8c4b-de19838a0b13 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 945 time: 0.0827835 Nov 24 14:26:25.859070 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aad840d5-4899-4609-93a3-f79e72ead94f req-aaaba2e3-355e-4788-9658-82479c7f850a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400829 Nov 24 14:26:27.076681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0d4bd8-02c5-48e0-bcc5-58f83eebfeac req-a3af8218-e356-4143-83d2-4744efb43ab4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:27.078104 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fa0d4bd8-02c5-48e0-bcc5-58f83eebfeac req-a3af8218-e356-4143-83d2-4744efb43ab4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 945 time: 0.0921924 Nov 24 14:26:27.124453 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fa0d4bd8-02c5-48e0-bcc5-58f83eebfeac req-c6e41eeb-032c-43e7-a6c6-5deff9db5bea tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409169 Nov 24 14:26:27.342708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c054b41a-8134-4663-90ca-25833230cefc req-c756faa5-dd93-4796-8079-681b8ae91063 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:27.344517 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c054b41a-8134-4663-90ca-25833230cefc req-c756faa5-dd93-4796-8079-681b8ae91063 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 945 time: 0.0826347 Nov 24 14:26:27.407191 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c054b41a-8134-4663-90ca-25833230cefc req-281baff9-be78-470e-9a5c-9f2a4049f306 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566556 Nov 24 14:26:27.436431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49490) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:26:27.513584 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d445fc3d-6c59-499d-983f-626d240d918a tempest-TestVolumeBootPattern-330482699 tempest-TestVolumeBootPattern-330482699-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1093 time: 0.0759084 Nov 24 14:26:27.516069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49494) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:26:27.521122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address': '172.20.0.4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:26:27.526836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:26:27.530789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:floatingip and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:26:27.533772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:26:27.539552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:26:27.551733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:27.692828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:27.833507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Allocated IP 172.26.4.205 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/16f3b377-6569-41d1-a42e-892403a45a4a) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:26:27.986106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:28.013149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:28.017236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d958e1cd-3055-40ac-9be7-95dde10de9e4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:28.075504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:26:28.083741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:26:28.088704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:26:28.123794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=16f3b377-6569-41d1-a42e-892403a45a4a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:28.140027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.140383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.140761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.141129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.141497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.141860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.142219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.142582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.142938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.143294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.143648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:26:28.152030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:28.895574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:28.958523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:29.162222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:29.167583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:29.171341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fe8e614-b57d-45cc-a6ca-8669fc6106ae tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:26:29.278296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=16f3b377-6569-41d1-a42e-892403a45a4a,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:26:29.281079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:26:29.296215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:29.490222 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Floating IP 01c1b227-73b0-4187-8077-c9a5a89b699f associated. External IP: 172.26.4.205, port: f23b449d-b6a8-4b92-82db-7e7c81d3225f. Nov 24 14:26:29.924503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:26:30.270110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:26:30.280416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:26:30.294173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:26:30.295097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:26:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:30.302526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:30.364287 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8472095 Nov 24 14:26:30.364947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:26:30.428114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'status': 'completed', 'code': 200} Nov 24 14:26:30.523469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-8a152bfd-4ef4-4954-9ff5-2aa86cd3a5d9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1098 time: 0.0710051 Nov 24 14:26:30.524106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:26:30.742357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-82c402c9-eb3b-49c8-9e69-60b8dcac44af service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:30.744535 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-82c402c9-eb3b-49c8-9e69-60b8dcac44af service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.2126567 Nov 24 14:26:30.857990 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-c3ecda0d-27ac-4e2c-903f-c79dc97c6c48 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 999 time: 0.1059680 Nov 24 14:26:30.920700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:28Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:30.926004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-9fb145bd-9d3e-4b9f-9990-2b36ffdd53e6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:26:30.926683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:26:30.927445 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-9fb145bd-9d3e-4b9f-9990-2b36ffdd53e6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0632849 Nov 24 14:26:30.946102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:26:30.948144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:26:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:31.013183 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-1622f0cd-2484-4fd2-93dd-72ac5bc9622a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0790832 Nov 24 14:26:31.180065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:26:31.183714 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-6587fe64-ced1-47d0-8c53-676c0fc17082 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1636882 Nov 24 14:26:31.330636 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bdec28d7-9d6e-429e-a4d8-7e7de5179d61 req-3c3303de-fbfd-4ca7-8aa0-e7a0d91c7a26 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1409874 Nov 24 14:26:31.628741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:28Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:26:31.634343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27e86a53-4472-4284-9dec-b2d708b130b9 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:28Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:26:31.862304 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f1f8343-57c5-44f2-9b07-e413469c37b1 None None] New status for floating IP 01c1b227-73b0-4187-8077-c9a5a89b699f: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:26:33.258679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4c25319a-9b6a-4634-858e-a695163ec515 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:33.643690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:35.815315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66a5fd54-2e10-494b-8ab8-5f44314fd7c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:36.815323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:38.509810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:47.981071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:26:49.816466 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:27:01.070483 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-5fb66780-af57-4c66-bfd8-ea18bbe1724c service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1327841 Nov 24 14:27:01.204567 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-c7afa029-dc8e-42c0-99cf-8546a398b511 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1098 time: 0.0680780 Nov 24 14:27:01.445508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-0c73d284-5c12-48e1-9470-8a87825865f5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:27:01.446989 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-0c73d284-5c12-48e1-9470-8a87825865f5 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.2251227 Nov 24 14:27:01.549790 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-e047d4e2-0514-4c38-b1b5-739b653c9558 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 1001 time: 0.0960879 Nov 24 14:27:01.613767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-321aa159-4627-4623-a07c-e388f39b0b59 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:27:01.615160 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-321aa159-4627-4623-a07c-e388f39b0b59 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0591557 Nov 24 14:27:01.688213 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-524c442d-c89a-4a1b-9a15-b0b05e011ecd service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0671315 Nov 24 14:27:01.697769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-9a700c9c-2bef-49e1-9106-fab4e21a40ce service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:27:01.698697 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-9a700c9c-2bef-49e1-9106-fab4e21a40ce service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0046566 Nov 24 14:27:01.829346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-728594f7-c91f-4a38-b896-fd7b333f373e service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240315 Nov 24 14:27:01.959590 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09144e50-e4cf-4086-b81d-d07addd3ee34 req-cf85f04d-50c3-41c0-944b-5a9fb92c10f9 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236892 Nov 24 14:27:03.264469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5df5719e-ffbd-4724-bbf2-51c70bdf1993 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:03.646231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:05.817172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25605c8d-9d5e-4952-932d-aa3f25594dae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:06.817929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:08.508108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:17.979507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:26.817183 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:27:33.256256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be9f6eae-f8ba-45fa-aa5c-d7400ed36a9d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:33.647665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:35.818491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-34ef2844-6ece-438a-bb2a-67f60871cd3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:36.821107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:38.509965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:27:47.990964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:02.941159 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-9b9124b3-7c5b-436d-b622-a6eb1294a0c6 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0726714 Nov 24 14:28:03.079912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-b455790e-e9fd-434a-b167-016044f8b489 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1098 time: 0.0697975 Nov 24 14:28:03.221814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-43fd4b03-e180-47ee-9714-62db92c1df24 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:03.223175 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-43fd4b03-e180-47ee-9714-62db92c1df24 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1251571 Nov 24 14:28:03.259381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d3a126e1-bcd2-40b2-9279-f11e4acae97f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:03.325123 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-a154e699-2fdf-42ac-90b6-8dbe3ba426c8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 1001 time: 0.0955930 Nov 24 14:28:03.386089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-f131dd65-ef84-4575-b606-c7da182a8fa9 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:03.387466 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-f131dd65-ef84-4575-b606-c7da182a8fa9 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0556571 Nov 24 14:28:03.464216 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-06d64534-9e75-48b3-bea6-26eefaa273a7 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0704780 Nov 24 14:28:03.594124 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-37b2fc04-ef24-403d-a80e-8c1a9aff8c30 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1219547 Nov 24 14:28:03.650131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:03.723136 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dde017f3-9abc-41da-8b03-78fb3ec75ded req-7148e281-73e9-486a-a9d5-4edf7c418b02 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229115 Nov 24 14:28:03.817919 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:28:05.819713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a23a4db3-9143-4d5e-827c-2c7bc40ddc98 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:06.825318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:08.512620 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:17.997812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:21.067984 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-24baa187-164f-439c-b74b-d06f5b4c325d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1931190936&fields=id&tenant_id=d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 267 time: 0.0415990 Nov 24 14:28:21.323678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-f6976e96-bce7-443d-8b52-06c9d728598e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:21.325120 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-f6976e96-bce7-443d-8b52-06c9d728598e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 811 time: 0.2510929 Nov 24 14:28:21.341688 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-bbf278e4-3710-40fb-a813-06776b9c51e9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/quotas/d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 375 time: 0.0103438 Nov 24 14:28:21.428574 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-ea3e8f43-db2f-4372-bcbb-512f7c802caf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0810444 Nov 24 14:28:21.630472 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0334da1d-01c6-476e-8f83-88c985f804f2 service neutron] 10.222.0.70 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1906083 Nov 24 14:28:21.760658 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-45536fe9-f81a-46aa-9baf-c53b1432a64c service neutron] 10.222.0.70 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1243815 Nov 24 14:28:22.267520 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-698d0353-2986-4cf1-8c72-c67cee19be36 req-0466d050-3717-4df2-a1bf-5c2ce1cfa3fc tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0435991 Nov 24 14:28:23.376585 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-60c137ea-9ddd-44b9-bac0-d9e2751161d8 req-6de02d89-4d78-434c-8962-0ab63b23e3c7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0416374 Nov 24 14:28:24.498883 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53c1d275-4e7f-46ba-bcd0-e7ffbfbffa8c req-aba3d3a1-a29c-4e76-a198-c19221cf8f24 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0435352 Nov 24 14:28:25.611675 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f522ace9-9fc5-40d1-811d-a842e1b31ff5 req-986d4836-a063-4885-8ac6-96de7f3c19e9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0441296 Nov 24 14:28:26.798566 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4fec466b-9128-4fae-a503-d02e2952a624 req-cbeb3ee4-ddea-4ab0-9344-43a6a7e9c324 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0501695 Nov 24 14:28:27.599971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-577ba457-5d89-42c4-8f5f-c2697438c425 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:27.600632 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-577ba457-5d89-42c4-8f5f-c2697438c425 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 811 time: 0.2520454 Nov 24 14:28:27.678912 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-31723242-27d9-4202-8bbc-f4db91dbe1d3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d44584538fcc4f2284b467ff03a0cb46 HTTP/1.1" status: 200 len: 380 time: 0.0645480 Nov 24 14:28:27.690496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'port': {'device_id': 'b106de22-1963-483a-9970-8acaf24abb9f', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'admin_state_up': True, 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'security_groups': ['23943074-ed1c-426f-84f1-4be54a041ead']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:28:27.855528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:28:27.866702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:28:27.879855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Made reservation on behalf of d44584538fcc4f2284b467ff03a0cb46 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:28:27.882939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:28.022568 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c9875994-c915-4db4-aa7c-373db85f1af7 req-4920b96e-f675-4d67-98d9-6d4dd2d216d4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0557284 Nov 24 14:28:28.141946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Allocated IP 172.20.0.6 (f5e04962-eb4f-4396-aa25-69add7c3142b/aaf4b47d-96c4-4601-9724-7a1db6954596/96384f71-e1ce-474a-b3c3-37a93782a9a2) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:28:28.360003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:28.378557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Transition to ACTIVE for port object 96384f71-e1ce-474a-b3c3-37a93782a9a2 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:28:28.403172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:28.413250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e270c776-e628-466b-83d7-5f102f2099f6 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:28.482368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Network f5e04962-eb4f-4396-aa25-69add7c3142b is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:28:28.490967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:28:28.494447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:28:28.542005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=96384f71-e1ce-474a-b3c3-37a93782a9a2,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:28.567866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.568366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.568801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.569217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.569681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.570149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.570558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.571033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.571437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.571994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.572215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:28.577077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:28.601515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:28.602116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:28.640224 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9556890 Nov 24 14:28:28.653464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Request body: {'port': {'device_id': 'b106de22-1963-483a-9970-8acaf24abb9f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:28:28.777744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d69b5b91-5cf6-4557-aeeb-fefe121bfb21 None None] Provisioning for port 96384f71-e1ce-474a-b3c3-37a93782a9a2 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:28:28.787225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:28.787577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d69b5b91-5cf6-4557-aeeb-fefe121bfb21 None None] Provisioning complete for port 96384f71-e1ce-474a-b3c3-37a93782a9a2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:28:28.788161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d69b5b91-5cf6-4557-aeeb-fefe121bfb21 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:28.858332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d69b5b91-5cf6-4557-aeeb-fefe121bfb21 None None] Port 96384f71-e1ce-474a-b3c3-37a93782a9a2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:28:29.292181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438e42d8-ced4-4816-8f48-fb71fb4459f4 req-3126eeb6-a912-4ae6-a62e-9a7953fe3333 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:29.295896 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-438e42d8-ced4-4816-8f48-fb71fb4459f4 req-3126eeb6-a912-4ae6-a62e-9a7953fe3333 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 931 time: 0.1243448 Nov 24 14:28:29.367937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 96384f71-e1ce-474a-b3c3-37a93782a9a2 {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:28:29.375978 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-438e42d8-ced4-4816-8f48-fb71fb4459f4 req-34704438-840f-462f-a3f6-4163410b59f2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0707541 Nov 24 14:28:29.383080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:29.401859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Transition to ACTIVE for port object 96384f71-e1ce-474a-b3c3-37a93782a9a2 will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:28:29.406666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:29.410375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ff2f90e4-32ee-4169-808b-3106465587de tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:29.537588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Pushing event updated for resources: {'Port': ['ID=96384f71-e1ce-474a-b3c3-37a93782a9a2,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:29.542659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:29.664786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Attempting to bind port 96384f71-e1ce-474a-b3c3-37a93782a9a2 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:28:29.665495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Attempting to bind port 96384f71-e1ce-474a-b3c3-37a93782a9a2 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:28:29.665618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Attempting to bind port 96384f71-e1ce-474a-b3c3-37a93782a9a2 on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:28:29.673213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Port 96384f71-e1ce-474a-b3c3-37a93782a9a2 on network f5e04962-eb4f-4396-aa25-69add7c3142b not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:28:29.673213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Attempting to bind port 96384f71-e1ce-474a-b3c3-37a93782a9a2 on network f5e04962-eb4f-4396-aa25-69add7c3142b {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:28:29.680671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 28, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:28:29.681120 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Checking segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:28:29.681626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Bound using segment: {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:28:29.682159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Bound port: 96384f71-e1ce-474a-b3c3-37a93782a9a2, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb5981d0-fea0-4acc-85f4-2063eb49fd05', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:28:29.682502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:29.787067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] For port 96384f71-e1ce-474a-b3c3-37a93782a9a2, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:28:29.790495 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] For port 96384f71-e1ce-474a-b3c3-37a93782a9a2, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:28:29.795569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:29.800912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a094c9a7-038e-4424-b246-5a52099a59c5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:29.868744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:29.870482 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] 10.222.0.47 "PUT /v2.0/ports/96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 200 len: 1093 time: 1.2225280 Nov 24 14:28:29.875108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:28:29.915677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Pushing event updated for resources: {'Port': ['ID=96384f71-e1ce-474a-b3c3-37a93782a9a2,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:29.922056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:29.968521 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'status': 'completed', 'code': 200} Nov 24 14:28:30.016709 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-fd480ff3-544c-49c9-946f-576feb17fece service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1096 time: 0.0931177 Nov 24 14:28:30.095530 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-e4f38d7a-a5bf-4390-ae09-0655c6cd4d04 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 200 len: 217 time: 0.0718930 Nov 24 14:28:30.158865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-30c0992f-5d01-46b6-afbe-3621aa37191e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:30.160306 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-30c0992f-5d01-46b6-afbe-3621aa37191e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0587718 Nov 24 14:28:30.238660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-73a1ef00-6481-4122-b7c6-75a25f585889 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0709076 Nov 24 14:28:30.373537 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-4f45f7a2-bc7f-4413-8b43-61d55874337d service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273103 Nov 24 14:28:30.506456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ff4f91b-ef18-4abf-a578-d1b21df31130 req-6f6220b3-f269-4913-9191-61952ea1d04c service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261191 Nov 24 14:28:30.571494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc539467-08fd-4faa-9e32-d31e81ab5cfb req-b4417bcc-bf4a-49fc-94b8-74a60649b651 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:30.573130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc539467-08fd-4faa-9e32-d31e81ab5cfb req-b4417bcc-bf4a-49fc-94b8-74a60649b651 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0824759 Nov 24 14:28:30.619482 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc539467-08fd-4faa-9e32-d31e81ab5cfb req-f34897a1-2af7-41a7-b07a-27bd2fbfaeff tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398893 Nov 24 14:28:30.623487 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-29ce4fb6-32d8-46f6-bc89-205f6d15c3a0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1096 time: 0.0728307 Nov 24 14:28:30.752394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65967598-5014-4387-acb8-e036ea17db69 req-242d956b-49c8-4316-a665-33a748c9d5e6 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:30.753797 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-242d956b-49c8-4316-a665-33a748c9d5e6 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1242325 Nov 24 14:28:30.824073 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-73b7ef58-1fd3-477c-9680-221650b85e2a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 200 len: 217 time: 0.0639527 Nov 24 14:28:30.886539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65967598-5014-4387-acb8-e036ea17db69 req-41949f43-8e41-4210-8251-9870d03a0876 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:30.887900 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-41949f43-8e41-4210-8251-9870d03a0876 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0568972 Nov 24 14:28:30.961394 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-649603a5-ee38-49b7-b41d-fb483a680b8a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0662785 Nov 24 14:28:31.190245 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-72ff5f44-80c4-4043-a26b-ed7a0e4b883a service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2218494 Nov 24 14:28:31.327474 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65967598-5014-4387-acb8-e036ea17db69 req-9499550f-792c-4bb2-a9ea-1eee6aac52de service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246965 Nov 24 14:28:31.815855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e08092-0e55-43d1-94c2-0f3f3f9dd024 req-4045af25-5f2d-4e4c-b51c-a04aacff2a4a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:31.816582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-f9e08092-0e55-43d1-94c2-0f3f3f9dd024 req-4045af25-5f2d-4e4c-b51c-a04aacff2a4a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:28:31.831695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-f9e08092-0e55-43d1-94c2-0f3f3f9dd024 req-4045af25-5f2d-4e4c-b51c-a04aacff2a4a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:28:31.832824 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f9e08092-0e55-43d1-94c2-0f3f3f9dd024 req-4045af25-5f2d-4e4c-b51c-a04aacff2a4a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0921752 Nov 24 14:28:31.880137 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f9e08092-0e55-43d1-94c2-0f3f3f9dd024 req-fe8a2ac6-a71c-4f84-9bc3-e518eec030a3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414517 Nov 24 14:28:33.075745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6daa83df-68e8-452a-b698-6eb57d6e4337 req-13baf238-dbc8-4ed9-8286-da562627c58f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:33.077400 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6daa83df-68e8-452a-b698-6eb57d6e4337 req-13baf238-dbc8-4ed9-8286-da562627c58f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0752664 Nov 24 14:28:33.125097 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6daa83df-68e8-452a-b698-6eb57d6e4337 req-e70637c3-53b6-4996-a518-cee79207e5e9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423822 Nov 24 14:28:33.262532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d4fb751c-aaf6-437f-8b68-e2f346f04912 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:33.651467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:34.326661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72351b4-29a0-4323-a4df-d55c50b216b5 req-fe242727-3edc-4e4d-9009-0b8bf1c72c24 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:34.328041 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e72351b4-29a0-4323-a4df-d55c50b216b5 req-fe242727-3edc-4e4d-9009-0b8bf1c72c24 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0848148 Nov 24 14:28:34.373992 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e72351b4-29a0-4323-a4df-d55c50b216b5 req-181e9aa8-2026-4ead-9e15-b721ea8a567c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405347 Nov 24 14:28:35.567870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ad076b-5eea-4024-8408-41f181560482 req-d2c0133f-f9c2-41bb-a8a2-1aec5b928f86 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:35.569217 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-38ad076b-5eea-4024-8408-41f181560482 req-d2c0133f-f9c2-41bb-a8a2-1aec5b928f86 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0757136 Nov 24 14:28:35.613850 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-38ad076b-5eea-4024-8408-41f181560482 req-b2a75510-98f7-48f1-a6ca-46fc373a89a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391614 Nov 24 14:28:35.820878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ff1e06e-4481-42d7-af56-2848f262fe70 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:36.810603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d70194-d582-4bfd-a542-79953c1f02ac req-d9952d9e-61af-4c56-8d4d-520bd9dd4e93 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:36.813074 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c1d70194-d582-4bfd-a542-79953c1f02ac req-d9952d9e-61af-4c56-8d4d-520bd9dd4e93 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0768633 Nov 24 14:28:36.829401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:36.860309 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c1d70194-d582-4bfd-a542-79953c1f02ac req-0587a750-f006-4007-95f2-cb9dae9a3373 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421801 Nov 24 14:28:38.058501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b66137c-283a-4824-9f7b-636ff0caa86e req-143082cf-2a7a-4e2f-82a5-86e47905f490 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:38.059922 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b66137c-283a-4824-9f7b-636ff0caa86e req-143082cf-2a7a-4e2f-82a5-86e47905f490 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0799828 Nov 24 14:28:38.106007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b66137c-283a-4824-9f7b-636ff0caa86e req-7955c4de-c85d-4b9e-b7a9-3e8bb42f56f3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398688 Nov 24 14:28:38.515868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:39.306780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f34739c-ce62-494b-81ad-f847a981f013 req-0b0843e8-0368-4444-af52-ce1b199717b0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:39.308225 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6f34739c-ce62-494b-81ad-f847a981f013 req-0b0843e8-0368-4444-af52-ce1b199717b0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 943 time: 0.0805340 Nov 24 14:28:39.352756 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6f34739c-ce62-494b-81ad-f847a981f013 req-9c2461a1-5275-4329-9d99-39d4192e21d1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383363 Nov 24 14:28:39.482379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 96384f71-e1ce-474a-b3c3-37a93782a9a2 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:28:39.614768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 96384f71-e1ce-474a-b3c3-37a93782a9a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:28:39.627312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'port_id': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'mac_address': 'fa:16:3e:1f:c3:45', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 863, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:28:39.683648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:39.700730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 96384f71-e1ce-474a-b3c3-37a93782a9a2 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:28:39.715741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 96384f71-e1ce-474a-b3c3-37a93782a9a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:28:39.721115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:39.722883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:39.785491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=96384f71-e1ce-474a-b3c3-37a93782a9a2,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:39.793462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.793802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.794136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.794466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.794793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.795118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.795438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.795775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.796889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.797251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.797643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:39.801328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:40.048490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['96384f71-e1ce-474a-b3c3-37a93782a9a2'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:28:40.552439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18069783-d8df-4b96-a1d3-9a97a2d94a30 req-ecc635dc-85d7-467d-875e-7cbbf96662a9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:40.553975 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-18069783-d8df-4b96-a1d3-9a97a2d94a30 req-ecc635dc-85d7-467d-875e-7cbbf96662a9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 944 time: 0.0794647 Nov 24 14:28:40.606378 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-18069783-d8df-4b96-a1d3-9a97a2d94a30 req-fd9285fc-c5c7-4e15-815c-4afaf4f8b3f7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465839 Nov 24 14:28:40.818038 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:28:41.489352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 96384f71-e1ce-474a-b3c3-37a93782a9a2 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:28:41.558635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 96384f71-e1ce-474a-b3c3-37a93782a9a2 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:28:41.563380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 96384f71-e1ce-474a-b3c3-37a93782a9a2 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:28:41.563765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:41.678250 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:41.705291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:28:41.714892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 96384f71-e1ce-474a-b3c3-37a93782a9a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:28:41.720140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:41.722190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:41.787548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=96384f71-e1ce-474a-b3c3-37a93782a9a2,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:41.790592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:41.809707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99dc7abb-e56c-400b-a2e8-0cf5a71402bf req-d6558106-dd98-4ed9-8543-2dba3fa4ff3d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:41.811148 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-99dc7abb-e56c-400b-a2e8-0cf5a71402bf req-d6558106-dd98-4ed9-8543-2dba3fa4ff3d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.0816774 Nov 24 14:28:41.857562 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-99dc7abb-e56c-400b-a2e8-0cf5a71402bf req-dbe0e84d-c6ab-4a7e-93b6-0a317684d61f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402269 Nov 24 14:28:42.918659 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'code': 200} Nov 24 14:28:43.258756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-344565e4-4b55-415d-9fda-256c1738be9f req-17677cba-b859-4967-866f-4c578de0831e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:43.260204 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-344565e4-4b55-415d-9fda-256c1738be9f req-17677cba-b859-4967-866f-4c578de0831e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.1382666 Nov 24 14:28:43.262777 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0f9d7a09-fa9d-44ca-ae46-9f31818b6b4c req-f36dd703-e2ad-48d7-9842-01e75de4df19 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1098 time: 0.1072848 Nov 24 14:28:43.335369 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-344565e4-4b55-415d-9fda-256c1738be9f req-5a9368ed-fd1e-4a60-87ab-31e752807c91 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684874 Nov 24 14:28:43.336909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0f9d7a09-fa9d-44ca-ae46-9f31818b6b4c req-4dc091f9-d214-4c0e-987a-7e5584b1c478 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571713 Nov 24 14:28:44.533609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8648987f-8a2c-42af-a7f9-90f33ad74a37 req-a8696c19-f076-44ba-ac66-f3c55b5197ee tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:44.534970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8648987f-8a2c-42af-a7f9-90f33ad74a37 req-a8696c19-f076-44ba-ac66-f3c55b5197ee tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.0798166 Nov 24 14:28:44.588560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8648987f-8a2c-42af-a7f9-90f33ad74a37 req-4587a693-f01e-4e9f-9353-60990cef64b9 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475919 Nov 24 14:28:45.777794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb6ecdb-30cc-48c7-8801-2278ed9c9c04 req-7e2cdf27-7b97-422b-8163-788b49506639 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:45.779203 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dfb6ecdb-30cc-48c7-8801-2278ed9c9c04 req-7e2cdf27-7b97-422b-8163-788b49506639 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.0773201 Nov 24 14:28:45.826827 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dfb6ecdb-30cc-48c7-8801-2278ed9c9c04 req-52c7e274-108c-43ce-9491-bb6543e178f3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421629 Nov 24 14:28:46.131833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1c260bc-54b4-4e38-ad1e-a9e1ebdc1fa9 req-97762326-a63a-4c2c-9513-9260795b43c0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:46.133157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c1c260bc-54b4-4e38-ad1e-a9e1ebdc1fa9 req-97762326-a63a-4c2c-9513-9260795b43c0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.1890936 Nov 24 14:28:46.180627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c1c260bc-54b4-4e38-ad1e-a9e1ebdc1fa9 req-2ed7c38f-e2f7-45b3-84fb-09c06683f23f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420306 Nov 24 14:28:46.208985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49650) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:28:46.282330 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2aa771a0-b102-4184-a328-0de3a7cb5cde tempest-TestVolumeBootPattern-330482699 tempest-TestVolumeBootPattern-330482699-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1093 time: 0.0721121 Nov 24 14:28:46.284810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49654) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:28:46.289935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address': '172.20.0.6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:28:46.295427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:28:46.300472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Usage tracker for resource:floatingip and tenant:d44584538fcc4f2284b467ff03a0cb46 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:28:46.303277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:28:46.308944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:28:46.320277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:46.455714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:46.589476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Allocated IP 172.26.4.145 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/12df234f-77f3-4a11-a7e9-01cd33ffff1b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:28:46.824984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:46.852893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:46.856392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:46.912919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:28:46.919995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:28:46.924187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:28:46.961647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=12df234f-77f3-4a11-a7e9-01cd33ffff1b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:46.980845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.981228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.981603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.981973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.982341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.982708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.983067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.984074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.984454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.984799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.985155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:28:46.989799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:47.440683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:47.499255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:47.706333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:47.710834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:47.714250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-221616cb-c813-43e2-ae3c-d4c0157c1956 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:28:47.811186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event updated for resources: {'Port': ['ID=12df234f-77f3-4a11-a7e9-01cd33ffff1b,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:28:47.815685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:28:47.830165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:47.988155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:48.015369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Floating IP fb41bff2-d0c2-41f0-8a36-6a21af94da99 associated. External IP: 172.26.4.145, port: 96384f71-e1ce-474a-b3c3-37a93782a9a2. Nov 24 14:28:48.514268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:28:48.714042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:28:48.723916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:28:48.735347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:28:48.736067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:28:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:28:48.738338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:28:48.795351 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5095260 Nov 24 14:28:48.796710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:28:48.857528 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'status': 'completed', 'code': 200} Nov 24 14:28:48.915879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:28:48.949335 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-75643a4c-78f8-4378-b841-0d18682cae88 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1098 time: 0.0692348 Nov 24 14:28:49.084109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-3da6592b-28dd-4d03-bb8a-9cad1593e31a service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:49.085455 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-3da6592b-28dd-4d03-bb8a-9cad1593e31a service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1292272 Nov 24 14:28:49.189835 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-a1b386b5-8948-49e6-ad1c-d574b4289c62 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 200 len: 999 time: 0.0980241 Nov 24 14:28:49.251983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-88c02159-df98-471b-baf8-e2c6b2839993 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:28:49.253411 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-88c02159-df98-471b-baf8-e2c6b2839993 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0572443 Nov 24 14:28:49.307288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:32Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}, {'id': 'fb41bff2-d0c2-41f0-8a36-6a21af94da99', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.145', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:1f:c3:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b106de22-1963-483a-9970-8acaf24abb9f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:28:47Z', 'updated_at': '2021-11-24T14:28:47Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:28:49.311126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:28:49.323006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:28:49.323604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:28:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:28:49.331986 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-24a289b0-ada2-4e8b-88ff-2e8ffbbaf1dc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0721989 Nov 24 14:28:49.505347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:28:49.563331 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-0238e742-6e1f-4156-9612-a153fd5d6c58 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2251666 Nov 24 14:28:49.696825 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9acc4009-8ced-4416-afe3-ff90cdafe118 req-2347d00f-e3a8-4908-a482-668fa15df000 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1275046 Nov 24 14:28:49.854023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:32Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}, {'id': 'fb41bff2-d0c2-41f0-8a36-6a21af94da99', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.145', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:1f:c3:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b106de22-1963-483a-9970-8acaf24abb9f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:28:47Z', 'updated_at': '2021-11-24T14:28:47Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:28:49.858023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ac213d6-3cd6-4221-9255-98112c282ae9 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:32Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}, {'id': 'fb41bff2-d0c2-41f0-8a36-6a21af94da99', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.145', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:1f:c3:45', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b106de22-1963-483a-9970-8acaf24abb9f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:28:47Z', 'updated_at': '2021-11-24T14:28:47Z', 'revision_number': 0, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:28:50.052673 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a2051bb-a578-462b-8a8a-1a4d7542ac26 None None] New status for floating IP fb41bff2-d0c2-41f0-8a36-6a21af94da99: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:29:03.276579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-03b5a6ab-12ac-44db-b5f9-2d69f6a10d24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:03.661919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:04.005093 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-76ae58e9-bf6b-40ac-badb-2ac5c34ea0ff service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0827696 Nov 24 14:29:04.149951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-180ed1f8-a176-4fbc-8ea0-423ea12975f6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1098 time: 0.0748811 Nov 24 14:29:04.309031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-5e87de7a-1561-48da-a399-d32c7bda0c56 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:29:04.309031 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-5e87de7a-1561-48da-a399-d32c7bda0c56 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1412528 Nov 24 14:29:04.409883 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-cc4a27f3-7630-4422-a76e-fd2f23894a2d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 1001 time: 0.0935454 Nov 24 14:29:04.473478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-e6126bec-2d12-49ed-92de-0581e48534c6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:29:04.473478 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-e6126bec-2d12-49ed-92de-0581e48534c6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0606549 Nov 24 14:29:04.552080 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-db1ee9ba-469e-48c2-8531-f0962dca6208 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0699093 Nov 24 14:29:04.689464 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-a75bdcb3-2051-48e0-9a7f-49cfd0a02563 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272535 Nov 24 14:29:04.833308 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5bf9b8ce-0331-46d3-9087-eb22827bd8ab req-d1391a55-f09a-4ab3-a8a2-5e8f23ce808a service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1449599 Nov 24 14:29:05.831720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-19560577-7402-4448-8f64-87798cdf9b7b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:06.829702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:08.522026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:17.819023 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:29:18.003471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:33.265807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c5f2d77a-3e0b-45b0-a9bb-c69971ce3dd9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:33.656876 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:35.818424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-037b8cad-f4b1-43ff-989b-4b063236088e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:36.833130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:38.522216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:48.029037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:29:54.818002 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:30:03.269301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1b3f1be-c9a8-496b-a577-87e292c250ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:03.658401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:03.999517 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-1f2ae340-eb38-4cd7-a011-ed2da3c4bfad service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0719903 Nov 24 14:30:04.089477 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-47a2e751-dc28-4d75-bbb7-a60ea87e43a5 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1098 time: 0.0690880 Nov 24 14:30:04.235858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-f728605f-4520-4640-be35-66288d9e55f2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:04.237264 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-f728605f-4520-4640-be35-66288d9e55f2 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1279254 Nov 24 14:30:04.340715 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-e60ac982-7d60-4442-8b2b-95163e604611 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 200 len: 1001 time: 0.0967278 Nov 24 14:30:04.401502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-ce06efcf-b38a-4441-bd61-a962e3017e30 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:04.402864 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-ce06efcf-b38a-4441-bd61-a962e3017e30 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0560250 Nov 24 14:30:04.479253 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-2042fe6b-2066-461a-9613-4dfa937029a8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0704021 Nov 24 14:30:04.713268 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-eb9f9cc2-423d-4329-bad4-41a233b4a90b service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2268491 Nov 24 14:30:04.841620 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a32402b-78a2-4237-a3d3-46b9598ab955 req-be6a94f4-b2fe-444c-bba1-8f12ae5dab61 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229892 Nov 24 14:30:05.820660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-968210ee-6987-4c09-bbe5-ae57501f3548 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:06.836547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:08.525501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:16.339164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49690) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:16.537999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Deleting port 12df234f-77f3-4a11-a7e9-01cd33ffff1b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:16.538257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:16.710631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:16.710949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:16.828339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Calling delete_port for 12df234f-77f3-4a11-a7e9-01cd33ffff1b owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:16.972459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:16.976388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-35353b83-cca5-46d1-945e-e32c3e46796b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:17.018515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'Port': ['ID=12df234f-77f3-4a11-a7e9-01cd33ffff1b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:17.058412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.058789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.059161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.059528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.059926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.060291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.060651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.061009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.061366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.061719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.062071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:17.068498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:17.124695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:17.609821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:30:17.809389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:30:17.819297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:30:17.828578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:17.831204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:17.831835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:17.882131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "DELETE /v2.0/floatingips/fb41bff2-d0c2-41f0-8a36-6a21af94da99 HTTP/1.1" status: 204 len: 168 time: 1.5418942 Nov 24 14:30:17.882768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:30:18.027731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:18.037125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:18.037983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'status': 'completed', 'code': 200} Nov 24 14:30:18.141336 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-0f47f270-240d-4d2d-9415-cd21dd84f173 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 1098 time: 0.0790439 Nov 24 14:30:18.285315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-04696309-c33c-4226-a62f-37dbcbf6ec19 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:18.287084 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-04696309-c33c-4226-a62f-37dbcbf6ec19 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1400540 Nov 24 14:30:18.380978 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-35b47c8f-e8ff-4147-be78-759b20534754 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 200 len: 217 time: 0.0856409 Nov 24 14:30:18.451945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-0fb7a95f-c52f-48e8-abf7-6e3b9fdbc5b1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:18.453402 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-0fb7a95f-c52f-48e8-abf7-6e3b9fdbc5b1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0645032 Nov 24 14:30:18.473653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:32Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:18.478324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:30:18.489065 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:18.489671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:18.593865 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-19378829-33d8-4b8e-bf0c-23249c24db40 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1340513 Nov 24 14:30:18.599356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7032f22c-cea1-4f1c-9ccb-9be3fc33fa38 req-c6d59699-52e5-4bc7-97f3-67f8fc5057d4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:18.600700 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7032f22c-cea1-4f1c-9ccb-9be3fc33fa38 req-c6d59699-52e5-4bc7-97f3-67f8fc5057d4 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.1787317 Nov 24 14:30:18.664488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:18.737416 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7032f22c-cea1-4f1c-9ccb-9be3fc33fa38 req-80e7aea6-1a7a-455b-ae9b-19d2ff2fdfbd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1189587 Nov 24 14:30:18.772852 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-f5fc2d23-04d2-47a2-ba5a-93ce1bd51561 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1712217 Nov 24 14:30:18.906406 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13ffef3-81bb-4147-947c-7b1e8f30c33f req-a0788db9-c34a-4930-a8f8-ece2b6834913 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1254904 Nov 24 14:30:19.033259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:32Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:19.037078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6453597d-0c2b-4418-879c-f4a9ae2c0699 None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '01c1b227-73b0-4187-8077-c9a5a89b699f', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'floating_ip_address': '172.26.4.205', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'port_id': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'mac_address': 'fa:16:3e:ce:fc:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96928687-bc2e-48ed-b126-91521d291fb3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:26:28Z', 'updated_at': '2021-11-24T14:26:32Z', 'revision_number': 1, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:30:19.247456 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-576d8602-f77c-48cd-a98d-92d75cc1f1ac None None] New status for floating IP fb41bff2-d0c2-41f0-8a36-6a21af94da99: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:30:19.934437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14af24e0-b2f7-4b02-a694-44a1516ab0f6 req-8f64c40c-2b92-4360-bfba-f4c9d884238d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:19.935122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-14af24e0-b2f7-4b02-a694-44a1516ab0f6 req-8f64c40c-2b92-4360-bfba-f4c9d884238d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:30:19.950309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-14af24e0-b2f7-4b02-a694-44a1516ab0f6 req-8f64c40c-2b92-4360-bfba-f4c9d884238d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:30:19.951608 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-14af24e0-b2f7-4b02-a694-44a1516ab0f6 req-8f64c40c-2b92-4360-bfba-f4c9d884238d tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.0917451 Nov 24 14:30:20.007953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-14af24e0-b2f7-4b02-a694-44a1516ab0f6 req-f22e18a6-19f8-4e8e-aa8d-c85515e590c0 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439045 Nov 24 14:30:20.130397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-704d450c-c273-42be-a24f-2d0ca7320ce2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:20.131824 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-704d450c-c273-42be-a24f-2d0ca7320ce2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 945 time: 0.0777061 Nov 24 14:30:20.199073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Deleting port 96384f71-e1ce-474a-b3c3-37a93782a9a2 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:20.199409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:20.449351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] For port 96384f71-e1ce-474a-b3c3-37a93782a9a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=96384f71-e1ce-474a-b3c3-37a93782a9a2,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:20.449613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:20.567577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Calling delete_port for 96384f71-e1ce-474a-b3c3-37a93782a9a2 owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:20.708337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:20.714441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:20.863117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'Port': ['ID=96384f71-e1ce-474a-b3c3-37a93782a9a2,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:20.901981 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.902361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.902732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.903102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.903467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.903867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.904230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.904590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.904951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.905306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.905662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:30:20.912294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:20.946680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] No DVR routers for this DVR port 96384f71-e1ce-474a-b3c3-37a93782a9a2 on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:30:20.948982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:20.951430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'name': 'network-vif-deleted', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:30:20.966976 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3bd2fd62-c964-4d4b-ae47-02a17af42c01 req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "DELETE /v2.0/ports/96384f71-e1ce-474a-b3c3-37a93782a9a2 HTTP/1.1" status: 204 len: 173 time: 0.8287506 Nov 24 14:30:21.102060 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b106de22-1963-483a-9970-8acaf24abb9f', 'name': 'network-vif-deleted', 'tag': '96384f71-e1ce-474a-b3c3-37a93782a9a2', 'status': 'completed', 'code': 200} Nov 24 14:30:21.168398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c7314247-837c-41ac-bea4-be849686cb17 req-39f83c7e-7005-42bf-aba4-5a387133b73a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=b106de22-1963-483a-9970-8acaf24abb9f HTTP/1.1" status: 200 len: 210 time: 0.0420115 Nov 24 14:30:23.981701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 96384f71-e1ce-474a-b3c3-37a93782a9a2 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:24.018459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 96384f71-e1ce-474a-b3c3-37a93782a9a2 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:24.018807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 96384f71-e1ce-474a-b3c3-37a93782a9a2 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:26.798270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49738) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:27.003136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Deleting port 16f3b377-6569-41d1-a42e-892403a45a4a {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:27.003471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:27.176087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:27.176409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:27.301091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Calling delete_port for 16f3b377-6569-41d1-a42e-892403a45a4a owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:27.448843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:27.453240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-85403c9b-2986-4f03-9c45-afea4f779b1b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:27.494814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'Port': ['ID=16f3b377-6569-41d1-a42e-892403a45a4a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:27.497766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:27.588344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:28.078058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:30:28.286163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:30:28.296260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:30:28.302437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:28.308245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:28.308864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:28.360879 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "DELETE /v2.0/floatingips/01c1b227-73b0-4187-8077-c9a5a89b699f HTTP/1.1" status: 204 len: 168 time: 1.5592356 Nov 24 14:30:28.360879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:30:28.413561 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'status': 'completed', 'code': 200} Nov 24 14:30:28.504482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:28.537197 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-fe292b86-2f03-492b-a121-f4ad59430e55 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=d44584538fcc4f2284b467ff03a0cb46&device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 1098 time: 0.0952997 Nov 24 14:30:28.726697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-dfc94119-bad4-4fe7-a05d-7f4dc82c79e3 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:28.728746 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-dfc94119-bad4-4fe7-a05d-7f4dc82c79e3 service neutron] 10.222.0.47 "GET /v2.0/networks?id=f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 200 len: 912 time: 0.1843534 Nov 24 14:30:28.821716 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-a648b8c6-6c66-41f5-b429-e7877e619f6f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 200 len: 217 time: 0.0852640 Nov 24 14:30:28.875341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:28.879295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:30:28.889271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3683a8d-c2f9-459f-8d71-cc1f02346478 req-1938d41a-25eb-4120-84b3-94e833400bf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:28.889962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-a3683a8d-c2f9-459f-8d71-cc1f02346478 req-1938d41a-25eb-4120-84b3-94e833400bf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:30:28.890163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:28.890760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:28.914190 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-c2ca9c3d-2ec6-4368-b8d1-3720a0912fe6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:28.916230 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-c2ca9c3d-2ec6-4368-b8d1-3720a0912fe6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 200 len: 850 time: 0.0841553 Nov 24 14:30:28.920676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-a3683a8d-c2f9-459f-8d71-cc1f02346478 req-1938d41a-25eb-4120-84b3-94e833400bf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:30:28.921758 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a3683a8d-c2f9-459f-8d71-cc1f02346478 req-1938d41a-25eb-4120-84b3-94e833400bf6 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 945 time: 0.2447631 Nov 24 14:30:29.016154 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a3683a8d-c2f9-459f-8d71-cc1f02346478 req-e7f3dff8-6b8f-42d8-9923-1a4f035fb7b7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602872 Nov 24 14:30:29.034809 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-286ca441-db99-4f7b-a99e-48b14f8f88ce service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=f5e04962-eb4f-4396-aa25-69add7c3142b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1119199 Nov 24 14:30:29.080616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:29.169640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-4763c47d-fd02-4393-b234-ff4a3ecd4833 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272883 Nov 24 14:30:29.305592 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d60dfaa-3b89-4919-87c2-9c416019444e req-51530c34-7e79-44e2-a4f8-b583a8c76be2 service neutron] 10.222.0.47 "GET /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295435 Nov 24 14:30:29.394706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:29.398913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bdda5a8-0ff1-48ef-a997-d19ac52af77a None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:19Z', 'revision_number': 4, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f', 'name': '', 'network_id': 'f5e04962-eb4f-4396-aa25-69add7c3142b', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'mac_address': 'fa:16:3e:a1:07:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:18Z', 'updated_at': '2021-11-24T14:23:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'subnets': [{'id': 'aaf4b47d-96c4-4601-9724-7a1db6954596', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:30:29.669054 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69f6966a-5014-4e4b-a4a6-05de1e765286 None None] New status for floating IP 01c1b227-73b0-4187-8077-c9a5a89b699f: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:30:30.220019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5b014f-c6cb-4845-a6f5-2461d451397c req-093a2d50-1a06-4801-881c-c4e9ea2949c2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:30.220710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9a5b014f-c6cb-4845-a6f5-2461d451397c req-093a2d50-1a06-4801-881c-c4e9ea2949c2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Synchronizing usage tracker for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:30:30.233897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9a5b014f-c6cb-4845-a6f5-2461d451397c req-093a2d50-1a06-4801-881c-c4e9ea2949c2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Unset dirty status for tenant:d44584538fcc4f2284b467ff03a0cb46 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:30:30.235805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9a5b014f-c6cb-4845-a6f5-2461d451397c req-093a2d50-1a06-4801-881c-c4e9ea2949c2 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 945 time: 0.0917380 Nov 24 14:30:30.280373 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9a5b014f-c6cb-4845-a6f5-2461d451397c req-9d0f21af-d799-4dfb-b54a-6f464bef5fe5 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/security-groups?id=23943074-ed1c-426f-84f1-4be54a041ead&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398037 Nov 24 14:30:30.353747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-961f6343-df05-4c1a-90de-5731cb3f5041 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:30.355081 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-961f6343-df05-4c1a-90de-5731cb3f5041 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 945 time: 0.0781407 Nov 24 14:30:30.426457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Deleting port f23b449d-b6a8-4b92-82db-7e7c81d3225f {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:30.426790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:30.676097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] For port f23b449d-b6a8-4b92-82db-7e7c81d3225f, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f23b449d-b6a8-4b92-82db-7e7c81d3225f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:30.676447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:30.795923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Calling delete_port for f23b449d-b6a8-4b92-82db-7e7c81d3225f owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:30.936533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:30.941871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-25f6ebe6-2cea-4fe7-be64-0d1e484ab4e3 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:31.088032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'Port': ['ID=f23b449d-b6a8-4b92-82db-7e7c81d3225f,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:31.092187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:31.168295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] No DVR routers for this DVR port f23b449d-b6a8-4b92-82db-7e7c81d3225f on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:30:31.170692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:31.173258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'name': 'network-vif-deleted', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:30:31.190009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a3032a48-6d73-4fb5-b194-384d61986bd2 req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.47 "DELETE /v2.0/ports/f23b449d-b6a8-4b92-82db-7e7c81d3225f HTTP/1.1" status: 204 len: 173 time: 0.8289304 Nov 24 14:30:31.243513 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96928687-bc2e-48ed-b126-91521d291fb3', 'name': 'network-vif-deleted', 'tag': 'f23b449d-b6a8-4b92-82db-7e7c81d3225f', 'status': 'completed', 'code': 200} Nov 24 14:30:31.453028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af880123-3af3-4bf4-8251-ac55022dcdc5 req-f9081035-3e9e-4cb9-ac26-7a01a6ac255b tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "GET /v2.0/ports?device_id=96928687-bc2e-48ed-b126-91521d291fb3 HTTP/1.1" status: 200 len: 210 time: 0.0493598 Nov 24 14:30:31.817249 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:30:32.562836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49756) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:32.715354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Deleting port 7fa40d08-2073-47c7-9950-d8796599f7c9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:32.715686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:32.885148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:32.885468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:33.002404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Calling delete_port for 7fa40d08-2073-47c7-9950-d8796599f7c9 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:33.145207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:33.149900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8449d58f-d7df-48bc-9fcd-9b0f4ef63f3e tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:33.192778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'Port': ['ID=7fa40d08-2073-47c7-9950-d8796599f7c9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:33.196137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:33.274775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f8a1d1bd-6a7c-4507-968c-cb2821087a73 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:33.286930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:33.301495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:33.302605 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "DELETE /v2.0/floatingips/50c1b853-40ff-4945-8588-651710a56dd5 HTTP/1.1" status: 204 len: 168 time: 0.7387338 Nov 24 14:30:33.662142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:34.001573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f23b449d-b6a8-4b92-82db-7e7c81d3225f no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:34.038296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: f23b449d-b6a8-4b92-82db-7e7c81d3225f {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:34.038643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f23b449d-b6a8-4b92-82db-7e7c81d3225f not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:35.794856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49774) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:35.829233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d556a679-427f-447c-9b17-e162d9b9644b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:35.978308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:36.012884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:36.085897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:36.090719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1d01ff16-993d-4672-834d-f11d1dcfb05a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:36.106574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=23943074-ed1c-426f-84f1-4be54a041ead,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:36.109512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:36.117916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:36.119187 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] 10.222.0.70 "DELETE /v2.0/security-groups/23943074-ed1c-426f-84f1-4be54a041ead HTTP/1.1" status: 204 len: 168 time: 0.3232970 Nov 24 14:30:36.186092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49780) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:36.714544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:36.840120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:37.303451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Deleting port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:37.304003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:37.469947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] For port 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:37.470293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:37.587248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Calling delete_port for 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:37.863297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:37.867684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b4e92d7-3ddc-4ffd-816b-70767c49ddb3 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:37.914343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Pushing event deleted for resources: {'Port': ['ID=110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:37.917519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:38.214015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:38.528113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:38.786268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Router cc599847-0d0e-4030-af50-b6c10474b537 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:30:38.996108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:30:39.004843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] Sync routers for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:30:39.008277 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] 10.222.0.70 "PUT /v2.0/routers/cc599847-0d0e-4030-af50-b6c10474b537/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8209984 Nov 24 14:30:39.011334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49786) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:39.019183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:39.020037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:39.209392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:39.338409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:39.514889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5'}], 'enable_snat': True}, 'gw_port_id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:30:37Z', 'revision_number': 5, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port': {'id': '33243d45-348c-4d38-aad5-1c1278d8431c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:f0:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:23:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:39.519103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] Checking router: cc599847-0d0e-4030-af50-b6c10474b537 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:30:39.529818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] Routers {'cc599847-0d0e-4030-af50-b6c10474b537'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:39.530436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['cc599847-0d0e-4030-af50-b6c10474b537'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:39.536132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:39.546950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Deleting port 33243d45-348c-4d38-aad5-1c1278d8431c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:39.547285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:39.683280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] Set router cc599847-0d0e-4030-af50-b6c10474b537 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:39.726962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] For port 33243d45-348c-4d38-aad5-1c1278d8431c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=33243d45-348c-4d38-aad5-1c1278d8431c,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:39.727368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:39.829567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:30:39Z', 'revision_number': 6, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:39.833616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-436749be-a9e6-41b9-b102-9325f53ea36c None None] The sync data for ids ['cc599847-0d0e-4030-af50-b6c10474b537'] in dv-neutron-818151-2-hyperv is: [{'id': 'cc599847-0d0e-4030-af50-b6c10474b537', 'name': 'tempest-TestVolumeBootPattern-287562138-router', 'tenant_id': 'd44584538fcc4f2284b467ff03a0cb46', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:16Z', 'updated_at': '2021-11-24T14:30:39Z', 'revision_number': 6, 'project_id': 'd44584538fcc4f2284b467ff03a0cb46', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:30:39.853652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Calling delete_port for 33243d45-348c-4d38-aad5-1c1278d8431c owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:40.017160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.021613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-de4ef0ef-84f8-4be4-95e9-3ac4966a2520 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:40.064587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Pushing event deleted for resources: {'Port': ['ID=33243d45-348c-4d38-aad5-1c1278d8431c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:40.067523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:40.290190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.542709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.547571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.573476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.574106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cc599847-0d0e-4030-af50-b6c10474b537 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:30:40.586674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.587869 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] 10.222.0.70 "DELETE /v2.0/routers/cc599847-0d0e-4030-af50-b6c10474b537 HTTP/1.1" status: 204 len: 168 time: 1.5755737 Nov 24 14:30:40.590740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49790) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:40.766129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Deleting subnet aaf4b47d-96c4-4601-9724-7a1db6954596 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:30:40.769162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.821353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.899266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.970907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:40.974523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b1c88c2-4928-4a05-b44b-ff71053dd409 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:41.010204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aaf4b47d-96c4-4601-9724-7a1db6954596,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:41.013061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:41.015406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.021409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/aaf4b47d-96c4-4601-9724-7a1db6954596 HTTP/1.1" status: 204 len: 168 time: 0.4297435 Nov 24 14:30:41.021558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d423a4b5-f044-4aaa-b206-b4a63e25a0e6 None None] Network f5e04962-eb4f-4396-aa25-69add7c3142b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:30:41.023839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49794) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:41.130688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.141428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Deleting port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:41.141758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.288536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] DHCP port deletion for f5e04962-eb4f-4396-aa25-69add7c3142b request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:30:41.294834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Deleting port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:41.295214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.346916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33243d45-348c-4d38-aad5-1c1278d8431c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:41.354020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] For port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:41.354339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.407019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 33243d45-348c-4d38-aad5-1c1278d8431c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:41.407289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 33243d45-348c-4d38-aad5-1c1278d8431c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:41.407703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:41.447117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:41.447469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 110ed9ce-af2d-4b04-b7c9-d9c94acc9c8f not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:41.447915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:41.473626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Calling delete_port for 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:41.547698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.552448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c622515-4f96-4694-8886-2dfda09ada89 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:41.597509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Pushing event deleted for resources: {'Port': ['ID=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:41.597794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No active binding found for port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce {{(pid=83527) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:222}} Nov 24 14:30:41.598215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:41.600864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:41.605523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] No DVR routers for this DVR port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:30:41.618028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] For port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3f021257-d1a4-4a32-8030-3c1f8d2cf1ce,segment=NetworkSegment(bb5981d0-fea0-4acc-85f4-2063eb49fd05),segment_id=bb5981d0-fea0-4acc-85f4-2063eb49fd05)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:41.618459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.723314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.738423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Calling delete_port for 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:41.749136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f5e04962-eb4f-4396-aa25-69add7c3142b']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:41.761384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb5981d0-fea0-4acc-85f4-2063eb49fd05') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:41.761678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb5981d0-fea0-4acc-85f4-2063eb49fd05') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:41.772798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.789861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.797462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Releasing vlan 863 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:30:41.797860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.808021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:30:41.808388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:30:41.811563 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:30:41.889203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.892747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d513913d-28e2-43c1-a86c-d1e89f56c395 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:41.906148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:41.916924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Pushing event deleted for resources: {'Network': ['ID=f5e04962-eb4f-4396-aa25-69add7c3142b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:41.920015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:41.930807 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] 10.222.0.70 "DELETE /v2.0/networks/f5e04962-eb4f-4396-aa25-69add7c3142b HTTP/1.1" status: 204 len: 168 time: 0.9060223 Nov 24 14:30:41.933859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49798) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:42.309557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Deleting port 3f021257-d1a4-4a32-8030-3c1f8d2cf1ce {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:42.310139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:42.379616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8fd0813d-699f-4389-ac1c-bf31c4287817 None None] The port '3f021257-d1a4-4a32-8030-3c1f8d2cf1ce' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:30:42.436924 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:43.029281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Deleting port 30cbe484-4a1d-49d2-bdd0-7ff090143a91 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:43.030014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:43.201257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] For port 30cbe484-4a1d-49d2-bdd0-7ff090143a91, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30cbe484-4a1d-49d2-bdd0-7ff090143a91,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:43.201608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:43.331077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Calling delete_port for 30cbe484-4a1d-49d2-bdd0-7ff090143a91 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:43.504089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:43.507654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dec812bd-36bb-4dab-b3d3-3e71deba51a2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:43.548954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Pushing event deleted for resources: {'Port': ['ID=30cbe484-4a1d-49d2-bdd0-7ff090143a91,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:43.551624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:43.864214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:44.530199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:30:44.728592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:30:44.736980 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] Sync routers for ids ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:30:44.738092 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] 10.222.0.70 "PUT /v2.0/routers/6c8663f7-95cc-45dd-af4f-b6f55dcfb64a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8030193 Nov 24 14:30:44.740383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49802) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:44.749822 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] Routers {'6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:44.750419 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:44.926642 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] Set router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:44.936373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:45.133399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:45.143287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Deleting port 06268286-8864-4a19-a687-f4567ffce48c {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:45.143617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:45.238983 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252'}], 'enable_snat': True}, 'gw_port_id': '06268286-8864-4a19-a687-f4567ffce48c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:30:43Z', 'revision_number': 5, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port': {'id': '06268286-8864-4a19-a687-f4567ffce48c', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:94:c8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:23:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:45.242779 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] Checking router: 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:30:45.253727 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] Routers {'6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:30:45.254317 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:30:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:45.328147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] For port 06268286-8864-4a19-a687-f4567ffce48c, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=06268286-8864-4a19-a687-f4567ffce48c,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:45.328496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:45.409083 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] Set router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:30:45.516185 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:30:45Z', 'revision_number': 6, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:45.520243 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f42fba12-c900-42a9-9c75-83341af4441a None None] The sync data for ids ['6c8663f7-95cc-45dd-af4f-b6f55dcfb64a'] in dv-neutron-818151-2-hyperv is: [{'id': '6c8663f7-95cc-45dd-af4f-b6f55dcfb64a', 'name': 'tempest-TestVolumeBootPattern-717437595-router', 'tenant_id': 'f8c98204728f42a9a3f20285ef92099f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:23:22Z', 'updated_at': '2021-11-24T14:30:45Z', 'revision_number': 6, 'project_id': 'f8c98204728f42a9a3f20285ef92099f', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:30:45.568200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Calling delete_port for 06268286-8864-4a19-a687-f4567ffce48c owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:45.737818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:45.741320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:45.781145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Pushing event deleted for resources: {'Port': ['ID=06268286-8864-4a19-a687-f4567ffce48c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:45.783507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:46.003618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.258413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.263397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.308820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.309317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 6c8663f7-95cc-45dd-af4f-b6f55dcfb64a {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:30:46.322504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.323592 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] 10.222.0.70 "DELETE /v2.0/routers/6c8663f7-95cc-45dd-af4f-b6f55dcfb64a HTTP/1.1" status: 204 len: 168 time: 1.5822110 Nov 24 14:30:46.326209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49806) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:46.388720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Deleting subnet 2bec22e6-af44-48de-a291-105f8a8a45e2 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:30:46.391724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.442912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.529160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.598112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.602358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2c09e548-d007-47ba-9064-64e71952b725 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:46.636319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2bec22e6-af44-48de-a291-105f8a8a45e2,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:46.638837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:46.641498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.649643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8bbf4ca1-fe82-477f-aaff-2a40c6e9f7bc None None] Network 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:30:46.650647 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fe3bcf3e-d874-471c-bde3-87cae099547b admin admin] 10.222.0.70 "DELETE /v2.0/subnets/2bec22e6-af44-48de-a291-105f8a8a45e2 HTTP/1.1" status: 204 len: 168 time: 0.3202605 Nov 24 14:30:46.650647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49810) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:46.767412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.778128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Deleting port 76ce773c-855f-49ee-86d8-e17ca7629858 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:46.778457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:46.901234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-921f48db-caca-457f-aacc-51226c945045 None None] DHCP port deletion for 9e520458-3d0a-44fe-8213-a30cdc4c6bc1 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:30:46.905569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-921f48db-caca-457f-aacc-51226c945045 None None] Deleting port 76ce773c-855f-49ee-86d8-e17ca7629858 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:46.906045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-921f48db-caca-457f-aacc-51226c945045 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.096826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] For port 76ce773c-855f-49ee-86d8-e17ca7629858, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=76ce773c-855f-49ee-86d8-e17ca7629858,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:47.097101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.125787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-921f48db-caca-457f-aacc-51226c945045 None None] For port 76ce773c-855f-49ee-86d8-e17ca7629858, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=76ce773c-855f-49ee-86d8-e17ca7629858,segment=NetworkSegment(cc7b312a-96d9-4d1c-a21c-7c99e6819124),segment_id=cc7b312a-96d9-4d1c-a21c-7c99e6819124)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:30:47.126176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-921f48db-caca-457f-aacc-51226c945045 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.218047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Calling delete_port for 76ce773c-855f-49ee-86d8-e17ca7629858 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:47.289444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-921f48db-caca-457f-aacc-51226c945045 None None] Calling delete_port for 76ce773c-855f-49ee-86d8-e17ca7629858 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:30:47.305388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.309653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-130e5be8-e224-4ed5-85e7-8b34f7c40bcc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:47.353417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Pushing event deleted for resources: {'Port': ['ID=76ce773c-855f-49ee-86d8-e17ca7629858,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:47.356403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:47.359956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 76ce773c-855f-49ee-86d8-e17ca7629858 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:47.362087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] No DVR routers for this DVR port 76ce773c-855f-49ee-86d8-e17ca7629858 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:30:47.394232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 76ce773c-855f-49ee-86d8-e17ca7629858 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:47.394589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 76ce773c-855f-49ee-86d8-e17ca7629858 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:47.395010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 06268286-8864-4a19-a687-f4567ffce48c no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:47.427284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-921f48db-caca-457f-aacc-51226c945045 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:30:47.427645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-921f48db-caca-457f-aacc-51226c945045 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:30:47.428251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 06268286-8864-4a19-a687-f4567ffce48c {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:47.428596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 06268286-8864-4a19-a687-f4567ffce48c not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:47.429010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30cbe484-4a1d-49d2-bdd0-7ff090143a91 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:30:47.463950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 30cbe484-4a1d-49d2-bdd0-7ff090143a91 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:30:47.464307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30cbe484-4a1d-49d2-bdd0-7ff090143a91 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:30:47.479608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.505979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e520458-3d0a-44fe-8213-a30cdc4c6bc1']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:47.518111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cc7b312a-96d9-4d1c-a21c-7c99e6819124') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:47.518397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cc7b312a-96d9-4d1c-a21c-7c99e6819124') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:30:47.529489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.545368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.551671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Releasing vlan 880 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:30:47.552073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:30:47.565893 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:30:47.642168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.645699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fdcf54aa-f02c-457a-b5a8-4c98a88731c2 tempest-NetworksIpV6Test-1087216916 tempest-NetworksIpV6Test-1087216916-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:47.659410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.670540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Pushing event deleted for resources: {'Network': ['ID=9e520458-3d0a-44fe-8213-a30cdc4c6bc1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:47.673230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:47.675920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] 10.222.0.70 "DELETE /v2.0/networks/9e520458-3d0a-44fe-8213-a30cdc4c6bc1 HTTP/1.1" status: 204 len: 168 time: 1.0229194 Nov 24 14:30:47.811647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49818) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:47.863750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-519b4241-988c-4434-bc3d-dd953690faa7 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=d44584538fcc4f2284b467ff03a0cb46&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0508268 Nov 24 14:30:47.866106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49822) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:47.929017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-921f48db-caca-457f-aacc-51226c945045 None None] Deleting port 76ce773c-855f-49ee-86d8-e17ca7629858 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:30:47.929550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-921f48db-caca-457f-aacc-51226c945045 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.930235 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.959416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:47.998026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-921f48db-caca-457f-aacc-51226c945045 None None] The port '76ce773c-855f-49ee-86d8-e17ca7629858' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:30:48.019588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.025586 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.029712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-805b18e7-96bf-4b79-b574-0a4da24843d9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:48.044886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=693b946e-dea4-4fc7-a982-4053a3bbb228,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:48.047898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:48.054417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.055592 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/693b946e-dea4-4fc7-a982-4053a3bbb228 HTTP/1.1" status: 204 len: 168 time: 0.1885939 Nov 24 14:30:48.464852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49830) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:48.526666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8045702c-a9ce-4543-b241-72293b4c30db admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=f8c98204728f42a9a3f20285ef92099f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0603387 Nov 24 14:30:48.529080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49834) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:30:48.592238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.623245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.677206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.681225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eff0f932-2de9-4d4f-a63e-e31bf7594ba8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:48.693222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d51cc03-a8ef-4666-ba1b-1e54d8314ffb,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:48.696916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:48.700539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:48.701650 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/7d51cc03-a8ef-4666-ba1b-1e54d8314ffb HTTP/1.1" status: 204 len: 168 time: 0.1716623 Nov 24 14:30:56.330222 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-0844661c-9367-4a53-a6bc-218437d668ab tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/networks?tenant_id=392e283cea27438494a285d5d14a8227&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0281138 Nov 24 14:30:56.486785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4510ecb1-b51b-443c-85df-f4334710c46e req-5fd6e8ec-17a9-4140-a765-3f0052d77de0 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:56.488218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-5fd6e8ec-17a9-4140-a765-3f0052d77de0 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1528950 Nov 24 14:30:56.504646 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cd06dfe4-0302-447d-8522-0dc8dc5ea2b2 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/quotas/392e283cea27438494a285d5d14a8227 HTTP/1.1" status: 200 len: 375 time: 0.0111313 Nov 24 14:30:56.552766 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-68258737-7d79-427d-b409-31e6c640e118 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=392e283cea27438494a285d5d14a8227&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0419629 Nov 24 14:30:56.740486 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-449e3855-ce43-45ab-aaf1-f4006c044088 req-63e15f13-04a4-4396-a778-ed4f2fc18e6d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 210 time: 0.0421600 Nov 24 14:30:57.648080 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-ab4ea158-6e4e-4350-b854-310d0bb3c6b9 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.47 "GET /v2.0/networks?tenant_id=392e283cea27438494a285d5d14a8227&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0378857 Nov 24 14:30:57.802230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cb649708-bb26-4b1a-80f1-7205d6b43309 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:57.803833 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cb649708-bb26-4b1a-80f1-7205d6b43309 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.47 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1507027 Nov 24 14:30:57.822358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Request body: {'port': {'device_id': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60', 'admin_state_up': True, 'tenant_id': '392e283cea27438494a285d5d14a8227'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:30:57.967098 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-486ed728-02e4-4a25-b276-e5124d35c769 req-57cb2ad0-7ddb-4155-bf8d-e01fa0b26c38 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 210 time: 0.0573816 Nov 24 14:30:58.020468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:30:58.025103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Usage tracker for resource:port and tenant:392e283cea27438494a285d5d14a8227 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:30:58.028079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:30:58.034099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:30:58.044277 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Made reservation on behalf of 392e283cea27438494a285d5d14a8227 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:30:58.047342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.060437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.094880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:30:58.098815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Usage tracker for resource:security_group_rule and tenant:392e283cea27438494a285d5d14a8227 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:30:58.101714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:30:58.108633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:30:58.180013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.184129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.187053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2f535f3e-561e-40ec-9049-f9aa62ce78ab tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:58.269340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5dec5279-ca40-40b7-9272-9cdd75914b89,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:58.274911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:58.380416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Allocated IP 192.168.233.100 (5376da5b-ee69-4423-bedc-0b4dfeca8d60/89be5eef-9612-449d-a8e3-9b7b44d0fbad/5a6a59a6-ba41-4ee9-8bdc-2a29594afe51) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:30:58.579380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.594690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Transition to ACTIVE for port object 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:30:58.615947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.622975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d115199-f215-4854-a686-cfbc5fc7a40e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:58.686273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:30:58.693551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:30:58.696125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:30:58.733395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Pushing event updated for resources: {'Port': ['ID=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:58.737933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:58.765921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:58.766558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.793258 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.9755197 Nov 24 14:30:58.804821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Request body: {'port': {'device_id': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:30:58.882131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-61963c29-8f8f-4594-9bf6-a06b5300dded None None] Provisioning for port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:30:58.887955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-61963c29-8f8f-4594-9bf6-a06b5300dded None None] Provisioning complete for port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:30:58.888498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-61963c29-8f8f-4594-9bf6-a06b5300dded None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.916977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:58.945201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-61963c29-8f8f-4594-9bf6-a06b5300dded None None] Port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:30:59.174118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d006171-442f-45c1-b4ef-47ca3b88a2fa req-89d1fd3c-d6d2-46e8-a8d0-f766889a6be7 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:30:59.175640 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9d006171-442f-45c1-b4ef-47ca3b88a2fa req-89d1fd3c-d6d2-46e8-a8d0-f766889a6be7 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 936 time: 0.0846496 Nov 24 14:30:59.225457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9d006171-442f-45c1-b4ef-47ca3b88a2fa req-34c78113-a6f8-463a-96a2-b7da64dd4d56 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437331 Nov 24 14:30:59.376352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:30:59.383081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:59.398061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Transition to ACTIVE for port object 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:30:59.402239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:59.406710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1a637077-4e7f-4a95-9e35-0e1ad60ace1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:59.537465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Pushing event updated for resources: {'Port': ['ID=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:59.542218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:59.645532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Attempting to bind port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:30:59.645871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Attempting to bind port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:30:59.646231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Attempting to bind port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 on network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:30:59.652710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 on network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:30:59.653028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Attempting to bind port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 on network 5376da5b-ee69-4423-bedc-0b4dfeca8d60 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:30:59.660611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 30, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:30:59.661003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Checking segment: {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:30:59.661447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Bound using segment: {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:30:59.661875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Bound port: 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '080cd143-a8a4-4852-90bb-c37b18b67653', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:30:59.662219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:59.755467 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] For port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:30:59.758279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] For port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:30:59.763793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:59.768549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8fd4d0ab-091b-4c13-a8fe-8315804485eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:30:59.822932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:30:59.823624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] 10.222.0.47 "PUT /v2.0/ports/5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 HTTP/1.1" status: 200 len: 1098 time: 1.0230355 Nov 24 14:30:59.824164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'tag': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:30:59.851832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Pushing event updated for resources: {'Port': ['ID=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:30:59.856343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:30:59.900396 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'tag': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51', 'status': 'completed', 'code': 200} Nov 24 14:30:59.944533 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-01728f7e-ceb5-4b3d-8858-b947f026b55e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=392e283cea27438494a285d5d14a8227&device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 1101 time: 0.0822620 Nov 24 14:31:00.014839 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-3a965f48-d049-4958-9b2b-834f71b98848 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.100&port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 HTTP/1.1" status: 200 len: 217 time: 0.0629768 Nov 24 14:31:00.080162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4510ecb1-b51b-443c-85df-f4334710c46e req-b069133f-c5c6-4604-bcbc-88d595587325 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:00.081581 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-b069133f-c5c6-4604-bcbc-88d595587325 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=89be5eef-9612-449d-a8e3-9b7b44d0fbad HTTP/1.1" status: 200 len: 843 time: 0.0611343 Nov 24 14:31:00.160483 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-70a07a17-a41e-4444-99ab-f95fcee74c7c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5376da5b-ee69-4423-bedc-0b4dfeca8d60&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1180 time: 0.0717826 Nov 24 14:31:00.303560 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-9b57a1e9-85e9-47c5-80cc-8f9eb5439d1c service neutron] 10.222.0.47 "GET /v2.0/networks/5376da5b-ee69-4423-bedc-0b4dfeca8d60?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361701 Nov 24 14:31:00.428553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7ff71e-5831-4d90-a4b1-93c311fdf3bd req-c8e6f9bc-3cbc-4e2e-89d3-10fe386880b2 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:00.429985 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7c7ff71e-5831-4d90-a4b1-93c311fdf3bd req-c8e6f9bc-3cbc-4e2e-89d3-10fe386880b2 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 948 time: 0.0761013 Nov 24 14:31:00.449082 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4510ecb1-b51b-443c-85df-f4334710c46e req-b32b5fcc-e32f-4065-9405-92306f3e4221 service neutron] 10.222.0.47 "GET /v2.0/networks/5376da5b-ee69-4423-bedc-0b4dfeca8d60?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1393597 Nov 24 14:31:00.477963 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7c7ff71e-5831-4d90-a4b1-93c311fdf3bd req-ee6d4fc7-9260-475c-9819-65f0443d42d2 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409303 Nov 24 14:31:00.568219 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-570793ca-c1b0-4fe8-a851-8f5242251db0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=392e283cea27438494a285d5d14a8227&device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 1101 time: 0.0730271 Nov 24 14:31:00.701384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88795857-a885-4df8-9564-239e504d957e req-7ab2d9ec-e6c0-4ea7-8157-c18eadc5a5b1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:00.702850 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-7ab2d9ec-e6c0-4ea7-8157-c18eadc5a5b1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=5376da5b-ee69-4423-bedc-0b4dfeca8d60 HTTP/1.1" status: 200 len: 870 time: 0.1282215 Nov 24 14:31:00.768735 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-589b1c0d-a97d-469a-bbc6-1cb4691a5ad2 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.100&port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 HTTP/1.1" status: 200 len: 217 time: 0.0598752 Nov 24 14:31:00.833438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88795857-a885-4df8-9564-239e504d957e req-15cf85ef-528f-4e04-865c-7307f6cf7f00 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:00.834744 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-15cf85ef-528f-4e04-865c-7307f6cf7f00 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=89be5eef-9612-449d-a8e3-9b7b44d0fbad HTTP/1.1" status: 200 len: 843 time: 0.0600646 Nov 24 14:31:00.908163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-57fb7203-3fa6-41d9-aee2-c0b59ef7d351 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5376da5b-ee69-4423-bedc-0b4dfeca8d60&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1180 time: 0.0669897 Nov 24 14:31:01.159589 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-52802a3d-902a-4d72-b5c4-7d3834f762aa service neutron] 10.222.0.47 "GET /v2.0/networks/5376da5b-ee69-4423-bedc-0b4dfeca8d60?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2441621 Nov 24 14:31:01.303281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-88795857-a885-4df8-9564-239e504d957e req-dd12cb3f-a06e-473a-aefe-0c4c7c4089ed service neutron] 10.222.0.47 "GET /v2.0/networks/5376da5b-ee69-4423-bedc-0b4dfeca8d60?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1360188 Nov 24 14:31:01.685617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-9fb3b26e-7e68-4611-a0e8-30c9d840aba9 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:01.686304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-9fb3b26e-7e68-4611-a0e8-30c9d840aba9 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Synchronizing usage tracker for tenant:392e283cea27438494a285d5d14a8227 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:31:01.702811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-9fb3b26e-7e68-4611-a0e8-30c9d840aba9 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Unset dirty status for tenant:392e283cea27438494a285d5d14a8227 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:31:01.703934 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-9fb3b26e-7e68-4611-a0e8-30c9d840aba9 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 948 time: 0.1009207 Nov 24 14:31:01.748611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-69cc2ecb-0973-473e-b8ec-d97221d20fb4 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Synchronizing usage tracker for tenant:392e283cea27438494a285d5d14a8227 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:31:01.770651 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-69cc2ecb-0973-473e-b8ec-d97221d20fb4 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Unset dirty status for tenant:392e283cea27438494a285d5d14a8227 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:31:01.771706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6a2290df-c487-4a5c-a50b-3053a44da268 req-69cc2ecb-0973-473e-b8ec-d97221d20fb4 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623596 Nov 24 14:31:02.976301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c57153-7e9a-403e-87b4-d6bead6d88e5 req-bc105395-892e-4247-bd43-616c794ae364 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:02.977728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1c57153-7e9a-403e-87b4-d6bead6d88e5 req-bc105395-892e-4247-bd43-616c794ae364 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 948 time: 0.0796192 Nov 24 14:31:03.024431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1c57153-7e9a-403e-87b4-d6bead6d88e5 req-7c27dd38-9584-4ada-8402-ea19caec25e6 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403266 Nov 24 14:31:03.269495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2bc72540-7c2a-4a23-83a5-c0615f0e5f66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:03.663866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:04.158429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:31:04.223960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-483c42e1-3da0-44e6-b359-a78f1a838f8a req-9146e779-8f8c-4c34-8272-984c5fa1625a tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:04.225535 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-483c42e1-3da0-44e6-b359-a78f1a838f8a req-9146e779-8f8c-4c34-8272-984c5fa1625a tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 948 time: 0.0800979 Nov 24 14:31:04.276217 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-483c42e1-3da0-44e6-b359-a78f1a838f8a req-fb5017e5-f4d8-4954-b3f5-e1da5b7ebb40 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450814 Nov 24 14:31:04.307408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:04.321267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51', 'network_id': '5376da5b-ee69-4423-bedc-0b4dfeca8d60', 'port_id': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51', 'mac_address': 'fa:16:3e:18:fe:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '89be5eef-9612-449d-a8e3-9b7b44d0fbad', 'ip_address': '192.168.233.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:31:04.374810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:04.391825 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:31:04.406925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:04.410844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:04.413695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ffb068b1-6638-4b8b-9c55-94fe143684db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:04.478306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:04.487435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.487916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.488248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.488576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.488901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.489248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.489567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.489884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.490199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.490529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.490848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:04.495156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:04.785255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['5a6a59a6-ba41-4ee9-8bdc-2a29594afe51'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:31:05.483120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e7076d8-793b-4a63-b6c3-9f46b79c06c6 req-d9caaa28-ce94-4675-a3e5-bab0caace178 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:05.484594 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4e7076d8-793b-4a63-b6c3-9f46b79c06c6 req-d9caaa28-ce94-4675-a3e5-bab0caace178 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 949 time: 0.0790062 Nov 24 14:31:05.530963 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4e7076d8-793b-4a63-b6c3-9f46b79c06c6 req-1261a14c-ecf2-4eb6-9061-94a33a33b26c tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409262 Nov 24 14:31:05.822398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8175c2c0-e1ef-4d50-afa3-46014e39e353 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:06.167903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:31:06.237740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:31:06.243075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:31:06.243476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:06.371994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:06.399446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:31:06.409575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:06.414276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:06.416082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:06.457542 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51', 'code': 200} Nov 24 14:31:06.484627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:06.487501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:06.735064 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9bca2634-2087-4004-ae84-fbecd67a2a7a req-7fa8d504-795b-4777-a598-300bfbe210db service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 1103 time: 0.0953825 Nov 24 14:31:06.753597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51b5ac5a-d14a-4662-b9ec-9d53b3232bb1 req-4f0d7d91-9293-4bec-8244-b705819b2854 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:06.756187 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-51b5ac5a-d14a-4662-b9ec-9d53b3232bb1 req-4f0d7d91-9293-4bec-8244-b705819b2854 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 950 time: 0.0969560 Nov 24 14:31:06.786872 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9bca2634-2087-4004-ae84-fbecd67a2a7a req-0426ed1a-1e8b-4325-bab2-8f9c5c44d98c service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459006 Nov 24 14:31:06.810679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-51b5ac5a-d14a-4662-b9ec-9d53b3232bb1 req-a686096e-1c8a-47ef-a220-3ed83b120b4d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463004 Nov 24 14:31:06.848530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:08.014472 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d78f9d7-6259-4213-bed3-b60d958e61cc req-d11bb353-6d88-4c74-99a9-39ad1d9192da tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:08.016041 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6d78f9d7-6259-4213-bed3-b60d958e61cc req-d11bb353-6d88-4c74-99a9-39ad1d9192da tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 950 time: 0.0828502 Nov 24 14:31:08.073813 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6d78f9d7-6259-4213-bed3-b60d958e61cc req-a2d655da-7176-49d5-ab86-659b79fc3744 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508392 Nov 24 14:31:08.531626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:08.819222 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:31:09.282421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44f2fab6-fe48-4cd2-ae8f-8ab017328519 req-8583c6e4-d7e5-4ab4-bb78-44b89b26777f tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:09.283906 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-44f2fab6-fe48-4cd2-ae8f-8ab017328519 req-8583c6e4-d7e5-4ab4-bb78-44b89b26777f tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 950 time: 0.0783095 Nov 24 14:31:09.433832 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-44f2fab6-fe48-4cd2-ae8f-8ab017328519 req-4c76dafb-b052-42d4-810f-c878358f7456 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444371 Nov 24 14:31:09.881854 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9315bdb1-9dca-4837-897a-0ddfc6a4e273 req-d48da200-b585-42fd-9c1d-150a5b0e9240 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0689142 Nov 24 14:31:10.518594 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-227f8d67-7b3e-44e6-9571-3fc5ee18398e req-aa1a7935-f4ed-44e8-bb27-7b6c2ddd3924 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.2090290 Nov 24 14:31:11.060029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c41c9be-b46c-425e-8e07-6cfe6c528c22 req-1c0ed1a5-83f5-4bce-9b45-175a53d69329 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:11.061459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7c41c9be-b46c-425e-8e07-6cfe6c528c22 req-1c0ed1a5-83f5-4bce-9b45-175a53d69329 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 950 time: 0.0834701 Nov 24 14:31:11.108226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7c41c9be-b46c-425e-8e07-6cfe6c528c22 req-47dbd002-767b-413a-a86f-bfd93e9389ff tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402572 Nov 24 14:31:12.324361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-515beaef-30bd-4352-ab74-0b10b10e5cd4 req-ea6536c1-c4aa-4638-baa1-c65a03a8dc62 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:12.325773 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-515beaef-30bd-4352-ab74-0b10b10e5cd4 req-ea6536c1-c4aa-4638-baa1-c65a03a8dc62 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 950 time: 0.0855882 Nov 24 14:31:12.378070 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-515beaef-30bd-4352-ab74-0b10b10e5cd4 req-652bec7a-71bd-485e-a8d7-32a23eaf8fa6 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/security-groups?id=5dec5279-ca40-40b7-9272-9cdd75914b89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458202 Nov 24 14:31:12.460116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-51fb377a-3d2d-4cdb-8a34-47f51e7d0b42 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:12.461748 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-51fb377a-3d2d-4cdb-8a34-47f51e7d0b42 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.47 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 950 time: 0.0803773 Nov 24 14:31:12.531154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Deleting port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:31:12.531487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:12.774858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] For port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,segment=NetworkSegment(080cd143-a8a4-4852-90bb-c37b18b67653),segment_id=080cd143-a8a4-4852-90bb-c37b18b67653)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:12.775126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:12.901617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Calling delete_port for 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:31:13.048293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:13.054585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4af54bde-661d-4cb2-940b-3ddd1f6c19a1 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:13.060407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['5a6a59a6-ba41-4ee9-8bdc-2a29594afe51'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:31:13.104315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Pushing event deleted for resources: {'Port': ['ID=5a6a59a6-ba41-4ee9-8bdc-2a29594afe51,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:13.108927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:13.181064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] No DVR routers for this DVR port 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:31:13.183680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:13.186678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'name': 'network-vif-deleted', 'tag': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:31:13.205645 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fd259d7f-3763-41cb-86dd-f4c407f3bf02 req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.47 "DELETE /v2.0/ports/5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 HTTP/1.1" status: 204 len: 173 time: 0.7386198 Nov 24 14:31:13.254552 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1da091e-8485-46d2-b1b5-46117cce7da0', 'name': 'network-vif-deleted', 'tag': '5a6a59a6-ba41-4ee9-8bdc-2a29594afe51', 'status': 'completed', 'code': 200} Nov 24 14:31:13.556460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-aae24b82-8200-442d-a661-a87064c8157c req-8d8c5fa2-a343-47f3-bba2-06d5436852dd tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Synchronizing usage tracker for tenant:392e283cea27438494a285d5d14a8227 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:31:13.572985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-aae24b82-8200-442d-a661-a87064c8157c req-8d8c5fa2-a343-47f3-bba2-06d5436852dd tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Unset dirty status for tenant:392e283cea27438494a285d5d14a8227 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:31:13.574129 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aae24b82-8200-442d-a661-a87064c8157c req-8d8c5fa2-a343-47f3-bba2-06d5436852dd tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] 10.222.0.70 "GET /v2.0/ports?device_id=f1da091e-8485-46d2-b1b5-46117cce7da0 HTTP/1.1" status: 200 len: 210 time: 0.0597796 Nov 24 14:31:15.033902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 49966) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:15.234140 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a7511c10-6322-4619-a8fb-3f0ceaaaada9 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=392e283cea27438494a285d5d14a8227&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1982467 Nov 24 14:31:15.236386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49972) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:15.298556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.325797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.378210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.382090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-221e70ee-f7d6-41b8-a6f7-198d9e286eda tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:15.394983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5dec5279-ca40-40b7-9272-9cdd75914b89,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:15.397946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:15.409309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.410409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/5dec5279-ca40-40b7-9272-9cdd75914b89 HTTP/1.1" status: 204 len: 168 time: 0.1730626 Nov 24 14:31:15.748642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49980) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:15.767822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.802176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:31:15.806775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Usage tracker for resource:security_group_rule and tenant:21dcaf4cf5c442688c2b5f6778e88634 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:31:15.809821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:31:15.816347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:31:15.902171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.907646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:15.914333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-884beb79-5b1b-482d-8ff1-5be20eaf5150 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:15.955255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d5ec45a-6c81-42ff-855c-58bced62fb53,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:15.959513 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=21dcaf4cf5c442688c2b5f6778e88634&name=default HTTP/1.1" status: 200 len: 2647 time: 0.2095308 Nov 24 14:31:15.960258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:15.962006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 49984) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:16.030748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:16.058764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:16.116061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:16.119689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6dcd11dd-3725-4edb-8683-2dde8ee45d03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:16.130689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d5ec45a-6c81-42ff-855c-58bced62fb53,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:16.134472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:16.137660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:16.138758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-25953c23-585f-4d9f-a3f7-4f69648a31d8 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/8d5ec45a-6c81-42ff-855c-58bced62fb53 HTTP/1.1" status: 204 len: 168 time: 0.1758575 Nov 24 14:31:16.219150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:31:16.255306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:31:16.255860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 5a6a59a6-ba41-4ee9-8bdc-2a29594afe51 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:31:17.022047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50006) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:17.157702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1149425275-network', 'tenant_id': '475e3e3519f64990818fdc6e57f69b81'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:31:17.162530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:31:17.166461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Usage tracker for resource:network and tenant:475e3e3519f64990818fdc6e57f69b81 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:31:17.171041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:31:17.176971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:31:17.186747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Made reservation on behalf of 475e3e3519f64990818fdc6e57f69b81 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:31:17.189144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.201336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.237949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:31:17.241716 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Usage tracker for resource:security_group_rule and tenant:475e3e3519f64990818fdc6e57f69b81 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:31:17.244474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:31:17.250854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:31:17.324731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.329419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.332971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-76799cfd-ec16-47c6-85ba-978c2a596ad4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:17.362125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:31:17.370308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74d33e70-e503-4d63-856c-6e4e172539d9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:17.373858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:17.376660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.376996 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Added segment b35241b1-d37a-4e58-b4dc-16dda165f9bf of type vlan for network a22ab38e-49c3-4dbb-8137-630509cae0d6 Nov 24 14:31:17.407973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.437432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.438367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:17.438932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.442248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bef71061-b48f-4715-b7d5-fb46a7b4830c tempest-RoutersNegativeIpV6Test-320547775 tempest-RoutersNegativeIpV6Test-320547775-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:17.543687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Pushing event updated for resources: {'Network': ['ID=a22ab38e-49c3-4dbb-8137-630509cae0d6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:17.548291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5251424 Nov 24 14:31:17.549404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:17.549941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50012) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:17.555346 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Request body: {'subnet': {'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1149425275-subnet', 'tenant_id': '475e3e3519f64990818fdc6e57f69b81', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:31:17.556056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network a22ab38e-49c3-4dbb-8137-630509cae0d6 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:31:17.560478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:31:17.565239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Usage tracker for resource:subnet and tenant:475e3e3519f64990818fdc6e57f69b81 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:31:17.568138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:31:17.573862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:31:17.584894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Made reservation on behalf of 475e3e3519f64990818fdc6e57f69b81 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:31:17.587418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.914772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:17.918560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1b1dfcb1-96fe-4434-b494-e5a815b55750 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:17.995080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5cc73d98-a15c-4f51-aad9-51ff514a3960,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:17.999922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:18.005639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Checking segment: {'id': 'b35241b1-d37a-4e58-b4dc-16dda165f9bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:31:18.006062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Network hostable DHCP agents. Network: a22ab38e-49c3-4dbb-8137-630509cae0d6, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:31:18.015729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:18.034557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Network a22ab38e-49c3-4dbb-8137-630509cae0d6 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:31:18.044960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, a22ab38e-49c3-4dbb-8137-630509cae0d6) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:31:18.050454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:18.051494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:18.055282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-723a5135-226e-42db-b05a-59a05cc58dcf None None] Network a22ab38e-49c3-4dbb-8137-630509cae0d6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:31:18.077676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-90421f20-2434-4d8b-946b-2411094e3836 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.5256114 Nov 24 14:31:18.307086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adc1bdbc-a2be-459c-bad3-e995f4b40e35 None None] Network a22ab38e-49c3-4dbb-8137-630509cae0d6 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:31:18.641529 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d489041-61ad-4223-9716-07add8d5ce3c req-c20f94a6-2045-40c6-9689-a2286af93836 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:18.642198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-8d489041-61ad-4223-9716-07add8d5ce3c req-c20f94a6-2045-40c6-9689-a2286af93836 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Synchronizing usage tracker for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:31:18.662388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-8d489041-61ad-4223-9716-07add8d5ce3c req-c20f94a6-2045-40c6-9689-a2286af93836 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Unset dirty status for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:31:18.664001 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-c20f94a6-2045-40c6-9689-a2286af93836 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 812 time: 0.1688643 Nov 24 14:31:18.682170 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-00b7d6ff-41f2-4191-bc76-1a3c6ac68867 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/quotas/475e3e3519f64990818fdc6e57f69b81 HTTP/1.1" status: 200 len: 375 time: 0.0128889 Nov 24 14:31:18.742449 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-05bf8d35-923a-4d2a-8499-c6423320a7ef tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0534146 Nov 24 14:31:18.885129 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-aa4e67e4-6055-4ce7-81e3-d048f50c0c8f service neutron] 10.222.0.70 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1348968 Nov 24 14:31:19.019330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-bd981ce8-2a42-4d25-a7b5-66b729853da8 service neutron] 10.222.0.70 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284156 Nov 24 14:31:19.216230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1674b604-d769-43ec-b2eb-a6958ae3efcc req-f3225390-b43b-4e33-a38b-f45d688de048 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 210 time: 0.0455744 Nov 24 14:31:20.253016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d489041-61ad-4223-9716-07add8d5ce3c req-7cdfdb17-c2ad-4859-8dd5-5e040fa4f758 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:20.254458 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-7cdfdb17-c2ad-4859-8dd5-5e040fa4f758 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.47 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 812 time: 0.1640778 Nov 24 14:31:20.273655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Request body: {'port': {'device_id': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6', 'admin_state_up': True, 'tenant_id': '475e3e3519f64990818fdc6e57f69b81'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:31:20.416934 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-653431c6-9e0f-411e-985b-4c22ac50eb38 req-08f732ba-2b15-45cc-bb6a-b96194919d35 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 210 time: 0.0524673 Nov 24 14:31:20.469478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:31:20.473354 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Usage tracker for resource:port and tenant:475e3e3519f64990818fdc6e57f69b81 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:31:20.476142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:31:20.484372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:31:20.495095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Made reservation on behalf of 475e3e3519f64990818fdc6e57f69b81 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:31:20.498339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:20.665356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Allocated IP 172.20.0.3 (a22ab38e-49c3-4dbb-8137-630509cae0d6/5cc73d98-a15c-4f51-aad9-51ff514a3960/a24c1cf1-a8cb-4c0e-9652-f921586570cd) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:31:20.890364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:20.917668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:20.924231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:20.983995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Network a22ab38e-49c3-4dbb-8137-630509cae0d6 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:31:20.991278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:31:20.995487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:31:21.025065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:21.043723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.044179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.044548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.044909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.045911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.046400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.046762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.047123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.047477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.047855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.048211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:31:21.057214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:21.072297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:21.072887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:21.095367 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8267429 Nov 24 14:31:21.106942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Request body: {'port': {'device_id': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:31:21.332763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:21.622554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15cadf51-0467-4a7b-b171-edf265217d12 req-0e05359b-4b05-4d34-9679-2d5d5c46edc2 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:21.624583 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-15cadf51-0467-4a7b-b171-edf265217d12 req-0e05359b-4b05-4d34-9679-2d5d5c46edc2 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 931 time: 0.0771656 Nov 24 14:31:21.674341 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-15cadf51-0467-4a7b-b171-edf265217d12 req-e8e1f4a1-1b4d-4f5e-8369-4318acad5eb1 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437386 Nov 24 14:31:21.688638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a24c1cf1-a8cb-4c0e-9652-f921586570cd {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:31:21.696105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:21.711933 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Transition to ACTIVE for port object a24c1cf1-a8cb-4c0e-9652-f921586570cd will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:31:21.715368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:21.720139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0f49fa5-0c54-4b26-92ec-a7f2af1ceb0c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:21.850290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:21.856221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:21.964806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Attempting to bind port a24c1cf1-a8cb-4c0e-9652-f921586570cd on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:31:21.965044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Attempting to bind port a24c1cf1-a8cb-4c0e-9652-f921586570cd by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'b35241b1-d37a-4e58-b4dc-16dda165f9bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:31:21.965364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Attempting to bind port a24c1cf1-a8cb-4c0e-9652-f921586570cd on network a22ab38e-49c3-4dbb-8137-630509cae0d6 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:31:21.972385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Port a24c1cf1-a8cb-4c0e-9652-f921586570cd on network a22ab38e-49c3-4dbb-8137-630509cae0d6 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:31:21.972697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Attempting to bind port a24c1cf1-a8cb-4c0e-9652-f921586570cd on network a22ab38e-49c3-4dbb-8137-630509cae0d6 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:31:21.978945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 31, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:31:21.979265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Checking segment: {'id': 'b35241b1-d37a-4e58-b4dc-16dda165f9bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:31:21.979644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Bound using segment: {'id': 'b35241b1-d37a-4e58-b4dc-16dda165f9bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:31:21.980077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Bound port: a24c1cf1-a8cb-4c0e-9652-f921586570cd, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b35241b1-d37a-4e58-b4dc-16dda165f9bf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:31:21.980420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:22.068656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:31:22.071723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:31:22.075532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:22.080219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-954ee91a-3718-4bd3-8eb6-0c728ede69aa tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:22.135368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:22.136778 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] 10.222.0.47 "PUT /v2.0/ports/a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 1093 time: 1.0338418 Nov 24 14:31:22.137420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:31:22.164660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:22.168490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:22.212307 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'status': 'completed', 'code': 200} Nov 24 14:31:22.254148 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-6e04b6b3-23ae-4b9f-9455-f1da62d13768 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1096 time: 0.0778039 Nov 24 14:31:22.329664 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-e946a770-c7e1-42a0-8898-1aae4325ae27 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 217 time: 0.0676210 Nov 24 14:31:22.392295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d489041-61ad-4223-9716-07add8d5ce3c req-939ca9fb-309c-43f7-8b00-34d2dec1718e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:22.393720 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-939ca9fb-309c-43f7-8b00-34d2dec1718e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 200 len: 852 time: 0.0580726 Nov 24 14:31:22.439918 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-f5f15b86-74f1-4de9-a150-98b5a5a6cd44 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a22ab38e-49c3-4dbb-8137-630509cae0d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0393877 Nov 24 14:31:22.574078 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-cf9170cf-f27d-4078-87b2-0a502c9ba011 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269155 Nov 24 14:31:22.705887 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d489041-61ad-4223-9716-07add8d5ce3c req-ea64e5b0-166c-4659-993e-dd601ad30bf1 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260896 Nov 24 14:31:22.824686 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-e8035dec-c3ff-4d77-b207-1113918f1411 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1096 time: 0.0740600 Nov 24 14:31:22.878199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a67a50c-c11f-427b-b7ac-f7b0c4b2062f req-947e51e0-4f0e-4715-8155-ccff6aa5375f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:22.879683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3a67a50c-c11f-427b-b7ac-f7b0c4b2062f req-947e51e0-4f0e-4715-8155-ccff6aa5375f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 943 time: 0.0833714 Nov 24 14:31:22.929016 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3a67a50c-c11f-427b-b7ac-f7b0c4b2062f req-e91265f6-a11f-4ae5-9475-3ecf65226350 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434518 Nov 24 14:31:23.068062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-b19bc31b-d2b9-4ae1-9fb5-b97974366f32 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:23.069472 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-b19bc31b-d2b9-4ae1-9fb5-b97974366f32 service neutron] 10.222.0.47 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 913 time: 0.2385659 Nov 24 14:31:23.139352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-83c76df9-1daf-488a-8b01-30381540b869 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 217 time: 0.0629351 Nov 24 14:31:23.203429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-ce5fe028-02c3-4afd-ac92-060283d8918d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:23.204884 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-ce5fe028-02c3-4afd-ac92-060283d8918d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 200 len: 852 time: 0.0597286 Nov 24 14:31:23.251149 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-5bf86217-055d-4961-9f91-97487fa8bfe5 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a22ab38e-49c3-4dbb-8137-630509cae0d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0387502 Nov 24 14:31:23.396709 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-9ce91a93-ec78-41db-b540-fe55c8b94fd6 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1372430 Nov 24 14:31:23.535429 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d8fc0ea4-1638-46ce-820f-70a27c210024 req-2c722d5d-b916-4a0e-8e94-0799de82dbc3 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1317198 Nov 24 14:31:24.133991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-324a65d2-9023-45d9-9483-72c64f6b64ef tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:24.134684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-324a65d2-9023-45d9-9483-72c64f6b64ef tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Synchronizing usage tracker for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:31:24.152920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-324a65d2-9023-45d9-9483-72c64f6b64ef tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Unset dirty status for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:31:24.154528 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-324a65d2-9023-45d9-9483-72c64f6b64ef tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 943 time: 0.1005602 Nov 24 14:31:24.200236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-18211c59-0516-416d-a67a-4d11312b3eaf tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Synchronizing usage tracker for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:31:24.220038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-18211c59-0516-416d-a67a-4d11312b3eaf tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Unset dirty status for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:31:24.221228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4e6c5e6d-7d3f-4f6c-affe-7185cdf902a3 req-18211c59-0516-416d-a67a-4d11312b3eaf tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612750 Nov 24 14:31:25.434325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d832c7b7-034a-4fab-aca9-78e2fbe049eb req-249a8a9b-3e21-49c6-968f-fa9988207274 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:25.436541 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d832c7b7-034a-4fab-aca9-78e2fbe049eb req-249a8a9b-3e21-49c6-968f-fa9988207274 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 943 time: 0.0770483 Nov 24 14:31:25.486132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d832c7b7-034a-4fab-aca9-78e2fbe049eb req-b7f2291a-f7c9-444f-9193-95be6eac4ff3 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441899 Nov 24 14:31:26.280991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:31:26.414758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:26.428345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6', 'port_id': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'mac_address': 'fa:16:3e:1b:3f:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cc73d98-a15c-4f51-aad9-51ff514a3960', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:31:26.487327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:26.506795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a24c1cf1-a8cb-4c0e-9652-f921586570cd {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:31:26.523823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:26.529230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:26.534788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4a5eca1e-5cae-497e-a462-1a4468896375 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:26.605013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:26.609386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:26.691070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973e15c6-d091-4c7e-a526-efcacd4847a7 req-3672a89c-1cad-4f87-85b4-4b730de77a7c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:26.692523 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-973e15c6-d091-4c7e-a526-efcacd4847a7 req-3672a89c-1cad-4f87-85b4-4b730de77a7c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 944 time: 0.0775156 Nov 24 14:31:26.738943 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-973e15c6-d091-4c7e-a526-efcacd4847a7 req-c318ed23-cd85-4b38-be2e-b504d75316de tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409942 Nov 24 14:31:26.840089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['a24c1cf1-a8cb-4c0e-9652-f921586570cd'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:31:27.948160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e7f782-ed00-4b9e-a7d4-314a8c48c0d3 req-1a9937c2-3f02-4528-8702-89206dfb929b tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:27.949620 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41e7f782-ed00-4b9e-a7d4-314a8c48c0d3 req-1a9937c2-3f02-4528-8702-89206dfb929b tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 944 time: 0.0776529 Nov 24 14:31:27.996640 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41e7f782-ed00-4b9e-a7d4-314a8c48c0d3 req-adf9e3fe-78e7-4ffb-9633-e43a08624091 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404437 Nov 24 14:31:28.314408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:31:28.384253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port a24c1cf1-a8cb-4c0e-9652-f921586570cd completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:31:28.388961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port a24c1cf1-a8cb-4c0e-9652-f921586570cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:31:28.389337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:28.505416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:28.534920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:31:28.546350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:31:28.551201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:28.554274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:31:28.600389 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'code': 200} Nov 24 14:31:28.626139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:31:28.629061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:31:28.826044 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13473b4-b26d-4fb7-81ea-030559baadad req-d0ac3174-92ea-4b21-b4d9-df8346ebda3d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1098 time: 0.0730927 Nov 24 14:31:28.870278 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f13473b4-b26d-4fb7-81ea-030559baadad req-74517096-7c74-4954-99e8-f11fb31152f3 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380323 Nov 24 14:31:29.202264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e67fc4-8ab4-4ddd-a0ff-c32fad222cfe req-14f38060-b055-4125-ba61-f774acd40c12 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:29.203733 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-60e67fc4-8ab4-4ddd-a0ff-c32fad222cfe req-14f38060-b055-4125-ba61-f774acd40c12 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0819805 Nov 24 14:31:29.254567 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-60e67fc4-8ab4-4ddd-a0ff-c32fad222cfe req-3b57639b-8fcf-469a-9238-497d90ef2ee0 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446653 Nov 24 14:31:30.471306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa01ae3-e48f-4685-8b74-601fb33eb8d9 req-41e15e2c-510f-44d4-b60a-3bd57fe30c88 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:30.472798 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4fa01ae3-e48f-4685-8b74-601fb33eb8d9 req-41e15e2c-510f-44d4-b60a-3bd57fe30c88 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0785644 Nov 24 14:31:30.525357 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4fa01ae3-e48f-4685-8b74-601fb33eb8d9 req-b7dfff03-af63-425b-b749-26747bdb9e70 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468833 Nov 24 14:31:30.738142 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8baefa2b-3ad3-41b3-935b-bd9cf1f4a338 req-6b18ff6a-3156-4fb8-bccf-33ee1eb32c2f service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0725508 Nov 24 14:31:31.016341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50070) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:31:31.067349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4460107-2b92-4e4e-81f5-8838768605ca req-4daac335-0303-4be4-a81c-5fbe94607f8f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:31.068860 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c4460107-2b92-4e4e-81f5-8838768605ca req-4daac335-0303-4be4-a81c-5fbe94607f8f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0872140 Nov 24 14:31:31.125139 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c4460107-2b92-4e4e-81f5-8838768605ca req-96727d1a-3130-45cf-b253-3eee8f970ff3 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498319 Nov 24 14:31:31.168079 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-e1fc593d-d20b-4cef-b03a-9d93b632df9a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1504583 Nov 24 14:31:32.334079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6332a4e7-ceec-42b4-8959-9f9018969943 req-b4802aa0-3bd1-43a6-8c55-906ec317f29c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:32.335546 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6332a4e7-ceec-42b4-8959-9f9018969943 req-b4802aa0-3bd1-43a6-8c55-906ec317f29c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0803692 Nov 24 14:31:32.383505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6332a4e7-ceec-42b4-8959-9f9018969943 req-76cd6a5e-72f8-4b99-bb2c-aa8234f37791 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422373 Nov 24 14:31:32.517169 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-3a32f93d-0a4c-45e1-8a77-62a9a8bc0bf0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1098 time: 0.0745804 Nov 24 14:31:32.664082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-cb33167d-d748-40dc-a852-e96d228fdb41 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:32.665543 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-cb33167d-d748-40dc-a852-e96d228fdb41 service neutron] 10.222.0.47 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 913 time: 0.1414847 Nov 24 14:31:32.733727 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-d1c01114-0649-4ac4-9f3d-1a18bc365c1b service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 217 time: 0.0620246 Nov 24 14:31:32.802161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-e1e2ff8a-15ec-4fe8-a416-451c1170c2c6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:32.803594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-e1e2ff8a-15ec-4fe8-a416-451c1170c2c6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 200 len: 852 time: 0.0635698 Nov 24 14:31:32.852694 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-0115ca27-733f-41d2-baa9-b2c36ea698ef service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a22ab38e-49c3-4dbb-8137-630509cae0d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0424333 Nov 24 14:31:32.988089 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-8e5612fb-fdd9-40ce-9825-d19903f9329b service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288395 Nov 24 14:31:33.246920 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-dbbdd9f2-48c2-41c4-9a53-b194b97d3b44 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2468557 Nov 24 14:31:33.273160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-264b1da0-6733-47e5-ac6e-af86669ec636 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:33.591134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-220a4208-934b-491c-971d-085fb278efa1 req-cd97d074-0f56-45c5-be59-afb301bf7658 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:33.593345 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-220a4208-934b-491c-971d-085fb278efa1 req-cd97d074-0f56-45c5-be59-afb301bf7658 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0829799 Nov 24 14:31:33.642771 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-220a4208-934b-491c-971d-085fb278efa1 req-c37a9525-1ca4-461b-ba30-a9ba5eaeb4ba tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438156 Nov 24 14:31:33.671475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:34.851527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27736eb3-10f9-443d-862d-441772cbb03a req-cb17251c-8b50-4454-b958-6f28d0257b21 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:34.852989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27736eb3-10f9-443d-862d-441772cbb03a req-cb17251c-8b50-4454-b958-6f28d0257b21 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0825138 Nov 24 14:31:34.899891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27736eb3-10f9-443d-862d-441772cbb03a req-aadeb7ea-122a-4a93-b716-e9fd785460e3 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406063 Nov 24 14:31:35.824877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-39f144d0-a4b0-4567-85cb-49f7fe841f55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:36.108088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92a0142-bd2e-45fe-8fa8-4993ebbb7936 req-88ed3d8b-bda0-4bad-9869-2c31d2a58f81 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:36.109468 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b92a0142-bd2e-45fe-8fa8-4993ebbb7936 req-88ed3d8b-bda0-4bad-9869-2c31d2a58f81 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0783029 Nov 24 14:31:36.156801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b92a0142-bd2e-45fe-8fa8-4993ebbb7936 req-4e08ea92-5fb5-4a38-af0e-c0bfea8ce804 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417805 Nov 24 14:31:36.849092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:37.366322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99f1680e-c187-44f1-96eb-753864e96984 req-7d440af0-c8d2-4160-a907-2d5fdb42b96f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:37.367764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-99f1680e-c187-44f1-96eb-753864e96984 req-7d440af0-c8d2-4160-a907-2d5fdb42b96f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0803399 Nov 24 14:31:37.414186 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-99f1680e-c187-44f1-96eb-753864e96984 req-848a5743-fa29-4a03-bc2a-e778f9fdc7fe tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399919 Nov 24 14:31:38.534562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:38.622325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3a0077-0131-4f5d-8b2e-8f608884503e req-726165ab-498a-4478-8c44-57a674a7e6c8 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:38.625508 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ab3a0077-0131-4f5d-8b2e-8f608884503e req-726165ab-498a-4478-8c44-57a674a7e6c8 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0848210 Nov 24 14:31:38.673394 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ab3a0077-0131-4f5d-8b2e-8f608884503e req-902a4a8b-e17e-46ad-ba22-63367607a77d tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421875 Nov 24 14:31:39.886553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f44b7d-6914-478b-a0a4-7d8288089a2c req-261f318b-64f3-4a31-ae82-48f075b4ff9e tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:39.888033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1f44b7d-6914-478b-a0a4-7d8288089a2c req-261f318b-64f3-4a31-ae82-48f075b4ff9e tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0909829 Nov 24 14:31:39.934408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e1f44b7d-6914-478b-a0a4-7d8288089a2c req-58f0a377-4379-4a34-8b0c-54faa52f1f9f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405288 Nov 24 14:31:41.138153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c39b8db6-8844-464b-a646-43f5f99e5ae2 req-f8078d76-102c-4bde-9bc4-18182f9450da tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:41.139619 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c39b8db6-8844-464b-a646-43f5f99e5ae2 req-f8078d76-102c-4bde-9bc4-18182f9450da tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0812609 Nov 24 14:31:41.187059 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c39b8db6-8844-464b-a646-43f5f99e5ae2 req-b4e149f3-392f-445b-ada7-314731948bf4 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413094 Nov 24 14:31:42.397388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4ebb35-6f48-4260-b68c-2573e90c5ee1 req-036199b5-9ea9-486b-95c6-1325400ed3fc tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:42.398876 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bd4ebb35-6f48-4260-b68c-2573e90c5ee1 req-036199b5-9ea9-486b-95c6-1325400ed3fc tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0810223 Nov 24 14:31:42.447204 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bd4ebb35-6f48-4260-b68c-2573e90c5ee1 req-17627bde-60c0-4ef4-ab38-5f03ca78be10 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426443 Nov 24 14:31:43.651406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08797fc6-4dad-421e-903f-543a29318dd2 req-a82f2ec9-3216-4266-877b-e11def49809c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:43.652919 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-08797fc6-4dad-421e-903f-543a29318dd2 req-a82f2ec9-3216-4266-877b-e11def49809c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0832191 Nov 24 14:31:43.700238 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-08797fc6-4dad-421e-903f-543a29318dd2 req-35ecf341-6e63-4b3f-a170-d96f46a7189b tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416863 Nov 24 14:31:44.900036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ac6e61-4fb5-47f4-8821-eb630dcc17ee req-0444f8ca-f38a-45b0-9c7e-34b3190c9cfc tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:44.901501 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-11ac6e61-4fb5-47f4-8821-eb630dcc17ee req-0444f8ca-f38a-45b0-9c7e-34b3190c9cfc tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0812092 Nov 24 14:31:44.946668 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-11ac6e61-4fb5-47f4-8821-eb630dcc17ee req-4e1e06da-d47d-4f1e-8834-8e75ddc86038 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391045 Nov 24 14:31:45.820612 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:31:46.145906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98444df1-48ab-4d41-99d7-234e9225aaeb req-9a0b28be-de0e-4429-ad41-039b2a0a3e8f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:46.147361 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-98444df1-48ab-4d41-99d7-234e9225aaeb req-9a0b28be-de0e-4429-ad41-039b2a0a3e8f tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0771744 Nov 24 14:31:46.197613 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-98444df1-48ab-4d41-99d7-234e9225aaeb req-100d19f4-6bbe-4a11-bd54-7c91deba951b tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443695 Nov 24 14:31:47.406555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e9b592-3253-4973-b9a9-7f7ba8df854d req-6556ff42-d362-409a-837b-335a6504797a tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:47.408139 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79e9b592-3253-4973-b9a9-7f7ba8df854d req-6556ff42-d362-409a-837b-335a6504797a tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0785055 Nov 24 14:31:47.551679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-79e9b592-3253-4973-b9a9-7f7ba8df854d req-13aa8848-36c9-4527-8ebc-3dfa69e50c3d tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1378832 Nov 24 14:31:48.014128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:31:48.755357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d529ad-efdb-46a2-8592-af1731e01d31 req-6d6461b0-b46f-4b59-92bb-697b2a4cfc8e tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:48.757740 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c0d529ad-efdb-46a2-8592-af1731e01d31 req-6d6461b0-b46f-4b59-92bb-697b2a4cfc8e tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0822222 Nov 24 14:31:48.803645 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c0d529ad-efdb-46a2-8592-af1731e01d31 req-911ee767-2736-42c7-8498-9ae01e1fb292 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404847 Nov 24 14:31:50.001479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce85b3e-e7d8-48bd-842f-e68ad0bf96e0 req-909f189b-6186-44d4-bee4-ae2fd534f3ea tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:50.002902 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fce85b3e-e7d8-48bd-842f-e68ad0bf96e0 req-909f189b-6186-44d4-bee4-ae2fd534f3ea tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0778809 Nov 24 14:31:50.055151 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fce85b3e-e7d8-48bd-842f-e68ad0bf96e0 req-b9592732-f36e-426e-93af-47926aebe1be tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465896 Nov 24 14:31:51.257941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-011207ab-eedb-484e-9ff5-2d65a4108cd2 req-9079ae30-04d2-45f7-84b8-44b11303d165 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:51.259395 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-011207ab-eedb-484e-9ff5-2d65a4108cd2 req-9079ae30-04d2-45f7-84b8-44b11303d165 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0828104 Nov 24 14:31:51.307919 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-011207ab-eedb-484e-9ff5-2d65a4108cd2 req-0205a974-eedd-4412-8e48-5b93922adb37 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429175 Nov 24 14:31:52.509659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb7099c-27db-4e25-a7c2-f6c1d290a7c1 req-f3ab2463-8742-4b25-a8cb-64b93bb8a7de tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:52.510970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9eb7099c-27db-4e25-a7c2-f6c1d290a7c1 req-f3ab2463-8742-4b25-a8cb-64b93bb8a7de tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0812376 Nov 24 14:31:52.558669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9eb7099c-27db-4e25-a7c2-f6c1d290a7c1 req-c31ab1e1-ce5f-4569-963d-5a47767bf147 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412116 Nov 24 14:31:53.763508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36bac40-abf0-4725-a045-0400d88dc1f3 req-fea9481a-b96e-4027-ac52-7623057c9520 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:53.764497 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e36bac40-abf0-4725-a045-0400d88dc1f3 req-fea9481a-b96e-4027-ac52-7623057c9520 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0826433 Nov 24 14:31:53.812199 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e36bac40-abf0-4725-a045-0400d88dc1f3 req-e354791e-da64-4c0d-80d7-78487d97b8d4 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397682 Nov 24 14:31:55.014186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-942a663c-742f-4f70-8800-0b345177b5b1 req-91883a1a-8a97-4f4d-afa0-2ffc5f57478c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:55.016355 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-942a663c-742f-4f70-8800-0b345177b5b1 req-91883a1a-8a97-4f4d-afa0-2ffc5f57478c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0839884 Nov 24 14:31:55.064910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-942a663c-742f-4f70-8800-0b345177b5b1 req-7dbd6cf3-4b70-4ffc-bf32-92253e399582 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428803 Nov 24 14:31:56.278443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2092e648-62b2-4c17-80bc-183b01d7c0e7 req-211cc480-25fb-4508-95eb-b7ba5a8c55f8 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:56.279939 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2092e648-62b2-4c17-80bc-183b01d7c0e7 req-211cc480-25fb-4508-95eb-b7ba5a8c55f8 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0893667 Nov 24 14:31:56.330702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2092e648-62b2-4c17-80bc-183b01d7c0e7 req-1f3d22b7-3703-456e-b15d-62df1ceb2105 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445139 Nov 24 14:31:57.536634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771b015c-a481-4fa8-bfea-326d980196c0 req-40e97e00-24ab-47cb-ade0-41589bba8665 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:57.538003 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771b015c-a481-4fa8-bfea-326d980196c0 req-40e97e00-24ab-47cb-ade0-41589bba8665 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0839064 Nov 24 14:31:57.584726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-771b015c-a481-4fa8-bfea-326d980196c0 req-07296538-f7e2-4754-943c-1397289c659d tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411987 Nov 24 14:31:58.787476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89978cbd-0d7d-4649-b9b8-e8be35e4a47a req-2321e2b0-2b6e-4923-a6ac-9760833dedf9 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:31:58.788986 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-89978cbd-0d7d-4649-b9b8-e8be35e4a47a req-2321e2b0-2b6e-4923-a6ac-9760833dedf9 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0794578 Nov 24 14:31:58.838858 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-89978cbd-0d7d-4649-b9b8-e8be35e4a47a req-417a497a-a000-487c-ad06-4f55f341c878 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440943 Nov 24 14:32:00.038472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2890ce55-b7e3-495a-ad95-386a0ecef2cd req-2b99ec4b-01c4-458c-9893-91b98bdb0acd tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:00.039975 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2890ce55-b7e3-495a-ad95-386a0ecef2cd req-2b99ec4b-01c4-458c-9893-91b98bdb0acd tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0780046 Nov 24 14:32:00.052881 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-0d9813af-8cd2-4b44-b08f-7d227ef05dbe service neutron] 10.222.0.47 "GET /v2.0/ports/a24c1cf1-a8cb-4c0e-9652-f921586570cd/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0796795 Nov 24 14:32:00.091040 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2890ce55-b7e3-495a-ad95-386a0ecef2cd req-30bab0ed-5bd6-417c-bbf1-2441e61156ce tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453405 Nov 24 14:32:00.338806 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-7dd4365e-6ddc-42a2-9118-7ae22ed8749d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784&tenant_id=475e3e3519f64990818fdc6e57f69b81 HTTP/1.1" status: 200 len: 1098 time: 0.0706418 Nov 24 14:32:00.441362 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-64f26503-39b3-4332-abc4-5c2ce7e1a598 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1098 time: 0.0785422 Nov 24 14:32:00.592202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-dd78b381-3a9d-4e47-a5cd-b4d089944e6d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:00.594207 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-dd78b381-3a9d-4e47-a5cd-b4d089944e6d service neutron] 10.222.0.47 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 913 time: 0.1467097 Nov 24 14:32:00.662635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-bf09dfa9-8338-4acf-a985-b7dfa18a60dd service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 217 time: 0.0630941 Nov 24 14:32:00.740578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-14e83f7b-3f4a-4f26-93a5-923077d8b124 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:00.742000 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-14e83f7b-3f4a-4f26-93a5-923077d8b124 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 200 len: 852 time: 0.0719304 Nov 24 14:32:00.859721 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-63e73ea8-a1ef-470f-bbcd-51e0113d90d2 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a22ab38e-49c3-4dbb-8137-630509cae0d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1105175 Nov 24 14:32:01.097284 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-e06f70eb-52f3-409e-af0e-9cce938d64bb service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2315533 Nov 24 14:32:01.279545 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d39f5613-a4b2-4624-a58b-b09b8e039fbb req-1382d784-539b-45dd-95a4-45376234279f service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1746924 Nov 24 14:32:01.317942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1b7fcb-32dc-4685-960c-dd1c8cdab9ff req-edbee63e-d524-4f95-b7d4-d1498e1dfa74 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:01.320282 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1e1b7fcb-32dc-4685-960c-dd1c8cdab9ff req-edbee63e-d524-4f95-b7d4-d1498e1dfa74 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.1044695 Nov 24 14:32:01.375236 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1e1b7fcb-32dc-4685-960c-dd1c8cdab9ff req-027e5dee-9f10-48c4-bf08-17ee17cb4d37 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495546 Nov 24 14:32:02.579295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900c0c0c-b6fd-4a7b-87dd-387ae6227eb8 req-8f61527d-a3cc-4a3a-961f-17be647dae2c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:02.580686 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-900c0c0c-b6fd-4a7b-87dd-387ae6227eb8 req-8f61527d-a3cc-4a3a-961f-17be647dae2c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0772779 Nov 24 14:32:02.626505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-900c0c0c-b6fd-4a7b-87dd-387ae6227eb8 req-ecaff019-5cb5-4e19-9ddf-9a9e4edd8324 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402398 Nov 24 14:32:03.278163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-094abe22-0ab1-4920-89d2-d99a73dcd22f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:03.664942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:03.830615 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851a8fb3-ff8d-4f92-9210-bc7a8db17935 req-9d44a760-667b-4093-81c2-5ee00997aa3c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:03.832101 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-851a8fb3-ff8d-4f92-9210-bc7a8db17935 req-9d44a760-667b-4093-81c2-5ee00997aa3c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0809636 Nov 24 14:32:03.880017 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-851a8fb3-ff8d-4f92-9210-bc7a8db17935 req-fe40387d-ccce-4892-afb0-220b8ecfce20 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421860 Nov 24 14:32:04.022457 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-c7ccfbf5-6ec7-4d78-a911-d97c77f36dd8 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1098 time: 0.0761657 Nov 24 14:32:04.214888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-1cbbd356-fbd6-406f-ab2c-0dd290390ae8 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:04.216378 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-1cbbd356-fbd6-406f-ab2c-0dd290390ae8 service neutron] 10.222.0.47 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 913 time: 0.1331410 Nov 24 14:32:04.289294 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-e6e58b87-23ac-4cac-9444-0ffedc575f0f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 217 time: 0.0662451 Nov 24 14:32:04.358582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-3d97f7b9-39d0-48f1-ad80-ceed417fe68d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:04.361193 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-3d97f7b9-39d0-48f1-ad80-ceed417fe68d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 200 len: 852 time: 0.0648077 Nov 24 14:32:04.411062 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-ed5e3139-6cc2-4b99-8bdc-ae48a9879a6b service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a22ab38e-49c3-4dbb-8137-630509cae0d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435104 Nov 24 14:32:04.521076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:32:04.523409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:32:04.549568 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-bdcf234f-89c5-4c74-8c5b-5894624b681d service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1321766 Nov 24 14:32:04.688378 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8eb1fde7-f61e-4f5d-bb99-a4affe5fb980 req-c9076777-87a5-4256-a007-c1f574bf68b1 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1316271 Nov 24 14:32:04.736064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:04.772471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:04.789626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:32:04.798085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'network_id': 'a22ab38e-49c3-4dbb-8137-630509cae0d6', 'port_id': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'mac_address': 'fa:16:3e:1b:3f:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5cc73d98-a15c-4f51-aad9-51ff514a3960', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:32:04.802216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:04.830545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:04.840676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:04.909457 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'code': 200} Nov 24 14:32:04.949380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:04.974409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:04.977284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a24c1cf1-a8cb-4c0e-9652-f921586570cd {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:32:04.995223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.995570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.995943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.996280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.996618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.996948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.997277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.997601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.997924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.998253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:04.998572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:32:05.003044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:05.004568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:05.009668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:05.011399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:05.080409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['a24c1cf1-a8cb-4c0e-9652-f921586570cd'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:32:05.089316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b41ecf27-5cc3-40c3-bfec-59464bca628f req-1c069605-c408-4109-aca1-573cd6951a1b tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:05.090816 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b41ecf27-5cc3-40c3-bfec-59464bca628f req-1c069605-c408-4109-aca1-573cd6951a1b tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 944 time: 0.0861006 Nov 24 14:32:05.131043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:05.135585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:05.145684 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b41ecf27-5cc3-40c3-bfec-59464bca628f req-563e1493-5864-40af-a011-2890fb75d084 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472510 Nov 24 14:32:05.566653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-6091e12c-fe51-4a5f-a44e-5fc2af259d37 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:05.568113 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-6091e12c-fe51-4a5f-a44e-5fc2af259d37 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.47 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784&tenant_id=475e3e3519f64990818fdc6e57f69b81&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 944 time: 0.0849109 Nov 24 14:32:05.714197 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-dd56a933-2a72-43e9-95fa-07a7a8b2d051 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=475e3e3519f64990818fdc6e57f69b81&device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 1097 time: 0.0725026 Nov 24 14:32:05.828892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e4e54508-8e72-4644-a0ca-ab15cc08321e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:05.850014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-3754945a-b9eb-4840-8b9a-6963ef8d04f5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:05.851476 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-3754945a-b9eb-4840-8b9a-6963ef8d04f5 service neutron] 10.222.0.47 "GET /v2.0/networks?id=a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 200 len: 913 time: 0.1309094 Nov 24 14:32:05.918357 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-399d76c7-6612-4cb8-9328-ac565f1ffb0b service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 200 len: 217 time: 0.0606909 Nov 24 14:32:06.087362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-61eea93f-dfa6-4674-8855-bf1d79032b66 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:06.088732 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-61eea93f-dfa6-4674-8855-bf1d79032b66 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 200 len: 852 time: 0.1641431 Nov 24 14:32:06.136629 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-cd55c73e-12a6-4aed-8685-ac5da0c19818 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=a22ab38e-49c3-4dbb-8137-630509cae0d6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409656 Nov 24 14:32:06.269667 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-d10f0191-17f3-4ad3-aff6-a4b8a7e6d15e service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265342 Nov 24 14:32:06.414531 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-c1a81344-0f4f-45d6-8501-2c0cd4f9e7d3 service neutron] 10.222.0.47 "GET /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1386003 Nov 24 14:32:06.528495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:32:06.610864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port a24c1cf1-a8cb-4c0e-9652-f921586570cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:32:06.611245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:06.740070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:06.782088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:06.786446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:06.788380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:06.871387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:06.887525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:06.892305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:06.910189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:32:06.973477 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'code': 200} Nov 24 14:32:07.314198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c237ccb9-c6a4-4961-8fcb-42bde64e77c0 req-1f8957b8-17fc-4459-9ec0-9a035a5a57da tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:07.315694 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c237ccb9-c6a4-4961-8fcb-42bde64e77c0 req-1f8957b8-17fc-4459-9ec0-9a035a5a57da tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0812292 Nov 24 14:32:07.367304 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c237ccb9-c6a4-4961-8fcb-42bde64e77c0 req-4b0a8137-fdc7-4971-8bfb-403b824c5df5 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459356 Nov 24 14:32:08.541956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:08.578328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25f9c49c-c858-409d-aab0-194c4e660d01 req-385866e0-8786-443c-859d-5b1eb19e0aff tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:08.579781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25f9c49c-c858-409d-aab0-194c4e660d01 req-385866e0-8786-443c-859d-5b1eb19e0aff tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0899558 Nov 24 14:32:08.624826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-25f9c49c-c858-409d-aab0-194c4e660d01 req-26c88952-5642-4b0c-9451-8ce7bc92bd7c tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/security-groups?id=74d33e70-e503-4d63-856c-6e4e172539d9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394049 Nov 24 14:32:09.011118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-206a47a6-6aac-4226-85bc-973a863371a3 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:09.012592 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-206a47a6-6aac-4226-85bc-973a863371a3 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.47 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 945 time: 0.0781782 Nov 24 14:32:09.082957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Deleting port a24c1cf1-a8cb-4c0e-9652-f921586570cd {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:32:09.083291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:09.332943 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] For port a24c1cf1-a8cb-4c0e-9652-f921586570cd, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=a24c1cf1-a8cb-4c0e-9652-f921586570cd,segment=NetworkSegment(b35241b1-d37a-4e58-b4dc-16dda165f9bf),segment_id=b35241b1-d37a-4e58-b4dc-16dda165f9bf)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:09.333297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:09.461634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Calling delete_port for a24c1cf1-a8cb-4c0e-9652-f921586570cd owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:32:09.605271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:09.611707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-23a08d48-7202-45ad-9823-91fc42812c3a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:09.616916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['a24c1cf1-a8cb-4c0e-9652-f921586570cd'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:32:09.663225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Pushing event deleted for resources: {'Port': ['ID=a24c1cf1-a8cb-4c0e-9652-f921586570cd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:09.668143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:09.738980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] No DVR routers for this DVR port a24c1cf1-a8cb-4c0e-9652-f921586570cd on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:32:09.741465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:09.744370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-deleted', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:32:09.799374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-3071840f-6567-419c-a3c3-4187dd3a1eb1 req-b97f4cb5-73af-4a1d-94e2-e5003944de5a tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Synchronizing usage tracker for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:32:09.802997 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9fcd847-ac42-4d1e-bcfd-e34dbec70784', 'name': 'network-vif-deleted', 'tag': 'a24c1cf1-a8cb-4c0e-9652-f921586570cd', 'status': 'completed', 'code': 200} Nov 24 14:32:09.804277 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afffee1c-6de3-4959-850c-80430f0cf6a3 req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.47 "DELETE /v2.0/ports/a24c1cf1-a8cb-4c0e-9652-f921586570cd HTTP/1.1" status: 204 len: 173 time: 0.7854950 Nov 24 14:32:09.819308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-3071840f-6567-419c-a3c3-4187dd3a1eb1 req-b97f4cb5-73af-4a1d-94e2-e5003944de5a tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Unset dirty status for tenant:475e3e3519f64990818fdc6e57f69b81 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:32:09.824184 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3071840f-6567-419c-a3c3-4187dd3a1eb1 req-b97f4cb5-73af-4a1d-94e2-e5003944de5a tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] 10.222.0.70 "GET /v2.0/ports?device_id=c9fcd847-ac42-4d1e-bcfd-e34dbec70784 HTTP/1.1" status: 200 len: 210 time: 0.0727096 Nov 24 14:32:11.085749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50174) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:32:11.147731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Deleting subnet 5cc73d98-a15c-4f51-aad9-51ff514a3960 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:32:11.150803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.199678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.260672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.333306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.337297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1d2a85bb-8111-48d6-933a-d1a12c9f6b5a tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:11.372565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5cc73d98-a15c-4f51-aad9-51ff514a3960,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:11.378142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:11.382649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.389009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] 10.222.0.70 "DELETE /v2.0/subnets/5cc73d98-a15c-4f51-aad9-51ff514a3960 HTTP/1.1" status: 204 len: 168 time: 0.3020308 Nov 24 14:32:11.392123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50178) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:32:11.613835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.743122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.770982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a22ab38e-49c3-4dbb-8137-630509cae0d6']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:32:11.783229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b35241b1-d37a-4e58-b4dc-16dda165f9bf') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:32:11.783517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b35241b1-d37a-4e58-b4dc-16dda165f9bf') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:32:11.794370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.809749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.815995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Releasing vlan 897 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:32:11.816369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:32:11.829929 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:32:11.905065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.908729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-347f5f9b-19fe-4360-baa1-3b5c2d9aa09a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:11.921466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:11.931362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Pushing event deleted for resources: {'Network': ['ID=a22ab38e-49c3-4dbb-8137-630509cae0d6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:11.934368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:11.941427 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] 10.222.0.70 "DELETE /v2.0/networks/a22ab38e-49c3-4dbb-8137-630509cae0d6 HTTP/1.1" status: 204 len: 168 time: 0.5483561 Nov 24 14:32:12.072125 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50184) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:32:12.121910 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-837cbc28-a6ed-4288-933d-3c17ab5b5ef7 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=475e3e3519f64990818fdc6e57f69b81&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0485482 Nov 24 14:32:12.124829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50188) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:32:12.183707 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:12.210821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:12.275423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:12.279275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:12.292535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74d33e70-e503-4d63-856c-6e4e172539d9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:12.295227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:12.307240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:12.308419 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-66f4e5e9-3557-4198-a8ff-85f0983176bf admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/74d33e70-e503-4d63-856c-6e4e172539d9 HTTP/1.1" status: 204 len: 168 time: 0.1825984 Nov 24 14:32:12.575026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:32:12.607038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: a24c1cf1-a8cb-4c0e-9652-f921586570cd {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:32:12.607391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device a24c1cf1-a8cb-4c0e-9652-f921586570cd not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:32:13.156142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50210) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:32:13.294251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-1869661217-network', 'tenant_id': 'ca3b7e56bf0b41b788c8d342a40f91e2'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:32:13.299403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:32:13.303172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Usage tracker for resource:network and tenant:ca3b7e56bf0b41b788c8d342a40f91e2 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:32:13.305994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:32:13.316147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:32:13.326071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Made reservation on behalf of ca3b7e56bf0b41b788c8d342a40f91e2 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:32:13.329243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.341536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.375010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:32:13.378911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Usage tracker for resource:security_group_rule and tenant:ca3b7e56bf0b41b788c8d342a40f91e2 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:32:13.381751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:32:13.387352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:32:13.474032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.478840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.484516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-67026a52-edde-4ea5-ab9d-a4af2e9c9530 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:13.512962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 878} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:32:13.521831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59d5aaed-d309-4827-a783-e18582aefbc3,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:13.525291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:13.527692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.528077 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Added segment a88edde9-5439-4663-b6c1-764715ef7871 of type vlan for network 9b3f1177-cd3c-4da4-b261-e444d32d8295 Nov 24 14:32:13.556213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.590805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.593369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:13.593955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.597582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cadfb26-d889-4dd4-8cfd-e1c415e35828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:13.705060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Pushing event updated for resources: {'Network': ['ID=9b3f1177-cd3c-4da4-b261-e444d32d8295,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:13.708248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:13.709755 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5526242 Nov 24 14:32:13.712724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50216) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:32:13.715806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 9b3f1177-cd3c-4da4-b261-e444d32d8295 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:32:13.718761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Request body: {'subnet': {'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-1869661217-subnet', 'tenant_id': 'ca3b7e56bf0b41b788c8d342a40f91e2', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:32:13.723650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:32:13.727585 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Usage tracker for resource:subnet and tenant:ca3b7e56bf0b41b788c8d342a40f91e2 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:32:13.730634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:32:13.736805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:32:13.747088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Made reservation on behalf of ca3b7e56bf0b41b788c8d342a40f91e2 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:32:13.750021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.971912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:13.975488 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e3cf8464-2d8c-4715-9b62-7e5812ff7efd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:14.051923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b4ba849b-41c2-4950-afe6-1c8c8cba2254,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:14.055689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:14.060964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Checking segment: {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:32:14.061217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Network hostable DHCP agents. Network: 9b3f1177-cd3c-4da4-b261-e444d32d8295, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:32:14.084667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Network 9b3f1177-cd3c-4da4-b261-e444d32d8295 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:32:14.096129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 9b3f1177-cd3c-4da4-b261-e444d32d8295) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:32:14.101412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:14.102174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:14.104895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75754011-5d6a-4e67-a0a7-ddb3421e1f1d None None] Network 9b3f1177-cd3c-4da4-b261-e444d32d8295 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:32:14.125014 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.4111667 Nov 24 14:32:14.365590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b017f93-a515-4dca-9edd-7892c0ab7c2a None None] Network 9b3f1177-cd3c-4da4-b261-e444d32d8295 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:32:14.718542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2edcde7-bb27-49bf-9514-9357b836336c req-5a5c2fb4-6fec-41aa-9062-175355f60e49 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:14.719386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2edcde7-bb27-49bf-9514-9357b836336c req-5a5c2fb4-6fec-41aa-9062-175355f60e49 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Synchronizing usage tracker for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:32:14.737660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2edcde7-bb27-49bf-9514-9357b836336c req-5a5c2fb4-6fec-41aa-9062-175355f60e49 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Unset dirty status for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:32:14.738819 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-5a5c2fb4-6fec-41aa-9062-175355f60e49 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 815 time: 0.1772137 Nov 24 14:32:14.755485 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2d9b6311-2173-472e-98a3-445c0fd483cf tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/quotas/ca3b7e56bf0b41b788c8d342a40f91e2 HTTP/1.1" status: 200 len: 375 time: 0.0113676 Nov 24 14:32:14.801034 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-054f1a09-c2f4-47dd-841b-476910f4b0c5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0404019 Nov 24 14:32:14.811156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1657fe8a-607a-468c-84ed-6d45666284ad service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:32:14.812337 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1657fe8a-607a-468c-84ed-6d45666284ad service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0048037 Nov 24 14:32:14.941960 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-11e3726b-2c60-4dc7-8f35-e8a3b70e87c8 service neutron] 10.222.0.70 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1242158 Nov 24 14:32:15.074840 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-a9da72b3-5261-4a8a-ae6f-7c7eb7e5733e service neutron] 10.222.0.70 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271145 Nov 24 14:32:15.261089 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6a9a5eb0-b996-4b74-884e-d529464626b1 req-85712491-292a-4ac6-9bd1-a4c007a0feb6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 210 time: 0.0437176 Nov 24 14:32:16.318661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2edcde7-bb27-49bf-9514-9357b836336c req-efc6b9b8-efad-4502-870f-2210040af3cd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:16.320127 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-efc6b9b8-efad-4502-870f-2210040af3cd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 815 time: 0.1662648 Nov 24 14:32:16.337624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Request body: {'port': {'device_id': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'admin_state_up': True, 'tenant_id': 'ca3b7e56bf0b41b788c8d342a40f91e2'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:32:16.579055 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0732a0ad-1295-4bbd-988e-af877e3b57e3 req-192960b2-2db4-4c44-a661-bb1c928de40f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 210 time: 0.1583409 Nov 24 14:32:16.624278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:32:16.627963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Usage tracker for resource:port and tenant:ca3b7e56bf0b41b788c8d342a40f91e2 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:32:16.630661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:32:16.636188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:32:16.646149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Made reservation on behalf of ca3b7e56bf0b41b788c8d342a40f91e2 for: {'port': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:32:16.649234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:16.818503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Allocated IP 172.20.0.8 (9b3f1177-cd3c-4da4-b261-e444d32d8295/b4ba849b-41c2-4950-afe6-1c8c8cba2254/f01a5f67-b834-4015-b6d4-1466aef5d8d8) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:32:17.026249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:17.054061 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:17.059860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0a75318f-f3f1-4772-a531-074b5a82703d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:17.122097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Network 9b3f1177-cd3c-4da4-b261-e444d32d8295 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:32:17.126557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:32:17.130566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:32:17.178025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:17.182195 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:17.205342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:17.205947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:17.227338 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8935997 Nov 24 14:32:17.239278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Request body: {'port': {'device_id': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:32:17.355989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:17.705377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f01a5f67-b834-4015-b6d4-1466aef5d8d8 {{(pid=83525) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:32:17.712443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:17.728605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Transition to ACTIVE for port object f01a5f67-b834-4015-b6d4-1466aef5d8d8 will not be triggered until provisioned by entity L2. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:32:17.732992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:17.739205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32b8d33c-9c01-4d6b-9edb-99c747273d11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:17.783546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6100d2f-1980-4137-beff-438482dd8c42 req-b50da779-566b-454e-a035-8d0c84be4969 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:17.785019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6100d2f-1980-4137-beff-438482dd8c42 req-b50da779-566b-454e-a035-8d0c84be4969 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 943 time: 0.0830665 Nov 24 14:32:17.835482 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6100d2f-1980-4137-beff-438482dd8c42 req-44e279ca-ac3a-45f2-9e8b-0591a61a4be8 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436323 Nov 24 14:32:17.871369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:17.875340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:17.983085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Attempting to bind port f01a5f67-b834-4015-b6d4-1466aef5d8d8 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:32:17.983565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Attempting to bind port f01a5f67-b834-4015-b6d4-1466aef5d8d8 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:32:17.983923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Attempting to bind port f01a5f67-b834-4015-b6d4-1466aef5d8d8 on network 9b3f1177-cd3c-4da4-b261-e444d32d8295 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:32:17.989847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Port f01a5f67-b834-4015-b6d4-1466aef5d8d8 on network 9b3f1177-cd3c-4da4-b261-e444d32d8295 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:32:17.990165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Attempting to bind port f01a5f67-b834-4015-b6d4-1466aef5d8d8 on network 9b3f1177-cd3c-4da4-b261-e444d32d8295 {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:32:17.996440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 31, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:32:17.996768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Checking segment: {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:32:17.997152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Bound using segment: {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'} {{(pid=83525) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:32:17.997561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.managers [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Bound port: f01a5f67-b834-4015-b6d4-1466aef5d8d8, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'}}] {{(pid=83525) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:32:17.997917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:18.017442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:18.087342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, cleared binding levels {{(pid=83525) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:32:18.090424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83525) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:32:18.094438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:18.098160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:18.156534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:18.157907 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] 10.222.0.47 "PUT /v2.0/ports/f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 1093 time: 0.9224813 Nov 24 14:32:18.158438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:32:18.180792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=3']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:18.183827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:18.242432 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'status': 'completed', 'code': 200} Nov 24 14:32:18.284217 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-30b8b407-8d82-4d6e-8ca9-6e876e29d55f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1096 time: 0.0854645 Nov 24 14:32:18.357469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-fe4209e1-2676-4c20-98ad-44f0e4b9d05c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 217 time: 0.0661287 Nov 24 14:32:18.422066 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2edcde7-bb27-49bf-9514-9357b836336c req-9396764b-f78a-4534-a4cf-7a9f0d3e7746 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:18.423401 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-9396764b-f78a-4534-a4cf-7a9f0d3e7746 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0604546 Nov 24 14:32:18.471163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-868e3b69-e037-4c1d-9bfa-16a1702765a4 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0412874 Nov 24 14:32:18.737504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-6928b39e-f6dc-46b3-b9e6-4e0d5b273e87 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2595875 Nov 24 14:32:18.869602 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2edcde7-bb27-49bf-9514-9357b836336c req-cafebeda-755d-4af1-bda0-5810dd5a8ab3 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261327 Nov 24 14:32:18.994849 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-0ac4d50e-9412-4431-9bc8-76d840f36512 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1096 time: 0.0782614 Nov 24 14:32:19.041633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821daefa-5f8a-4240-8086-b786fe32c5d7 req-001289c9-69fd-4529-a2aa-e56129f0efb5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:19.043073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-821daefa-5f8a-4240-8086-b786fe32c5d7 req-001289c9-69fd-4529-a2aa-e56129f0efb5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 943 time: 0.0798733 Nov 24 14:32:19.090794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-821daefa-5f8a-4240-8086-b786fe32c5d7 req-b9b50d89-4a99-4d23-884d-876be275357c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418339 Nov 24 14:32:19.130936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-fc9d5ccf-d7bd-46cb-ab28-62f8aa2d442a service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:19.132392 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-fc9d5ccf-d7bd-46cb-ab28-62f8aa2d442a service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1312785 Nov 24 14:32:19.208103 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-cf82d998-96e3-479a-b9ec-f22ffa000ff7 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 217 time: 0.0675893 Nov 24 14:32:19.272999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-c3ea9259-ef95-41c4-bde5-57dd5c899282 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:19.274346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-c3ea9259-ef95-41c4-bde5-57dd5c899282 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0603874 Nov 24 14:32:19.321714 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-59b0f90b-6c4d-4f0d-95ec-2c4b2d72b0c0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0400434 Nov 24 14:32:19.464816 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-1d331f2f-dc61-40e8-ac8b-dd00ab23b58e service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1359010 Nov 24 14:32:19.600973 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2a170a4-3c7f-4294-b88c-6048aaa0f36e req-20c6de03-ec23-4205-b790-f52530c1fd98 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1292028 Nov 24 14:32:20.299796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-fcf714ab-1e1c-4622-858b-25abc811142c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:20.300516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-fcf714ab-1e1c-4622-858b-25abc811142c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Synchronizing usage tracker for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:32:20.318962 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-fcf714ab-1e1c-4622-858b-25abc811142c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Unset dirty status for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:32:20.320257 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-fcf714ab-1e1c-4622-858b-25abc811142c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 943 time: 0.1047659 Nov 24 14:32:20.368329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-08a49f45-0385-46cd-afa4-b231c657f094 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Synchronizing usage tracker for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:32:20.385289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-08a49f45-0385-46cd-afa4-b231c657f094 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Unset dirty status for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:32:20.386404 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9ca8c632-cb84-4a56-9f7e-6c9ea34c9b7f req-08a49f45-0385-46cd-afa4-b231c657f094 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603313 Nov 24 14:32:21.591885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fa74223-fece-4e3c-9404-faa2616762dc req-c577ab04-e12b-411f-b769-f01bdce19777 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:21.594063 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5fa74223-fece-4e3c-9404-faa2616762dc req-c577ab04-e12b-411f-b769-f01bdce19777 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 943 time: 0.0817475 Nov 24 14:32:21.640416 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5fa74223-fece-4e3c-9404-faa2616762dc req-17eb4826-3bf8-4ed3-a5d7-fc0b494f2f28 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400350 Nov 24 14:32:22.606340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:32:22.742407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:22.756905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'port_id': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'mac_address': 'fa:16:3e:51:45:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 878, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b4ba849b-41c2-4950-afe6-1c8c8cba2254', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:32:22.816281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:22.821480 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:32:22.834055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f01a5f67-b834-4015-b6d4-1466aef5d8d8 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:32:22.839708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d99bc79d-e2c0-4906-aeed-13305c42d93c req-87aef7d5-b171-40d2-9a9b-ebe577c17119 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:22.841211 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d99bc79d-e2c0-4906-aeed-13305c42d93c req-87aef7d5-b171-40d2-9a9b-ebe577c17119 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 943 time: 0.0788102 Nov 24 14:32:22.849982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:22.853952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:22.855802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:22.894949 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d99bc79d-e2c0-4906-aeed-13305c42d93c req-f59d922e-8a27-4958-8f74-5bbb1d05d97a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478117 Nov 24 14:32:22.922122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:22.925252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:23.171409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f01a5f67-b834-4015-b6d4-1466aef5d8d8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:32:24.093452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-addc9c83-aee5-434d-81e8-4f576e7c2934 req-3907bd78-99a5-4114-958a-e9d1ff3c3882 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:24.094910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-addc9c83-aee5-434d-81e8-4f576e7c2934 req-3907bd78-99a5-4114-958a-e9d1ff3c3882 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 944 time: 0.0779965 Nov 24 14:32:24.140818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-addc9c83-aee5-434d-81e8-4f576e7c2934 req-61f39aa9-e20d-406d-a7ca-612f08b09b47 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403705 Nov 24 14:32:24.606050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:32:24.674870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port f01a5f67-b834-4015-b6d4-1466aef5d8d8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:32:24.679870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port f01a5f67-b834-4015-b6d4-1466aef5d8d8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:32:24.680252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:24.792962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:24.819645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:32:24.829139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:32:24.833386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:24.835627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:32:24.879440 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'code': 200} Nov 24 14:32:24.908066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:32:24.912710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:32:25.116053 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5355a6ca-1e8f-4e28-a45d-4365c0307ae1 req-34612eec-b8ae-4a44-8b4f-3281bcbc1b66 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1098 time: 0.0765798 Nov 24 14:32:25.159928 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5355a6ca-1e8f-4e28-a45d-4365c0307ae1 req-e75d45b8-ab86-4c10-b4b8-a7b78deeaef5 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374088 Nov 24 14:32:25.344465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496646e4-651f-43f7-b57a-4e554ea484d2 req-71ba8e16-64fb-4e36-9252-32ad07553551 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:25.345926 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-496646e4-651f-43f7-b57a-4e554ea484d2 req-71ba8e16-64fb-4e36-9252-32ad07553551 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0813363 Nov 24 14:32:25.401552 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-496646e4-651f-43f7-b57a-4e554ea484d2 req-3536418c-12e8-404b-ae19-50c4395ba792 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499682 Nov 24 14:32:26.617015 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3640b1-5dbf-4ed6-b032-fae2a778fcdc req-23273d43-e559-4e6c-94a9-2cf10a85af7a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:26.618376 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4e3640b1-5dbf-4ed6-b032-fae2a778fcdc req-23273d43-e559-4e6c-94a9-2cf10a85af7a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0845706 Nov 24 14:32:26.666812 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4e3640b1-5dbf-4ed6-b032-fae2a778fcdc req-77b1c5ea-ae7d-4beb-8a01-31cbad72fc41 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427752 Nov 24 14:32:27.859750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b62726-8415-4daa-b6bb-2c3b399eefc8 req-8ccdae5c-244c-4384-9337-66a066ea6c3e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:27.861194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40b62726-8415-4daa-b6bb-2c3b399eefc8 req-8ccdae5c-244c-4384-9337-66a066ea6c3e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0754206 Nov 24 14:32:27.909650 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40b62726-8415-4daa-b6bb-2c3b399eefc8 req-4294c5d2-1f2e-4a6d-bf04-39e350829311 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430348 Nov 24 14:32:28.104463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc165811-dd03-4b5e-a945-c7b08af6aa9a req-ed1dcfc0-765d-4799-a1ca-469c7cfd6124 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:28.105908 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cc165811-dd03-4b5e-a945-c7b08af6aa9a req-ed1dcfc0-765d-4799-a1ca-469c7cfd6124 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0771496 Nov 24 14:32:28.152433 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cc165811-dd03-4b5e-a945-c7b08af6aa9a req-f47b7626-3f48-4b43-8de8-e1b1366b800e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403738 Nov 24 14:32:28.536065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c74239-8fb1-43ad-aa91-7833332f30ee req-5e5f47ec-1313-4339-b62c-3a4065cad0fe tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:28.537413 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2c74239-8fb1-43ad-aa91-7833332f30ee req-5e5f47ec-1313-4339-b62c-3a4065cad0fe tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0814834 Nov 24 14:32:28.582914 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f2c74239-8fb1-43ad-aa91-7833332f30ee req-2e5a39f1-9b14-4bc4-90c5-882abfd86da9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400670 Nov 24 14:32:28.782027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4524ffdf-6e07-45b7-98a0-facef36c75e6 req-2995ae5d-d8e4-431d-8dce-c2d15646f878 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:28.783477 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4524ffdf-6e07-45b7-98a0-facef36c75e6 req-2995ae5d-d8e4-431d-8dce-c2d15646f878 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0790603 Nov 24 14:32:28.828780 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4524ffdf-6e07-45b7-98a0-facef36c75e6 req-e2a28f2c-6e51-466e-a6a0-f3a06c54b6f0 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397015 Nov 24 14:32:29.022802 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-209536da-b8cc-4d7d-8d04-d429ee96f888 req-0a16efa2-d18d-4ba2-b8e3-b6c2cb96dfe7 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0675690 Nov 24 14:32:29.313971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-7cb975a5-114e-4df7-b395-83ebcc77dabe service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1190345 Nov 24 14:32:29.340228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb259cb-1ab6-42fe-b3f9-f481975f0159 req-86f598bb-67f8-4786-b612-8dc791b1c6ba tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:29.341898 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8bb259cb-1ab6-42fe-b3f9-f481975f0159 req-86f598bb-67f8-4786-b612-8dc791b1c6ba tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0943179 Nov 24 14:32:29.398428 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8bb259cb-1ab6-42fe-b3f9-f481975f0159 req-d47901f8-4822-491d-9d14-a210f1487956 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502882 Nov 24 14:32:30.639593 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-b401ba36-b688-46bf-9b64-1e56b1e0613f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1098 time: 0.1432199 Nov 24 14:32:30.646957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b006e2e-4ee3-4bad-a7db-effc368d117c req-caa81271-a7fa-4e26-a7bf-9feb88e5b738 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:30.648375 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7b006e2e-4ee3-4bad-a7db-effc368d117c req-caa81271-a7fa-4e26-a7bf-9feb88e5b738 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.1061332 Nov 24 14:32:30.904520 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7b006e2e-4ee3-4bad-a7db-effc368d117c req-6de60288-434a-4f4c-b353-e53e6afc81ed tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2372851 Nov 24 14:32:30.924378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-15573631-55b9-4c36-ba90-a18625cf883e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:30.925801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-15573631-55b9-4c36-ba90-a18625cf883e service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.2765932 Nov 24 14:32:30.994252 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-bbbec9bb-022a-4d03-b027-a163387c5990 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 217 time: 0.0615263 Nov 24 14:32:31.058075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-242775c3-3ce0-48f1-a462-c80b195cb207 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:31.059470 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-242775c3-3ce0-48f1-a462-c80b195cb207 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0589337 Nov 24 14:32:31.105363 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-220d522f-3672-4a06-ae51-ee7ccb32774a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0394061 Nov 24 14:32:31.239911 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-da46ad49-52a1-492c-8b36-1ccc6c64de91 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279809 Nov 24 14:32:31.381046 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-9f3f8257-8cad-412e-be15-7b880b5473c4 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1344471 Nov 24 14:32:32.105146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a92de5e-cb8c-4159-8609-871698c0d5fc req-5d1da1c6-2878-4672-9ab0-3d21bee44232 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:32.106569 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1a92de5e-cb8c-4159-8609-871698c0d5fc req-5d1da1c6-2878-4672-9ab0-3d21bee44232 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0788639 Nov 24 14:32:32.153029 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1a92de5e-cb8c-4159-8609-871698c0d5fc req-3d2877cc-8e68-4741-b5ca-610c7e098dec tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409529 Nov 24 14:32:33.283509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c3e20636-acc9-4d56-b43f-b79632fe9232 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:33.355631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ff977a-9984-4040-b6d8-10c7bb1baeda req-bb8bcd25-f124-4a90-8e19-f6d1a1392796 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:33.357104 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f6ff977a-9984-4040-b6d8-10c7bb1baeda req-bb8bcd25-f124-4a90-8e19-f6d1a1392796 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0808914 Nov 24 14:32:33.409500 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f6ff977a-9984-4040-b6d8-10c7bb1baeda req-15a2d309-bcaf-4943-bf4a-0f5bb317aac9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466347 Nov 24 14:32:33.669226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:34.609663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7109ff-2a8b-4516-87d7-0ccd800ecc0f req-c2182a29-a965-4ea8-876a-634bee821646 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:34.611014 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7f7109ff-2a8b-4516-87d7-0ccd800ecc0f req-c2182a29-a965-4ea8-876a-634bee821646 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0790031 Nov 24 14:32:34.659421 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7f7109ff-2a8b-4516-87d7-0ccd800ecc0f req-0ea3a4fd-003b-44e9-93aa-634c7d0612b6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425155 Nov 24 14:32:35.831921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8ddbfebe-297e-4149-9a31-aa35b45b3b0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:35.862422 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff7cc227-91f8-409d-83c8-d2d4f9c70c26 req-5dbb4a72-bf7e-4e92-beda-cd8c83aab2f1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:35.863903 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ff7cc227-91f8-409d-83c8-d2d4f9c70c26 req-5dbb4a72-bf7e-4e92-beda-cd8c83aab2f1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0839334 Nov 24 14:32:35.910802 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ff7cc227-91f8-409d-83c8-d2d4f9c70c26 req-1a2fa82b-111b-41ca-bd65-d3e809a24e6a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412943 Nov 24 14:32:36.854880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:37.208115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7751bc-bbea-47a6-9e44-4a09e31c4dbe req-e30002f7-cab5-4c7e-80f0-12807aafe80b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:37.210445 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-de7751bc-bbea-47a6-9e44-4a09e31c4dbe req-e30002f7-cab5-4c7e-80f0-12807aafe80b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.1792266 Nov 24 14:32:37.258291 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-de7751bc-bbea-47a6-9e44-4a09e31c4dbe req-08fb2d6a-50f0-4cc7-80f2-eff563d4a61f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418344 Nov 24 14:32:38.458269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b986e7-7f57-46d0-a1cb-09d82c7bc384 req-ba08135f-4e55-40ba-a5b1-f4c7deeae7ee tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:38.459707 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b8b986e7-7f57-46d0-a1cb-09d82c7bc384 req-ba08135f-4e55-40ba-a5b1-f4c7deeae7ee tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0827105 Nov 24 14:32:38.505299 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b8b986e7-7f57-46d0-a1cb-09d82c7bc384 req-1638e7a2-e402-4a3a-8a60-7bfd54dcd622 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401354 Nov 24 14:32:38.539302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:39.708077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2b530d-e60c-4e7d-b299-78ef9bfe3b7a req-66473958-82cd-44f6-873c-365d3c995826 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:39.709534 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-df2b530d-e60c-4e7d-b299-78ef9bfe3b7a req-66473958-82cd-44f6-873c-365d3c995826 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0787742 Nov 24 14:32:39.755880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-df2b530d-e60c-4e7d-b299-78ef9bfe3b7a req-9d1a229d-3583-4ab1-9d30-11b4c2e8b510 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408440 Nov 24 14:32:40.962063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f22313-42cb-4988-b298-68f3e7d0a839 req-28851122-1f74-41f4-9bf3-46e1652d2498 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:40.963528 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-98f22313-42cb-4988-b298-68f3e7d0a839 req-28851122-1f74-41f4-9bf3-46e1652d2498 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0767004 Nov 24 14:32:41.010072 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-98f22313-42cb-4988-b298-68f3e7d0a839 req-5522a77e-6bca-4edb-b166-b2acb428ae45 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406661 Nov 24 14:32:42.204944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-665bc6c3-515f-4565-8a10-e836087e614f req-c2523f39-41c1-4c33-ac4a-bde91f735084 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:42.206225 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665bc6c3-515f-4565-8a10-e836087e614f req-c2523f39-41c1-4c33-ac4a-bde91f735084 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0763330 Nov 24 14:32:42.253172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665bc6c3-515f-4565-8a10-e836087e614f req-744733b3-0cb5-41dc-8f28-5133fd164678 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404603 Nov 24 14:32:43.450412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29893921-8de1-4f64-bff8-90f2db8f4d39 req-85af59ed-5d35-45b5-aa74-268066eb71f3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:43.452549 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-29893921-8de1-4f64-bff8-90f2db8f4d39 req-85af59ed-5d35-45b5-aa74-268066eb71f3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0815341 Nov 24 14:32:43.497726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-29893921-8de1-4f64-bff8-90f2db8f4d39 req-ba510b24-3d76-4cae-a7d0-b20e71530b6d tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398772 Nov 24 14:32:44.696679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174e2368-356e-4f47-bea1-5f6c9533e5d7 req-59b12fda-8469-4ead-9cb3-bb49d28e6290 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:44.698361 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-174e2368-356e-4f47-bea1-5f6c9533e5d7 req-59b12fda-8469-4ead-9cb3-bb49d28e6290 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0803246 Nov 24 14:32:44.747861 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-174e2368-356e-4f47-bea1-5f6c9533e5d7 req-1a1c8de2-1738-41de-92d8-c5a494071487 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425780 Nov 24 14:32:45.945188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16293b3a-0c4a-45bb-95cf-dd62e4ec0e4d req-8760d5fe-0fee-40d4-884c-19182f5cf8f4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:45.946635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-16293b3a-0c4a-45bb-95cf-dd62e4ec0e4d req-8760d5fe-0fee-40d4-884c-19182f5cf8f4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0779912 Nov 24 14:32:45.999354 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-16293b3a-0c4a-45bb-95cf-dd62e4ec0e4d req-9e68e72c-b2e4-4b1f-9092-44c50e324707 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441425 Nov 24 14:32:47.200774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3a0bd5-a3fc-47ff-96d2-c9db35a993ff req-30f81b3a-badf-422c-baba-e0df0ed52743 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:47.203160 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d3a0bd5-a3fc-47ff-96d2-c9db35a993ff req-30f81b3a-badf-422c-baba-e0df0ed52743 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0796483 Nov 24 14:32:47.253915 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d3a0bd5-a3fc-47ff-96d2-c9db35a993ff req-7fcb3619-bf6f-4658-aec6-dfbe3a78ba9d tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452356 Nov 24 14:32:48.030149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:32:48.497749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079ec23e-1fc2-4e66-8566-9ad66af7c98e req-ce5aedb0-b64a-417e-a3d8-9c4b57616633 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:48.499894 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-079ec23e-1fc2-4e66-8566-9ad66af7c98e req-ce5aedb0-b64a-417e-a3d8-9c4b57616633 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0826461 Nov 24 14:32:48.546587 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-079ec23e-1fc2-4e66-8566-9ad66af7c98e req-797bd919-4c03-43b7-9fb1-9aa0b29b6ed9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408409 Nov 24 14:32:49.745525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f268fb21-a1ea-4dde-9d94-20a1947b7c37 req-3990d2c2-b1f5-404b-b068-4efad9da7ccf tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:49.746950 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f268fb21-a1ea-4dde-9d94-20a1947b7c37 req-3990d2c2-b1f5-404b-b068-4efad9da7ccf tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0776963 Nov 24 14:32:49.791904 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f268fb21-a1ea-4dde-9d94-20a1947b7c37 req-d62a7673-bb7f-4143-bad9-f6effa0ab6b9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387883 Nov 24 14:32:50.991396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c38e7e6-0471-44fa-9f96-40f84a81c74e req-bf97850a-b809-49f8-934e-cbf71859642e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:50.992841 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5c38e7e6-0471-44fa-9f96-40f84a81c74e req-bf97850a-b809-49f8-934e-cbf71859642e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0789502 Nov 24 14:32:51.037763 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5c38e7e6-0471-44fa-9f96-40f84a81c74e req-ec8a4fa9-31e9-42e5-90e3-a1590d8bf240 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395002 Nov 24 14:32:52.245084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193fadfd-62c0-4ac9-8ff8-4d786f1db34c req-6e20ba21-5d8b-4cc7-8a7c-252cea1f1c96 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:52.246514 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-193fadfd-62c0-4ac9-8ff8-4d786f1db34c req-6e20ba21-5d8b-4cc7-8a7c-252cea1f1c96 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0888600 Nov 24 14:32:52.292115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-193fadfd-62c0-4ac9-8ff8-4d786f1db34c req-4effccfc-b505-4898-95da-4231a874cddd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387490 Nov 24 14:32:53.496184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180f786b-38eb-4599-822b-23eeeaca8ea0 req-77e9b75d-07ce-40ae-9643-6750cdcbdd44 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:53.497526 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-180f786b-38eb-4599-822b-23eeeaca8ea0 req-77e9b75d-07ce-40ae-9643-6750cdcbdd44 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0777965 Nov 24 14:32:53.543141 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-180f786b-38eb-4599-822b-23eeeaca8ea0 req-678504bd-2473-4caf-92aa-d6dac40bd774 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395868 Nov 24 14:32:54.742150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2e5404a-c22a-42aa-b00d-7feef7d536f4 req-a33558b1-d8eb-4a2d-bb2f-c8e81b9b1b94 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:54.743591 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e5404a-c22a-42aa-b00d-7feef7d536f4 req-a33558b1-d8eb-4a2d-bb2f-c8e81b9b1b94 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0777850 Nov 24 14:32:54.790358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c2e5404a-c22a-42aa-b00d-7feef7d536f4 req-cd992129-abbb-4d57-b7df-67b2271cae66 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412710 Nov 24 14:32:56.001152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a29eb56-8628-48c4-9b41-4235a9af9824 req-e74d014c-f90b-4c86-a969-8bbda957fb80 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:56.003260 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1a29eb56-8628-48c4-9b41-4235a9af9824 req-e74d014c-f90b-4c86-a969-8bbda957fb80 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0914891 Nov 24 14:32:56.054488 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1a29eb56-8628-48c4-9b41-4235a9af9824 req-a4fe4304-ff1f-41ca-9d03-725bc0056386 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455465 Nov 24 14:32:57.250738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a92b5a-6a5d-49f4-abd5-410ab9a63a7c req-6f64bf54-fd47-44be-8a85-b172d15f7cba tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:57.252182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6a92b5a-6a5d-49f4-abd5-410ab9a63a7c req-6f64bf54-fd47-44be-8a85-b172d15f7cba tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0797124 Nov 24 14:32:57.296510 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a6a92b5a-6a5d-49f4-abd5-410ab9a63a7c req-17e391ac-ba7f-4aa7-a844-f8f9d2832618 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383487 Nov 24 14:32:58.174848 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-05d8fc5c-7f55-4e5a-89d4-67fdf52bebaf service neutron] 10.222.0.47 "GET /v2.0/ports/f01a5f67-b834-4015-b6d4-1466aef5d8d8/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0731115 Nov 24 14:32:58.601365 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-dc3c1028-c0a3-42f2-8b37-cd4b8564a567 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57&tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2 HTTP/1.1" status: 200 len: 1098 time: 0.2308726 Nov 24 14:32:58.611108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a37c7b8-c7ea-43da-ac71-7a9e04d93b76 req-b965771b-90dd-422b-9542-1f514622250f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:58.612690 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5a37c7b8-c7ea-43da-ac71-7a9e04d93b76 req-b965771b-90dd-422b-9542-1f514622250f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.1013393 Nov 24 14:32:58.707205 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5a37c7b8-c7ea-43da-ac71-7a9e04d93b76 req-7bdd01c0-324c-4dde-b4e9-0aa348b1cc48 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882964 Nov 24 14:32:58.729099 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-71828eb2-f175-47d6-a07a-27089aa7ac56 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1098 time: 0.0932446 Nov 24 14:32:58.859007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-752ffc3c-568b-4885-9221-17f366b83906 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:58.860367 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-752ffc3c-568b-4885-9221-17f366b83906 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1243479 Nov 24 14:32:58.930222 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-8d446f61-8603-4a7d-8fce-f43efa6e701f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 217 time: 0.0629790 Nov 24 14:32:58.991241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-4505d356-5700-4422-8de5-ff4df9d1e640 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:58.992626 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-4505d356-5700-4422-8de5-ff4df9d1e640 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0566902 Nov 24 14:32:59.037110 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-539bbcf0-1832-422d-8a6a-e8694ee49840 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381925 Nov 24 14:32:59.165193 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-72b1102f-7d7a-4ca4-9360-aaecd11fe81c service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213710 Nov 24 14:32:59.294749 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c756788e-5f6f-42c7-929a-7bacaed9c595 req-5194a689-8ed0-41c3-819c-f67fcd3d2c48 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1231742 Nov 24 14:32:59.822053 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:32:59.904775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81a9d94-e7d2-40b5-a1eb-c0f47714e0c0 req-9a9edd2a-ff9c-4ff5-9742-df7ddf26ec3c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:32:59.906207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b81a9d94-e7d2-40b5-a1eb-c0f47714e0c0 req-9a9edd2a-ff9c-4ff5-9742-df7ddf26ec3c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0789104 Nov 24 14:32:59.955627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b81a9d94-e7d2-40b5-a1eb-c0f47714e0c0 req-7054bec7-b0f9-4505-a78a-80b3454ecf4f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439999 Nov 24 14:33:01.155074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abf6505-78d2-48fc-bf33-40eb60ae5c31 req-3a4ec10f-ba8d-4333-8979-3fd19adb782e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:01.156539 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1abf6505-78d2-48fc-bf33-40eb60ae5c31 req-3a4ec10f-ba8d-4333-8979-3fd19adb782e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0807953 Nov 24 14:33:01.201241 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1abf6505-78d2-48fc-bf33-40eb60ae5c31 req-724989e6-b9ee-4527-827c-3ea80a748eb7 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383885 Nov 24 14:33:02.402864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162b57da-ebfb-483c-b9ae-8315c7434397 req-d297b40f-643c-40aa-b894-f95202efd5c6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:02.404298 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-162b57da-ebfb-483c-b9ae-8315c7434397 req-d297b40f-643c-40aa-b894-f95202efd5c6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0754290 Nov 24 14:33:02.449534 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-162b57da-ebfb-483c-b9ae-8315c7434397 req-a45f6e52-e194-47e4-b1b2-246f1a4123f9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397589 Nov 24 14:33:02.770435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:33:02.776363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:33:02.781092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-6a573047-55c1-4180-b52a-8874e52d394b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:02.781557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1a1f5a-515a-47d3-b2ab-ab9ed98f26f2 req-393973d5-4198-445f-b677-065d1041dbdf tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:02.782539 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-6a573047-55c1-4180-b52a-8874e52d394b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57&tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 945 time: 0.0882673 Nov 24 14:33:02.782659 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4f1a1f5a-515a-47d3-b2ab-ab9ed98f26f2 req-393973d5-4198-445f-b677-065d1041dbdf tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0809047 Nov 24 14:33:02.831799 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4f1a1f5a-515a-47d3-b2ab-ab9ed98f26f2 req-817375a7-e49f-4710-abdc-111c567d41a4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414932 Nov 24 14:33:02.948290 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-bcf82606-1a1a-4934-9ecc-df2e32057d80 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1098 time: 0.0725684 Nov 24 14:33:03.006053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.023659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:03.043331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'port_id': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'mac_address': 'fa:16:3e:51:45:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 878, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b4ba849b-41c2-4950-afe6-1c8c8cba2254', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:33:03.048342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:03.081522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-e0d93bb5-7174-408f-ae8d-3e563a79ece7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:03.083490 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-e0d93bb5-7174-408f-ae8d-3e563a79ece7 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1292095 Nov 24 14:33:03.090271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:03.099263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.102299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:03.140012 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'code': 200} Nov 24 14:33:03.154580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-1f856f1d-ee28-468e-8798-d0a0bc98dfe2 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 217 time: 0.0652862 Nov 24 14:33:03.154852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.183950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id f01a5f67-b834-4015-b6d4-1466aef5d8d8 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:33:03.219911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-1c4876d8-9988-4a25-9148-580b26b360fb service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:03.221346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-1c4876d8-9988-4a25-9148-580b26b360fb service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0604758 Nov 24 14:33:03.230805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:03.235378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:03.252714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:33:03.253078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:33:03.269143 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-1553f136-8967-4583-b857-22fd9f04d4e7 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0418334 Nov 24 14:33:03.283734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20119489-81c0-43f8-98c8-7b7d8e59810f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.407778 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-b40d8789-fadb-43de-8d66-87060ff52434 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313410 Nov 24 14:33:03.643397 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-397e3bfa-1c30-47d8-bac2-87195fc53ed8 req-0ab5e3c5-36e2-43ed-bfa2-7edd80bfda5b service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2290161 Nov 24 14:33:03.673311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.809334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.826464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f01a5f67-b834-4015-b6d4-1466aef5d8d8 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:33:03.841444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:03.845056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:03.846721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:03.907661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f01a5f67-b834-4015-b6d4-1466aef5d8d8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:33:03.950453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:03.955385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:04.042547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437bdfa2-0eda-4062-9446-f890ec101bc2 req-a9bf8cc7-0c54-4477-98a3-2af0a2500940 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:04.048347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-437bdfa2-0eda-4062-9446-f890ec101bc2 req-a9bf8cc7-0c54-4477-98a3-2af0a2500940 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 944 time: 0.0865099 Nov 24 14:33:04.096313 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-437bdfa2-0eda-4062-9446-f890ec101bc2 req-1679e9e6-4b78-427a-a4c0-91d75788dc18 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457358 Nov 24 14:33:04.784394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:33:04.853128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port f01a5f67-b834-4015-b6d4-1466aef5d8d8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:33:04.853806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:04.964404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:04.996175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:05.000299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:05.002139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:05.068888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:05.076995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.077341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.077679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.078011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.078341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.078667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.078989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.079311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.079632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.079974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.080292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:05.084112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:05.141084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:05.195203 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'code': 200} Nov 24 14:33:05.298179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf380bb-385d-436e-b4a1-2f47942f037b req-6945670f-60ff-43cf-a06c-c87e2bfd50be tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:05.299614 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fcf380bb-385d-436e-b4a1-2f47942f037b req-6945670f-60ff-43cf-a06c-c87e2bfd50be tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0806677 Nov 24 14:33:05.344499 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fcf380bb-385d-436e-b4a1-2f47942f037b req-17fa5d22-3daa-4105-8aea-26ca9475dbf5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385039 Nov 24 14:33:05.546315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59061aaa-b545-460c-8599-6e53713b7eee req-62eff019-912e-4814-a041-5ead5c75f54c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:05.547742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-59061aaa-b545-460c-8599-6e53713b7eee req-62eff019-912e-4814-a041-5ead5c75f54c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0798929 Nov 24 14:33:05.592300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-59061aaa-b545-460c-8599-6e53713b7eee req-409f7679-78fd-49df-ba35-2658e031a596 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388873 Nov 24 14:33:05.787535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df62f9fa-7ad2-46ec-b472-d39df2510572 req-5757cfd5-b7fe-4124-ba11-c56cc38ab040 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:05.789009 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-df62f9fa-7ad2-46ec-b472-d39df2510572 req-5757cfd5-b7fe-4124-ba11-c56cc38ab040 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.0765777 Nov 24 14:33:05.834849 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-df62f9fa-7ad2-46ec-b472-d39df2510572 req-bc3bff53-b12f-4c7e-87d3-07746d5c1595 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403876 Nov 24 14:33:05.835050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d44ebfb5-4cf5-4726-a2e9-a1c18998e747 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:05.953779 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-d217e34d-d04f-49f5-b986-46ebe8e9a71a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0717578 Nov 24 14:33:06.110987 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-acd051ec-6d27-4003-9fed-307cf7efb3d9 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 1098 time: 0.0831926 Nov 24 14:33:06.359990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-3e3ce943-4a51-421e-9f55-45a7ae3fc996 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:06.361490 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-3e3ce943-4a51-421e-9f55-45a7ae3fc996 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.2272768 Nov 24 14:33:06.451376 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-3b500fb7-7018-4a12-8d7b-aa99f6a0cdf2 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 200 len: 217 time: 0.0770979 Nov 24 14:33:06.463290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daad0364-1815-435e-8667-193a00448ecc req-f7677562-7924-4a33-a4c4-cd8a0d940158 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:06.464655 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-f7677562-7924-4a33-a4c4-cd8a0d940158 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 815 time: 0.2505193 Nov 24 14:33:06.524728 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-08c42676-9e30-4ae0-b296-037d3c1037d1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/quotas/ca3b7e56bf0b41b788c8d342a40f91e2 HTTP/1.1" status: 200 len: 375 time: 0.0295088 Nov 24 14:33:06.563896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-9b17161b-4b4e-4460-9f89-95b4356eefa2 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:06.565222 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-9b17161b-4b4e-4460-9f89-95b4356eefa2 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.1068616 Nov 24 14:33:06.618929 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-511bdb4f-de49-44ea-a3f2-15c8be1dcd75 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0429184 Nov 24 14:33:06.738652 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-a65e2537-6ea7-4ca3-9e60-9d3753aee272 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2067275 Nov 24 14:33:06.841821 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-06cb5fca-4964-45b5-828a-c902556dcb21 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2147496 Nov 24 14:33:06.858736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:06.985186 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-4270c5d7-348a-4ea4-86cc-952bf0dad64e service neutron] 10.222.0.70 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2319617 Nov 24 14:33:07.092564 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70e5a27c-3a6c-4bd2-a6e0-2f81edf6d0ec req-1fd45a64-4c67-4838-ba10-a3ffb237d4bc service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2409577 Nov 24 14:33:07.146386 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-9334a064-4bdf-49c3-b001-de2cd342d7fc service neutron] 10.222.0.70 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1488879 Nov 24 14:33:07.340157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-19d0057e-9f62-44c7-b154-01f4db220c3b req-1d48f235-45df-4b4c-8234-2b4c71a2ecb3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 210 time: 0.0455780 Nov 24 14:33:08.219374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-bc6ed995-70ab-457b-9057-6d0ed339f6b3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:08.221486 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-bc6ed995-70ab-457b-9057-6d0ed339f6b3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "GET /v2.0/ports?device_id=bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57 HTTP/1.1" status: 200 len: 945 time: 0.1928627 Nov 24 14:33:08.301597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Deleting port f01a5f67-b834-4015-b6d4-1466aef5d8d8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:33:08.301940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:08.372623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daad0364-1815-435e-8667-193a00448ecc req-d7f76b7d-7fc3-4570-89a2-28a9fc2dfe35 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:08.374279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-d7f76b7d-7fc3-4570-89a2-28a9fc2dfe35 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 815 time: 0.1838696 Nov 24 14:33:08.392323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Request body: {'port': {'device_id': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'admin_state_up': True, 'tenant_id': 'ca3b7e56bf0b41b788c8d342a40f91e2'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:33:08.544371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:08.572141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:33:08.580842 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1c302e5d-8c14-41c1-99ac-ae6730c51c83 req-7c597d73-9394-4c04-9c0a-3113207c5944 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 210 time: 0.0604415 Nov 24 14:33:08.583152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:33:08.594688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Made reservation on behalf of ca3b7e56bf0b41b788c8d342a40f91e2 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:33:08.599729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:08.658012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] For port f01a5f67-b834-4015-b6d4-1466aef5d8d8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=f01a5f67-b834-4015-b6d4-1466aef5d8d8,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:08.658367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:08.818703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Calling delete_port for f01a5f67-b834-4015-b6d4-1466aef5d8d8 owned by compute:nova {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:33:08.914771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Allocated IP 172.20.0.6 (9b3f1177-cd3c-4da4-b261-e444d32d8295/b4ba849b-41c2-4950-afe6-1c8c8cba2254/431fd986-1577-458e-9d2d-7caa85348ec7) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:33:08.981270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:08.988675 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b34ac840-5af1-48d1-9133-116fd3864903 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:08.993190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f01a5f67-b834-4015-b6d4-1466aef5d8d8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:33:09.040232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Pushing event deleted for resources: {'Port': ['ID=f01a5f67-b834-4015-b6d4-1466aef5d8d8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:09.053294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.053737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.054117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.054487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.054852 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.055223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.055579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.055968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.056324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.057238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.057238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.084901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:09.129183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] No DVR routers for this DVR port f01a5f67-b834-4015-b6d4-1466aef5d8d8 on host hv-neutron-8181 {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:33:09.131693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.134424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-deleted', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:09.150981 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "DELETE /v2.0/ports/f01a5f67-b834-4015-b6d4-1466aef5d8d8 HTTP/1.1" status: 204 len: 173 time: 0.9235933 Nov 24 14:33:09.165475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.199874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.202079 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd3b0fdf-4e63-4061-b0e1-c93a0aa4cf57', 'name': 'network-vif-deleted', 'tag': 'f01a5f67-b834-4015-b6d4-1466aef5d8d8', 'status': 'completed', 'code': 200} Nov 24 14:33:09.205837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:09.216098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['f01a5f67-b834-4015-b6d4-1466aef5d8d8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:33:09.273098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:09.289223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.289614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.289990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.290360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.290772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.291130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.291496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.291910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.292296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.292664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.293025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:33:09.297439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:09.302122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Network 9b3f1177-cd3c-4da4-b261-e444d32d8295 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:33:09.304043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:33:09.306257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:33:09.365940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:09.366542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.389623 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0020115 Nov 24 14:33:09.401620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Request body: {'port': {'device_id': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:33:09.510301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.804294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0e395d-4267-46a0-b037-e00494537dce req-84534c2a-b1b0-4d9e-990f-b59191dfd744 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:09.804997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-7a0e395d-4267-46a0-b037-e00494537dce req-84534c2a-b1b0-4d9e-990f-b59191dfd744 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Synchronizing usage tracker for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:33:09.822038 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-7a0e395d-4267-46a0-b037-e00494537dce req-84534c2a-b1b0-4d9e-990f-b59191dfd744 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Unset dirty status for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:33:09.823238 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a0e395d-4267-46a0-b037-e00494537dce req-84534c2a-b1b0-4d9e-990f-b59191dfd744 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 931 time: 0.1076746 Nov 24 14:33:09.870469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a0e395d-4267-46a0-b037-e00494537dce req-94414755-579d-4268-a830-772a832a94a0 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414016 Nov 24 14:33:09.891536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 431fd986-1577-458e-9d2d-7caa85348ec7 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:33:09.898837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.913062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Transition to ACTIVE for port object 431fd986-1577-458e-9d2d-7caa85348ec7 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:33:09.916097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:09.920069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7ab38bf0-8d99-4aee-a96a-aa2a65e7b800 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:10.039384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:10.042259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:10.141494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Attempting to bind port 431fd986-1577-458e-9d2d-7caa85348ec7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:33:10.141736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Attempting to bind port 431fd986-1577-458e-9d2d-7caa85348ec7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:33:10.142054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Attempting to bind port 431fd986-1577-458e-9d2d-7caa85348ec7 on network 9b3f1177-cd3c-4da4-b261-e444d32d8295 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:33:10.148804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Port 431fd986-1577-458e-9d2d-7caa85348ec7 on network 9b3f1177-cd3c-4da4-b261-e444d32d8295 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:33:10.149115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Attempting to bind port 431fd986-1577-458e-9d2d-7caa85348ec7 on network 9b3f1177-cd3c-4da4-b261-e444d32d8295 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:33:10.155062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 32, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:33:10.155392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Checking segment: {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:33:10.155775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Bound using segment: {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:33:10.156204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Bound port: 431fd986-1577-458e-9d2d-7caa85348ec7, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a88edde9-5439-4663-b6c1-764715ef7871', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:33:10.156540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:10.245352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:33:10.248658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:33:10.252709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:10.257509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-01ba4cde-532d-4292-bda0-77ce63198867 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:10.317911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:10.319253 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] 10.222.0.47 "PUT /v2.0/ports/431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 200 len: 1093 time: 0.9216182 Nov 24 14:33:10.319775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:10.336179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:10.339137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:10.394699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7', 'status': 'completed', 'code': 200} Nov 24 14:33:10.429010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-437d3470-8807-4a1e-93c7-9bdcc9c84282 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 1096 time: 0.0727704 Nov 24 14:33:10.500259 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-21d9d74b-cab0-4efb-b0dd-67cb314df76d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 200 len: 217 time: 0.0638561 Nov 24 14:33:10.562719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daad0364-1815-435e-8667-193a00448ecc req-4d93a091-e799-45b6-b22d-544b90cb818c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:10.564183 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-4d93a091-e799-45b6-b22d-544b90cb818c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0584979 Nov 24 14:33:10.608582 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-97cca9a0-729e-40ab-8c2b-f34c04c1b875 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0379493 Nov 24 14:33:10.736907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-e173d9d2-ac94-41a3-88d1-f3d6fab05b8b service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1217067 Nov 24 14:33:10.958083 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-daad0364-1815-435e-8667-193a00448ecc req-995a3639-b259-4f9e-8aa2-cc6e4d64a336 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2149873 Nov 24 14:33:11.073785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63547a7e-da4d-4048-8e6e-078c65ed8c60 req-3c36f79b-d859-4324-abd3-4a24fce529d6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:11.075205 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-63547a7e-da4d-4048-8e6e-078c65ed8c60 req-3c36f79b-d859-4324-abd3-4a24fce529d6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 943 time: 0.0790625 Nov 24 14:33:11.077721 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-f274093c-52c1-43eb-b135-cab259470bab service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 1096 time: 0.0713298 Nov 24 14:33:11.132843 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-63547a7e-da4d-4048-8e6e-078c65ed8c60 req-57dae08e-864d-411e-b755-758781faa97f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519712 Nov 24 14:33:11.211487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-a7837b24-e3a9-429e-b39a-155c4aa4dd97 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:11.212951 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-a7837b24-e3a9-429e-b39a-155c4aa4dd97 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1291058 Nov 24 14:33:11.279287 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-be62028c-b13b-4878-a2b2-5f99c0c26f5e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 200 len: 217 time: 0.0592291 Nov 24 14:33:11.344180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-3bc8a5bb-65e8-4ed8-8a3b-9a8248663034 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:11.345498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-3bc8a5bb-65e8-4ed8-8a3b-9a8248663034 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0598021 Nov 24 14:33:11.389677 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-4cc1b9be-8f0c-43bc-a252-3611f0e1559f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381229 Nov 24 14:33:11.525041 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-469de98f-2c81-416e-b322-78772a05ff4e service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1287563 Nov 24 14:33:11.654648 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bf067a7a-58bc-44af-9e25-8bb5d406aeeb req-7514a435-0cd9-4ec4-939f-25bf2f505740 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1221571 Nov 24 14:33:12.332717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a40e4bd-677a-4b43-9c77-ab6b661e7700 req-25948ef1-3c66-4191-9418-4df44ff8276c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:12.333394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9a40e4bd-677a-4b43-9c77-ab6b661e7700 req-25948ef1-3c66-4191-9418-4df44ff8276c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Synchronizing usage tracker for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:33:12.345254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9a40e4bd-677a-4b43-9c77-ab6b661e7700 req-25948ef1-3c66-4191-9418-4df44ff8276c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Unset dirty status for tenant:ca3b7e56bf0b41b788c8d342a40f91e2 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:33:12.346316 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9a40e4bd-677a-4b43-9c77-ab6b661e7700 req-25948ef1-3c66-4191-9418-4df44ff8276c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 943 time: 0.0932662 Nov 24 14:33:12.391443 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9a40e4bd-677a-4b43-9c77-ab6b661e7700 req-8c126f8e-050e-4498-a55c-907c4ca684d7 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389678 Nov 24 14:33:12.800109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:33:12.836410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: f01a5f67-b834-4015-b6d4-1466aef5d8d8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:33:12.836754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device f01a5f67-b834-4015-b6d4-1466aef5d8d8 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:33:13.584703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0d5d64-4166-41bb-99e2-0e06c3920258 req-9f6dfb58-2b1f-4c48-a2c4-42208e9f800a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:13.586054 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dc0d5d64-4166-41bb-99e2-0e06c3920258 req-9f6dfb58-2b1f-4c48-a2c4-42208e9f800a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 943 time: 0.0754502 Nov 24 14:33:13.633287 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dc0d5d64-4166-41bb-99e2-0e06c3920258 req-1b8c81d6-71cb-46a7-a5db-ca5b4876be9f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418611 Nov 24 14:33:14.815240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:33:14.825956 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672c3de1-7039-410f-9989-cda676d26098 req-90929467-d76c-4142-8eab-7e4d39d4505e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:14.827374 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-672c3de1-7039-410f-9989-cda676d26098 req-90929467-d76c-4142-8eab-7e4d39d4505e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 943 time: 0.0760567 Nov 24 14:33:14.874039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-672c3de1-7039-410f-9989-cda676d26098 req-a85015eb-634f-4f00-ac7e-8580dca0bb4b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410414 Nov 24 14:33:14.948036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:14.960757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '431fd986-1577-458e-9d2d-7caa85348ec7', 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'port_id': '431fd986-1577-458e-9d2d-7caa85348ec7', 'mac_address': 'fa:16:3e:0c:f9:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 878, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b4ba849b-41c2-4950-afe6-1c8c8cba2254', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:33:15.013969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:15.030645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 431fd986-1577-458e-9d2d-7caa85348ec7 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:33:15.045923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:15.049272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:15.051569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:15.116647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:15.119512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:15.372478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['431fd986-1577-458e-9d2d-7caa85348ec7'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:33:16.070318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e74aee2-6c56-4db5-b478-61862a730072 req-3a07ebf7-ac17-4c15-9c2a-79a4cb3932b7 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:16.071723 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1e74aee2-6c56-4db5-b478-61862a730072 req-3a07ebf7-ac17-4c15-9c2a-79a4cb3932b7 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 944 time: 0.0806952 Nov 24 14:33:16.116902 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1e74aee2-6c56-4db5-b478-61862a730072 req-c6214947-fedb-4de7-bc3a-e5ba115e6181 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397069 Nov 24 14:33:16.837866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:33:16.909253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 431fd986-1577-458e-9d2d-7caa85348ec7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:33:16.914963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 431fd986-1577-458e-9d2d-7caa85348ec7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:33:16.915411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:17.027389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:17.053249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:17.062531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:17.066486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:17.068454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:17.115169 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7', 'code': 200} Nov 24 14:33:17.139317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:17.142345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:17.320081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53f20ead-efbe-4658-a1ac-33963176cf14 req-08816726-24e3-4324-8fee-cca2f479e9cb tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:17.321543 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-53f20ead-efbe-4658-a1ac-33963176cf14 req-08816726-24e3-4324-8fee-cca2f479e9cb tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0789313 Nov 24 14:33:17.354396 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-010986da-0da8-487f-a625-6aa0717e1218 req-7b3118d2-da32-48a9-a1cb-c5782a81425a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 1098 time: 0.0781295 Nov 24 14:33:17.373796 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-53f20ead-efbe-4658-a1ac-33963176cf14 req-33239dc5-bfe3-4c7f-80f6-b2cf4d459ff9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467031 Nov 24 14:33:17.399103 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-010986da-0da8-487f-a625-6aa0717e1218 req-df050c7b-4a0e-475f-8983-dae22211e014 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380759 Nov 24 14:33:18.038842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:18.573742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dd0537-00f2-49c4-a94a-8e0ae4579be6 req-19cee677-27e6-4404-b97d-6911451facca tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:18.575173 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41dd0537-00f2-49c4-a94a-8e0ae4579be6 req-19cee677-27e6-4404-b97d-6911451facca tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0770714 Nov 24 14:33:18.620825 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-41dd0537-00f2-49c4-a94a-8e0ae4579be6 req-149c20f3-41f9-4ca3-9b20-c663d0932ecd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402188 Nov 24 14:33:19.824607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06cd2b7b-483a-4f51-9f20-916936bc4141 req-e24e3e53-f8b9-438a-b848-40af84f18f63 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:19.826040 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-06cd2b7b-483a-4f51-9f20-916936bc4141 req-e24e3e53-f8b9-438a-b848-40af84f18f63 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0817912 Nov 24 14:33:19.870339 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-06cd2b7b-483a-4f51-9f20-916936bc4141 req-637e00d5-ccfb-4425-9941-12b8e82cb7f2 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389123 Nov 24 14:33:20.068475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08dba750-4c28-4db8-8f45-053f57af0901 req-51c56c94-5d61-4b7b-abf5-9e8016fab437 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:20.069907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-08dba750-4c28-4db8-8f45-053f57af0901 req-51c56c94-5d61-4b7b-abf5-9e8016fab437 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0783803 Nov 24 14:33:20.115097 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-08dba750-4c28-4db8-8f45-053f57af0901 req-2260f5d1-96a2-4956-b264-da5632ac2185 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398123 Nov 24 14:33:20.306922 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-70523f12-12e1-47ad-a806-b8d9bb143bf3 req-bcb14b07-ceef-4839-a671-77eeaa158793 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0684769 Nov 24 14:33:20.600254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-a0846945-c2b6-4616-9e27-1ab861249867 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1146457 Nov 24 14:33:20.631106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f068aacf-cc53-4d42-9293-45406c1a3597 req-2c8c09eb-c633-4bfb-abec-cba4b9ac90f1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:20.632699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f068aacf-cc53-4d42-9293-45406c1a3597 req-2c8c09eb-c633-4bfb-abec-cba4b9ac90f1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0919466 Nov 24 14:33:20.681055 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f068aacf-cc53-4d42-9293-45406c1a3597 req-4ceae292-011d-42be-8423-8b5fcc24c8b5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424895 Nov 24 14:33:21.734690 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-c70c5451-b72a-433a-94d2-c312910bed66 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 1098 time: 0.0722003 Nov 24 14:33:21.875208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-45449091-2314-4aff-8fd0-e9ac437e5fa0 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:21.876694 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-45449091-2314-4aff-8fd0-e9ac437e5fa0 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1360888 Nov 24 14:33:21.904931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-602a52ff-98ee-4793-a8fd-1287da1f8e8e req-493caf27-09cf-4a8a-9f53-34296c2e3dbd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:21.906434 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-602a52ff-98ee-4793-a8fd-1287da1f8e8e req-493caf27-09cf-4a8a-9f53-34296c2e3dbd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0853961 Nov 24 14:33:21.955152 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-602a52ff-98ee-4793-a8fd-1287da1f8e8e req-ffa12df8-abfe-482d-8afa-5089bd956ffb tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420783 Nov 24 14:33:22.043227 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-5fa0cc6a-db4f-4f27-9745-005bd102b774 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 200 len: 217 time: 0.1605210 Nov 24 14:33:22.106874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-27bea8b7-d173-44c3-ada3-83edd6a87591 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:22.108292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-27bea8b7-d173-44c3-ada3-83edd6a87591 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0585132 Nov 24 14:33:22.152609 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-464629a6-9b9c-4ab0-9bb9-124fb029d502 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0377743 Nov 24 14:33:22.284758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-01af083b-997f-4f10-8373-60e6a48526b8 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1258452 Nov 24 14:33:22.417019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-e28878b6-77fe-4072-becf-ec0d094fbc86 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1264842 Nov 24 14:33:23.166611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a60e65-308b-4778-84f7-14bd2ede7683 req-ea4e65e5-54d8-4a30-90ac-e0d9e038b119 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:23.168397 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b6a60e65-308b-4778-84f7-14bd2ede7683 req-ea4e65e5-54d8-4a30-90ac-e0d9e038b119 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0887027 Nov 24 14:33:23.215337 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b6a60e65-308b-4778-84f7-14bd2ede7683 req-56fee6f3-70a9-4a8f-a137-bc69d7490077 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414391 Nov 24 14:33:24.430829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c91b5f-2544-414a-b788-7595ee6564a0 req-44609ea3-452f-4157-be83-26ec1ef5b65e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:24.432281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a5c91b5f-2544-414a-b788-7595ee6564a0 req-44609ea3-452f-4157-be83-26ec1ef5b65e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0755677 Nov 24 14:33:24.477316 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a5c91b5f-2544-414a-b788-7595ee6564a0 req-06aa94b1-1d11-4620-8c8e-884cd1779ba1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396583 Nov 24 14:33:25.673093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841cfbb1-75e0-432e-8773-6b96f78cfb01 req-98f16c6f-0626-49c7-ab31-e670ddc24afa tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:25.674514 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-841cfbb1-75e0-432e-8773-6b96f78cfb01 req-98f16c6f-0626-49c7-ab31-e670ddc24afa tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0775306 Nov 24 14:33:25.718946 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-841cfbb1-75e0-432e-8773-6b96f78cfb01 req-382ebe98-dc6c-4a1c-b3da-0b6204360f6e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389032 Nov 24 14:33:27.170432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57114e36-38bf-423a-a687-08bd43708fe9 req-35e4f5d2-dd61-439a-8e4b-48a9fc6890d2 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:27.171881 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-57114e36-38bf-423a-a687-08bd43708fe9 req-35e4f5d2-dd61-439a-8e4b-48a9fc6890d2 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.1835778 Nov 24 14:33:27.217362 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-57114e36-38bf-423a-a687-08bd43708fe9 req-6462ce2f-8f60-479e-8cd4-1bf1df14e357 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401301 Nov 24 14:33:28.416704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06479b5-1c7a-40db-a800-d117bea9194d req-bd798c5a-8cbe-4bfc-9d39-9b05589618b5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:28.418130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a06479b5-1c7a-40db-a800-d117bea9194d req-bd798c5a-8cbe-4bfc-9d39-9b05589618b5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0812736 Nov 24 14:33:28.462558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a06479b5-1c7a-40db-a800-d117bea9194d req-22c46e5d-72c1-4705-9a4c-f7ed5df252bb tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389140 Nov 24 14:33:29.663185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca431cf-4c0f-42fb-a548-21ed591792c5 req-0303b430-a665-4343-8c32-2d01cb00b146 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:29.664659 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cca431cf-4c0f-42fb-a548-21ed591792c5 req-0303b430-a665-4343-8c32-2d01cb00b146 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0823371 Nov 24 14:33:29.710462 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cca431cf-4c0f-42fb-a548-21ed591792c5 req-38dfec44-a4fb-4ec4-b06c-e9eca9af92dd tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402939 Nov 24 14:33:31.062088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de40d73-1a95-4d41-9201-a40c20624e53 req-6c11d605-31dd-4a56-b9ea-9ca444cca91e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:31.063431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7de40d73-1a95-4d41-9201-a40c20624e53 req-6c11d605-31dd-4a56-b9ea-9ca444cca91e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0778039 Nov 24 14:33:31.107405 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7de40d73-1a95-4d41-9201-a40c20624e53 req-95e19167-9a8d-4ae7-80ea-3ab514e77f79 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380416 Nov 24 14:33:32.304525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9cb127b-0dae-4fec-bd31-3691a6236920 req-01e51163-8a21-4564-907c-623d366daab3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:32.305968 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e9cb127b-0dae-4fec-bd31-3691a6236920 req-01e51163-8a21-4564-907c-623d366daab3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0785642 Nov 24 14:33:32.351025 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e9cb127b-0dae-4fec-bd31-3691a6236920 req-39c0c929-59b5-49aa-99b9-685fc7fb9235 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395482 Nov 24 14:33:33.278367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-efd658fe-e179-4c12-abcf-75f0b1e27324 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:33.550700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e01745-dc36-488e-836d-e862620a51cc req-6a0efd4d-2865-40dc-914b-d3a452ba2ba0 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:33.552043 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63e01745-dc36-488e-836d-e862620a51cc req-6a0efd4d-2865-40dc-914b-d3a452ba2ba0 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0822337 Nov 24 14:33:33.598456 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63e01745-dc36-488e-836d-e862620a51cc req-1864391f-1d24-451a-8002-914ab24df471 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403526 Nov 24 14:33:33.675057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:34.800216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233a5aff-aebb-4012-92fe-a0f4e79189bd req-bb087297-624d-49ec-9881-123324057f43 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:34.801660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-233a5aff-aebb-4012-92fe-a0f4e79189bd req-bb087297-624d-49ec-9881-123324057f43 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0815825 Nov 24 14:33:34.847583 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-233a5aff-aebb-4012-92fe-a0f4e79189bd req-c9896aad-a514-4288-a7ba-bf0791927424 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402932 Nov 24 14:33:35.837355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a01e1f40-c376-4202-8513-cf96b849a997 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:36.038952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-342f14d3-96c1-4d93-9816-55d625277b87 req-7f276f8c-1678-42bf-ad76-bb1141e3c6f2 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:36.040404 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-342f14d3-96c1-4d93-9816-55d625277b87 req-7f276f8c-1678-42bf-ad76-bb1141e3c6f2 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0757592 Nov 24 14:33:36.089070 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-342f14d3-96c1-4d93-9816-55d625277b87 req-75aa3fd9-bf03-46b9-8e13-75830c47f95d tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416644 Nov 24 14:33:36.822075 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:33:36.859165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:37.296165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35067892-da43-4542-938f-79bfc1966fbf req-07a73410-a8f9-4fbd-af7e-a3f9fcdf2848 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:37.297593 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-35067892-da43-4542-938f-79bfc1966fbf req-07a73410-a8f9-4fbd-af7e-a3f9fcdf2848 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0794101 Nov 24 14:33:37.344776 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-35067892-da43-4542-938f-79bfc1966fbf req-ce5773f3-947f-44a7-91be-313c5baacd6c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415299 Nov 24 14:33:38.545556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3902b8c-37df-489b-97f5-0ce1dab1e8a1 req-d7cf70ea-d21b-48c3-8626-98545b24ccc9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:38.546868 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b3902b8c-37df-489b-97f5-0ce1dab1e8a1 req-d7cf70ea-d21b-48c3-8626-98545b24ccc9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0796349 Nov 24 14:33:38.547134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:38.593935 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b3902b8c-37df-489b-97f5-0ce1dab1e8a1 req-c51c69e7-4162-4d4b-9a49-1235c2df99c4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412688 Nov 24 14:33:39.803726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d0521d-d4a6-4956-8fa2-4cb9c2a687cb req-1f745ac2-8bb8-4eac-934c-90b709e8b876 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:39.805169 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d7d0521d-d4a6-4956-8fa2-4cb9c2a687cb req-1f745ac2-8bb8-4eac-934c-90b709e8b876 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0801983 Nov 24 14:33:39.858099 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d7d0521d-d4a6-4956-8fa2-4cb9c2a687cb req-d4f9089b-b08f-4ce2-8ce6-f024d1fab777 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451515 Nov 24 14:33:41.068537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f906cd-d128-4a83-99b8-28f74517b5e4 req-d9167245-74b6-4845-9c4a-6b83a6e0d1cb tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:41.069961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c5f906cd-d128-4a83-99b8-28f74517b5e4 req-d9167245-74b6-4845-9c4a-6b83a6e0d1cb tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0808399 Nov 24 14:33:41.115534 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c5f906cd-d128-4a83-99b8-28f74517b5e4 req-76bfe169-38dc-4e82-b41a-4a7d2341939c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394759 Nov 24 14:33:42.326868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d495141-4082-443a-9c5d-ea8919fea6c8 req-0d90761c-24c9-4df1-bf8d-f30a373ec9f6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:42.328361 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1d495141-4082-443a-9c5d-ea8919fea6c8 req-0d90761c-24c9-4df1-bf8d-f30a373ec9f6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0786676 Nov 24 14:33:42.380363 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1d495141-4082-443a-9c5d-ea8919fea6c8 req-de27ecef-cf65-46c5-b9c7-58fe21f970a9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463991 Nov 24 14:33:43.578202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63bec4c2-b055-48e1-b897-9a261cdd9a79 req-b715517b-5a75-449f-82ce-21e7096251b6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:43.579509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63bec4c2-b055-48e1-b897-9a261cdd9a79 req-b715517b-5a75-449f-82ce-21e7096251b6 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0780475 Nov 24 14:33:43.627268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63bec4c2-b055-48e1-b897-9a261cdd9a79 req-42d31a62-ee4e-4748-8811-3bda5e7fba05 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415549 Nov 24 14:33:44.821854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a552a77-8c7b-4c65-8633-9d559122f8ed req-9a97dc50-8bca-4359-b3b9-2e2678bf8a94 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:44.823273 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a552a77-8c7b-4c65-8633-9d559122f8ed req-9a97dc50-8bca-4359-b3b9-2e2678bf8a94 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0761869 Nov 24 14:33:44.867979 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a552a77-8c7b-4c65-8633-9d559122f8ed req-2cb03895-3d37-4734-ae6b-fe74bbf8cb5c tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389876 Nov 24 14:33:46.069280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-885a3798-571d-4985-8a45-b8e82067fc88 req-b2046bd8-0528-418c-a5df-56d685cb446a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:46.070711 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-885a3798-571d-4985-8a45-b8e82067fc88 req-b2046bd8-0528-418c-a5df-56d685cb446a tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0811148 Nov 24 14:33:46.115432 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-885a3798-571d-4985-8a45-b8e82067fc88 req-114c1528-cb7d-44b7-92e5-d96acfeeb25f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386970 Nov 24 14:33:47.315146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc95a836-4186-48ec-8a25-f4acc3e259b5 req-a02ea179-80ff-4d77-ab77-82efec13b1c0 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:47.317594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fc95a836-4186-48ec-8a25-f4acc3e259b5 req-a02ea179-80ff-4d77-ab77-82efec13b1c0 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0819821 Nov 24 14:33:47.364643 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fc95a836-4186-48ec-8a25-f4acc3e259b5 req-c180d678-fbed-4e8c-a430-461ceef7b906 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417621 Nov 24 14:33:48.035822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:48.635220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b12a730-1036-4f6d-a21a-227c312fef95 req-f76dcd93-0a16-4b3a-8bff-221d983b25d5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:48.637109 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b12a730-1036-4f6d-a21a-227c312fef95 req-f76dcd93-0a16-4b3a-8bff-221d983b25d5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.1508739 Nov 24 14:33:48.686997 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5b12a730-1036-4f6d-a21a-227c312fef95 req-481e3892-18b0-4b25-956e-73b2a840f40f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441988 Nov 24 14:33:49.062801 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-f19c8bba-073e-4177-99a6-359e4146a70b service neutron] 10.222.0.47 "GET /v2.0/ports/431fd986-1577-458e-9d2d-7caa85348ec7/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0723274 Nov 24 14:33:49.329497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-76a7d679-7674-4837-9424-21cc8c34967c service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5&tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2 HTTP/1.1" status: 200 len: 1098 time: 0.0755892 Nov 24 14:33:49.509578 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-69e7ecba-0e60-4421-b2bb-60c921c113fd service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 1098 time: 0.1572833 Nov 24 14:33:49.640393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-45b297a7-816e-4b3c-9aef-7f2ebf4fb8cf service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:49.641808 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-45b297a7-816e-4b3c-9aef-7f2ebf4fb8cf service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1258149 Nov 24 14:33:49.711332 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-8d4cfcf3-eeec-4981-bf86-161b35f7e4ef service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 200 len: 217 time: 0.0625861 Nov 24 14:33:49.773742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-1b5570f0-0679-44e6-9d43-145f50bb42a3 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:49.775176 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-1b5570f0-0679-44e6-9d43-145f50bb42a3 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0574858 Nov 24 14:33:49.820673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-82876b6d-0d38-4ac0-80cb-5386b4024df3 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0391064 Nov 24 14:33:49.891992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9d97c2-37f4-4714-9c44-a04dd1d516f4 req-4c6077b9-3c83-42d6-8f9d-b4c385e026b4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:49.893338 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ab9d97c2-37f4-4714-9c44-a04dd1d516f4 req-4c6077b9-3c83-42d6-8f9d-b4c385e026b4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0829895 Nov 24 14:33:49.939681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ab9d97c2-37f4-4714-9c44-a04dd1d516f4 req-ab52a626-1112-433a-baca-5653212e3da9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409052 Nov 24 14:33:49.953552 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-245fdf61-6a3c-4b71-bbd2-493abebd3562 service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267641 Nov 24 14:33:50.084368 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3b12dec-8198-44af-9034-3d49a5b54c57 req-fe17362e-aa75-42b5-be8a-3a1d523992ca service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238663 Nov 24 14:33:51.136072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cee67064-168f-40b2-a5b1-bcfef945cba1 req-5a288ed2-1fc4-409a-b32e-c4fa6d8633c1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:51.137592 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cee67064-168f-40b2-a5b1-bcfef945cba1 req-5a288ed2-1fc4-409a-b32e-c4fa6d8633c1 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0795491 Nov 24 14:33:51.183512 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cee67064-168f-40b2-a5b1-bcfef945cba1 req-c152ea50-08c1-45dd-b669-bec62b5ac5ed tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401447 Nov 24 14:33:52.383613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5050eb69-c3dc-408b-9f7d-1df0d763bc14 req-ed4abbb1-01b4-4d24-82a8-7689b840798e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:52.385060 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5050eb69-c3dc-408b-9f7d-1df0d763bc14 req-ed4abbb1-01b4-4d24-82a8-7689b840798e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0800321 Nov 24 14:33:52.430352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5050eb69-c3dc-408b-9f7d-1df0d763bc14 req-ccd2e177-fddb-4ff1-b907-bc3ce2f68a96 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396781 Nov 24 14:33:53.009912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:33:53.012440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:33:53.222609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:53.254237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:53.275330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:53.281990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '431fd986-1577-458e-9d2d-7caa85348ec7', 'network_id': '9b3f1177-cd3c-4da4-b261-e444d32d8295', 'port_id': '431fd986-1577-458e-9d2d-7caa85348ec7', 'mac_address': 'fa:16:3e:0c:f9:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 878, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b4ba849b-41c2-4950-afe6-1c8c8cba2254', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:33:53.287924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:53.319281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:53.326583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2a182ad4-1947-4a30-bb04-2d85933cba11 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:53.394239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:53.419898 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7', 'code': 200} Nov 24 14:33:53.421241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 431fd986-1577-458e-9d2d-7caa85348ec7 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:33:53.424866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:53.428594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:53.439060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:53.442760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:53.444546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:53.509594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['431fd986-1577-458e-9d2d-7caa85348ec7'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:33:53.552259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:53.556760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:53.630058 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335b32a9-fb04-4d51-9e52-f69b458763b1 req-7d2bfbdd-ec93-46f2-a85c-7fad645bb529 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:53.631469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-335b32a9-fb04-4d51-9e52-f69b458763b1 req-7d2bfbdd-ec93-46f2-a85c-7fad645bb529 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 944 time: 0.0786290 Nov 24 14:33:53.682958 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-335b32a9-fb04-4d51-9e52-f69b458763b1 req-b31efeee-7dc1-4c61-87e3-68d0d5083b73 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450358 Nov 24 14:33:54.006684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-545f3ece-21a7-4a4d-88bc-ec8d2ce060a9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:54.008120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-545f3ece-21a7-4a4d-88bc-ec8d2ce060a9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5&tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 944 time: 0.0812683 Nov 24 14:33:54.014556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b133d8-9556-41e2-9bf9-c8010a6049eb req-d119abfc-2187-4264-9673-1bd94f9d54be tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:54.016163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-83b133d8-9556-41e2-9bf9-c8010a6049eb req-d119abfc-2187-4264-9673-1bd94f9d54be tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 944 time: 0.0782859 Nov 24 14:33:54.062218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-83b133d8-9556-41e2-9bf9-c8010a6049eb req-60871074-2245-4afd-a70e-61cb4a128ca5 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405414 Nov 24 14:33:54.148318 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-26b1a2c5-f99d-42d5-ae6f-a36134d66d9c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 1097 time: 0.0730805 Nov 24 14:33:54.279202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-59f02141-aa26-40c4-b6f5-e66a118985a2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:54.280750 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-59f02141-aa26-40c4-b6f5-e66a118985a2 service neutron] 10.222.0.47 "GET /v2.0/networks?id=9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 200 len: 916 time: 0.1261263 Nov 24 14:33:54.346375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-7906aa34-831a-4362-920e-15a88b9cf43f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 200 len: 217 time: 0.0592682 Nov 24 14:33:54.409045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-52f6c143-a8f0-4025-8304-7c7cdc3a203b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:54.410324 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-52f6c143-a8f0-4025-8304-7c7cdc3a203b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 200 len: 855 time: 0.0580056 Nov 24 14:33:54.454097 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-eeb2aafe-c3cd-46e4-90eb-c8a0ed83f34a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=9b3f1177-cd3c-4da4-b261-e444d32d8295&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0376740 Nov 24 14:33:54.584041 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-17bcbe91-dfb3-4c21-9d0e-3d6819d398cb service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1234443 Nov 24 14:33:54.711952 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bb058e0-feba-40fb-a138-cacea90c1a56 req-e9467930-4a37-4004-9870-e680ef7edd2b service neutron] 10.222.0.47 "GET /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219258 Nov 24 14:33:55.011466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:33:55.084411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 431fd986-1577-458e-9d2d-7caa85348ec7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:33:55.084783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:55.205732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:55.322120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:55.327829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:55.332078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:55.416596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:55.420429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:55.420926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:55.427738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-647f1573-ee56-4525-b71e-39e67d8a2ef8 req-f4e876ec-c652-46e5-a8df-ff828bde160b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:55.429210 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-647f1573-ee56-4525-b71e-39e67d8a2ef8 req-f4e876ec-c652-46e5-a8df-ff828bde160b tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 944 time: 0.2339296 Nov 24 14:33:55.474457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-647f1573-ee56-4525-b71e-39e67d8a2ef8 req-900a3aff-36f1-433d-9d4d-64b856bb3d56 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395875 Nov 24 14:33:55.475116 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7', 'code': 200} Nov 24 14:33:55.679724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c923c9-6fb0-429a-a491-f3580d791c8c req-8fdab372-c720-43d8-9dde-7637155b2d0e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:55.681167 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-25c923c9-6fb0-429a-a491-f3580d791c8c req-8fdab372-c720-43d8-9dde-7637155b2d0e tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0850866 Nov 24 14:33:55.726449 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-25c923c9-6fb0-429a-a491-f3580d791c8c req-22933c0b-b7c2-46b5-8162-0cd7ce2fc254 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397353 Nov 24 14:33:55.920931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95f06d1-1cb7-4bc3-94a9-7587a2ea78f8 req-3ff4546c-7128-44c7-aa98-5d17d66cfca9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:55.922362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d95f06d1-1cb7-4bc3-94a9-7587a2ea78f8 req-3ff4546c-7128-44c7-aa98-5d17d66cfca9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0764349 Nov 24 14:33:55.968612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d95f06d1-1cb7-4bc3-94a9-7587a2ea78f8 req-6b96bbed-1c3f-4096-b431-216f611778a9 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404840 Nov 24 14:33:56.543697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e1bc2e2-0abf-40a3-91c3-d898394ade6b req-a03aefb9-14c6-414a-991e-8f34852824f3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:56.545071 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9e1bc2e2-0abf-40a3-91c3-d898394ade6b req-a03aefb9-14c6-414a-991e-8f34852824f3 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 945 time: 0.0766535 Nov 24 14:33:56.589751 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9e1bc2e2-0abf-40a3-91c3-d898394ade6b req-f3304f4a-7857-459b-a0d3-3d6d37334a9f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385783 Nov 24 14:33:57.033255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:33:57.143863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:57.174820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:57.178739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:57.180450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:57.246476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:57.249457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:57.476405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:57.529811 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7', 'code': 200} Nov 24 14:33:57.793842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bfca39-e350-4aff-a786-1a9ff4083883 req-4cc36d5e-0e81-43c9-bd5f-6991c2eecf96 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:57.795285 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-34bfca39-e350-4aff-a786-1a9ff4083883 req-4cc36d5e-0e81-43c9-bd5f-6991c2eecf96 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 943 time: 0.0830302 Nov 24 14:33:57.841022 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-34bfca39-e350-4aff-a786-1a9ff4083883 req-fccdfc9f-484c-4102-a4f4-745d8c4a654f tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/security-groups?id=59d5aaed-d309-4827-a783-e18582aefbc3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403125 Nov 24 14:33:58.158395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-310f0990-1fca-4fa5-bd82-fb07d14f1926 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:33:58.159832 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-310f0990-1fca-4fa5-bd82-fb07d14f1926 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 943 time: 0.0783172 Nov 24 14:33:58.225469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Deleting port 431fd986-1577-458e-9d2d-7caa85348ec7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:33:58.225804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:58.463104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] For port 431fd986-1577-458e-9d2d-7caa85348ec7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=431fd986-1577-458e-9d2d-7caa85348ec7,segment=NetworkSegment(a88edde9-5439-4663-b6c1-764715ef7871),segment_id=a88edde9-5439-4663-b6c1-764715ef7871)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:33:58.463371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:58.583808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Calling delete_port for 431fd986-1577-458e-9d2d-7caa85348ec7 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:33:58.724372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:58.730713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7e0a2434-dde2-4f0c-8a05-63c69a3cb3b8 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:33:58.774851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Pushing event deleted for resources: {'Port': ['ID=431fd986-1577-458e-9d2d-7caa85348ec7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:33:58.779524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:33:58.848465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] No DVR routers for this DVR port 431fd986-1577-458e-9d2d-7caa85348ec7 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:33:58.850758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:33:58.853447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-deleted', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:33:58.874674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1cf5a96c-f14f-43ba-bd26-778fe7020973 req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.47 "DELETE /v2.0/ports/431fd986-1577-458e-9d2d-7caa85348ec7 HTTP/1.1" status: 204 len: 173 time: 0.7090888 Nov 24 14:33:58.915515 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2aa750f-53cb-45dd-a343-6a31ffdc7fc5', 'name': 'network-vif-deleted', 'tag': '431fd986-1577-458e-9d2d-7caa85348ec7', 'status': 'completed', 'code': 200} Nov 24 14:33:59.020768 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f1159b37-e4ae-499d-b425-2b311d1d18b1 req-ab996dab-7e92-4711-b27f-e10b7bad45e8 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] 10.222.0.70 "GET /v2.0/ports?device_id=e2aa750f-53cb-45dd-a343-6a31ffdc7fc5 HTTP/1.1" status: 200 len: 210 time: 0.0427001 Nov 24 14:34:00.277218 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50540) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:00.338444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Deleting subnet b4ba849b-41c2-4950-afe6-1c8c8cba2254 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:34:00.342289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.390990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.444760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.607964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.611475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bdea8cc3-8a2c-4622-9c9a-eee0094d78b9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:00.644153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b4ba849b-41c2-4950-afe6-1c8c8cba2254,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:00.647498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:00.650664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.656490 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/b4ba849b-41c2-4950-afe6-1c8c8cba2254 HTTP/1.1" status: 204 len: 168 time: 0.3781722 Nov 24 14:34:00.658860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50544) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:00.765549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.891360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.917980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b3f1177-cd3c-4da4-b261-e444d32d8295']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:00.931196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a88edde9-5439-4663-b6c1-764715ef7871') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:00.931487 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a88edde9-5439-4663-b6c1-764715ef7871') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:00.943714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.960856 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.968345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Releasing vlan 878 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:34:00.968768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:34:00.983012 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:34:01.061862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:01.065710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e43fd1fd-0eb9-40cf-9cab-ba8daf07ca63 tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:01.081742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:01.088326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Pushing event deleted for resources: {'Network': ['ID=9b3f1177-cd3c-4da4-b261-e444d32d8295,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:01.093749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:01.101978 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cc89bf37-64ea-4bc5-a345-a97033f96bb8 admin admin] 10.222.0.70 "DELETE /v2.0/networks/9b3f1177-cd3c-4da4-b261-e444d32d8295 HTTP/1.1" status: 204 len: 168 time: 0.4412777 Nov 24 14:34:01.281056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50550) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:01.330849 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0082f6eb-67b0-4eed-8066-149c843d6005 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ca3b7e56bf0b41b788c8d342a40f91e2&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0485730 Nov 24 14:34:01.333260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50554) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:01.391358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:01.419916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:01.469689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:01.473411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4b56d67b-2135-48a3-a634-077439944432 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:01.486351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59d5aaed-d309-4827-a783-e18582aefbc3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:01.489498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:01.499771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:01.500921 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/59d5aaed-d309-4827-a783-e18582aefbc3 HTTP/1.1" status: 204 len: 168 time: 0.1667976 Nov 24 14:34:02.391460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50576) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:02.518001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1381956282-network', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:02.522692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:02.527096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Usage tracker for resource:network and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:02.530442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:02.537114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:02.546810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Made reservation on behalf of 644eeb3051394d9da6b3f5fb4139e803 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:34:02.549094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.561115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.593747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:02.597539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Usage tracker for resource:security_group_rule and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:02.600289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:02.606236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:02.670019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.673715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.676526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16625623-24bf-4bd9-8c77-84bc0e65a199 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:02.703978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 853} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:34:02.712253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93da3016-7a0f-4eb0-b255-157a859ca5be,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:02.716714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:02.719151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.719494 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Added segment ccf8281b-cd10-426d-865a-cd4652bd2f44 of type vlan for network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 Nov 24 14:34:02.744865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.776962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.778190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:02.778482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:02.783183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:02.873869 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4812410 Nov 24 14:34:02.876823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:02.878965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Pushing event updated for resources: {'Network': ['ID=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:02.881770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:02.882680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Request body: {'subnet': {'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1381956282-subnet', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:02.888984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:02.889606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:34:02.892843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Usage tracker for resource:subnet and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:02.895618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:02.901883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:02.912031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Made reservation on behalf of 644eeb3051394d9da6b3f5fb4139e803 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:34:02.914301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.101893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:34:03.117537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.122725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1f810102-4065-4283-90f7-41756da7f18c tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:03.134237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 431fd986-1577-458e-9d2d-7caa85348ec7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:34:03.134595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 431fd986-1577-458e-9d2d-7caa85348ec7 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:34:03.194563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=22012fd4-20c7-4275-844f-7e901c9b102d,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:03.198874 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:03.209080 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:34:03.209454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Network hostable DHCP agents. Network: b20ce7e1-47d2-4747-a9a3-ec140e6fcda1, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:34:03.232105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:34:03.241238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, b20ce7e1-47d2-4747-a9a3-ec140e6fcda1) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:03.245851 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:03.246420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.250865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-facde61d-4c97-4e65-88d5-587a22d895d2 None None] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:34:03.267435 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3895161 Nov 24 14:34:03.270398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50586) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:03.275972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:03.281305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:03.285248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Usage tracker for resource:router and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:03.288886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:03.295685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:03.305419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.306281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.325197 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.334799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1e923372-1604-4efb-96ea-5bf937ca0ae6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.473151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.477510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:34:03.478394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.639590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Allocated IP 172.20.0.2 (b20ce7e1-47d2-4747-a9a3-ec140e6fcda1/22012fd4-20c7-4275-844f-7e901c9b102d/8175b28d-cb4e-4c3a-9752-e61127a860d1) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:34:03.738538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.762737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.798109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.862661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.873907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Transition to ACTIVE for port object 8175b28d-cb4e-4c3a-9752-e61127a860d1 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:03.891970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Transition to ACTIVE for port object 8175b28d-cb4e-4c3a-9752-e61127a860d1 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:03.901682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:03.906319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:03.939345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Allocated IP 172.26.4.158 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/3ff6c9a3-0d32-4e84-bed5-613455a850a8) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:34:03.971872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:34:03.974976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:03.980063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:34:03.982105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Pushing event updated for resources: {'Port': ['ID=8175b28d-cb4e-4c3a-9752-e61127a860d1,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:03.985097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:04.068925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Attempting to bind port 8175b28d-cb4e-4c3a-9752-e61127a860d1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:34:04.069302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Attempting to bind port 8175b28d-cb4e-4c3a-9752-e61127a860d1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:34:04.069667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Attempting to bind port 8175b28d-cb4e-4c3a-9752-e61127a860d1 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:34:04.076896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 34, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:34:04.077275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:34:04.077682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.078085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Bound using segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:34:04.078562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Bound port: 8175b28d-cb4e-4c3a-9752-e61127a860d1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:34:04.078949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.092377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.119786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.124211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6a73cad-86e1-4fb5-9e52-1c1ebc52c926 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:04.171115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] For port 8175b28d-cb4e-4c3a-9752-e61127a860d1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:34:04.174540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] For port 8175b28d-cb4e-4c3a-9752-e61127a860d1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8175b28d-cb4e-4c3a-9752-e61127a860d1,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:34:04.178425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.182134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:04.194190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:34:04.197594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Pushing event updated for resources: {'Port': ['ID=3ff6c9a3-0d32-4e84-bed5-613455a850a8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:04.200698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:04.202460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:04.203216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:34:04.267002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Pushing event updated for resources: {'Port': ['ID=8175b28d-cb4e-4c3a-9752-e61127a860d1,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:04.271657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:04.368837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.370269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.627077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:34:04.832812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:34:04.843624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:34:04.856662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:34:04.857448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:33:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:04.859119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:04.863530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50590) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:04.864134 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.5921340 Nov 24 14:34:05.099568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:34:05.208172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75367f99-5d1d-43f6-8dd3-7303fd12287c None None] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:34:05.380513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f4d25464-177f-4ca7-b938-e143e23293fb None None] Provisioning for port 8175b28d-cb4e-4c3a-9752-e61127a860d1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:05.480095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8175b28d-cb4e-4c3a-9752-e61127a860d1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:05.654696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8175b28d-cb4e-4c3a-9752-e61127a860d1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:05.665552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8175b28d-cb4e-4c3a-9752-e61127a860d1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:05.665931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:05.702401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:04Z', 'revision_number': 3, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:05.717675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:34:05.717957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Updating router a1f1cddf-2326-4df3-8968-7c34b02d9326 port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:34:05.764775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:05.794241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:05.939736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-07fd7e39-d4ba-4dd7-9560-67186b52d71a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:05.962363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:05.985246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Allocated IP 172.20.0.1 (b20ce7e1-47d2-4747-a9a3-ec140e6fcda1/22012fd4-20c7-4275-844f-7e901c9b102d/265b3dc2-c548-421f-a223-c720c58278ad) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:34:06.036993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 8175b28d-cb4e-4c3a-9752-e61127a860d1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8175b28d-cb4e-4c3a-9752-e61127a860d1,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:34:06.093521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.097194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:06.132953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.149077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Transition to ACTIVE for port object 265b3dc2-c548-421f-a223-c720c58278ad will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:06.170464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.174952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:06.189285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3d262890-1a20-478e-9fa2-ab4f35d9fc0c None None] Provisioning complete for port 8175b28d-cb4e-4c3a-9752-e61127a860d1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:06.189830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d262890-1a20-478e-9fa2-ab4f35d9fc0c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.237599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:34:06.244285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=8175b28d-cb4e-4c3a-9752-e61127a860d1,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:06.244598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:06.247796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:34:06.273098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.273442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.273775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.274113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.274436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.274761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.275086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.275956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.275956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.276174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.276476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:06.281741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:06.295309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Pushing event updated for resources: {'Port': ['ID=265b3dc2-c548-421f-a223-c720c58278ad,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:06.300533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:06.327393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.422330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.428014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.443367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Transition to ACTIVE for port object 3ff6c9a3-0d32-4e84-bed5-613455a850a8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:06.450041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.454028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-2a182ad4-1947-4a30-bb04-2d85933cba11 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:06.535647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e938e61-260b-434c-b281-52194194179b None None] Pushing event updated for resources: {'Port': ['ID=3ff6c9a3-0d32-4e84-bed5-613455a850a8,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:06.537830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Attempting to bind port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:34:06.538200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Attempting to bind port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:34:06.538559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Attempting to bind port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:34:06.542475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e938e61-260b-434c-b281-52194194179b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:06.553548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 34, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:34:06.553872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:34:06.554255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.554649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:34:06.555106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Bound port: 3ff6c9a3-0d32-4e84-bed5-613455a850a8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:34:06.555483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.598945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a2397ca9-a796-4f57-b01d-2c5c55ec35f0 None None] Provisioning for port 265b3dc2-c548-421f-a223-c720c58278ad completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:06.612171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a2397ca9-a796-4f57-b01d-2c5c55ec35f0 None None] Provisioning complete for port 265b3dc2-c548-421f-a223-c720c58278ad triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:06.612543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a2397ca9-a796-4f57-b01d-2c5c55ec35f0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.653220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.657861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.677759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] For port 3ff6c9a3-0d32-4e84-bed5-613455a850a8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:34:06.684849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4666e5f2-4edb-4dd5-82ed-2088a3f4ee2a tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:06.686837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a2397ca9-a796-4f57-b01d-2c5c55ec35f0 None None] Port 265b3dc2-c548-421f-a223-c720c58278ad cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:34:06.690223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] For port 3ff6c9a3-0d32-4e84-bed5-613455a850a8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3ff6c9a3-0d32-4e84-bed5-613455a850a8,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:34:06.694375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.698100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:06.768202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:06.771586 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Pushing event updated for resources: {'Port': ['ID=265b3dc2-c548-421f-a223-c720c58278ad,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:06.774756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:06.832487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e938e61-260b-434c-b281-52194194179b None None] Pushing event updated for resources: {'Port': ['ID=3ff6c9a3-0d32-4e84-bed5-613455a850a8,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:06.835508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e938e61-260b-434c-b281-52194194179b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:06.836828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:34:06.837421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:34:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:06.909939 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:34:06.911086 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:06.919155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:07.037011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:34:07.292965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-08d4f73e-5065-4e6c-a843-a5966582585a None None] Provisioning complete for port 265b3dc2-c548-421f-a223-c720c58278ad triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:07.293574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-08d4f73e-5065-4e6c-a843-a5966582585a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:07.335088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:34:07.381655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-08d4f73e-5065-4e6c-a843-a5966582585a None None] Port 265b3dc2-c548-421f-a223-c720c58278ad cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:34:07.416541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 2, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:07.421372 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43b5b73b-eb64-4815-bb74-e58b2d6d6189 None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 2, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:34:07.448823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8175b28d-cb4e-4c3a-9752-e61127a860d1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:07.525543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8175b28d-cb4e-4c3a-9752-e61127a860d1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:07.526119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:07.721159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:34:07.733618 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] 10.222.0.70 "PUT /v2.0/routers/a1f1cddf-2326-4df3-8968-7c34b02d9326/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8689594 Nov 24 14:34:08.303908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50600) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:08.324402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'security_group': {'name': 'tempest-securitygroup--290047065', 'description': 'tempest-description--552427176'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:08.331519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:08.335459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Usage tracker for resource:security_group and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:08.338572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:08.344833 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:08.356196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.395505 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:08.399259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Usage tracker for resource:security_group_rule and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:08.402705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:08.412617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:08.484460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.487648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.491641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aa27be72-6f37-4d0d-9be8-8eb5ebd98e3f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:08.543421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7ef8b8e0-808b-4ac2-88ce-f247cce14b78,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:08.546376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.547862 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1612 time: 0.2425575 Nov 24 14:34:08.548944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ad0bc3ce-014d-4681-bc20-59fa5fb69b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:08.551067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50604) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:08.551478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.557701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'security_group_rule': {'security_group_id': '7ef8b8e0-808b-4ac2-88ce-f247cce14b78', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:08.566493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:08.570475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Usage tracker for resource:security_group_rule and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:08.575166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:08.581669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:08.602106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.664557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.668673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.674721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b703d77d-e8e2-414a-8493-3441f670690d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:08.695174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=986b6a72-bac1-4386-b7d8-bd85dcaf76e2,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:08.698302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:08.707614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.709244 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b5d15860-0927-47cb-b683-fc43880c4d8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1570318 Nov 24 14:34:08.712164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50608) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:08.719120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'security_group_rule': {'security_group_id': '7ef8b8e0-808b-4ac2-88ce-f247cce14b78', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:08.725207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:08.729063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Usage tracker for resource:security_group_rule and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:08.733450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:08.739091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:08.756425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.819251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.823188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.825064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-032ebe79-dfb7-4453-a438-db970ff9bc9e tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:08.848008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8b0df7a-04d0-4a19-a4a8-c306406251c4,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:08.852474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:08.861083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:08.862356 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1491811 Nov 24 14:34:08.865360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50612) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:08.871332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:08.877190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:08.881276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Usage tracker for resource:floatingip and tenant:644eeb3051394d9da6b3f5fb4139e803 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:34:08.884319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:34:08.891236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:08.905031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.044094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.183208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Allocated IP 172.26.4.246 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/b273c498-286f-4631-b1d1-b37cc26026f4) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:34:09.333192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.360424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.363969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d6ce58f-37bb-4a88-9810-ba39a7817a90 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:09.461306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3ff6c9a3-0d32-4e84-bed5-613455a850a8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:09.530344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:34:09.532770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:09.537602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:09.537766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:09.538300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.540342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:34:09.576280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'Port': ['ID=b273c498-286f-4631-b1d1-b37cc26026f4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:09.595082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.595471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.595883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.596260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.596630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.596998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.597360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.597728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.598089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.598444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.598802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:09.602420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:09.658216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.674896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 3ff6c9a3-0d32-4e84-bed5-613455a850a8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3ff6c9a3-0d32-4e84-bed5-613455a850a8,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:34:09.678746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.680669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:09.725927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.747166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=3ff6c9a3-0d32-4e84-bed5-613455a850a8,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:09.750126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:09.782209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.991518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:09.996092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:10.000612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:10.095954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'Port': ['ID=b273c498-286f-4631-b1d1-b37cc26026f4,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:10.099730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:10.115522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:10.137158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:10.138550 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2722487 Nov 24 14:34:10.319462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-2b54d254-abc6-44c1-bf3d-f2b4900b1d80 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:34:10.336072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-2b54d254-abc6-44c1-bf3d-f2b4900b1d80 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:34:10.337195 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-2b54d254-abc6-44c1-bf3d-f2b4900b1d80 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--290047065&fields=id&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 267 time: 0.0620317 Nov 24 14:34:10.489392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-7cc2ebac-e663-4604-8500-6f229c8a46dc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:10.489960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-7cc2ebac-e663-4604-8500-6f229c8a46dc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:34:10.509979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-7cc2ebac-e663-4604-8500-6f229c8a46dc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:34:10.512403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-7cc2ebac-e663-4604-8500-6f229c8a46dc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1677303 Nov 24 14:34:10.529505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-a01ffde2-e865-44a9-8d4c-6d00e20fd318 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/quotas/644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 375 time: 0.0117087 Nov 24 14:34:10.611484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-2c02fc7a-a485-41ba-a3cd-0fc4fe0ce3eb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0768092 Nov 24 14:34:10.626992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-40699ccf-9f99-4c3e-a693-19a1a7178c32 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:34:10.627921 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-40699ccf-9f99-4c3e-a693-19a1a7178c32 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0048335 Nov 24 14:34:10.762352 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-c828f547-270a-46af-ae32-b8ae6b91b061 service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288259 Nov 24 14:34:10.897181 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-0140cad7-3bfe-4e1a-af20-284ac9c5cb7c service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293139 Nov 24 14:34:11.081945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-cbca532c-2007-494c-bc69-1e78945ec25d req-46e84607-655f-480d-bcde-cbe2ec7e34a1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:34:11.099694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-cbca532c-2007-494c-bc69-1e78945ec25d req-46e84607-655f-480d-bcde-cbe2ec7e34a1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:34:11.101012 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cbca532c-2007-494c-bc69-1e78945ec25d req-46e84607-655f-480d-bcde-cbe2ec7e34a1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 210 time: 0.0641537 Nov 24 14:34:11.440307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3ff6c9a3-0d32-4e84-bed5-613455a850a8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:11.512595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:11.512973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:12.312768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d78a4068-ed04-4127-ab8b-36700534c0c9 req-e4058645-afe9-4ee6-bb13-15eb5996366c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 210 time: 0.0510428 Nov 24 14:34:12.367221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-790b2040-0e31-498b-88c9-b3209e449647 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:12.368672 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-790b2040-0e31-498b-88c9-b3209e449647 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1987362 Nov 24 14:34:12.424558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-41b29110-8db3-42a4-ae20-9a72c9405478 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 379 time: 0.0421417 Nov 24 14:34:12.436863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'port': {'device_id': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'admin_state_up': True, 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'security_groups': ['7ef8b8e0-808b-4ac2-88ce-f247cce14b78']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:12.580085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:34:12.589451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:34:12.598873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Made reservation on behalf of 644eeb3051394d9da6b3f5fb4139e803 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:34:12.601825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:12.860535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Allocated IP 172.20.0.11 (b20ce7e1-47d2-4747-a9a3-ec140e6fcda1/22012fd4-20c7-4275-844f-7e901c9b102d/0686f929-b528-4908-a879-f8e7296ebcc9) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:34:13.048131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.063076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Transition to ACTIVE for port object 0686f929-b528-4908-a879-f8e7296ebcc9 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:13.087487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.093957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:13.157349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:34:13.164506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:34:13.169527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:34:13.208476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:13.217996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:13.246708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:13.247315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.272909 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8405232 Nov 24 14:34:13.284902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Request body: {'port': {'device_id': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:13.398500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.466350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b215586a-b8de-4f53-89dc-7d68a9777b0f None None] Provisioning for port 0686f929-b528-4908-a879-f8e7296ebcc9 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:13.472869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b215586a-b8de-4f53-89dc-7d68a9777b0f None None] Provisioning complete for port 0686f929-b528-4908-a879-f8e7296ebcc9 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:13.473262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b215586a-b8de-4f53-89dc-7d68a9777b0f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.525545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ab2674-453f-45eb-8e0a-a905bbf43f4d req-24010670-f775-436d-a66f-c1f2055ee7c7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:13.527598 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-11ab2674-453f-45eb-8e0a-a905bbf43f4d req-24010670-f775-436d-a66f-c1f2055ee7c7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 932 time: 0.0884717 Nov 24 14:34:13.530016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b215586a-b8de-4f53-89dc-7d68a9777b0f None None] Port 0686f929-b528-4908-a879-f8e7296ebcc9 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:34:13.573430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-11ab2674-453f-45eb-8e0a-a905bbf43f4d req-35a972f4-71e2-4a0e-a75f-73583050fbfb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:34:13.585109 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-11ab2674-453f-45eb-8e0a-a905bbf43f4d req-35a972f4-71e2-4a0e-a75f-73583050fbfb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:34:13.586245 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-11ab2674-453f-45eb-8e0a-a905bbf43f4d req-35a972f4-71e2-4a0e-a75f-73583050fbfb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0531080 Nov 24 14:34:13.741711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0686f929-b528-4908-a879-f8e7296ebcc9 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:34:13.748704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.763112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Transition to ACTIVE for port object 0686f929-b528-4908-a879-f8e7296ebcc9 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:13.766850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:13.770942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-52420bfe-e169-4132-bb55-276d14316e0f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:13.822385 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:34:13.894100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:13.898077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:14.010763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Attempting to bind port 0686f929-b528-4908-a879-f8e7296ebcc9 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:34:14.011100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Attempting to bind port 0686f929-b528-4908-a879-f8e7296ebcc9 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:34:14.011423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Attempting to bind port 0686f929-b528-4908-a879-f8e7296ebcc9 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:34:14.017285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Port 0686f929-b528-4908-a879-f8e7296ebcc9 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:34:14.017602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Attempting to bind port 0686f929-b528-4908-a879-f8e7296ebcc9 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:34:14.023854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 33, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:34:14.024191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:34:14.024597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Bound using segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:34:14.025015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Bound port: 0686f929-b528-4908-a879-f8e7296ebcc9, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:34:14.025354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:14.116196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:34:14.119114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:34:14.123854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:14.127985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-73843ca0-710d-40e7-bd06-bf49d5044f7f tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:14.184684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:14.186130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] 10.222.0.47 "PUT /v2.0/ports/0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 1094 time: 0.9055707 Nov 24 14:34:14.186644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:34:14.212558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:14.222967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:14.301976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9', 'status': 'completed', 'code': 200} Nov 24 14:34:14.323407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-78657e6c-51fd-45bf-a5f5-b10f0663f022 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1097 time: 0.0889847 Nov 24 14:34:14.401833 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-6f9f31d3-b0d9-415a-a21a-172ecacf2d73 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 217 time: 0.0721042 Nov 24 14:34:14.467674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-655824b7-58de-4d1b-9768-9f4115ca0f1d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:14.469029 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-655824b7-58de-4d1b-9768-9f4115ca0f1d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0616391 Nov 24 14:34:14.552875 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-aa0eb283-1373-4868-abc5-ac83181cf0f2 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0761781 Nov 24 14:34:14.787744 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-893d17c8-ab3b-4145-8702-231d2ca88a9a service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2280471 Nov 24 14:34:14.798535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f2feb2-f117-4147-b4ac-713749b5ae1d req-d2443256-0d6b-42bb-9722-e1e8629f92a9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:14.799925 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-62f2feb2-f117-4147-b4ac-713749b5ae1d req-d2443256-0d6b-42bb-9722-e1e8629f92a9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 944 time: 0.0858855 Nov 24 14:34:14.845461 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-62f2feb2-f117-4147-b4ac-713749b5ae1d req-3d32be71-f527-41ab-9d2a-d881e546d0c4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398862 Nov 24 14:34:14.919772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8ca795f0-3fb7-4c87-a9e2-3404318d4647 req-b8974732-53f6-4962-91ab-364a618ebc65 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260877 Nov 24 14:34:15.036745 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-96ccebdf-06e1-4e98-8938-3a839aefb06c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1097 time: 0.0677698 Nov 24 14:34:15.165213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-38e2a7c3-2aa4-4db6-b94a-273285542ff4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:15.167405 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-38e2a7c3-2aa4-4db6-b94a-273285542ff4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1243498 Nov 24 14:34:15.237038 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-f57259d7-ce46-478a-b039-c062d5d22145 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 217 time: 0.0636282 Nov 24 14:34:15.297834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-cfefc06a-9b8c-48fc-9360-1753d0b7c5b4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:15.299236 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-cfefc06a-9b8c-48fc-9360-1753d0b7c5b4 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0562944 Nov 24 14:34:15.376130 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-e81b98fa-0057-44ba-b794-d27444295cbd service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0697968 Nov 24 14:34:15.507239 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-9024ae5b-1374-43fe-a314-38357d2d2dbe service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1246278 Nov 24 14:34:15.637434 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2d2e9c8f-6aa1-4746-b7f9-69fe44690d20 req-835636e2-9fa3-4569-bdc6-c0867a506654 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237981 Nov 24 14:34:16.042546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff001451-4a19-471a-8fb0-8c1a200b3302 req-aba0031d-0803-42c9-a6a4-18e7a64c641b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:16.043223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ff001451-4a19-471a-8fb0-8c1a200b3302 req-aba0031d-0803-42c9-a6a4-18e7a64c641b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:34:16.059167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ff001451-4a19-471a-8fb0-8c1a200b3302 req-aba0031d-0803-42c9-a6a4-18e7a64c641b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:34:16.060702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ff001451-4a19-471a-8fb0-8c1a200b3302 req-aba0031d-0803-42c9-a6a4-18e7a64c641b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 944 time: 0.0928037 Nov 24 14:34:16.107242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ff001451-4a19-471a-8fb0-8c1a200b3302 req-864f751c-2285-44f2-941a-c78eac6703a8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407112 Nov 24 14:34:17.304200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea53bd8-7527-48bb-ac90-26617ce35d12 req-41633e33-649d-4ec7-a323-0ec1b2fb8d19 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:17.305613 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0ea53bd8-7527-48bb-ac90-26617ce35d12 req-41633e33-649d-4ec7-a323-0ec1b2fb8d19 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 944 time: 0.0800798 Nov 24 14:34:17.352579 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0ea53bd8-7527-48bb-ac90-26617ce35d12 req-c5f70e24-ed65-4606-a244-be55b7772455 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403945 Nov 24 14:34:18.052311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:18.553890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff776f1f-f203-4228-9e66-b6259528f45b req-48e7e61a-7360-4c37-8ebd-4da147845127 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:18.555299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ff776f1f-f203-4228-9e66-b6259528f45b req-48e7e61a-7360-4c37-8ebd-4da147845127 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 944 time: 0.0814819 Nov 24 14:34:18.600637 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ff776f1f-f203-4228-9e66-b6259528f45b req-4ae861ab-4d8a-4a68-88d9-ad724d5df9ef tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397704 Nov 24 14:34:19.195335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:34:19.330525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:34:19.344272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '0686f929-b528-4908-a879-f8e7296ebcc9', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '0686f929-b528-4908-a879-f8e7296ebcc9', 'mac_address': 'fa:16:3e:fc:96:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:34:19.436514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:19.452816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0686f929-b528-4908-a879-f8e7296ebcc9 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:34:19.467982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:34:19.472150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:19.473879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-fa43e71d-6a78-4ad7-85ca-144f9fbefd66 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:19.536612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:19.539516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:19.794282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['0686f929-b528-4908-a879-f8e7296ebcc9'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:34:19.800235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d23082-3ab2-4c68-8c32-d94f08106fc3 req-c317bcce-da91-4c30-9a64-4ef0bae33b62 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:19.801677 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-68d23082-3ab2-4c68-8c32-d94f08106fc3 req-c317bcce-da91-4c30-9a64-4ef0bae33b62 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 945 time: 0.0796249 Nov 24 14:34:19.852105 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-68d23082-3ab2-4c68-8c32-d94f08106fc3 req-edf0a035-8acd-41a2-bee5-1f6ddd81bfa3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449290 Nov 24 14:34:20.928228 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:34:20.939982 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:34:20.940596 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:34:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:21.049734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffb7e58-771f-4c3f-9ab4-680b2a0fb687 req-981d7df4-9afb-4342-af4a-404dbcec3223 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:21.051182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ffb7e58-771f-4c3f-9ab4-680b2a0fb687 req-981d7df4-9afb-4342-af4a-404dbcec3223 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 945 time: 0.0766048 Nov 24 14:34:21.096081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ffb7e58-771f-4c3f-9ab4-680b2a0fb687 req-9b22f6f8-5350-4909-988e-09d398d5682a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392947 Nov 24 14:34:21.115215 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:34:21.210679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:21.284244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 0686f929-b528-4908-a879-f8e7296ebcc9 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:21.289004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 0686f929-b528-4908-a879-f8e7296ebcc9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:21.289399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:21.403037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:21.430256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:34:21.430492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 2, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:21.435036 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:34:21.435401 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Updating router a1f1cddf-2326-4df3-8968-7c34b02d9326 port 265b3dc2-c548-421f-a223-c720c58278ad binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:34:21.440548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:34:21.444484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:21.446279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:21.488402 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:21.491565 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9', 'code': 200} Nov 24 14:34:21.519079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:21.523104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:21.722729 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbcf66f5-dbba-4edc-b8f6-2962278ac770 req-68fe8f57-fc4c-412b-a646-fd16dd900e7e service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1099 time: 0.0756977 Nov 24 14:34:21.766679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbcf66f5-dbba-4edc-b8f6-2962278ac770 req-16f4e10b-54ef-4a3c-b3da-57369fb64a98 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0366700 Nov 24 14:34:21.853534 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:21.866392 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Transition to ACTIVE for port object 265b3dc2-c548-421f-a223-c720c58278ad will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:34:21.874232 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:21.877473 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:22.004310 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Pushing event updated for resources: {'Port': ['ID=265b3dc2-c548-421f-a223-c720c58278ad,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:22.043901 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.044244 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.044570 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.044892 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.045212 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.045528 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.045840 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.046153 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.046462 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.046769 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.047081 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:34:22.054343 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:22.107860 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Attempting to bind port 265b3dc2-c548-421f-a223-c720c58278ad on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:34:22.108229 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Attempting to bind port 265b3dc2-c548-421f-a223-c720c58278ad by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:34:22.108586 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Attempting to bind port 265b3dc2-c548-421f-a223-c720c58278ad on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:34:22.115314 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 34, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:34:22.115698 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:34:22.116098 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:22.116616 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Bound using segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:34:22.116929 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Bound port: 265b3dc2-c548-421f-a223-c720c58278ad, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:34:22.117296 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:22.209854 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] For port 265b3dc2-c548-421f-a223-c720c58278ad, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:34:22.213764 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] For port 265b3dc2-c548-421f-a223-c720c58278ad, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=265b3dc2-c548-421f-a223-c720c58278ad,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:34:22.219143 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:22.224396 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-4c6d8f8b-97a4-43b6-8174-fabd738a5e80 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:22.306146 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Pushing event updated for resources: {'Port': ['ID=265b3dc2-c548-421f-a223-c720c58278ad,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:22.308754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55c9282-8fad-4565-9ee8-b8d50b7e2223 req-4d2521f1-1553-47ad-9653-ae38f61edab0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:22.309763 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:22.311674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b55c9282-8fad-4565-9ee8-b8d50b7e2223 req-4d2521f1-1553-47ad-9653-ae38f61edab0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0908012 Nov 24 14:34:22.319414 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:34:22.319772 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:34:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:22.366849 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b55c9282-8fad-4565-9ee8-b8d50b7e2223 req-6bed8677-6a4b-4cc8-a825-6f10417c53ac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495148 Nov 24 14:34:22.514759 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:34:22.852589 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:22Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:22.856938 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7c2269c-67d9-4a14-9b35-821b768c1ed6 None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:22Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:34:23.462388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 265b3dc2-c548-421f-a223-c720c58278ad up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:23.534303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 265b3dc2-c548-421f-a223-c720c58278ad completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:34:23.539063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 265b3dc2-c548-421f-a223-c720c58278ad triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:23.539577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:23.576016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca176f11-6df0-4847-bbf8-dbd768722ed2 req-2bd52334-7b34-42af-a367-1d9041017077 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:23.577551 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ca176f11-6df0-4847-bbf8-dbd768722ed2 req-2bd52334-7b34-42af-a367-1d9041017077 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0800085 Nov 24 14:34:23.625385 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ca176f11-6df0-4847-bbf8-dbd768722ed2 req-4c269702-1179-4665-9f9f-2dc609fa24d9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421643 Nov 24 14:34:23.659224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:23.691168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 265b3dc2-c548-421f-a223-c720c58278ad, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=265b3dc2-c548-421f-a223-c720c58278ad,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:34:23.695583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:23.698907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e938e61-260b-434c-b281-52194194179b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:34:23.766358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=265b3dc2-c548-421f-a223-c720c58278ad,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:34:23.769303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:34:23.817320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6f269a-8c32-48d3-a11a-9dcb1d8d28c3 req-52668ceb-8aa2-4385-8686-fe1c0cf98b9c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:23.818728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc6f269a-8c32-48d3-a11a-9dcb1d8d28c3 req-52668ceb-8aa2-4385-8686-fe1c0cf98b9c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0749485 Nov 24 14:34:23.828518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 50664) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:34:23.833743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'floatingip': {'port_id': '0686f929-b528-4908-a879-f8e7296ebcc9'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:34:23.913337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:24.609684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:24.613170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:24.800606 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 associated. External IP: 172.26.4.246, port: 0686f929-b528-4908-a879-f8e7296ebcc9. Nov 24 14:34:25.185682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:34:25.388312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:34:25.392749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:25.454727 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d61937a-d856-4a98-8e40-4946bc5dd279 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "PUT /v2.0/floatingips/7522ecd4-9586-4e09-9875-65fffb502df1 HTTP/1.1" status: 200 len: 992 time: 1.6224911 Nov 24 14:34:25.454727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:34:25.479978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 265b3dc2-c548-421f-a223-c720c58278ad up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:34:25.508347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9', 'status': 'completed', 'code': 200} Nov 24 14:34:25.515920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:34:25.559996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:34:25.559996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:34:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:25.717927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 265b3dc2-c548-421f-a223-c720c58278ad triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:34:25.718214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:25.726789 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-58870e38-449c-4922-af19-29d814b8b793 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1099 time: 0.1957378 Nov 24 14:34:25.810044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:34:25.862462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-bb159dea-f7ec-465d-86bb-469edbf96431 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:25.863940 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-bb159dea-f7ec-465d-86bb-469edbf96431 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1310635 Nov 24 14:34:25.977242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-f9315345-cc2a-4c89-8a4c-e7668a5b2852 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 1000 time: 0.1065240 Nov 24 14:34:26.039904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-357ea9a1-5e5a-4975-842d-c1e445d20768 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:34:26.041871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-357ea9a1-5e5a-4975-842d-c1e445d20768 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0584083 Nov 24 14:34:26.126262 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-41cd1a7d-25e0-43e2-bc8e-01a56c1a2ebc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0784681 Nov 24 14:34:26.211859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '0686f929-b528-4908-a879-f8e7296ebcc9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:fc:96:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:34:24Z', 'revision_number': 1, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:26.216962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:34:26.227740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:34:26.228409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:34:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:26.302724 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-5fe9f61a-c906-4ff5-ac09-dbe964efd3d0 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1691079 Nov 24 14:34:26.437740 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-74221496-e764-4b1c-b4e3-8208dac8e8e9 req-d58d6226-9b20-4e65-992b-5c7633333286 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291142 Nov 24 14:34:26.453166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:34:26.796226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '0686f929-b528-4908-a879-f8e7296ebcc9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:fc:96:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:34:24Z', 'revision_number': 1, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:34:26.800320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0edbec66-e5bf-4c2b-9780-b966fa39002d None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '0686f929-b528-4908-a879-f8e7296ebcc9', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:fc:96:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:34:24Z', 'revision_number': 1, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:34:27.000866 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c91889f-ecf5-4e2a-b54b-49f459421e8d None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:34:33.277663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d40ffb11-d88a-4b7a-b882-2491e4a41f55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:33.679383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:35.841382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5791ea88-a1e2-4a6a-8c92-06f6f90986a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:36.865588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:38.552259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:48.071002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:34:50.822597 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:35:03.282859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-03730acf-be60-44eb-9031-cb8ed4b3cc27 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:03.681610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:05.844877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1dbdc1d-d618-41ca-b7ee-4aed34e87cc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:05.929178 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-5d89e0d4-3bc9-479a-affb-17806fdb4152 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0700755 Nov 24 14:35:06.083538 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-a8218257-03c0-42e9-bc6e-8f2075d92e5d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1099 time: 0.0699098 Nov 24 14:35:06.228766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-a6e51fd2-b814-47a2-92ff-e77d99b52f31 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:06.230758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-a6e51fd2-b814-47a2-92ff-e77d99b52f31 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1284902 Nov 24 14:35:06.337302 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-eb53d6ba-cbee-4af5-99b1-0504b72e23ee service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 1002 time: 0.0997398 Nov 24 14:35:06.398404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-46d483fa-97a2-4e1d-bfb0-472f83ca07f4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:06.399819 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-46d483fa-97a2-4e1d-bfb0-472f83ca07f4 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0567458 Nov 24 14:35:06.473100 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-8e3558ec-6c1c-4e4c-9587-abf08b407074 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0666685 Nov 24 14:35:06.608039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-194b7a73-bf5a-4b80-adcc-dbc611d76c26 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1229563 Nov 24 14:35:06.735482 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cd17b75-be04-412a-b5ef-78b9558f8be5 req-bd47158e-8cf2-4d31-b4e9-4702bc2bd65a service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1212907 Nov 24 14:35:06.867937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:08.556408 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:18.066226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:27.824578 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:35:33.288734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fd6cd017-d430-46d7-a9ca-d57eae1e26bd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:33.686151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:35.846644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a6b8e670-ce31-4b06-b05b-1056b433799b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:36.871475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:38.557677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:39.666347 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36bf2396-f9f4-4f9d-8d0c-a1cab3277dad req-0fd6ab5a-9638-45a1-b338-c76e98fc59bd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:39.667781 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-36bf2396-f9f4-4f9d-8d0c-a1cab3277dad req-0fd6ab5a-9638-45a1-b338-c76e98fc59bd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.1522501 Nov 24 14:35:39.715184 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-36bf2396-f9f4-4f9d-8d0c-a1cab3277dad req-1e421ed2-f6f1-469a-a815-1b49bb5c5cae tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413888 Nov 24 14:35:40.014386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cd85a514-5393-40da-8f69-73389ebdfacf req-7a7308f4-9ba9-4ead-9817-de517df8b84d service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.1718693 Nov 24 14:35:40.270930 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-c5de648c-d30f-46aa-8a53-963423359de1 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0727007 Nov 24 14:35:40.328789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f737e3a0-5790-404f-a737-528c2431bc3d req-2ba0a80a-7784-432b-a75b-a532b9bf50b4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:40.330570 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f737e3a0-5790-404f-a737-528c2431bc3d req-2ba0a80a-7784-432b-a75b-a532b9bf50b4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0795314 Nov 24 14:35:40.380309 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f737e3a0-5790-404f-a737-528c2431bc3d req-50e5acf6-9954-4fb6-a13d-239dc7c34854 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442324 Nov 24 14:35:41.467976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-8de401b4-d662-4ed4-a312-16c8774b901f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1099 time: 0.0749476 Nov 24 14:35:41.644219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80509d06-5bbd-455e-8a23-c591314159c7 req-86ecb02b-c19c-4100-bf6b-0a9f026ec784 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:41.645644 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-86ecb02b-c19c-4100-bf6b-0a9f026ec784 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1707747 Nov 24 14:35:41.718621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d47229-56a4-4e51-b5a3-13d20c702f1b req-015eb170-1c7a-4c0c-8db9-d7a8dcbe1543 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:41.720156 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e7d47229-56a4-4e51-b5a3-13d20c702f1b req-015eb170-1c7a-4c0c-8db9-d7a8dcbe1543 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.1759624 Nov 24 14:35:41.797860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-c5f9fae5-229b-4530-b549-0e25bfe21137 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 1002 time: 0.1459155 Nov 24 14:35:41.800364 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e7d47229-56a4-4e51-b5a3-13d20c702f1b req-50410ebc-9408-4402-8649-33a0e9b58747 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678639 Nov 24 14:35:41.863632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80509d06-5bbd-455e-8a23-c591314159c7 req-026d0f64-4a77-4ee1-833c-87c4fad75a3a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:41.865137 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-026d0f64-4a77-4ee1-833c-87c4fad75a3a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0600135 Nov 24 14:35:41.937041 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-54c926a8-7843-472f-8300-5d796eefdc33 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0659833 Nov 24 14:35:42.068709 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-2ed295e6-d9cf-4ef4-8f0a-6aaec99d2a8f service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1244245 Nov 24 14:35:42.199366 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-e3677ef4-c22e-4649-a761-5e641a7424c4 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246922 Nov 24 14:35:43.007296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d8501c-d4c0-4267-b90e-479f00828fc6 req-a67dc13b-8699-4c27-b7ad-ec34b9e4c116 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:43.008748 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-73d8501c-d4c0-4267-b90e-479f00828fc6 req-a67dc13b-8699-4c27-b7ad-ec34b9e4c116 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0792787 Nov 24 14:35:43.054169 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-73d8501c-d4c0-4267-b90e-479f00828fc6 req-006c2bcb-b73b-4c2f-b660-68d5bc93ff91 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397615 Nov 24 14:35:44.259146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ee94c11-e940-4fb2-9b11-9a1a44651c23 req-c4e6aafe-5425-4ce7-97fd-d0bb25e79e93 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:44.260598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7ee94c11-e940-4fb2-9b11-9a1a44651c23 req-c4e6aafe-5425-4ce7-97fd-d0bb25e79e93 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0838139 Nov 24 14:35:44.306429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7ee94c11-e940-4fb2-9b11-9a1a44651c23 req-26dfa24f-293e-43b0-80be-685aeae3b37a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402653 Nov 24 14:35:45.517249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16250236-24ca-4178-afe6-357019cdbcbe req-4d272bc3-ac20-4671-a61b-3bee24144105 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:45.518889 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-16250236-24ca-4178-afe6-357019cdbcbe req-4d272bc3-ac20-4671-a61b-3bee24144105 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0934019 Nov 24 14:35:45.568925 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-16250236-24ca-4178-afe6-357019cdbcbe req-5c174213-7c8f-451c-84d7-7bafb5b4d19a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440142 Nov 24 14:35:46.765547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52d6102-c893-4ecd-9873-c74e4a2bca15 req-17226f52-e839-4897-a3a5-d4f6852344b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:46.767239 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f52d6102-c893-4ecd-9873-c74e4a2bca15 req-17226f52-e839-4897-a3a5-d4f6852344b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0793068 Nov 24 14:35:46.812279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f52d6102-c893-4ecd-9873-c74e4a2bca15 req-8fc9462b-c5ae-40e6-af23-fa709ac02b91 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395520 Nov 24 14:35:48.007526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b538936-8fc9-4ac1-a6ae-e4208586b6df req-99cc328c-2202-48b6-b8bf-f55d66311523 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:48.008962 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3b538936-8fc9-4ac1-a6ae-e4208586b6df req-99cc328c-2202-48b6-b8bf-f55d66311523 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0755777 Nov 24 14:35:48.053812 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3b538936-8fc9-4ac1-a6ae-e4208586b6df req-effa1985-7d2c-4eca-911a-94333bbe83e6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394225 Nov 24 14:35:48.070627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:49.257799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26904f52-0f51-44ef-bcd5-c57df4fd20fe req-16689606-ce2f-4f71-918d-19b328bebd53 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:49.259222 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-26904f52-0f51-44ef-bcd5-c57df4fd20fe req-16689606-ce2f-4f71-918d-19b328bebd53 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0824611 Nov 24 14:35:49.305733 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-26904f52-0f51-44ef-bcd5-c57df4fd20fe req-e5ec4491-d6aa-4b2b-97f6-3925f9dc59ca tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409970 Nov 24 14:35:50.506878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780613c5-ffc5-4672-971b-63d00cc94781 req-8046beb5-5df8-4745-99ef-6b588fc329e2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:50.508329 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-780613c5-ffc5-4672-971b-63d00cc94781 req-8046beb5-5df8-4745-99ef-6b588fc329e2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0803638 Nov 24 14:35:50.552744 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-780613c5-ffc5-4672-971b-63d00cc94781 req-2c0eb106-1e20-4b31-b1d3-d2e2898cf91d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388632 Nov 24 14:35:51.751469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e889e0a8-2179-40a0-9cd6-2ae201893bd9 req-912b6007-3d8c-468f-bf03-b60e2c9b19c1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:51.752920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e889e0a8-2179-40a0-9cd6-2ae201893bd9 req-912b6007-3d8c-468f-bf03-b60e2c9b19c1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0781701 Nov 24 14:35:51.799004 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e889e0a8-2179-40a0-9cd6-2ae201893bd9 req-7738967b-142b-4a73-bf6c-29dfab4287b5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401628 Nov 24 14:35:53.001777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79f9fbf-05ff-4970-97f9-01e62d02874b req-e9cb638b-581b-44ee-b522-c8af509893ac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:53.003187 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c79f9fbf-05ff-4970-97f9-01e62d02874b req-e9cb638b-581b-44ee-b522-c8af509893ac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0774164 Nov 24 14:35:53.047537 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c79f9fbf-05ff-4970-97f9-01e62d02874b req-5ce57e5e-a50c-4eb4-ada2-f26e4360d3fa tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388839 Nov 24 14:35:53.961773 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-73b9922b-a430-4901-8983-9369ddd97ac4 service neutron] 10.222.0.47 "GET /v2.0/ports/0686f929-b528-4908-a879-f8e7296ebcc9/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0769668 Nov 24 14:35:54.293064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-d0b6d69e-4a89-40f9-9a46-83790b151dc1 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 1099 time: 0.1329708 Nov 24 14:35:54.304662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42288e76-fef9-44ed-8a3d-7abc2d2dfb61 req-7908cb66-440b-4ce6-a3d9-e780a8f66ca5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:54.306059 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42288e76-fef9-44ed-8a3d-7abc2d2dfb61 req-7908cb66-440b-4ce6-a3d9-e780a8f66ca5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.1152356 Nov 24 14:35:54.394267 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42288e76-fef9-44ed-8a3d-7abc2d2dfb61 req-8d39d9e6-db9c-4ee5-bb28-b96dfa072a73 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0826702 Nov 24 14:35:54.419205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-de59cbf3-aa12-4c7c-8cb6-8f6e994b0d68 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1099 time: 0.0934403 Nov 24 14:35:54.657050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80509d06-5bbd-455e-8a23-c591314159c7 req-803cb501-ffb7-40da-a543-b54d0fe0569b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:54.658649 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-803cb501-ffb7-40da-a543-b54d0fe0569b service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.2333078 Nov 24 14:35:54.763146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-6cdad62c-357e-42b3-9489-c2072398c673 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 1002 time: 0.0974958 Nov 24 14:35:54.828593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80509d06-5bbd-455e-8a23-c591314159c7 req-98a6ef0b-9ca6-4af8-9bbe-3fefa4e6d371 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:54.830058 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-98a6ef0b-9ca6-4af8-9bbe-3fefa4e6d371 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0610836 Nov 24 14:35:54.903546 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-c94c6639-6986-4ddc-9110-8e5c98923204 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0665722 Nov 24 14:35:55.033874 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-5f9396cc-c098-44fb-9492-ac049edab50e service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238453 Nov 24 14:35:55.164362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80509d06-5bbd-455e-8a23-c591314159c7 req-0d809f34-5cf7-4422-bb9a-e4f2afb3e6c3 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242163 Nov 24 14:35:55.597689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-305516b9-627e-4b32-99db-eb8fdee4e86b req-ca954ca4-7c7b-427b-9918-d8f5a777751f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:55.599107 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-305516b9-627e-4b32-99db-eb8fdee4e86b req-ca954ca4-7c7b-427b-9918-d8f5a777751f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0788560 Nov 24 14:35:55.649469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-305516b9-627e-4b32-99db-eb8fdee4e86b req-d96b8cfb-2c6c-4d4e-944b-6c65197b1bd5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446379 Nov 24 14:35:56.856190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325bd85f-5303-4adf-a8bb-a2e0b7092621 req-b9179152-daea-4bfc-b141-892183057930 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:56.857616 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-325bd85f-5303-4adf-a8bb-a2e0b7092621 req-b9179152-daea-4bfc-b141-892183057930 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0831573 Nov 24 14:35:56.903172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-325bd85f-5303-4adf-a8bb-a2e0b7092621 req-fc448127-f88a-415f-b05d-294361c68766 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399497 Nov 24 14:35:57.650752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:35:57.654529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:35:57.876840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:57.897980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:35:57.917472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '0686f929-b528-4908-a879-f8e7296ebcc9', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '0686f929-b528-4908-a879-f8e7296ebcc9', 'mac_address': 'fa:16:3e:fc:96:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:35:57.922252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:35:57.963910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:35:57.973305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:57.982083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:35:58.010502 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9', 'code': 200} Nov 24 14:35:58.027969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:58.058603 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 0686f929-b528-4908-a879-f8e7296ebcc9 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:35:58.071498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:35:58.109228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c31fc4-7ab5-4adc-9888-9e80dcd2be02 req-9a1791f2-3fa4-4a1d-a03b-109f2becb575 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:58.110772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d2c31fc4-7ab5-4adc-9888-9e80dcd2be02 req-9a1791f2-3fa4-4a1d-a03b-109f2becb575 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 944 time: 0.0801651 Nov 24 14:35:58.116297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.116643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.116973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.117300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.117626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.117948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.118270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.118588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.118902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.119249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.119573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:35:58.125256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:35:58.139933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:35:58.140342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:35:58.161993 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d2c31fc4-7ab5-4adc-9888-9e80dcd2be02 req-d2f152bc-4306-46d9-9e6e-446118fa6ecc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449717 Nov 24 14:35:58.698943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:58.751854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0686f929-b528-4908-a879-f8e7296ebcc9 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:35:58.767139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:35:58.770892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:58.772624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:35:58.833917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['0686f929-b528-4908-a879-f8e7296ebcc9'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:35:58.882607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:35:58.887153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:35:59.371836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e430707-90ab-475c-9e45-d755d2cbf727 req-a0f5dca3-22de-4aa1-9adf-423b7cd0077f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:59.373292 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5e430707-90ab-475c-9e45-d755d2cbf727 req-a0f5dca3-22de-4aa1-9adf-423b7cd0077f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 945 time: 0.0775535 Nov 24 14:35:59.432105 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5e430707-90ab-475c-9e45-d755d2cbf727 req-0065d6a9-cb9e-401b-b7e9-18c81d4fb3f7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0532970 Nov 24 14:35:59.663954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:35:59.735729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 0686f929-b528-4908-a879-f8e7296ebcc9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:35:59.736401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:59.752175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f35284-341f-4edf-8e49-85b28f5eb495 req-51b16cdb-b08b-41d0-9684-aa55dea93e41 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:59.753614 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-56f35284-341f-4edf-8e49-85b28f5eb495 req-51b16cdb-b08b-41d0-9684-aa55dea93e41 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 945 time: 0.0789199 Nov 24 14:35:59.766783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-79af70ea-035a-4be1-9eb2-2ab41805bfa3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:35:59.768233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-79af70ea-035a-4be1-9eb2-2ab41805bfa3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8&tenant_id=644eeb3051394d9da6b3f5fb4139e803&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 945 time: 0.0994987 Nov 24 14:35:59.805408 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-56f35284-341f-4edf-8e49-85b28f5eb495 req-35b36b6f-8b58-440a-9665-394ce5811627 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454609 Nov 24 14:35:59.873702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:59.909364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:35:59.914094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:35:59.916010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-5b4121ed-5b89-46e0-93e3-1120f3d518bb service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 1098 time: 0.0711348 Nov 24 14:35:59.916841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:35:59.986471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:35:59.990387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:00.011131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:36:00.048428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-e1123b4a-272d-4e65-9de5-5959116a415f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:00.049863 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-e1123b4a-272d-4e65-9de5-5959116a415f service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1281536 Nov 24 14:36:00.077755 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9', 'code': 200} Nov 24 14:36:00.154768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-12fafdd1-9d25-4f85-8236-97f48134bb61 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 200 len: 1002 time: 0.0984540 Nov 24 14:36:00.220288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-77b064e8-6060-456c-9348-f3e5bc3aa39a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:00.221676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-77b064e8-6060-456c-9348-f3e5bc3aa39a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0596139 Nov 24 14:36:00.301270 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-b7e0719d-8cea-4f04-8c80-97e634243275 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0732508 Nov 24 14:36:00.430077 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-c5c37a09-3be6-4d87-926a-2a3f5e1440bf service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1228023 Nov 24 14:36:00.668285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a374dd84-dfd6-4840-b026-54ecb79c4ec5 req-2f922e95-dd24-4eeb-89ed-c25c1711b1be service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2320552 Nov 24 14:36:01.021973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7d44598-3ac0-4a43-8919-2b979e0e193f req-70aa31a5-9ee6-486b-8d9e-77ebf6a9b696 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:01.023340 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d7d44598-3ac0-4a43-8919-2b979e0e193f req-70aa31a5-9ee6-486b-8d9e-77ebf6a9b696 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0860078 Nov 24 14:36:01.189272 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d7d44598-3ac0-4a43-8919-2b979e0e193f req-d67a1c6a-4382-40fc-bb4c-74c091be14a9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1597593 Nov 24 14:36:02.387955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0828e7b7-7371-43b9-83d2-fec92e71bb23 req-85179f68-2c26-421f-89ba-3f1616f47e40 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:02.389377 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0828e7b7-7371-43b9-83d2-fec92e71bb23 req-85179f68-2c26-421f-89ba-3f1616f47e40 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0762851 Nov 24 14:36:02.435720 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0828e7b7-7371-43b9-83d2-fec92e71bb23 req-e3631d79-26f4-4189-9b61-45ee057b5090 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406942 Nov 24 14:36:02.636625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4cd689-f17e-4620-a987-edbdbfd4fd11 req-4a7fdd1d-b3ec-47e7-b547-f5c675f3ea17 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:02.638054 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ff4cd689-f17e-4620-a987-edbdbfd4fd11 req-4a7fdd1d-b3ec-47e7-b547-f5c675f3ea17 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0770836 Nov 24 14:36:02.682553 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ff4cd689-f17e-4620-a987-edbdbfd4fd11 req-7a31c1b3-2b3a-44a7-b972-68100b83a33d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389590 Nov 24 14:36:02.886611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-355ef46a-6a46-44bc-aa19-020d9c75d565 req-0f279965-d5de-4fb0-a9e4-f369ff92d3c5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:02.888059 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-355ef46a-6a46-44bc-aa19-020d9c75d565 req-0f279965-d5de-4fb0-a9e4-f369ff92d3c5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0804574 Nov 24 14:36:02.932848 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-355ef46a-6a46-44bc-aa19-020d9c75d565 req-77f0dab4-f8f9-4764-977b-60dd5ea96002 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392704 Nov 24 14:36:03.280797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7d18373f-6395-4fed-8407-77fb8b35c698 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:03.334526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01c9845-dc2b-4a20-912a-a0d1324daa8a req-cebee3b1-e1f0-4c1d-9863-595807837be0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:03.336005 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e01c9845-dc2b-4a20-912a-a0d1324daa8a req-cebee3b1-e1f0-4c1d-9863-595807837be0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0775902 Nov 24 14:36:03.384727 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e01c9845-dc2b-4a20-912a-a0d1324daa8a req-848ab8c3-5fd3-4f5a-a3b1-b36b18f3e45f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428286 Nov 24 14:36:03.688693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:04.588846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36e8504-8465-4a25-b089-f3aaf75efccd req-61ca940f-0148-483a-b227-06f6f4ee1a77 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:04.590182 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c36e8504-8465-4a25-b089-f3aaf75efccd req-61ca940f-0148-483a-b227-06f6f4ee1a77 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0771253 Nov 24 14:36:04.635428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c36e8504-8465-4a25-b089-f3aaf75efccd req-b6812536-0e0c-4d08-81fa-46d960d49218 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395153 Nov 24 14:36:04.824285 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:36:05.202484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-ca321fba-3007-47cd-8774-20053ba2b474 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:05.203908 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-ca321fba-3007-47cd-8774-20053ba2b474 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.0751724 Nov 24 14:36:05.270443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Deleting port 0686f929-b528-4908-a879-f8e7296ebcc9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:36:05.270789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:05.521187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] For port 0686f929-b528-4908-a879-f8e7296ebcc9, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0686f929-b528-4908-a879-f8e7296ebcc9,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:36:05.521543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:05.849060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dbf09e4-5653-4295-a1c1-ba0fc703663e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:05.853847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:05.854222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:05.854530 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 disassociated. External IP: 172.26.4.246, port: 0686f929-b528-4908-a879-f8e7296ebcc9. Nov 24 14:36:05.854870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Calling delete_port for 0686f929-b528-4908-a879-f8e7296ebcc9 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:36:05.928818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592eb4ef-9f8b-47ad-a3e8-37f708899142 req-22ad07f6-cb65-4106-a232-ce98cef22979 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:05.930216 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-592eb4ef-9f8b-47ad-a3e8-37f708899142 req-22ad07f6-cb65-4106-a232-ce98cef22979 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 946 time: 0.1682363 Nov 24 14:36:06.023319 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-592eb4ef-9f8b-47ad-a3e8-37f708899142 req-bbc84533-3e68-4804-a209-1741869d7f9b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0796921 Nov 24 14:36:06.046923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:06.052585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b02d5bb3-1216-42d4-86df-50fb8482f30c tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:36:06.099200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event deleted for resources: {'Port': ['ID=0686f929-b528-4908-a879-f8e7296ebcc9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:36:06.112389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.112780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.113161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.113538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.113911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.114285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.114660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.115030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.115415 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.115828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.116195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:36:06.120063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:06.327380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:36:06.643653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:36:06.653494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:36:06.666228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:36:06.667059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:36:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:06.717896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] No DVR routers for this DVR port 0686f929-b528-4908-a879-f8e7296ebcc9 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:36:06.721522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:06.724396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-deleted', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:36:06.741588 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31ad3767-04ae-45d8-9281-1ca478c0f774 req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "DELETE /v2.0/ports/0686f929-b528-4908-a879-f8e7296ebcc9 HTTP/1.1" status: 204 len: 173 time: 1.5311887 Nov 24 14:36:06.869682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:36:06.918815 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0a399caa-b64d-4513-ab4f-1cb549b7d0e8', 'name': 'network-vif-deleted', 'tag': '0686f929-b528-4908-a879-f8e7296ebcc9', 'status': 'completed', 'code': 200} Nov 24 14:36:06.926200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:06.930985 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cf4648f-5ede-4035-8a4d-e921e1c2dd0c req-3d98455a-8655-4be9-ab92-80577f1891ef service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0487664 Nov 24 14:36:07.043035 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cf4648f-5ede-4035-8a4d-e921e1c2dd0c req-d9dbdd2e-aaac-4bcb-8c3b-dfb5a0c16404 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 210 time: 0.0404763 Nov 24 14:36:07.205758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:07.210467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:36:07.222282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9cab1ed3-896b-4caa-924d-108067ef6ff5 req-cca414be-b8b9-478f-9e31-679f1531bbf8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:36:07.224695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:36:07.225320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:36:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:07.266864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf4648f-5ede-4035-8a4d-e921e1c2dd0c req-ed563321-a214-4c5d-bc92-6bb524126e1c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:07.269033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cf4648f-5ede-4035-8a4d-e921e1c2dd0c req-ed563321-a214-4c5d-bc92-6bb524126e1c service neutron] 10.222.0.47 "GET /v2.0/networks?tenant_id=644eeb3051394d9da6b3f5fb4139e803&shared=False HTTP/1.1" status: 200 len: 913 time: 0.2049491 Nov 24 14:36:07.306125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9cab1ed3-896b-4caa-924d-108067ef6ff5 req-cca414be-b8b9-478f-9e31-679f1531bbf8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:36:07.307239 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9cab1ed3-896b-4caa-924d-108067ef6ff5 req-cca414be-b8b9-478f-9e31-679f1531bbf8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0a399caa-b64d-4513-ab4f-1cb549b7d0e8 HTTP/1.1" status: 200 len: 210 time: 0.1345022 Nov 24 14:36:07.425702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf4648f-5ede-4035-8a4d-e921e1c2dd0c req-3f882d02-7a6d-40f0-bbc9-7c2099525d82 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:07.427240 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3cf4648f-5ede-4035-8a4d-e921e1c2dd0c req-3f882d02-7a6d-40f0-bbc9-7c2099525d82 service neutron] 10.222.0.47 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1449673 Nov 24 14:36:07.434831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:36:07.781985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:07.785875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cf6798f-c060-469d-b1ba-40e2f02f1b8e None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:36:07.998119 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b41e1a04-539c-4569-af94-8448728af5fb None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:36:08.563436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:08.672321 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-f16621bc-b3a2-4f3a-aa7a-ab79bee109df tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--290047065&fields=id&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 267 time: 0.0402403 Nov 24 14:36:08.816148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-7cea3a72-22f5-49a7-9bf0-548ef49831bd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:08.817461 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-7cea3a72-22f5-49a7-9bf0-548ef49831bd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1384447 Nov 24 14:36:08.835717 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-d4ab7bc2-4170-4759-91b3-8d1720021145 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/quotas/644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 375 time: 0.0122108 Nov 24 14:36:08.920678 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c935b4cc-30a2-4665-a6d3-d01f1eba1042 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0800509 Nov 24 14:36:09.120795 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-ce8c7d77-4a44-490a-bfa3-279a806b901c service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1877022 Nov 24 14:36:09.255386 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-78109d8c-8600-47b2-b147-0605d2f94eed service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288865 Nov 24 14:36:09.464266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9d988003-6865-4570-b492-e46149d0e134 req-78216b1f-cb52-42c1-b0fc-95a63a1b1ade tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 210 time: 0.0486004 Nov 24 14:36:09.658741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:36:09.696010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 0686f929-b528-4908-a879-f8e7296ebcc9 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:36:09.696370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0686f929-b528-4908-a879-f8e7296ebcc9 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:36:10.531166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-81c63a3b-dd5a-4837-b4df-57ddd2a37ad6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:10.532730 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-81c63a3b-dd5a-4837-b4df-57ddd2a37ad6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1502876 Nov 24 14:36:10.589114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-fe9875c2-6bd8-4a12-8dfc-d55171031c22 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 379 time: 0.0426495 Nov 24 14:36:10.602556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'port': {'device_id': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'admin_state_up': True, 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'security_groups': ['7ef8b8e0-808b-4ac2-88ce-f247cce14b78']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:36:10.652951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-54c5d5cb-ae06-4c0c-b3f7-4707edfd828d req-9500d9b4-e8bf-49c4-9647-7bef53c3767f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 210 time: 0.0433011 Nov 24 14:36:10.738303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:36:10.749682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:36:10.759829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Made reservation on behalf of 644eeb3051394d9da6b3f5fb4139e803 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:36:10.762857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:10.922807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Allocated IP 172.20.0.9 (b20ce7e1-47d2-4747-a9a3-ec140e6fcda1/22012fd4-20c7-4275-844f-7e901c9b102d/69b52f35-ccaa-4176-a323-e3cface74d49) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:36:11.109714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:11.125241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Transition to ACTIVE for port object 69b52f35-ccaa-4176-a323-e3cface74d49 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:36:11.149020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:11.155050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-381500f7-95a3-46b7-9527-8f1279aac292 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:36:11.218487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:36:11.225826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:36:11.230234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:36:11.261951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:36:11.268491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:11.296942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:11.297643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:11.324954 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7272704 Nov 24 14:36:11.339653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Request body: {'port': {'device_id': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:36:11.492528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4a1b86b8-5a48-4ca8-bc38-2e03c44798d5 None None] Provisioning for port 69b52f35-ccaa-4176-a323-e3cface74d49 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:36:11.498655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4a1b86b8-5a48-4ca8-bc38-2e03c44798d5 None None] Provisioning complete for port 69b52f35-ccaa-4176-a323-e3cface74d49 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:36:11.499126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4a1b86b8-5a48-4ca8-bc38-2e03c44798d5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:11.561271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4a1b86b8-5a48-4ca8-bc38-2e03c44798d5 None None] Port 69b52f35-ccaa-4176-a323-e3cface74d49 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:36:11.567991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:11.917357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25c26a1-0fa5-4f5d-8b5b-0af1194613ad req-6d3a5da7-fc43-49ee-bd1c-f80d04acbc9d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:11.918040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d25c26a1-0fa5-4f5d-8b5b-0af1194613ad req-6d3a5da7-fc43-49ee-bd1c-f80d04acbc9d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:36:11.983054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d25c26a1-0fa5-4f5d-8b5b-0af1194613ad req-6d3a5da7-fc43-49ee-bd1c-f80d04acbc9d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:36:11.984299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d25c26a1-0fa5-4f5d-8b5b-0af1194613ad req-6d3a5da7-fc43-49ee-bd1c-f80d04acbc9d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 931 time: 0.2027564 Nov 24 14:36:11.990252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 69b52f35-ccaa-4176-a323-e3cface74d49 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:36:11.999743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:12.032903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Transition to ACTIVE for port object 69b52f35-ccaa-4176-a323-e3cface74d49 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:36:12.042068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:12.047940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4c63d2c-b935-4b05-b573-b3be1c8bd55f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:36:12.105086 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d25c26a1-0fa5-4f5d-8b5b-0af1194613ad req-74e1f444-98b6-4091-97c9-b1a98dcd5990 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1097913 Nov 24 14:36:12.199390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:36:12.202478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:12.318985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Attempting to bind port 69b52f35-ccaa-4176-a323-e3cface74d49 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:36:12.319365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Attempting to bind port 69b52f35-ccaa-4176-a323-e3cface74d49 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:36:12.319625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Attempting to bind port 69b52f35-ccaa-4176-a323-e3cface74d49 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:36:12.326055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Port 69b52f35-ccaa-4176-a323-e3cface74d49 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:36:12.326371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Attempting to bind port 69b52f35-ccaa-4176-a323-e3cface74d49 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:36:12.333113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 35, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:36:12.333465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:36:12.333906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Bound using segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:36:12.335245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Bound port: 69b52f35-ccaa-4176-a323-e3cface74d49, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:36:12.335420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:12.426614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:36:12.430736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:36:12.434480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:12.440087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3fbc8eb2-eada-4285-80fc-672cc07c0b5a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:36:12.497441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:12.498846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] 10.222.0.47 "PUT /v2.0/ports/69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 1093 time: 1.1659849 Nov 24 14:36:12.499413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:36:12.523518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:36:12.526968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:12.586860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49', 'status': 'completed', 'code': 200} Nov 24 14:36:12.629702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-89008068-ef53-4ac4-a252-4ce1cb877cdd service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1096 time: 0.0741270 Nov 24 14:36:12.703226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-1f31cff6-6085-46a7-9968-de95df8fe98e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 217 time: 0.0661647 Nov 24 14:36:12.765625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-2e57602a-3093-4044-b3fe-941bd9f26983 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:12.766922 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-2e57602a-3093-4044-b3fe-941bd9f26983 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0581720 Nov 24 14:36:12.842785 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-27df12ef-09a6-450b-9c86-b4cc4e5c5a42 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0688369 Nov 24 14:36:12.973647 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-3bb3c599-13fc-4ed8-a4cc-bb99bd9f1416 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1240985 Nov 24 14:36:13.104316 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d6cc459d-0786-460b-833a-477a4caf4c74 req-a195cb29-620a-4664-b78e-2c7d02f10a1c service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1251097 Nov 24 14:36:13.225678 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-58d68b5e-47c0-4731-aad6-b5e4fd5ad742 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1096 time: 0.0765123 Nov 24 14:36:13.514515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-f3e9f497-b5f6-4dbb-8844-6c4f4f2e783b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:13.515908 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-f3e9f497-b5f6-4dbb-8844-6c4f4f2e783b service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.2842462 Nov 24 14:36:13.525246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61aca890-3f27-4fe3-a6fe-db797f2b59d3 req-d72965e9-be3b-42ed-bdb8-83080a0e654d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:13.526575 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-61aca890-3f27-4fe3-a6fe-db797f2b59d3 req-d72965e9-be3b-42ed-bdb8-83080a0e654d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 943 time: 0.2762961 Nov 24 14:36:13.613780 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-2a722995-3be1-49a9-9ad3-609055f3eca3 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 217 time: 0.0862522 Nov 24 14:36:13.678508 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-61aca890-3f27-4fe3-a6fe-db797f2b59d3 req-1a260baa-bfe1-48a8-a0a6-3423639a6ccd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0990617 Nov 24 14:36:13.693611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-d02ff1ec-79a5-424b-8066-bc38f1a5f918 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:13.695172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-d02ff1ec-79a5-424b-8066-bc38f1a5f918 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0699999 Nov 24 14:36:13.769742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-c3cd4b3f-32ca-4ea0-abc9-bedfb56977e7 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0678406 Nov 24 14:36:13.908911 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-807dfb8c-6a77-4fb0-b6a2-b8cd4e41dfb1 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314735 Nov 24 14:36:14.048778 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a8defcf-4855-4e91-adfc-529d538b54ee req-7c93883d-d3e1-4f4f-a2ee-7b93ecdad36e service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1330018 Nov 24 14:36:14.886028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc7d3ed-3c0d-4abf-9ff6-6e362832750d req-73ef257c-4b52-41f1-9f37-f7d4ef9003b6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:14.887451 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0dc7d3ed-3c0d-4abf-9ff6-6e362832750d req-73ef257c-4b52-41f1-9f37-f7d4ef9003b6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 943 time: 0.0848567 Nov 24 14:36:14.934047 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0dc7d3ed-3c0d-4abf-9ff6-6e362832750d req-1e18aaa0-9493-4745-a4e0-26b4ea81e83b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407629 Nov 24 14:36:15.711719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:36:15.847019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:36:15.860500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '69b52f35-ccaa-4176-a323-e3cface74d49', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '69b52f35-ccaa-4176-a323-e3cface74d49', 'mac_address': 'fa:16:3e:60:22:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:36:15.916896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:15.934724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 69b52f35-ccaa-4176-a323-e3cface74d49 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:36:15.949421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:36:15.953719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:15.955947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:36:16.022906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:36:16.026338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:16.139575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ec33f4-1e5e-4340-a775-6ab092f116a5 req-13bb176f-2a39-4a45-b114-dd32feedf3d4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:16.141039 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04ec33f4-1e5e-4340-a775-6ab092f116a5 req-13bb176f-2a39-4a45-b114-dd32feedf3d4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 944 time: 0.0783939 Nov 24 14:36:16.192842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04ec33f4-1e5e-4340-a775-6ab092f116a5 req-b0fbf39b-5e29-45b8-aee0-70f3aedbe9f1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461531 Nov 24 14:36:16.273014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['69b52f35-ccaa-4176-a323-e3cface74d49'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:36:17.391137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e11b7f1-b18e-4c76-94c1-eb15856bd9c4 req-571ad9ae-bf5c-4c35-b622-641c2b2f6ab6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:17.392612 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5e11b7f1-b18e-4c76-94c1-eb15856bd9c4 req-571ad9ae-bf5c-4c35-b622-641c2b2f6ab6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 944 time: 0.0772674 Nov 24 14:36:17.439491 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5e11b7f1-b18e-4c76-94c1-eb15856bd9c4 req-6df0a41b-72c3-4675-a2a3-4c39719653c9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409451 Nov 24 14:36:17.720222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:36:17.786493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 69b52f35-ccaa-4176-a323-e3cface74d49 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:36:17.791906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 69b52f35-ccaa-4176-a323-e3cface74d49 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:36:17.792287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:17.908599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:17.936435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:36:17.947281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:36:17.951318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:17.953831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a93d7bd5-8b00-407f-8d4d-2a5f4a07edfb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:36:18.000292 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49', 'code': 200} Nov 24 14:36:18.027562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:36:18.030455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:36:18.078926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:18.224976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-55da5bb2-6047-4ad6-93a5-324faf297b92 req-e0f3a953-7c0a-4692-bc9b-c14b680f9249 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0687513 Nov 24 14:36:18.268412 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-55da5bb2-6047-4ad6-93a5-324faf297b92 req-7c23f1b1-def6-4f18-853d-eb66db25a0ad service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377188 Nov 24 14:36:18.640879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d80072-6fae-4d3a-8792-99f4a8d404b0 req-dc6c5490-5740-49a1-9777-4d169004b031 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:18.642312 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09d80072-6fae-4d3a-8792-99f4a8d404b0 req-dc6c5490-5740-49a1-9777-4d169004b031 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0808928 Nov 24 14:36:18.688917 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-09d80072-6fae-4d3a-8792-99f4a8d404b0 req-825bea5c-7680-4461-9598-58c7a592735e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405710 Nov 24 14:36:19.889447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d5b3e8-923c-4039-9b66-6d59402fbbc1 req-0ba8ab8f-aca2-4907-ba87-e41fa525364e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:19.890989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62d5b3e8-923c-4039-9b66-6d59402fbbc1 req-0ba8ab8f-aca2-4907-ba87-e41fa525364e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0806658 Nov 24 14:36:19.935946 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62d5b3e8-923c-4039-9b66-6d59402fbbc1 req-8efc77e1-afa8-444e-9da0-11e9484c331a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386651 Nov 24 14:36:20.127691 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336dd7a0-ee20-41fe-9482-12659f5dd7aa req-e346c946-8969-4ee3-b91b-57672a0c4a48 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:20.129181 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-336dd7a0-ee20-41fe-9482-12659f5dd7aa req-e346c946-8969-4ee3-b91b-57672a0c4a48 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0762908 Nov 24 14:36:20.138595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 50948) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:36:20.143915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'floatingip': {'port_id': '69b52f35-ccaa-4176-a323-e3cface74d49'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:36:20.222049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:20.936805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:20.940670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:21.134243 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 associated. External IP: 172.26.4.246, port: 69b52f35-ccaa-4176-a323-e3cface74d49. Nov 24 14:36:21.529391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:36:21.727364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:36:21.731698 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:21.738405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:36:21.752465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:36:21.753198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:36:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:21.794511 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8556be9c-b72b-40b2-b725-ae24c45c7b1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "PUT /v2.0/floatingips/7522ecd4-9586-4e09-9875-65fffb502df1 HTTP/1.1" status: 200 len: 991 time: 1.6546535 Nov 24 14:36:21.795511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:36:21.967120 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49', 'status': 'completed', 'code': 200} Nov 24 14:36:21.986217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:36:22.059310 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-c17471b5-f420-473a-a18f-397fe48b8923 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0715606 Nov 24 14:36:22.195329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-a09bd0a6-8d83-4dc9-ad0f-4115286beb27 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:22.196938 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-a09bd0a6-8d83-4dc9-ad0f-4115286beb27 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1315837 Nov 24 14:36:22.309695 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-3c1ae503-5e64-4eda-99e8-c28d8dff6f8e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 999 time: 0.1059871 Nov 24 14:36:22.378311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '69b52f35-ccaa-4176-a323-e3cface74d49', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:60:22:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:36:20Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:22.379306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-0f5c9905-fa01-4880-af11-a7d62f0fe95a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:36:22.381312 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-0f5c9905-fa01-4880-af11-a7d62f0fe95a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0647535 Nov 24 14:36:22.383933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:36:22.394853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:36:22.395451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:36:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:22.464612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-b08d96fb-c5a0-4d2e-8112-2fd9385bd0fa service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0767560 Nov 24 14:36:22.665154 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-7c51f5a3-1052-4612-a56b-57b40a2d37f1 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1941431 Nov 24 14:36:22.697415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:36:22.917904 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-34a4d20e-aaa0-4d35-9c4e-5783ab66d28d req-b6a65aa6-22ed-4dca-84a6-f9ccc18a1490 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2461450 Nov 24 14:36:23.073432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '69b52f35-ccaa-4176-a323-e3cface74d49', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:60:22:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:36:20Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:36:23.077633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c06bdf03-3bb0-4cd5-a535-2d5b8a9abae8 None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '69b52f35-ccaa-4176-a323-e3cface74d49', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:60:22:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:36:20Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:36:23.277898 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12691c61-402e-425f-8976-3fec807c19a8 None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:36:33.283162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0d81639f-b61f-4e36-b2dc-45bbbbeb58e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:33.691399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:35.852967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d2eb7216-b819-49da-8d3d-ff4e4238a217 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:36.875584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:38.564804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:36:41.825288 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:36:48.075541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:03.286282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bc9e54ea-1cad-44dc-bf74-fe82b17afb87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:03.698137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:05.854084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-45069086-837d-4c13-8b22-e8f5625ee6d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:06.881172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:06.999375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-cc869b9c-e58e-4f65-8464-a51f27d44159 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1326301 Nov 24 14:37:07.137484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-ac8ec6a4-282d-4ac8-9961-e3efaef3c292 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0702972 Nov 24 14:37:07.283583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-58d6ebf3-00a5-46e1-b667-9a28ec54c5a1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:07.285891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-58d6ebf3-00a5-46e1-b667-9a28ec54c5a1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1299458 Nov 24 14:37:07.388081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-fa0080fe-e342-41bf-aff8-01f7de3e1624 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 1001 time: 0.0959947 Nov 24 14:37:07.453012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-759925e6-d49c-4381-88d8-a6684e344642 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:07.454400 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-759925e6-d49c-4381-88d8-a6684e344642 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0592713 Nov 24 14:37:07.527751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-1d01b2e5-835c-41c9-bfe2-03d2cba696b4 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0670483 Nov 24 14:37:07.537789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-d681b256-58b7-4fa4-a7a3-1b87344e4407 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:37:07.538684 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-d681b256-58b7-4fa4-a7a3-1b87344e4407 service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0046937 Nov 24 14:37:07.669361 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-7d3d3f3a-88ba-4f5a-a330-3b1aa8a7ead2 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236820 Nov 24 14:37:07.798691 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-65b7629f-ff69-45db-a7d3-779d8ebbf8e5 req-0667daac-1c35-478e-8aaf-fe4585e6f517 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1227555 Nov 24 14:37:08.568596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:18.090520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:18.827494 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:37:33.288834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-37e13af0-2f93-463c-89b3-e9a627e5dfb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:33.699821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:35.857074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ceea771c-4b82-4f40-9e7a-288fc48efad7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:36.885632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:37.188020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d55461a-c977-4008-be77-f8ddacf13a24 req-a85a001e-e82c-4848-ac5d-e9c32646649c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:37.189450 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3d55461a-c977-4008-be77-f8ddacf13a24 req-a85a001e-e82c-4848-ac5d-e9c32646649c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0769455 Nov 24 14:37:37.235923 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3d55461a-c977-4008-be77-f8ddacf13a24 req-f8d5b7dd-abbb-4b71-b798-a1ece5be1867 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402153 Nov 24 14:37:38.435572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e155c125-345a-47c6-833e-05f22a8c0a29 req-2c23d8d8-38bf-40ab-9913-87b4f13b3a0a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:38.437024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e155c125-345a-47c6-833e-05f22a8c0a29 req-2c23d8d8-38bf-40ab-9913-87b4f13b3a0a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0800784 Nov 24 14:37:38.482008 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e155c125-345a-47c6-833e-05f22a8c0a29 req-947c3787-1ef1-4850-9849-1dd7a887e7ed tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390611 Nov 24 14:37:38.572843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:39.679982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d167441-9242-4a89-9527-74e5326a945a req-466e5a0c-968d-4a49-8642-e99c8572ab8b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:39.681411 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d167441-9242-4a89-9527-74e5326a945a req-466e5a0c-968d-4a49-8642-e99c8572ab8b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0786872 Nov 24 14:37:39.726978 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8d167441-9242-4a89-9527-74e5326a945a req-afd9d9a6-e03c-4551-9665-d11e189925b6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401402 Nov 24 14:37:40.934376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8406500-3252-44bd-8725-16394a172c5e req-3264a341-86d6-48b9-9194-b4184c1c0cac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:40.935817 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8406500-3252-44bd-8725-16394a172c5e req-3264a341-86d6-48b9-9194-b4184c1c0cac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0846512 Nov 24 14:37:40.981977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8406500-3252-44bd-8725-16394a172c5e req-081fbeb1-994c-4fe1-9dcd-e1c05184a1e8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406082 Nov 24 14:37:42.183283 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0628e233-0dff-485c-9317-74462c56ddde req-9270c17d-556b-496f-befe-ca876dc68c28 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:42.184750 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0628e233-0dff-485c-9317-74462c56ddde req-9270c17d-556b-496f-befe-ca876dc68c28 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0791507 Nov 24 14:37:42.230767 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0628e233-0dff-485c-9317-74462c56ddde req-ab28c867-02d4-4a9a-af3f-89e11877f7d5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405352 Nov 24 14:37:43.432181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e845354e-c0f8-474a-974f-fd384f6e4534 req-95f64800-5695-4ee7-8c22-1055abff29d2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:43.433621 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e845354e-c0f8-474a-974f-fd384f6e4534 req-95f64800-5695-4ee7-8c22-1055abff29d2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0808182 Nov 24 14:37:43.478994 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e845354e-c0f8-474a-974f-fd384f6e4534 req-348b977f-ea56-42c9-82da-43212af1cb3f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398779 Nov 24 14:37:44.801254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e5d6911-c5db-4e81-9abc-c0b1bf8c9f8e req-a1f73082-af23-4638-9a99-5eddec0aa18a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:44.802596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9e5d6911-c5db-4e81-9abc-c0b1bf8c9f8e req-a1f73082-af23-4638-9a99-5eddec0aa18a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.2011068 Nov 24 14:37:44.848909 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9e5d6911-c5db-4e81-9abc-c0b1bf8c9f8e req-4662c553-cbab-4a5b-94b4-04aa7025ee5e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400982 Nov 24 14:37:46.052239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5394a0fc-d88f-45ae-a2fc-5252599fd6db req-c2d72d4d-16ca-4ba6-b303-51fe51149b2b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:46.053689 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5394a0fc-d88f-45ae-a2fc-5252599fd6db req-c2d72d4d-16ca-4ba6-b303-51fe51149b2b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0776939 Nov 24 14:37:46.103562 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5394a0fc-d88f-45ae-a2fc-5252599fd6db req-6b89211d-078d-4249-9a90-50dfc8881674 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441630 Nov 24 14:37:47.305699 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2eefeb0-84e0-4ea0-b86c-749bae6dc9fa req-4d75d3c7-fbde-427a-8289-57dd8402b166 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:47.307149 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2eefeb0-84e0-4ea0-b86c-749bae6dc9fa req-4d75d3c7-fbde-427a-8289-57dd8402b166 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0786979 Nov 24 14:37:47.361037 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2eefeb0-84e0-4ea0-b86c-749bae6dc9fa req-2e5f8d0a-ccec-4e49-976c-f5e91709f4b0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479763 Nov 24 14:37:48.085453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:37:48.556459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a8d45d-a5a6-45df-bd8d-0c599c3700d7 req-b05e74ab-c139-47fd-b9a9-bd509a049d1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:48.558233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4a8d45d-a5a6-45df-bd8d-0c599c3700d7 req-b05e74ab-c139-47fd-b9a9-bd509a049d1d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0776761 Nov 24 14:37:48.602990 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4a8d45d-a5a6-45df-bd8d-0c599c3700d7 req-507377df-f492-4a8f-8b60-c4d1b508463a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394101 Nov 24 14:37:49.801758 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab37108-d30f-462e-b12e-8aeb2c5c510e req-5d0ca7e4-88ee-448c-9d80-120e9c04cfe0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:49.803197 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ab37108-d30f-462e-b12e-8aeb2c5c510e req-5d0ca7e4-88ee-448c-9d80-120e9c04cfe0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0772574 Nov 24 14:37:49.851453 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1ab37108-d30f-462e-b12e-8aeb2c5c510e req-f3c7bea6-5d38-424e-bb11-2fc6894eda87 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424161 Nov 24 14:37:51.057768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af54bd05-9ae6-4a36-9700-6647fcdf8fb6 req-d7e5c2b8-3879-48bc-a3ff-7e5630a64999 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:51.059194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af54bd05-9ae6-4a36-9700-6647fcdf8fb6 req-d7e5c2b8-3879-48bc-a3ff-7e5630a64999 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0823073 Nov 24 14:37:51.105560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af54bd05-9ae6-4a36-9700-6647fcdf8fb6 req-f16d0153-37f0-4918-9f43-62a16dbdb6aa tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406635 Nov 24 14:37:52.309469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00b5f4c2-c9e4-4326-8a88-87b4e196062d req-455d7c41-6c00-43bf-9c8f-623188bd443b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:52.311064 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-00b5f4c2-c9e4-4326-8a88-87b4e196062d req-455d7c41-6c00-43bf-9c8f-623188bd443b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0849071 Nov 24 14:37:52.375607 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-00b5f4c2-c9e4-4326-8a88-87b4e196062d req-8f61399c-22c5-4c6d-bb67-c4d17a0c955a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0570793 Nov 24 14:37:53.573461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f9ba44-c968-42f2-ac35-b4284a9a51db req-93e25734-f716-4da6-8bd1-90335d294bd3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:53.574823 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3f9ba44-c968-42f2-ac35-b4284a9a51db req-93e25734-f716-4da6-8bd1-90335d294bd3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0782194 Nov 24 14:37:53.620844 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c3f9ba44-c968-42f2-ac35-b4284a9a51db req-4c5b8112-dea8-43f8-bd1a-f58e927c279e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400269 Nov 24 14:37:53.814271 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-edfdaae6-c3c9-47f9-8ec3-97915c9d6dbc req-fc4c2fd4-d578-4196-a2a0-32df51e60e4b service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0679550 Nov 24 14:37:54.183122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598048cb-56e1-4750-8846-3fbe5736e66a req-4b48454b-46f4-48cf-8c89-fe0ca5d68b5c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:54.184575 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-598048cb-56e1-4750-8846-3fbe5736e66a req-4b48454b-46f4-48cf-8c89-fe0ca5d68b5c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.1291964 Nov 24 14:37:54.218713 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-5f32a5ea-c698-49c5-abbf-221cab428908 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2181654 Nov 24 14:37:54.245468 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-598048cb-56e1-4750-8846-3fbe5736e66a req-581ec662-25db-4c30-a2f3-192c59e12708 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537171 Nov 24 14:37:55.486783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef8ac82-502b-4dc5-be11-386fbf82cb1d req-444a5884-e752-4502-bf55-aa7d2dd33dd9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:55.489323 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ef8ac82-502b-4dc5-be11-386fbf82cb1d req-444a5884-e752-4502-bf55-aa7d2dd33dd9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0843320 Nov 24 14:37:55.537485 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ef8ac82-502b-4dc5-be11-386fbf82cb1d req-9c2bf103-336a-4fcd-846a-0beaac88021b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421090 Nov 24 14:37:55.538574 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-3758fe78-4caf-468b-9168-3cf5fb995201 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0728030 Nov 24 14:37:55.764872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-b0e253dd-734a-4456-a4a6-5ee329df55d1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:55.766306 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-b0e253dd-734a-4456-a4a6-5ee329df55d1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.2212741 Nov 24 14:37:55.828221 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:37:55.870492 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-b01ff821-2edc-4da3-bed8-8f743231251c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 1001 time: 0.0975842 Nov 24 14:37:55.930989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-2e9bcba3-7c1d-4a92-8faa-1539fe9eae6c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:55.932427 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-2e9bcba3-7c1d-4a92-8faa-1539fe9eae6c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0562105 Nov 24 14:37:56.010402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-8d21ae9a-3f15-404f-8100-e516deecdc89 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0711956 Nov 24 14:37:56.140323 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-59eeb4bb-2bad-4e2e-93cc-6898d94e91a6 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236930 Nov 24 14:37:56.273483 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-81985e6d-4626-4617-82d4-511c8c8b077c service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263161 Nov 24 14:37:56.742051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6732045-f18d-421c-8331-2c0905f14e26 req-f3fd0da9-4243-41ef-a9bb-f16c9b4bf036 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:56.743480 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6732045-f18d-421c-8331-2c0905f14e26 req-f3fd0da9-4243-41ef-a9bb-f16c9b4bf036 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0794222 Nov 24 14:37:56.790062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e6732045-f18d-421c-8331-2c0905f14e26 req-5be6525e-0fdf-4234-b1a2-34a222983fd6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404685 Nov 24 14:37:57.958106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-04f1fab4-8350-49f4-9d5f-e52da2138cbf service neutron] 10.222.0.47 "GET /v2.0/ports/69b52f35-ccaa-4176-a323-e3cface74d49/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0782049 Nov 24 14:37:57.997341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae093f5d-700c-4490-97ae-da9871072da3 req-ff809f05-1b64-4d54-853b-f0a47c565af6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:57.998800 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae093f5d-700c-4490-97ae-da9871072da3 req-ff809f05-1b64-4d54-853b-f0a47c565af6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0862048 Nov 24 14:37:58.063415 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae093f5d-700c-4490-97ae-da9871072da3 req-635b7ab0-80d6-44e4-a3fd-2b5caeddc808 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0547369 Nov 24 14:37:58.234406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-2eaafa62-161c-45f6-b3d2-6d237521ac64 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 1098 time: 0.0719550 Nov 24 14:37:58.337372 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-f651ceb9-e802-45ff-9b85-bfef438b5e8b service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0753465 Nov 24 14:37:58.467121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-ae2cc7c8-67e6-4327-901c-f61d00775e3b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:58.468579 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-ae2cc7c8-67e6-4327-901c-f61d00775e3b service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1256919 Nov 24 14:37:58.569818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-2f805e39-79b5-47a6-8b7b-bcf224533a94 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 1001 time: 0.0940790 Nov 24 14:37:58.635576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-8642a7b1-2524-4b79-9d21-11b072a6eda4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:58.637026 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-8642a7b1-2524-4b79-9d21-11b072a6eda4 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0611470 Nov 24 14:37:58.710934 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-10c8e68e-31a2-444f-8054-e259d1a13ee0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0681689 Nov 24 14:37:58.838035 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-b09acb95-96f4-4f72-808e-8e2ec07d5914 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1210897 Nov 24 14:37:58.967570 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-e426c234-a9ae-4127-a7f9-337e9b28ee99 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1235139 Nov 24 14:37:59.379245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8516c108-2dfb-4ef5-8294-72b4cfd3215d req-17833b39-26be-41ec-832a-9cedc656c3e6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:37:59.380698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8516c108-2dfb-4ef5-8294-72b4cfd3215d req-17833b39-26be-41ec-832a-9cedc656c3e6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.1872644 Nov 24 14:37:59.426030 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8516c108-2dfb-4ef5-8294-72b4cfd3215d req-4eef926d-c8f3-4e6a-ac1c-de81d0bae581 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398860 Nov 24 14:38:00.633462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b58f52b-5b5b-4cea-b9c1-917f7e256085 req-dc9eedca-4628-4de9-9622-be23f3977da1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:00.634940 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6b58f52b-5b5b-4cea-b9c1-917f7e256085 req-dc9eedca-4628-4de9-9622-be23f3977da1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0809011 Nov 24 14:38:00.691524 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6b58f52b-5b5b-4cea-b9c1-917f7e256085 req-b3e87b9a-2ec1-434e-ae92-9bebe0dc1ff4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506918 Nov 24 14:38:01.887015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3687f4c2-05a7-454f-ab4d-06322e336e59 req-e78d8ca1-c615-4ece-a0fa-0b2f1e5c42a0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:01.888537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3687f4c2-05a7-454f-ab4d-06322e336e59 req-e78d8ca1-c615-4ece-a0fa-0b2f1e5c42a0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0763459 Nov 24 14:38:01.935747 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3687f4c2-05a7-454f-ab4d-06322e336e59 req-cc7dbbf7-ed54-4db6-8f5c-f8a607b95cb7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408082 Nov 24 14:38:02.195835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:38:02.199485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:38:02.370641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-e96c6a34-9e5d-486c-8d3b-0c2f26116bc6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:02.372746 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-e96c6a34-9e5d-486c-8d3b-0c2f26116bc6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e&tenant_id=644eeb3051394d9da6b3f5fb4139e803&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 945 time: 0.1879225 Nov 24 14:38:02.383365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71d31cb-da08-4fc8-98e4-662439a19221 req-5c2c04bf-a19e-46d4-a5c6-bf02b83ca6f5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:02.391800 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f71d31cb-da08-4fc8-98e4-662439a19221 req-5c2c04bf-a19e-46d4-a5c6-bf02b83ca6f5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.1674519 Nov 24 14:38:02.428801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:02.452074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '69b52f35-ccaa-4176-a323-e3cface74d49', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '69b52f35-ccaa-4176-a323-e3cface74d49', 'mac_address': 'fa:16:3e:60:22:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:38:02.453651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:02.504729 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f71d31cb-da08-4fc8-98e4-662439a19221 req-a1ed9d22-0d5e-4c3d-80eb-00ec7cf26113 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1097379 Nov 24 14:38:02.523540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:38:02.542494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:02.554789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:02.555003 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-2c687fb2-4d3a-40c5-95aa-f078ae08312a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.1063776 Nov 24 14:38:02.561211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:02.564122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:02.606052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 69b52f35-ccaa-4176-a323-e3cface74d49 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:38:02.653052 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49', 'code': 200} Nov 24 14:38:02.677188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:02.696338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:38:02.696699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:38:02.696865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-5c80fbf3-f0d1-4547-a807-84a700ea4d94 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:02.697933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.698291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.698448 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-5c80fbf3-f0d1-4547-a807-84a700ea4d94 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1374116 Nov 24 14:38:02.698624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.698945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.699273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.699593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.699938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.700260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.700577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.700896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.701211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:02.705006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:02.815248 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-562240d2-d8df-4b36-9cdb-957517a9baac service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 999 time: 0.1099248 Nov 24 14:38:02.880916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-5ec65593-7998-40c0-a245-12ff0cdddc41 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:02.882361 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-5ec65593-7998-40c0-a245-12ff0cdddc41 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0614400 Nov 24 14:38:02.960123 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-d47f51a1-d886-4af7-b8d6-530caf9c128d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0714538 Nov 24 14:38:03.097884 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-4e899193-3b8d-463b-af54-44647b403735 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1308827 Nov 24 14:38:03.232474 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-923e7b15-38fe-478f-92ea-cf75bfe8903c req-0b564942-1ee9-4a58-bb11-a8bc25e73f83 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1285849 Nov 24 14:38:03.255366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:03.296894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 69b52f35-ccaa-4176-a323-e3cface74d49 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:38:03.314441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-021841dd-ed51-45b1-8b1a-3d1c6b63a075 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:03.322309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:03.326819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:03.328506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4e938e61-260b-434c-b281-52194194179b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:03.430924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['69b52f35-ccaa-4176-a323-e3cface74d49'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:38:03.514140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:03.518839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:03.711727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:03.743646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3373f2a5-a4d0-430d-bc49-dd192e0ff340 req-a4894a96-3ca4-4a6e-a0cc-7bf925958b49 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:03.745145 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3373f2a5-a4d0-430d-bc49-dd192e0ff340 req-a4894a96-3ca4-4a6e-a0cc-7bf925958b49 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 944 time: 0.1021225 Nov 24 14:38:03.795494 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3373f2a5-a4d0-430d-bc49-dd192e0ff340 req-91c67cc0-8290-4785-a53f-05a8adb56fd4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415616 Nov 24 14:38:04.223239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:38:04.291725 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 69b52f35-ccaa-4176-a323-e3cface74d49 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:38:04.292390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:04.406365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:04.439021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:04.443661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:04.446774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:04.513024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:04.516660 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:04.654066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:38:04.711594 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49', 'code': 200} Nov 24 14:38:04.998775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b489b904-5a2a-48e7-9c63-2db4c13eefcc req-ad3f87f9-560d-4504-9ce4-5dc3bfe883ff tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:05.000283 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b489b904-5a2a-48e7-9c63-2db4c13eefcc req-ad3f87f9-560d-4504-9ce4-5dc3bfe883ff tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0812838 Nov 24 14:38:05.047031 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b489b904-5a2a-48e7-9c63-2db4c13eefcc req-5d2d328b-8025-4dc5-9c60-fe2c97e0d0dd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403328 Nov 24 14:38:05.257398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8408c4d-2032-417f-a963-1362d2c05f6f req-ef833400-3a27-499d-98a6-f9053b7bf5c1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:05.258885 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c8408c4d-2032-417f-a963-1362d2c05f6f req-ef833400-3a27-499d-98a6-f9053b7bf5c1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0788853 Nov 24 14:38:05.312197 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c8408c4d-2032-417f-a963-1362d2c05f6f req-13f2c085-df1b-42c2-8082-3886d76b5a19 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451720 Nov 24 14:38:05.704582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3279ab4f-4185-4008-bc75-ee33837bc7fc req-02f4f57f-48b0-485c-ab3e-15bd75cc5968 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:05.706583 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3279ab4f-4185-4008-bc75-ee33837bc7fc req-02f4f57f-48b0-485c-ab3e-15bd75cc5968 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0849576 Nov 24 14:38:05.724580 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-b95539c5-0e18-436c-ac87-e41787ec212f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0740929 Nov 24 14:38:05.754901 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3279ab4f-4185-4008-bc75-ee33837bc7fc req-540c6a3e-8ec3-4175-af54-08794c926ced tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425992 Nov 24 14:38:05.870507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25c20ed6-6074-49e4-9673-f7418431e08b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:05.881573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-639a9b81-7614-4098-bb39-c8c1331ebf91 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:05.882010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-639a9b81-7614-4098-bb39-c8c1331ebf91 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1511009 Nov 24 14:38:05.987972 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-991ddb31-94c4-498d-9096-57417e3c5b22 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 1001 time: 0.0998142 Nov 24 14:38:06.052833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-1e28b98a-7027-4995-ac58-15bb8448b0ec service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:06.054261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-1e28b98a-7027-4995-ac58-15bb8448b0ec service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0603497 Nov 24 14:38:06.245990 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-0b815942-06e1-4d38-a950-09b2ad10d04f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1850643 Nov 24 14:38:06.385680 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-2422566a-87ed-490f-950a-d194325c425e service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328840 Nov 24 14:38:06.524474 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dbf9e5dc-ab72-4081-9f21-8dc86921d0da req-df2829d0-7372-4e19-bea7-8c4e72ed5335 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1329489 Nov 24 14:38:06.891264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:06.966139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed60b92-ef9f-4ff1-acfd-b5110a8cfcc1 req-224c861e-11f8-4bdd-b1b4-6526aeb384f8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:06.967611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0ed60b92-ef9f-4ff1-acfd-b5110a8cfcc1 req-224c861e-11f8-4bdd-b1b4-6526aeb384f8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0883043 Nov 24 14:38:07.014313 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0ed60b92-ef9f-4ff1-acfd-b5110a8cfcc1 req-d7f78764-398a-4fbb-8b94-ef6ca1140867 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408189 Nov 24 14:38:07.923286 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-245f705a-d7cf-4b89-8f78-67c6c29dc53e service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0689266 Nov 24 14:38:08.074887 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-16333b00-540e-4ae5-8aa1-4206356c27ba service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 1098 time: 0.0738809 Nov 24 14:38:08.225105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27411077-7e82-4999-bdd8-64994b23d9fa req-671bee6d-4403-4c3a-b589-013350b229a4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:08.226437 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-671bee6d-4403-4c3a-b589-013350b229a4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1319997 Nov 24 14:38:08.248577 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f3da3a-e707-49fd-bca6-37a69be22283 req-181d5838-5799-4fa9-a64d-048aa4c2eb16 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:08.250988 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a3f3da3a-e707-49fd-bca6-37a69be22283 req-181d5838-5799-4fa9-a64d-048aa4c2eb16 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0983422 Nov 24 14:38:08.324676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a3f3da3a-e707-49fd-bca6-37a69be22283 req-4a25581b-287b-45f6-85df-ad926fc64b85 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661061 Nov 24 14:38:08.334922 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-3de55810-0536-4b43-9b9c-96c8b03b2d35 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 200 len: 1001 time: 0.0993195 Nov 24 14:38:08.403294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27411077-7e82-4999-bdd8-64994b23d9fa req-02d00c90-5b0d-4780-8056-6bb45fb5625d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:08.404878 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-02d00c90-5b0d-4780-8056-6bb45fb5625d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0639603 Nov 24 14:38:08.480764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-ef6963c3-35ad-43f8-bedf-d156a5553ef1 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0697546 Nov 24 14:38:08.595492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:08.638207 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-be2d6236-2349-4eee-b42b-7fe938343153 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1514163 Nov 24 14:38:08.769415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de65a483-b5a5-44c4-a749-04c7fe420947 req-d8930e8d-23b9-46e9-8f01-c037a44d7155 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:08.770775 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de65a483-b5a5-44c4-a749-04c7fe420947 req-d8930e8d-23b9-46e9-8f01-c037a44d7155 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0783682 Nov 24 14:38:08.774349 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27411077-7e82-4999-bdd8-64994b23d9fa req-be8d63da-12f2-4356-a726-34c37e6e5e5f service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1290593 Nov 24 14:38:08.833401 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de65a483-b5a5-44c4-a749-04c7fe420947 req-19267a09-a532-4782-bf02-df5325c7b6a6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561721 Nov 24 14:38:10.110850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bf04bb0-bb54-4478-b40c-e93e8a66f5b0 req-66cad4b8-293b-4ba1-bbc2-29baf2f2c226 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:10.112859 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8bf04bb0-bb54-4478-b40c-e93e8a66f5b0 req-66cad4b8-293b-4ba1-bbc2-29baf2f2c226 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0855286 Nov 24 14:38:10.161609 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8bf04bb0-bb54-4478-b40c-e93e8a66f5b0 req-f10ab034-f86f-45cf-9f4b-960ffa12d00f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429316 Nov 24 14:38:10.603852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d6f0de-43ea-4342-8641-409058085dba req-6167653c-6d81-485a-867d-064b186b258d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:10.605261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53d6f0de-43ea-4342-8641-409058085dba req-6167653c-6d81-485a-867d-064b186b258d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0833442 Nov 24 14:38:10.676312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Deleting port 69b52f35-ccaa-4176-a323-e3cface74d49 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:38:10.676650 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:11.015427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] For port 69b52f35-ccaa-4176-a323-e3cface74d49, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=69b52f35-ccaa-4176-a323-e3cface74d49,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:11.015797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:11.310977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:11.311876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:11.311876 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 disassociated. External IP: 172.26.4.246, port: 69b52f35-ccaa-4176-a323-e3cface74d49. Nov 24 14:38:11.312196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Calling delete_port for 69b52f35-ccaa-4176-a323-e3cface74d49 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:38:11.379609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe74e05-d079-4462-a0a4-9d2dd6c60add req-ecad829d-7f81-40b7-900a-c2261985167a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:11.381116 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4fe74e05-d079-4462-a0a4-9d2dd6c60add req-ecad829d-7f81-40b7-900a-c2261985167a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 945 time: 0.0844841 Nov 24 14:38:11.431158 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4fe74e05-d079-4462-a0a4-9d2dd6c60add req-c55dbebb-a89e-4364-98f3-e822f18c8caa tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432718 Nov 24 14:38:11.464939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:11.472124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf92f466-7d0e-4d1f-94e5-bf03aab8bebf tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:11.515944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event deleted for resources: {'Port': ['ID=69b52f35-ccaa-4176-a323-e3cface74d49,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:11.531863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.532243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.532624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.532987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.533992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.534532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.535041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.535332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.535700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.536079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.536429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:38:11.539809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:11.751064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:38:11.955164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:38:11.966751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:38:11.986402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:38:11.987450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:38:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:12.046863 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] No DVR routers for this DVR port 69b52f35-ccaa-4176-a323-e3cface74d49 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:38:12.050179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:12.052915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-deleted', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:38:12.069644 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53d6f0de-43ea-4342-8641-409058085dba req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "DELETE /v2.0/ports/69b52f35-ccaa-4176-a323-e3cface74d49 HTTP/1.1" status: 204 len: 173 time: 1.4591460 Nov 24 14:38:12.169230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd52d3e02-5834-4541-bfc0-e90e7e12996e', 'name': 'network-vif-deleted', 'tag': '69b52f35-ccaa-4176-a323-e3cface74d49', 'status': 'completed', 'code': 200} Nov 24 14:38:12.242672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:38:12.589658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:12.593985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:38:12.606360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:38:12.607111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:38:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:12.642262 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-95d64829-ebfa-49e8-8286-709a8ab66775 req-64506f95-376c-443b-8f7e-a992cc58d2a3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=d52d3e02-5834-4541-bfc0-e90e7e12996e HTTP/1.1" status: 200 len: 210 time: 0.0485897 Nov 24 14:38:12.795912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:38:13.150694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:13.154627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1502bc1f-a5cd-4d79-8da5-d96ebd963a2e None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:38:13.386775 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b55b990f-f610-4c0d-9dc4-ecaf03a8bdf6 None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:38:14.100902 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-5725396f-7b3a-41cf-afc1-a6a4c2355a46 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--290047065&fields=id&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 267 time: 0.0443025 Nov 24 14:38:14.264149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7976984-8023-4b06-8872-313caf789023 req-c6016855-4a0f-4c93-a6da-927ce345ef99 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:14.266601 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-c6016855-4a0f-4c93-a6da-927ce345ef99 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1587119 Nov 24 14:38:14.278644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:38:14.297622 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-46ea3af2-6e08-43e3-baa0-573053410a1e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/quotas/644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 375 time: 0.0249493 Nov 24 14:38:14.320508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 69b52f35-ccaa-4176-a323-e3cface74d49 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:38:14.320861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 69b52f35-ccaa-4176-a323-e3cface74d49 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:38:14.437734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f7976984-8023-4b06-8872-313caf789023 req-62c1ff66-4dd6-4d2b-8613-747c9257131a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:38:14.460353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f7976984-8023-4b06-8872-313caf789023 req-62c1ff66-4dd6-4d2b-8613-747c9257131a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:38:14.462194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-62c1ff66-4dd6-4d2b-8613-747c9257131a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1576676 Nov 24 14:38:14.680914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-9fc4621f-862f-43ae-8782-7d5499f9fc88 service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2038922 Nov 24 14:38:14.923459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-e89d222b-f313-4b49-b4ec-b3601d25fdb8 service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2369406 Nov 24 14:38:15.115357 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-719badd0-cbf2-4b14-9605-1a9ebe16941e req-bcbce90f-0d2e-459e-89d9-744aa7d70846 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 210 time: 0.0472236 Nov 24 14:38:16.152156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7976984-8023-4b06-8872-313caf789023 req-be6d1c31-ec79-45ae-816c-c9da9b8a6fd9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:16.153774 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-be6d1c31-ec79-45ae-816c-c9da9b8a6fd9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1501346 Nov 24 14:38:16.225033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-16d74beb-d1ca-4d46-a385-e12b853a66be tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 379 time: 0.0573537 Nov 24 14:38:16.243864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'port': {'device_id': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'admin_state_up': True, 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'security_groups': ['7ef8b8e0-808b-4ac2-88ce-f247cce14b78']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:38:16.383493 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-123eb2f9-108d-4235-9b4f-483674499e70 req-7a6da510-1f1f-4131-8fe1-575b4a82c900 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 210 time: 0.1179836 Nov 24 14:38:16.449151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:38:16.458728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:38:16.468884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Made reservation on behalf of 644eeb3051394d9da6b3f5fb4139e803 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:38:16.473407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:16.642435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Allocated IP 172.20.0.11 (b20ce7e1-47d2-4747-a9a3-ec140e6fcda1/22012fd4-20c7-4275-844f-7e901c9b102d/aa80b031-1280-4358-b302-372954e2ea1e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:38:16.844221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:16.860320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Transition to ACTIVE for port object aa80b031-1280-4358-b302-372954e2ea1e will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:38:16.883015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:16.888767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:16.954286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:38:16.963511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:38:16.967520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:38:17.017073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:17.020606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:17.059469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:17.060103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:17.090173 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8605876 Nov 24 14:38:17.104060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Request body: {'port': {'device_id': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:38:17.233007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:17.239219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4776e408-dc81-48dd-a39e-f4ab3031cb42 None None] Provisioning for port aa80b031-1280-4358-b302-372954e2ea1e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:38:17.245027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4776e408-dc81-48dd-a39e-f4ab3031cb42 None None] Provisioning complete for port aa80b031-1280-4358-b302-372954e2ea1e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:38:17.245688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4776e408-dc81-48dd-a39e-f4ab3031cb42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:17.305469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4776e408-dc81-48dd-a39e-f4ab3031cb42 None None] Port aa80b031-1280-4358-b302-372954e2ea1e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:38:17.612007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43dcff58-9bde-4650-9b94-4bee3462a5be req-c11c2faf-81ea-4c61-be87-6de1e7dd00cb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:17.613496 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-43dcff58-9bde-4650-9b94-4bee3462a5be req-c11c2faf-81ea-4c61-be87-6de1e7dd00cb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 932 time: 0.0828311 Nov 24 14:38:17.614902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:38:17.622033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:17.639130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Transition to ACTIVE for port object aa80b031-1280-4358-b302-372954e2ea1e will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:38:17.644808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:17.648752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:17.663226 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-43dcff58-9bde-4650-9b94-4bee3462a5be req-bff32912-cd73-499b-8231-5bbac1148697 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436559 Nov 24 14:38:17.775145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:17.778069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:17.988290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Attempting to bind port aa80b031-1280-4358-b302-372954e2ea1e on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:38:17.988526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Attempting to bind port aa80b031-1280-4358-b302-372954e2ea1e by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:38:17.988811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Attempting to bind port aa80b031-1280-4358-b302-372954e2ea1e on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:38:17.994442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Port aa80b031-1280-4358-b302-372954e2ea1e on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:38:17.994758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Attempting to bind port aa80b031-1280-4358-b302-372954e2ea1e on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:38:18.000897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 37, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:38:18.001224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:38:18.001598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Bound using segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:38:18.002550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Bound port: aa80b031-1280-4358-b302-372954e2ea1e, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:38:18.002891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:18.091807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:38:18.097076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:38:18.102095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:18.102486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:18.108010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5b9068a8-844a-455a-9027-b7ad8df2afdc tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:18.157352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:18.158690 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] 10.222.0.47 "PUT /v2.0/ports/aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1094 time: 1.0606678 Nov 24 14:38:18.159403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:38:18.187405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:18.197709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:18.239052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'status': 'completed', 'code': 200} Nov 24 14:38:18.289017 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-909de13d-af3e-46a0-8f95-39230a94ebed service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1097 time: 0.0879939 Nov 24 14:38:18.363488 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-22d39c7a-06a1-4f31-bb98-f58b478f8699 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 217 time: 0.0671387 Nov 24 14:38:18.429794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7976984-8023-4b06-8872-313caf789023 req-678f07ec-2bf6-4c40-9b0f-851fc4b6df8a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:18.431227 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-678f07ec-2bf6-4c40-9b0f-851fc4b6df8a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0620241 Nov 24 14:38:18.506042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-a7198a6b-110b-4112-b36d-9a0e15275cf7 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0684552 Nov 24 14:38:18.636522 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-10f52c23-867e-4e28-8c42-6af50eed2bd9 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238720 Nov 24 14:38:18.775007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7976984-8023-4b06-8872-313caf789023 req-22855200-06c3-44a0-86c9-cac93e5afe09 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1319318 Nov 24 14:38:18.886979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c847d6d1-5bee-4589-b2fe-4ea532901673 req-cdc42abb-a418-458c-8fd4-9b60ddb82bd5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:18.888446 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c847d6d1-5bee-4589-b2fe-4ea532901673 req-cdc42abb-a418-458c-8fd4-9b60ddb82bd5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 944 time: 0.0875471 Nov 24 14:38:18.917120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-b43d47cc-9526-431f-9722-9b7af3db27cf service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1097 time: 0.0757635 Nov 24 14:38:18.937020 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c847d6d1-5bee-4589-b2fe-4ea532901673 req-eb34a6b9-060a-4097-b48c-879512a4f1d7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426130 Nov 24 14:38:19.047922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67900e31-5c87-4f68-8426-a918405daa45 req-c63a2b6b-0379-4def-b8e1-12e78d87e52d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:19.050044 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-c63a2b6b-0379-4def-b8e1-12e78d87e52d service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1264408 Nov 24 14:38:19.121611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-44343600-07cc-4a00-a08f-1af7fba5d2ec service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 217 time: 0.0632474 Nov 24 14:38:19.188649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67900e31-5c87-4f68-8426-a918405daa45 req-0f9479bd-66fd-4e6f-ba21-a9a4be149dbe service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:19.190726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-0f9479bd-66fd-4e6f-ba21-a9a4be149dbe service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0626879 Nov 24 14:38:19.265570 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-46f427a8-17b9-4478-8bdf-9e9b0828c4cf service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0688651 Nov 24 14:38:19.400492 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-1b6075a5-933c-4f03-b0a2-f911a28cdbc2 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280305 Nov 24 14:38:19.532197 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67900e31-5c87-4f68-8426-a918405daa45 req-d16857cb-e985-46b0-90f0-74c9442067af service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1252387 Nov 24 14:38:20.233119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-625516e1-0d76-4293-95d0-8377b4a220b4 req-71689bfd-68b9-4b88-b990-496f1495719b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:20.233696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-625516e1-0d76-4293-95d0-8377b4a220b4 req-71689bfd-68b9-4b88-b990-496f1495719b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:38:20.249940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-625516e1-0d76-4293-95d0-8377b4a220b4 req-71689bfd-68b9-4b88-b990-496f1495719b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:38:20.251121 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-625516e1-0d76-4293-95d0-8377b4a220b4 req-71689bfd-68b9-4b88-b990-496f1495719b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 944 time: 0.1931107 Nov 24 14:38:20.296174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-625516e1-0d76-4293-95d0-8377b4a220b4 req-72de1343-a8bc-4b5d-8186-21349d4932d4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393267 Nov 24 14:38:21.499926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447af552-5f41-4878-9c68-e88f948360c8 req-95afb710-551d-4ced-953d-1c489dfc25b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:21.501369 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-447af552-5f41-4878-9c68-e88f948360c8 req-95afb710-551d-4ced-953d-1c489dfc25b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 944 time: 0.0810864 Nov 24 14:38:21.549865 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-447af552-5f41-4878-9c68-e88f948360c8 req-54e7abc6-d586-4b2a-932f-a5f75289936b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421176 Nov 24 14:38:22.339549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:38:22.470295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:22.483587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'aa80b031-1280-4358-b302-372954e2ea1e', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e', 'mac_address': 'fa:16:3e:51:e2:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:38:22.536830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:22.553999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:38:22.568507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:22.572015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:22.573689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:22.640156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:22.643883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:22.748527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0f5eff-a08e-461a-b06d-846ea9275147 req-8d1dba0e-5417-4882-8947-407c931ab3be tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:22.749933 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d0f5eff-a08e-461a-b06d-846ea9275147 req-8d1dba0e-5417-4882-8947-407c931ab3be tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 945 time: 0.0781496 Nov 24 14:38:22.793455 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d0f5eff-a08e-461a-b06d-846ea9275147 req-be02d9e3-1dba-4446-a1ce-79005d93d775 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0379386 Nov 24 14:38:22.948421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['aa80b031-1280-4358-b302-372954e2ea1e'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:38:23.993225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08aa77d-886c-4c0f-bfe4-e4f9fb20558f req-08511cb2-f665-4ae1-b0af-b1ecac9e6b29 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:23.994575 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a08aa77d-886c-4c0f-bfe4-e4f9fb20558f req-08511cb2-f665-4ae1-b0af-b1ecac9e6b29 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 945 time: 0.0809162 Nov 24 14:38:24.040249 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a08aa77d-886c-4c0f-bfe4-e4f9fb20558f req-b5e88c3f-ae8b-41ae-b1fd-26433b758a8f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403066 Nov 24 14:38:24.339390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:38:24.405521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port aa80b031-1280-4358-b302-372954e2ea1e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:38:24.410464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port aa80b031-1280-4358-b302-372954e2ea1e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:38:24.410845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:24.522697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:24.548110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:38:24.557808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:38:24.560785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:24.562522 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:38:24.604331 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'code': 200} Nov 24 14:38:24.628820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:38:24.631621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:38:24.827411 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-818eea72-7518-4813-b7f5-ef40296ef7af req-172728fd-d777-455b-9fff-ded1c2136c49 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0678658 Nov 24 14:38:24.868796 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-818eea72-7518-4813-b7f5-ef40296ef7af req-09de55a3-1110-4be3-afd7-f7f17ecc6284 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0351553 Nov 24 14:38:25.235271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33fc6e4-5382-429e-8b8e-0854590ee13a req-2fd6c24e-480b-41a0-8d25-4dcd652099b9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:25.237304 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d33fc6e4-5382-429e-8b8e-0854590ee13a req-2fd6c24e-480b-41a0-8d25-4dcd652099b9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0767872 Nov 24 14:38:25.283862 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d33fc6e4-5382-429e-8b8e-0854590ee13a req-1c415121-3f16-4814-ab40-dcd32f7696a3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398989 Nov 24 14:38:26.479418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f15b87a2-ad61-4ded-8aba-4e08baab2492 req-b92a97ef-c098-4b9a-8a94-b8aee3f47fbe tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:26.480863 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f15b87a2-ad61-4ded-8aba-4e08baab2492 req-b92a97ef-c098-4b9a-8a94-b8aee3f47fbe tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0763497 Nov 24 14:38:26.528740 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f15b87a2-ad61-4ded-8aba-4e08baab2492 req-040525bb-b557-4c72-a1cb-cb7efb65a430 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424149 Nov 24 14:38:26.815508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cedc100-4c7b-408a-ac56-3ac755c3a0dd req-d4b5234a-8aba-4d7a-aa82-f38556ab393c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:26.816876 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0cedc100-4c7b-408a-ac56-3ac755c3a0dd req-d4b5234a-8aba-4d7a-aa82-f38556ab393c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.1707749 Nov 24 14:38:26.825544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 51260) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:38:26.831281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'floatingip': {'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:38:26.905657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:27.495878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:27.500174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:27.690660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 associated. External IP: 172.26.4.246, port: aa80b031-1280-4358-b302-372954e2ea1e. Nov 24 14:38:28.076741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:38:28.386341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:38:28.391144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:28.395843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:38:28.407244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:38:28.408511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:38:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:28.445225 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a89b1fdc-a844-4fb0-b252-ec731529db43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "PUT /v2.0/floatingips/7522ecd4-9586-4e09-9875-65fffb502df1 HTTP/1.1" status: 200 len: 992 time: 1.6186500 Nov 24 14:38:28.445876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:38:28.617046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:38:28.645142 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'status': 'completed', 'code': 200} Nov 24 14:38:28.738354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-bb18ed1c-a336-413b-96bc-b4d150e8ceb0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0689788 Nov 24 14:38:28.870737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27925510-d408-41d2-9757-1d3fd386c49d req-e9207ca5-c31b-4727-81e1-b7c0da0042dd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:28.872198 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-e9207ca5-c31b-4727-81e1-b7c0da0042dd service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1269350 Nov 24 14:38:28.972255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:51:e2:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:38:27Z', 'revision_number': 9, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:28.976118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-0b9cfbbc-bc3b-48ec-8ebb-289a25f6fe3e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1000 time: 0.0979638 Nov 24 14:38:28.976254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:38:28.986933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:38:28.987546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:38:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:29.037269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27925510-d408-41d2-9757-1d3fd386c49d req-bf4b553e-12f9-4d0f-aa43-bd9a7629db8a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:38:29.038684 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-bf4b553e-12f9-4d0f-aa43-bd9a7629db8a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0568104 Nov 24 14:38:29.117703 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-959476fc-0507-420a-b4ab-1562a1d03b07 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0731630 Nov 24 14:38:29.209820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:38:29.255235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-35376f36-64e3-4861-aca6-149c3444c430 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1303692 Nov 24 14:38:29.388867 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-27925510-d408-41d2-9757-1d3fd386c49d req-597a2a50-0a7a-4340-8db1-5d430ddc8774 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1282005 Nov 24 14:38:29.567863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:51:e2:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:38:27Z', 'revision_number': 9, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:38:29.571895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b18870c-511e-496c-96b5-27d5b65a065d None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:51:e2:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:38:27Z', 'revision_number': 9, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:38:29.791664 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b9e90a1-215e-4e86-802c-0e725958f0db None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:38:32.827682 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:38:33.288369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4578154a-36f4-40ef-8c8b-d85dafcfbaca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:33.705363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:35.865871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2f929415-de14-422e-bb44-3a36bb32a129 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:36.892499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:38.582189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:38:48.130567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:03.290784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f0c907ab-eefa-40fb-8ed4-de32b63ce565 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:03.708615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:05.868762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bc58c732-45dd-4f53-a742-c388f3f85dea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:06.891702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:07.925933 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-370a844a-8bac-4bc2-8968-ec12381e1b76 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0680344 Nov 24 14:39:08.072424 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-3a8cde97-153b-46ff-9a91-4434fed358ee service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0766127 Nov 24 14:39:08.216284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-3f00913f-2553-4d03-8b35-df98f0f5ef15 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:08.217437 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-3f00913f-2553-4d03-8b35-df98f0f5ef15 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1274488 Nov 24 14:39:08.319093 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-85f0ea7a-6c13-4e04-8a0e-af8f6d450fc1 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1003 time: 0.0948851 Nov 24 14:39:08.385132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-28d65a30-70c2-47db-860d-42ea6d40c4f1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:08.386794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-28d65a30-70c2-47db-860d-42ea6d40c4f1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0612290 Nov 24 14:39:08.461878 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-8b1ee064-0933-4e2a-94e0-749a3f810430 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0690756 Nov 24 14:39:08.584865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:08.698501 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-347a3ce0-12cb-4c29-94c4-ad32dffa3fe9 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2284343 Nov 24 14:39:08.827294 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b4ba275-29d1-442a-9000-b3c6471f7806 req-57a060b1-0c7f-4744-beda-2fa12a76b15c service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1225595 Nov 24 14:39:09.829897 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:39:18.133417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:33.294234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21f467bb-3809-4fec-a516-de875007aca0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:33.710828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:35.873281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-05fc1a81-573c-4df9-aa9b-4d8c4afa47d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:36.893959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:38.587092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:44.974551 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-da41fcb4-5ab8-42cd-a542-7a49ac6bc8c1 req-f2162587-731c-4ad2-bc04-dce3885fb4fb service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0690269 Nov 24 14:39:45.211953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51420) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:39:45.408020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b533fcb-2dc3-45b5-aa05-255494539360 req-a5597413-5d7c-4d81-902e-48890dbe40b4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:45.409459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b533fcb-2dc3-45b5-aa05-255494539360 req-a5597413-5d7c-4d81-902e-48890dbe40b4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.2084510 Nov 24 14:39:45.412073 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-27ce6923-4860-45fd-b939-7499aa6fedb5 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1989374 Nov 24 14:39:45.460645 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b533fcb-2dc3-45b5-aa05-255494539360 req-7e134530-10ca-4195-9297-17464d5e2bf9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457373 Nov 24 14:39:46.667987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0727dd-a251-4772-88bc-e324299c5ed1 req-8ff2bdb0-ba7f-4187-9221-9ebac6699e20 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:46.670182 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5c0727dd-a251-4772-88bc-e324299c5ed1 req-8ff2bdb0-ba7f-4187-9221-9ebac6699e20 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0816383 Nov 24 14:39:46.686254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-30ad1185-04ea-4a67-b742-9027d7ee02dc service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0694647 Nov 24 14:39:46.716246 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5c0727dd-a251-4772-88bc-e324299c5ed1 req-739c49c5-e2ca-413f-8c8d-cd3226a83923 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403941 Nov 24 14:39:46.817465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-0a347b72-a1c9-4615-be61-ca57e51cae09 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:46.818787 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-0a347b72-a1c9-4615-be61-ca57e51cae09 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1267521 Nov 24 14:39:46.829877 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:39:46.926824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-18b4c14e-ada1-49b5-8028-4dadb4fc428d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1003 time: 0.1020081 Nov 24 14:39:46.987875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-6ccb8ea6-af52-4255-a5da-c34be5133220 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:46.989256 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-6ccb8ea6-af52-4255-a5da-c34be5133220 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0558612 Nov 24 14:39:47.065702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-0e45293f-378d-42f5-938f-ec6316e92971 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0702350 Nov 24 14:39:47.201432 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-d02099da-ce71-4974-b91e-f3b22561298f service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1295636 Nov 24 14:39:47.331650 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-a75586f6-6a2b-43da-95d0-0a836cba3e30 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1243048 Nov 24 14:39:47.909745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5026f70-8a21-4047-8eed-ccc5571e59b2 req-4d789bf1-fe99-49e7-ae26-ca6c02d7fa3f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:47.911189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c5026f70-8a21-4047-8eed-ccc5571e59b2 req-4d789bf1-fe99-49e7-ae26-ca6c02d7fa3f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0754681 Nov 24 14:39:47.957406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c5026f70-8a21-4047-8eed-ccc5571e59b2 req-4aaaf5e5-4c85-4403-992b-38c92aac1b05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405431 Nov 24 14:39:48.144471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:39:49.161771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b91953-9e48-416d-aa35-84412cee61ea req-7d39a067-b69e-44e7-95d5-d65f1315acc8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:49.163209 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f7b91953-9e48-416d-aa35-84412cee61ea req-7d39a067-b69e-44e7-95d5-d65f1315acc8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0786922 Nov 24 14:39:49.208259 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f7b91953-9e48-416d-aa35-84412cee61ea req-ff42aec8-e399-4f75-9dde-442e6b73c976 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389082 Nov 24 14:39:50.566883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9160b3ba-ffff-46b7-bcbb-8263c0073212 req-24170bd7-1ce1-47d1-ae0e-b2146c9a0e1f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:50.568261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9160b3ba-ffff-46b7-bcbb-8263c0073212 req-24170bd7-1ce1-47d1-ae0e-b2146c9a0e1f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0919719 Nov 24 14:39:50.615092 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9160b3ba-ffff-46b7-bcbb-8263c0073212 req-5fd45a60-9870-4882-967c-d088f3ebd2e4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413399 Nov 24 14:39:51.826106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705baa45-78ff-417c-b02c-260003ce6b56 req-f9cd538d-430f-45b2-bb14-ec88ae8ade74 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:51.827443 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-705baa45-78ff-417c-b02c-260003ce6b56 req-f9cd538d-430f-45b2-bb14-ec88ae8ade74 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0780523 Nov 24 14:39:51.873207 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-705baa45-78ff-417c-b02c-260003ce6b56 req-d08483d2-97fa-4d0a-b3a0-dbfcdd0b77ce tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403271 Nov 24 14:39:53.065909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c883bc9b-e391-4145-bae0-c5eabdeeefec req-9d314687-f469-40c3-8095-4186be128e21 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:53.067242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c883bc9b-e391-4145-bae0-c5eabdeeefec req-9d314687-f469-40c3-8095-4186be128e21 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0756538 Nov 24 14:39:53.112380 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c883bc9b-e391-4145-bae0-c5eabdeeefec req-9a113b70-c463-42d2-be53-29267f7ff4c2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396917 Nov 24 14:39:54.318102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e609b179-c496-490a-bcc2-ad2a8692aa19 req-e4b5905b-fb6e-46bd-b708-0fe49ab20ca4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:54.319781 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e609b179-c496-490a-bcc2-ad2a8692aa19 req-e4b5905b-fb6e-46bd-b708-0fe49ab20ca4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0800953 Nov 24 14:39:54.369228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e609b179-c496-490a-bcc2-ad2a8692aa19 req-b1d8e800-a7cf-4822-ac2d-28f2ba310ece tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439935 Nov 24 14:39:55.573287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1de50f32-2644-414d-b9ea-a5f684d60117 req-b4ab1a83-ab1c-40a6-97df-6c5ac84e877b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:55.575886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1de50f32-2644-414d-b9ea-a5f684d60117 req-b4ab1a83-ab1c-40a6-97df-6c5ac84e877b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0827146 Nov 24 14:39:55.620120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1de50f32-2644-414d-b9ea-a5f684d60117 req-d87874c6-c4dd-493b-b61d-ef20b0adfcb6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388029 Nov 24 14:39:56.813971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3adde777-2596-48a7-b06c-ec46fb95414c req-8587260c-2ccb-4306-af5f-ebd5d072a75a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:56.815406 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3adde777-2596-48a7-b06c-ec46fb95414c req-8587260c-2ccb-4306-af5f-ebd5d072a75a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0755658 Nov 24 14:39:56.860954 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3adde777-2596-48a7-b06c-ec46fb95414c req-6c0e4b44-584b-42b5-9dae-a210fb1e9523 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400386 Nov 24 14:39:58.056626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8170ca8e-bf31-4945-b99d-7b92cd7eb201 req-256182b3-c4f8-4d25-949d-1be8e751e93d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:58.058064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8170ca8e-bf31-4945-b99d-7b92cd7eb201 req-256182b3-c4f8-4d25-949d-1be8e751e93d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0792062 Nov 24 14:39:58.110387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8170ca8e-bf31-4945-b99d-7b92cd7eb201 req-bd2930b7-66ad-4e23-8fb7-4bbb9c0c2dac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449162 Nov 24 14:39:59.075205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-9337d325-4f08-48b4-bac8-9dbd9968519e service neutron] 10.222.0.47 "GET /v2.0/ports/aa80b031-1280-4358-b302-372954e2ea1e/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.1715641 Nov 24 14:39:59.324635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e33ca3cd-79ff-4a64-a8bd-6f689a518ceb req-8e108cb5-a637-426b-9f94-cc2678d167b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:59.327008 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e33ca3cd-79ff-4a64-a8bd-6f689a518ceb req-8e108cb5-a637-426b-9f94-cc2678d167b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0853641 Nov 24 14:39:59.358292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-6f126536-1c2c-4218-b108-196193ecb6be service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 1099 time: 0.0727503 Nov 24 14:39:59.380580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e33ca3cd-79ff-4a64-a8bd-6f689a518ceb req-1679cb6a-c9f2-4f90-8447-e41338c86fd7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461133 Nov 24 14:39:59.451447 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-e9b807bc-1f33-4652-b99b-89dd49ad9ea4 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0705419 Nov 24 14:39:59.585667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-743c290e-f97a-4372-9b2f-03bf33665997 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:59.587119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-743c290e-f97a-4372-9b2f-03bf33665997 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1291511 Nov 24 14:39:59.693446 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-79c303a3-94c3-485f-ad76-edfa53706fe0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1003 time: 0.1000381 Nov 24 14:39:59.758430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-8b932b0d-0875-4ba6-823f-25d900a171f0 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:39:59.759851 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-8b932b0d-0875-4ba6-823f-25d900a171f0 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0609977 Nov 24 14:39:59.840327 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-7617fb80-f21d-4eb4-8fb3-eb9a19a45a3b service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0739965 Nov 24 14:39:59.984973 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-62641463-1161-4c5b-9d1b-712b78486030 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1374381 Nov 24 14:40:00.122491 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-23911a00-51b1-4ab6-b583-242c8abf5881 req-e08cdcf5-41e2-4076-bb11-881cc39c67e1 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310062 Nov 24 14:40:00.586171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c32c8da-caee-4039-a311-2398bffb9b2a req-5ca60d6e-e460-4d14-be69-6e7bb2a9c1a9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:00.587605 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0c32c8da-caee-4039-a311-2398bffb9b2a req-5ca60d6e-e460-4d14-be69-6e7bb2a9c1a9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0798926 Nov 24 14:40:00.635062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0c32c8da-caee-4039-a311-2398bffb9b2a req-54815f65-7134-4dc2-b18d-d65585e6a5a4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402918 Nov 24 14:40:01.836167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd25c15e-e4a8-451b-960b-3d43846325ca req-e2ebfaf2-b983-4852-9201-9484cc55bcc0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:01.837636 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dd25c15e-e4a8-451b-960b-3d43846325ca req-e2ebfaf2-b983-4852-9201-9484cc55bcc0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0782912 Nov 24 14:40:01.885415 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dd25c15e-e4a8-451b-960b-3d43846325ca req-c41edf93-8211-4b91-a6fb-6a4bcd9b4d7d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414300 Nov 24 14:40:02.948185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:40:02.958463 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:40:03.113673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-890dbba3-da31-4c99-9294-1b178c186522 req-e32ae383-db03-409b-91db-57013d87b3e0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:03.115131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-890dbba3-da31-4c99-9294-1b178c186522 req-e32ae383-db03-409b-91db-57013d87b3e0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0868990 Nov 24 14:40:03.164340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-890dbba3-da31-4c99-9294-1b178c186522 req-c93f4032-0c92-438d-aba3-23f3b524aadc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406222 Nov 24 14:40:03.189581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:03.207737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:03.228122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'aa80b031-1280-4358-b302-372954e2ea1e', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e', 'mac_address': 'fa:16:3e:51:e2:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:40:03.235116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:03.280835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:03.294107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:03.299271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:03.366431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dc9571ee-9563-4a5c-ba96-02cdc757db89 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:03.371229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:03.390063 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'code': 200} Nov 24 14:40:03.403673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:40:03.410053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:03.453451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.453699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.454033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.454365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.454683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.454997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.455313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.455630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.455964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.456280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.456613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:03.461013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:03.482492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:40:03.482849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:40:03.715796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:04.039001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:04.055739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:40:04.070976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:04.076328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:04.078018 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:04.141041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['aa80b031-1280-4358-b302-372954e2ea1e'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:40:04.177280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:04.181552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:04.372523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e788ae-c713-4d17-b6c7-a84b682f8a29 req-320fbe75-580b-4310-bd6c-1d6f98f282c6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:04.374123 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-19e788ae-c713-4d17-b6c7-a84b682f8a29 req-320fbe75-580b-4310-bd6c-1d6f98f282c6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 945 time: 0.0794563 Nov 24 14:40:04.421040 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-19e788ae-c713-4d17-b6c7-a84b682f8a29 req-e054c0f7-9b07-4092-9e23-acc84b252a42 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406814 Nov 24 14:40:04.913905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-88331b09-6f00-4729-81db-715b48719dc4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:04.915327 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-88331b09-6f00-4729-81db-715b48719dc4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205&tenant_id=644eeb3051394d9da6b3f5fb4139e803&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 945 time: 0.1446309 Nov 24 14:40:04.964224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:40:04.990129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51605cbd-3b67-4595-b0e7-515dd177e8e9 req-3135e148-849c-4f1a-8be6-4f7873ef52ee tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:04.991982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-51605cbd-3b67-4595-b0e7-515dd177e8e9 req-3135e148-849c-4f1a-8be6-4f7873ef52ee tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 945 time: 0.1632597 Nov 24 14:40:05.032845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port aa80b031-1280-4358-b302-372954e2ea1e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:40:05.033254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:05.053305 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-73dfea5a-aaba-491f-a550-6b0477f3a7df service neutron] 10.222.0.47 "GET /v2.0/ports/aa80b031-1280-4358-b302-372954e2ea1e/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.1309266 Nov 24 14:40:05.055842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-51605cbd-3b67-4595-b0e7-515dd177e8e9 req-e61bb53f-3a4c-4f4a-a9fa-9e92d84c369f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527914 Nov 24 14:40:05.148876 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-6d6fa0bb-1824-4b9d-bcf7-e0b28d5de7cc service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1098 time: 0.0710475 Nov 24 14:40:05.151610 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:05.185532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:05.189987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:05.191895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:05.263485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:05.266599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:05.292265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-1a56c2f4-4ec8-4566-a70c-8d64716025d9 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:05.294737 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-1a56c2f4-4ec8-4566-a70c-8d64716025d9 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1399961 Nov 24 14:40:05.391774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:05.461964 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'code': 200} Nov 24 14:40:05.505278 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-932ab5cc-8897-4999-bfc5-da1b6ef8e739 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1003 time: 0.2039587 Nov 24 14:40:05.568529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-ddd7b923-9eb5-4d9f-b3ee-79362ccda1d2 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:05.569983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-ddd7b923-9eb5-4d9f-b3ee-79362ccda1d2 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0590601 Nov 24 14:40:05.645235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-7187280f-d253-4a29-8f8f-96cd7ca9b51e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0694842 Nov 24 14:40:05.784793 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-14d023c4-3057-426f-aaf2-396cf14c338c service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1332695 Nov 24 14:40:05.875228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-62dbe864-5edb-4bf4-a9b7-aecea90be7a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:05.918632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-9bbc6e98-5be6-4eef-9916-693b83f226e0 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281362 Nov 24 14:40:06.268703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094f8e98-9eed-42c4-afdc-0d94d34935b3 req-577d02e2-277f-41ce-a7b3-e8c46e146f9a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:06.270030 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-094f8e98-9eed-42c4-afdc-0d94d34935b3 req-577d02e2-277f-41ce-a7b3-e8c46e146f9a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0831831 Nov 24 14:40:06.316333 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-094f8e98-9eed-42c4-afdc-0d94d34935b3 req-13cfc7bc-c47d-463f-9e55-0406051c8b46 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404811 Nov 24 14:40:06.897629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:07.530477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5abaa3e3-f13c-4c46-80c2-8e3b3af60074 req-0042ceec-fe35-45ae-9314-fc3e78dbb411 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:07.531872 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5abaa3e3-f13c-4c46-80c2-8e3b3af60074 req-0042ceec-fe35-45ae-9314-fc3e78dbb411 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0840547 Nov 24 14:40:07.579617 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5abaa3e3-f13c-4c46-80c2-8e3b3af60074 req-45d9811f-369d-4d0f-9f5a-19e83fbdb714 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414255 Nov 24 14:40:08.409706 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-50ba3751-abcc-4ec7-95eb-92ab89cdc7b2 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 1099 time: 0.0677485 Nov 24 14:40:08.515315 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-221bf2ce-c11e-4d61-b9ca-da609806ab82 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0837927 Nov 24 14:40:08.592466 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:08.658911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-5fa8645a-98be-4a70-8929-5a1b0a721553 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:08.660453 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-5fa8645a-98be-4a70-8929-5a1b0a721553 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1377318 Nov 24 14:40:08.807933 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-e0d0871f-8861-4cee-8b84-e3865a6cd080 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1003 time: 0.1413372 Nov 24 14:40:08.878777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377a3a14-989c-410e-b20d-a91ce981a43a req-aaadc7a2-24a7-41c2-84cb-0c3c286a5796 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:08.880226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-377a3a14-989c-410e-b20d-a91ce981a43a req-aaadc7a2-24a7-41c2-84cb-0c3c286a5796 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.1664352 Nov 24 14:40:08.903835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-4ae32fec-e4fd-42f1-87df-77def6dea1f1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:08.905233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-4ae32fec-e4fd-42f1-87df-77def6dea1f1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0908122 Nov 24 14:40:08.978760 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-377a3a14-989c-410e-b20d-a91ce981a43a req-e68316f9-cfd1-4c8a-bf29-c0f147cbb3a9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0915449 Nov 24 14:40:09.002472 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-b523150f-ac29-48bf-94af-c106c3166e94 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0898883 Nov 24 14:40:09.135012 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-fae322bf-1369-4547-a326-4b6d46afc2be service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262069 Nov 24 14:40:09.268736 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9b88cfff-817f-4155-a3dc-376622c9e6e7 req-5d06584a-332f-40ad-bfd0-c192c4227187 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1274562 Nov 24 14:40:09.989247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-be0b09d9-3c7a-4404-aea2-3d88ccb8f82a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 1099 time: 0.0703731 Nov 24 14:40:10.185899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a374c542-113a-4caf-9ce2-d4247aeb671a req-d48b01f5-35fc-4fab-a010-09ecacbbe647 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:10.187343 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a374c542-113a-4caf-9ce2-d4247aeb671a req-d48b01f5-35fc-4fab-a010-09ecacbbe647 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0807180 Nov 24 14:40:10.239549 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a374c542-113a-4caf-9ce2-d4247aeb671a req-3dbfc133-1dd1-4880-8f9a-4cb58f8c9aac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455546 Nov 24 14:40:10.258715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-bfcec3b7-9e04-487f-84fe-0381ded9cc55 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:10.260198 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-bfcec3b7-9e04-487f-84fe-0381ded9cc55 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.2510564 Nov 24 14:40:10.371746 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-e04d4bfd-4371-475f-82c6-2e78a67427c2 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 200 len: 1003 time: 0.1042693 Nov 24 14:40:10.445327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-d037296e-919f-46c0-a4c3-4b826ed0dd73 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:10.447121 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-d037296e-919f-46c0-a4c3-4b826ed0dd73 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0679333 Nov 24 14:40:10.532159 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-c96c09f1-600d-4115-8af3-429647b684e1 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0786946 Nov 24 14:40:10.684382 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-d0b21e1a-7f79-424e-beb3-96059ea223bf service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1434748 Nov 24 14:40:10.842162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c19f7ab6-b699-41f3-9bf3-ba178e3549de req-05198114-7744-4e79-b6f3-2aa0219598a3 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1503916 Nov 24 14:40:10.999091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:40:11.002493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:40:11.267134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:11.303436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:11.329997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'aa80b031-1280-4358-b302-372954e2ea1e', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': 'aa80b031-1280-4358-b302-372954e2ea1e', 'mac_address': 'fa:16:3e:51:e2:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:40:11.361679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:11.391445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:11.405863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:11.411142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:11.450832 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'code': 200} Nov 24 14:40:11.490308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:11.546146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:40:11.552244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53af1dfa-cf8f-4b20-bbd5-c409d81e57d2 req-3afa2afb-dfa2-4364-afeb-0aa0098f5a0f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:11.554406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53af1dfa-cf8f-4b20-bbd5-c409d81e57d2 req-3afa2afb-dfa2-4364-afeb-0aa0098f5a0f tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 944 time: 0.1170795 Nov 24 14:40:11.557455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:11.592283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:11.621993 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53af1dfa-cf8f-4b20-bbd5-c409d81e57d2 req-3d3436fe-ed83-45e1-a169-27ec37508f9a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527239 Nov 24 14:40:11.646338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:40:11.647451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:40:12.203491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:12.220550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:40:12.236167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:12.240414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:12.243436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:12.310836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['aa80b031-1280-4358-b302-372954e2ea1e'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:40:12.360527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=10']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:12.364791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:12.819702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2664a8f-6f88-46ce-a39f-69b07957962f req-8dd9a66b-0b68-45d5-a1ce-81ef5356f2b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:12.821156 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2664a8f-6f88-46ce-a39f-69b07957962f req-8dd9a66b-0b68-45d5-a1ce-81ef5356f2b3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0772314 Nov 24 14:40:12.867388 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e2664a8f-6f88-46ce-a39f-69b07957962f req-280e2f82-459d-4871-8791-8ebe8eca6e5d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406001 Nov 24 14:40:13.005653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:40:13.070837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e842b3a3-2d3b-46c1-ac4d-99c24097a5db req-3c6f5067-0633-47f4-a21b-67d0acc7665a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:13.072889 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e842b3a3-2d3b-46c1-ac4d-99c24097a5db req-3c6f5067-0633-47f4-a21b-67d0acc7665a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 946 time: 0.0825226 Nov 24 14:40:13.078303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port aa80b031-1280-4358-b302-372954e2ea1e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:40:13.078680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:13.122683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e842b3a3-2d3b-46c1-ac4d-99c24097a5db req-0717e2d7-cc89-4e7c-bbb9-6bca118925ef tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430074 Nov 24 14:40:13.197191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:13.232291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:13.237406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:13.239730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:13.317987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=11']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:13.323337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:13.348860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5c7636-b118-4b28-95f5-d2d4b259b2fd req-b8bec086-ce84-436f-b53e-f803bbaa3949 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:13.350284 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7e5c7636-b118-4b28-95f5-d2d4b259b2fd req-b8bec086-ce84-436f-b53e-f803bbaa3949 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 947 time: 0.0948756 Nov 24 14:40:13.395479 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7e5c7636-b118-4b28-95f5-d2d4b259b2fd req-3e6be9eb-ced9-4a96-bd4c-b9d5eae1712e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390654 Nov 24 14:40:13.451783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:13.507298 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'code': 200} Nov 24 14:40:13.808259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083d4b7a-908b-453a-8b15-50365bb35915 req-6547e8fd-8a67-4857-80c4-0242f8412b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:13.809754 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-083d4b7a-908b-453a-8b15-50365bb35915 req-6547e8fd-8a67-4857-80c4-0242f8412b70 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 947 time: 0.0775585 Nov 24 14:40:13.861731 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-083d4b7a-908b-453a-8b15-50365bb35915 req-38e07051-932c-4caa-a3e2-748fb029455c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432892 Nov 24 14:40:15.005069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:40:15.066340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c06fb99-b6ae-47c2-af20-f0de215dcd10 req-64332078-6f0d-4a93-8471-7481f497d7d1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:15.067816 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c06fb99-b6ae-47c2-af20-f0de215dcd10 req-64332078-6f0d-4a93-8471-7481f497d7d1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 947 time: 0.0848887 Nov 24 14:40:15.115402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c06fb99-b6ae-47c2-af20-f0de215dcd10 req-eb44d7a5-760f-4c33-8084-36c6520f2015 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417621 Nov 24 14:40:15.119967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:15.155484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:15.159519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:15.161271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:15.225802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=12']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:15.228850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:15.508882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:15.565136 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'code': 200} Nov 24 14:40:15.918543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-b2dc5a8f-92bc-447f-bdfb-e96f40306fe4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:15.919999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-b2dc5a8f-92bc-447f-bdfb-e96f40306fe4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 945 time: 0.0769529 Nov 24 14:40:15.992332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Deleting port aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:40:15.992673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:16.250624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] For port aa80b031-1280-4358-b302-372954e2ea1e, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=aa80b031-1280-4358-b302-372954e2ea1e,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:16.251302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:16.736106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca1c2a4-32ea-4265-8da0-fb1f69eac955 req-4c5d1a7e-333c-4b15-a7ec-a1cdb7be32d0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:16.738175 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3ca1c2a4-32ea-4265-8da0-fb1f69eac955 req-4c5d1a7e-333c-4b15-a7ec-a1cdb7be32d0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 945 time: 0.4929278 Nov 24 14:40:16.953739 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3ca1c2a4-32ea-4265-8da0-fb1f69eac955 req-a86b50e7-b8e0-460b-8829-bdff78cf34d0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2026758 Nov 24 14:40:16.957256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:16.957761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:16.958208 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 disassociated. External IP: 172.26.4.246, port: aa80b031-1280-4358-b302-372954e2ea1e. Nov 24 14:40:16.958676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Calling delete_port for aa80b031-1280-4358-b302-372954e2ea1e owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:40:17.133600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:17.139855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:17.185878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event deleted for resources: {'Port': ['ID=aa80b031-1280-4358-b302-372954e2ea1e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:17.198688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.199078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.199452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.199841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.200212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.200573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.200940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.201307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.201661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.202304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.202670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:40:17.206340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:17.447110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:40:17.670490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:40:17.683411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:40:17.696873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:40:17.697485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:40:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:17.740784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] No DVR routers for this DVR port aa80b031-1280-4358-b302-372954e2ea1e on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:40:17.743253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:17.746140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-deleted', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:17.763791 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-606e3648-a0c9-48ca-bf3e-21a840f7163c req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "DELETE /v2.0/ports/aa80b031-1280-4358-b302-372954e2ea1e HTTP/1.1" status: 204 len: 173 time: 1.8375292 Nov 24 14:40:17.825580 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '46115d5a-8bb7-471d-88cd-6bf1db404205', 'name': 'network-vif-deleted', 'tag': 'aa80b031-1280-4358-b302-372954e2ea1e', 'status': 'completed', 'code': 200} Nov 24 14:40:17.931332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:40:18.188532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-295a3636-2dd4-4041-9892-8070e39d43bd req-1ce60cd1-07c0-4cf9-a948-41e88ea6d1d6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:40:18.196327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:18.208341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-295a3636-2dd4-4041-9892-8070e39d43bd req-1ce60cd1-07c0-4cf9-a948-41e88ea6d1d6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:40:18.209562 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-295a3636-2dd4-4041-9892-8070e39d43bd req-1ce60cd1-07c0-4cf9-a948-41e88ea6d1d6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=46115d5a-8bb7-471d-88cd-6bf1db404205 HTTP/1.1" status: 200 len: 210 time: 0.0763407 Nov 24 14:40:18.344080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:18.348740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:40:18.361116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:40:18.361747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:40:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:18.540060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:40:18.857073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:18.861104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76d86381-0623-4b6a-b8d1-cac883cb8f21 None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:40:19.020481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:40:19.054303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: aa80b031-1280-4358-b302-372954e2ea1e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:40:19.054655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device aa80b031-1280-4358-b302-372954e2ea1e not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:40:19.082961 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd56f4c2-dc48-4d7e-b62f-93137dc6b32b None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:40:19.650875 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-69f73053-4f9b-4933-bcf3-a7c287ff4444 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-securitygroup--290047065&fields=id&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 267 time: 0.0450051 Nov 24 14:40:19.900563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba675f96-b603-4566-8f3f-669135024109 req-69da4691-1350-4706-b558-0b38b317aee7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:19.902791 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-69da4691-1350-4706-b558-0b38b317aee7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.2450991 Nov 24 14:40:19.918807 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-cb283b73-c1e0-40c3-83a3-23d7c2869610 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/quotas/644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 375 time: 0.0107059 Nov 24 14:40:20.001053 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-2496c613-2bb4-43ff-9a60-ebaecc2db751 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0769622 Nov 24 14:40:20.138989 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-e22640e0-4c9c-430f-b191-37b82db93ba6 service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1259069 Nov 24 14:40:20.274460 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-4e83e3b6-0f66-4e04-b9bb-252b309954e2 service neutron] 10.222.0.70 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1293249 Nov 24 14:40:20.471805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e71fbef0-db09-4b8c-90bc-0f704656b0a9 req-0793e13c-5086-40f5-aac1-fcb63c12cfba tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 210 time: 0.0443528 Nov 24 14:40:21.538775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba675f96-b603-4566-8f3f-669135024109 req-cfca5ab0-03b8-4143-9ff0-1375159d5789 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:21.541103 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-cfca5ab0-03b8-4143-9ff0-1375159d5789 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 812 time: 0.1995940 Nov 24 14:40:21.602803 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-9a986017-1c21-4166-8d67-23395f9793a2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 379 time: 0.0480661 Nov 24 14:40:21.637892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'port': {'device_id': '0c20b361-c289-409d-8467-1350dad743fe', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'admin_state_up': True, 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'security_groups': ['7ef8b8e0-808b-4ac2-88ce-f247cce14b78']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:40:21.661972 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c4a85bca-858c-4b83-90ff-4feb215da9ab req-23c01f97-1b12-470f-85ec-0cd22c3cd659 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 210 time: 0.0474162 Nov 24 14:40:21.793263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:40:21.805823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:40:21.817771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Made reservation on behalf of 644eeb3051394d9da6b3f5fb4139e803 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:40:21.820864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:21.984778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Allocated IP 172.20.0.11 (b20ce7e1-47d2-4747-a9a3-ec140e6fcda1/22012fd4-20c7-4275-844f-7e901c9b102d/4b2a8819-f9a7-4bc2-90e0-08ef65759ab8) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:40:22.174789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:22.190390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Transition to ACTIVE for port object 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:40:22.212022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:22.218535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60339d48-819c-477c-b43e-adbadf7c56ba tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:22.398423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:40:22.407581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:40:22.412687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:40:22.449012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:22.455699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:22.487072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:22.488544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:22.518862 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8868070 Nov 24 14:40:22.533664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Request body: {'port': {'device_id': '0c20b361-c289-409d-8467-1350dad743fe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:40:22.653352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:22.662643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-aaa2af2e-8522-43bc-81e5-e0eb1f7bc705 None None] Provisioning for port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:40:22.668177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-aaa2af2e-8522-43bc-81e5-e0eb1f7bc705 None None] Provisioning complete for port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:40:22.668553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aaa2af2e-8522-43bc-81e5-e0eb1f7bc705 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:22.723136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-aaa2af2e-8522-43bc-81e5-e0eb1f7bc705 None None] Port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:40:22.998187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346e8eca-8ace-4d87-ade9-ca6cfc081792 req-c792cc32-85e0-47e1-a82c-7713c6dfda22 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:22.998788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-346e8eca-8ace-4d87-ade9-ca6cfc081792 req-c792cc32-85e0-47e1-a82c-7713c6dfda22 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Synchronizing usage tracker for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:40:23.025302 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-346e8eca-8ace-4d87-ade9-ca6cfc081792 req-c792cc32-85e0-47e1-a82c-7713c6dfda22 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Unset dirty status for tenant:644eeb3051394d9da6b3f5fb4139e803 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:40:23.027233 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-346e8eca-8ace-4d87-ade9-ca6cfc081792 req-c792cc32-85e0-47e1-a82c-7713c6dfda22 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 932 time: 0.2214661 Nov 24 14:40:23.109807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:40:23.120525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:23.135278 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-346e8eca-8ace-4d87-ade9-ca6cfc081792 req-1224d5b5-55c7-452f-b6f0-e03f71a8eff3 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0761361 Nov 24 14:40:23.141541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Transition to ACTIVE for port object 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:40:23.145836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:23.151449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c9447263-75fb-4c9d-bfe1-3d3c0ed1aba6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:23.277170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:23.280529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:23.394491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Attempting to bind port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:40:23.394823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Attempting to bind port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:40:23.395146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Attempting to bind port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:40:23.401701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:40:23.402017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Attempting to bind port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 on network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:40:23.408429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 40, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:40:23.408762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Checking segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:40:23.409144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Bound using segment: {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:40:23.409562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Bound port: 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ccf8281b-cd10-426d-865a-cd4652bd2f44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 853, 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:40:23.409907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:23.511321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:40:23.514950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:40:23.521024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:23.528193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:23.595984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:23.597572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] 10.222.0.47 "PUT /v2.0/ports/4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1094 time: 1.0706265 Nov 24 14:40:23.598105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:23.621519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:23.624942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:23.680455 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'status': 'completed', 'code': 200} Nov 24 14:40:23.723295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-570e5b85-517b-4a9f-abb1-6029de805fa4 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1097 time: 0.0866036 Nov 24 14:40:23.811221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-a2939bc1-6ad2-42b5-a43c-488525a91675 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 217 time: 0.0800819 Nov 24 14:40:23.829911 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:40:23.875720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba675f96-b603-4566-8f3f-669135024109 req-84b336f4-2054-4e84-94ff-61519f29c118 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:23.877169 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-84b336f4-2054-4e84-94ff-61519f29c118 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0588028 Nov 24 14:40:23.952502 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-a1d43980-1588-4d33-8bdc-d742db428b42 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0690722 Nov 24 14:40:24.093795 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-edb98d1e-7767-442a-a406-66d5892033ac service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1345425 Nov 24 14:40:24.227994 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ba675f96-b603-4566-8f3f-669135024109 req-4d382869-34db-44c9-a0c3-084244876100 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1277194 Nov 24 14:40:24.516241 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-173edcc6-ccfb-4412-b3c8-c68e27cf7139 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1097 time: 0.2378654 Nov 24 14:40:24.528279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b7dbe6-83f4-41f7-a654-bafbf7423f6a req-17ccfcfc-af0a-494e-9810-b856a0143897 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:24.530999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b6b7dbe6-83f4-41f7-a654-bafbf7423f6a req-17ccfcfc-af0a-494e-9810-b856a0143897 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 944 time: 0.1101019 Nov 24 14:40:24.668285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b6b7dbe6-83f4-41f7-a654-bafbf7423f6a req-b4c150fb-2bf7-4143-adb6-128db38dabee tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1149361 Nov 24 14:40:24.702062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-8c5477a7-17d7-4346-a1ad-e4fce36cb1f1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:24.703560 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-8c5477a7-17d7-4346-a1ad-e4fce36cb1f1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1711912 Nov 24 14:40:24.771691 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-35a4e403-2739-4983-89fc-1f4f1b6dd713 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 217 time: 0.0607436 Nov 24 14:40:24.836966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-46aa9051-8c48-4844-9e59-0cf4dd684c26 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:24.839236 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-46aa9051-8c48-4844-9e59-0cf4dd684c26 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0608828 Nov 24 14:40:24.914302 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-5a607589-09c6-46d0-b083-cde4e0885362 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0682108 Nov 24 14:40:25.047797 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-ab6fe066-fc8e-46cb-8b0a-b6e558f0906d service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267903 Nov 24 14:40:25.184507 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-575c3301-2d61-425b-9d3c-1b3833eaf64c req-17b8e588-acab-4050-bcdf-3dfa466981c3 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300488 Nov 24 14:40:25.875729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c75fa6a5-33db-439f-9cc9-ad90954e34a9 req-84ee7c75-97ac-4567-abc5-e655a23d041c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:25.877167 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c75fa6a5-33db-439f-9cc9-ad90954e34a9 req-84ee7c75-97ac-4567-abc5-e655a23d041c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 944 time: 0.0776467 Nov 24 14:40:25.923703 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c75fa6a5-33db-439f-9cc9-ad90954e34a9 req-3235889e-9247-43f9-a435-5e59f4423172 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410109 Nov 24 14:40:27.036465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:40:27.122478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53fb2fe9-6f45-48ef-bc7d-8f6ae7a198ca req-cb5495d4-e6b3-4c95-aea7-364a7b83ae10 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:27.123983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53fb2fe9-6f45-48ef-bc7d-8f6ae7a198ca req-cb5495d4-e6b3-4c95-aea7-364a7b83ae10 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 944 time: 0.0811300 Nov 24 14:40:27.168797 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-53fb2fe9-6f45-48ef-bc7d-8f6ae7a198ca req-c102c9e3-1c53-4a37-9051-e35bc716aeab tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393546 Nov 24 14:40:27.169965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:27.183607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'mac_address': 'fa:16:3e:8c:b0:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:40:27.236810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:27.253565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:40:27.269051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:27.273577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:27.275281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:27.379431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:27.383788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:27.611266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:40:28.505768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46fd42a7-da3b-4d32-8c17-8dd260bbbb8e req-9c4e5efb-11e2-4f58-94d9-4d4fc6ced176 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:28.507114 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-46fd42a7-da3b-4d32-8c17-8dd260bbbb8e req-9c4e5efb-11e2-4f58-94d9-4d4fc6ced176 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 945 time: 0.0811932 Nov 24 14:40:28.552461 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-46fd42a7-da3b-4d32-8c17-8dd260bbbb8e req-0f80a35f-7ebe-496d-aeab-0ee7953cb56b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398364 Nov 24 14:40:29.051593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:40:29.121984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:40:29.126541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:40:29.126919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:29.247869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:29.274035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:29.284047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:40:29.287738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:29.290118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:40:29.332435 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'code': 200} Nov 24 14:40:29.355489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:40:29.358339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:40:29.553372 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-018bd036-fc15-4ab2-ba3c-e9c579c0de71 req-b710ef9f-d172-4872-b5d2-ed2228609e3a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0690041 Nov 24 14:40:29.600471 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-018bd036-fc15-4ab2-ba3c-e9c579c0de71 req-68efbeb6-4c22-4097-9010-00f706d8b9ef service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409844 Nov 24 14:40:29.748454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec959a11-3566-45d3-b2db-85279013e728 req-eecfdc16-3e13-40b8-8e49-119f6b380011 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:29.749898 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ec959a11-3566-45d3-b2db-85279013e728 req-eecfdc16-3e13-40b8-8e49-119f6b380011 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0778778 Nov 24 14:40:29.795964 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ec959a11-3566-45d3-b2db-85279013e728 req-f3a6cfd5-8cae-4b15-9032-a2a31073db8d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401976 Nov 24 14:40:31.002154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cb49bd9-3b60-48ff-88ab-3ebf39c18374 req-86188e29-b9f7-4805-abfe-7b47c39a0e4c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:31.003586 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cb49bd9-3b60-48ff-88ab-3ebf39c18374 req-86188e29-b9f7-4805-abfe-7b47c39a0e4c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0825438 Nov 24 14:40:31.048112 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cb49bd9-3b60-48ff-88ab-3ebf39c18374 req-f0340e47-9164-4146-8a7e-98f9c58e054b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390656 Nov 24 14:40:32.250232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29903556-f07e-477d-9fb2-4c0f7b56f9e4 req-8b1ba0b0-ff51-4598-9a22-c64c91c1d811 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:32.251676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-29903556-f07e-477d-9fb2-4c0f7b56f9e4 req-8b1ba0b0-ff51-4598-9a22-c64c91c1d811 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0819185 Nov 24 14:40:32.299198 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-29903556-f07e-477d-9fb2-4c0f7b56f9e4 req-eb879eba-3f88-4cbe-b65e-6eba208e2d6c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420034 Nov 24 14:40:32.501818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-832d99a9-6407-4fab-8a74-53899b393d15 req-8e763b1c-11a9-46bd-9b7a-a888137c6655 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:32.505656 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-832d99a9-6407-4fab-8a74-53899b393d15 req-8e763b1c-11a9-46bd-9b7a-a888137c6655 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0802741 Nov 24 14:40:32.514117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51580) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:40:32.519320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Request body: {'floatingip': {'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:40:32.604972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:33.299444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-55738efe-11b1-4759-941d-7276b396b13c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:33.300082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:33.303401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:33.491920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 associated. External IP: 172.26.4.246, port: 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8. Nov 24 14:40:33.717651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:33.883483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:40:34.078293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:40:34.083115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:34.087653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:40:34.099608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:40:34.100245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:40:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:34.138869 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-bee7cae7-55c9-43a3-b343-4ab43ddfb524 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "PUT /v2.0/floatingips/7522ecd4-9586-4e09-9875-65fffb502df1 HTTP/1.1" status: 200 len: 993 time: 1.6236134 Nov 24 14:40:34.139431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:40:34.194117 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'status': 'completed', 'code': 200} Nov 24 14:40:34.287537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-e21221a2-8d97-4a7a-a1bb-b0fa75d7d0e7 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0724823 Nov 24 14:40:34.299891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:40:34.417298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-2ae0357f-7e10-41bb-b9b4-3c107e337045 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:34.418632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-2ae0357f-7e10-41bb-b9b4-3c107e337045 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1249964 Nov 24 14:40:34.641450 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-34a4f694-59f6-4472-9a2a-4b447a1e7795 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1001 time: 0.2162449 Nov 24 14:40:34.655635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:8c:b0:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c20b361-c289-409d-8467-1350dad743fe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:40:33Z', 'revision_number': 13, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:34.659554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:40:34.670069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:40:34.670600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:40:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:34.703792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-43c9b701-fe96-42d8-8295-859174f15ff5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:40:34.705196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-43c9b701-fe96-42d8-8295-859174f15ff5 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0577221 Nov 24 14:40:34.782256 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-f48585af-b1c6-479b-8ac4-3b99a23352b7 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0711098 Nov 24 14:40:34.845939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:40:34.914947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-21f3adef-c715-4195-87bf-bea86efafcc8 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257353 Nov 24 14:40:35.050839 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf0facb9-7b4e-4689-bca5-33209d1ebe1d req-49bd5c56-b8f9-4814-8937-f45641c42e15 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1297429 Nov 24 14:40:35.231134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:8c:b0:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c20b361-c289-409d-8467-1350dad743fe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:40:33Z', 'revision_number': 13, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:40:35.235095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37ba434-86a3-4097-8cfd-3dd169887f0a None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7522ecd4-9586-4e09-9875-65fffb502df1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'floating_ip_address': '172.26.4.246', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'mac_address': 'fa:16:3e:8c:b0:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c20b361-c289-409d-8467-1350dad743fe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:34:09Z', 'updated_at': '2021-11-24T14:40:33Z', 'revision_number': 13, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:40:35.436340 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bda8375-9752-43a7-9aff-051c9b5ca05f None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:40:35.875653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fcf4d526-bc5d-44ce-aea3-5a993678df66 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:36.901875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:38.593306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:40:48.170227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:00.830543 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:41:03.301915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8734a3f7-c5c9-4b4b-871c-b45a88d7c75f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:03.719795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:05.877924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b2925e1d-0e42-4702-92e1-f727f61db3f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:06.902336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:08.597612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:09.902687 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-abb7bf35-4769-45fd-8cf6-96ce49d367c2 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0693913 Nov 24 14:41:10.045300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-8347c3db-b747-4cd1-b7e4-223f66998a86 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0729389 Nov 24 14:41:10.188243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-1f4ff422-2a11-44aa-b797-9958214194f9 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:41:10.189763 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-1f4ff422-2a11-44aa-b797-9958214194f9 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1259873 Nov 24 14:41:10.307142 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-3b0bd0a6-d03c-48e6-9a73-35aa86e54d4f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1003 time: 0.1108160 Nov 24 14:41:10.375013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-bba47e7e-2118-4e4e-aeb8-bcc1f00e1c96 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:41:10.377002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-bba47e7e-2118-4e4e-aeb8-bcc1f00e1c96 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0622072 Nov 24 14:41:10.451109 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-46be3552-6c02-4708-a63d-e4c32b5132e9 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0678988 Nov 24 14:41:10.592857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-0e0fc3a8-7c30-4f03-90ce-ddbe1b767385 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1356900 Nov 24 14:41:10.757089 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d1ec8e1-d3fe-4f7d-8dfa-4cf76386e803 req-659552f5-9da4-47b4-afa8-203f5adc0fe5 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1554484 Nov 24 14:41:18.192643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:33.302800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d4a89768-2652-466b-8b43-eab6b31485f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:33.721532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:35.879114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95f5c92a-a415-4fe1-bbd2-375f91f9451b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:36.907222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:37.831283 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:41:38.599989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:48.182471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:41:49.740459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c5f8af-eef5-4a64-9e16-7a2044a8086b req-fd289090-b9c1-45e8-bbb6-ca17d36db243 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:41:49.741947 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87c5f8af-eef5-4a64-9e16-7a2044a8086b req-fd289090-b9c1-45e8-bbb6-ca17d36db243 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.1485989 Nov 24 14:41:49.790831 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87c5f8af-eef5-4a64-9e16-7a2044a8086b req-782abcea-24f6-47dd-92e3-8cda07ed9150 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433164 Nov 24 14:42:03.304719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-58c9a50d-9674-4db0-8d6b-9b3f5992d87f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:03.723833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:03.799363 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a4f3d53a-7e67-4124-95b7-37a132bbc5e2 req-a7a2b9a4-fe2a-4d1b-b7bc-33120dfdf7be service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.1344335 Nov 24 14:42:04.088545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-72b64ac5-b688-479d-9f65-ce67ce7622e6 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1073112 Nov 24 14:42:04.132331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219d8764-fae7-4c65-9d6f-21fab1b4eb40 req-e4a078c8-cced-4591-9250-48f5a9d3f502 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:04.133787 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219d8764-fae7-4c65-9d6f-21fab1b4eb40 req-e4a078c8-cced-4591-9250-48f5a9d3f502 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0897319 Nov 24 14:42:04.183228 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219d8764-fae7-4c65-9d6f-21fab1b4eb40 req-8af24ab3-bb8c-4c88-a309-b4596343bebc tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419450 Nov 24 14:42:05.383020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-221a612f-ef9c-4126-9be7-3fb05dfd36af req-430be3db-7460-4455-a45a-37b4741a8889 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:05.384381 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-221a612f-ef9c-4126-9be7-3fb05dfd36af req-430be3db-7460-4455-a45a-37b4741a8889 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0777555 Nov 24 14:42:05.433536 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-221a612f-ef9c-4126-9be7-3fb05dfd36af req-d7b13cea-49e0-4a6a-8a19-5b44c6e9255b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429013 Nov 24 14:42:05.880750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3a8d6068-790d-4422-81ed-58b412e2bcae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:06.635686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6483194-172b-4c89-a9a7-a31def46878c req-3d2cbe59-1fb8-4b4d-97df-636ced0a6016 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:06.637171 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6483194-172b-4c89-a9a7-a31def46878c req-3d2cbe59-1fb8-4b4d-97df-636ced0a6016 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0814984 Nov 24 14:42:06.686004 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6483194-172b-4c89-a9a7-a31def46878c req-19a298ea-44dd-44f0-bda1-c2516e7049cd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432317 Nov 24 14:42:06.908816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:07.377426 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-904faee4-24ce-446d-a909-bb7ee6f9e2a2 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.1355584 Nov 24 14:42:07.607978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0abaef-b97e-40db-a053-827cc7206149 req-19eb9831-5c89-49b6-afee-2bfafb26dec9 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:07.609422 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-19eb9831-5c89-49b6-afee-2bfafb26dec9 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.2260003 Nov 24 14:42:07.713141 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-dbe4b6dd-654c-492e-aa43-2a5d1fdcd836 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1003 time: 0.0967183 Nov 24 14:42:07.778130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0abaef-b97e-40db-a053-827cc7206149 req-48f68bf2-0422-45dc-9302-f6cceac7a4e5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:07.779548 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-48f68bf2-0422-45dc-9302-f6cceac7a4e5 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0604925 Nov 24 14:42:07.857890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-e66848a5-9ec5-4bac-8263-c659608aae7f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0723293 Nov 24 14:42:07.892504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc4856a-1a1b-4cb6-bac7-d7ec6f0f7d72 req-46c2f021-26f3-4b6f-a040-5315100b83fb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:07.893925 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4bc4856a-1a1b-4cb6-bac7-d7ec6f0f7d72 req-46c2f021-26f3-4b6f-a040-5315100b83fb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0765102 Nov 24 14:42:07.939722 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4bc4856a-1a1b-4cb6-bac7-d7ec6f0f7d72 req-24d082c2-4f2f-463f-9fbd-4807b1f71cac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401249 Nov 24 14:42:07.989947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-0d3605f4-a431-4e71-9084-da54cd428d87 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1260197 Nov 24 14:42:08.117808 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-15f66437-c740-4a4a-9dfe-ea59d977c934 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1216333 Nov 24 14:42:08.605155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:09.136031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa56bdbd-e730-46dc-afae-7d552d0a2a6a req-ef76c09f-0b63-45eb-b9b2-0d732449c960 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:09.137496 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fa56bdbd-e730-46dc-afae-7d552d0a2a6a req-ef76c09f-0b63-45eb-b9b2-0d732449c960 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0751901 Nov 24 14:42:09.182223 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fa56bdbd-e730-46dc-afae-7d552d0a2a6a req-a0fa4702-2a1e-4b9e-a9f9-4311c8ef76ce tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392890 Nov 24 14:42:09.976337 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-fee940a3-f583-43cb-af74-6d4bb1795640 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0787420 Nov 24 14:42:10.122419 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-afe87826-5c8c-4415-80e4-b560dc0901c6 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:10.123909 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-afe87826-5c8c-4415-80e4-b560dc0901c6 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1278763 Nov 24 14:42:10.227171 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-757329ce-d6ad-416e-958e-c05f489d1c2a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1003 time: 0.0964456 Nov 24 14:42:10.306096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-8db2c0d5-99c6-483d-bfb7-162208a84a8f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:10.309011 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-8db2c0d5-99c6-483d-bfb7-162208a84a8f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0744498 Nov 24 14:42:10.389700 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-44bf2b69-bac2-4718-95b0-1a72512dfbd1 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0745966 Nov 24 14:42:10.391664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a2f3d8-0213-4aab-a4c8-90eceae6a2b3 req-830b0934-8047-4be6-972b-703b765882ac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:10.393125 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f7a2f3d8-0213-4aab-a4c8-90eceae6a2b3 req-830b0934-8047-4be6-972b-703b765882ac tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0846188 Nov 24 14:42:10.445413 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f7a2f3d8-0213-4aab-a4c8-90eceae6a2b3 req-87f201db-b54d-440c-aa10-20a985334ece tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463626 Nov 24 14:42:10.527052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-9a2fd279-223a-4d8f-9384-c566b9feeb49 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311665 Nov 24 14:42:10.672900 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eae18202-f117-4db9-b463-28dbc0ed3fdd req-c6eee0da-22c8-4c70-9e22-8f6e7bfb6924 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1352692 Nov 24 14:42:11.655948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231614c3-3d51-48e7-8004-86ec1f48adb9 req-ad172378-fa21-4d45-950c-9ec76919ad69 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:11.657404 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-231614c3-3d51-48e7-8004-86ec1f48adb9 req-ad172378-fa21-4d45-950c-9ec76919ad69 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0792098 Nov 24 14:42:11.706718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-231614c3-3d51-48e7-8004-86ec1f48adb9 req-26401a9e-471f-41c4-b04b-395b6661e0c5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437839 Nov 24 14:42:12.904002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64895fa9-dd9f-4b86-af9e-2a3b9dafb9e2 req-791dbf04-bc9c-4956-b0de-84da7c144a9d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:12.905430 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-64895fa9-dd9f-4b86-af9e-2a3b9dafb9e2 req-791dbf04-bc9c-4956-b0de-84da7c144a9d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0764594 Nov 24 14:42:12.950286 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-64895fa9-dd9f-4b86-af9e-2a3b9dafb9e2 req-bb102872-7b88-4c77-bdab-72508afb8403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393817 Nov 24 14:42:14.159153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72af522a-f94d-4e76-ad34-5c13a4454da1 req-a8149544-f6d5-4de6-8006-8e9612d83363 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:14.160638 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-72af522a-f94d-4e76-ad34-5c13a4454da1 req-a8149544-f6d5-4de6-8006-8e9612d83363 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0846028 Nov 24 14:42:14.323422 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-72af522a-f94d-4e76-ad34-5c13a4454da1 req-dadeffd1-e4c0-4ae4-b678-38adf013e8e4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1566844 Nov 24 14:42:14.831190 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:42:15.526782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-592acb96-22ee-40a2-84a9-1a9e2540f205 req-6e199b59-332b-4e8f-948b-63db944f0f27 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:15.528242 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-592acb96-22ee-40a2-84a9-1a9e2540f205 req-6e199b59-332b-4e8f-948b-63db944f0f27 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0823040 Nov 24 14:42:15.574985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-592acb96-22ee-40a2-84a9-1a9e2540f205 req-fb0dbb70-56d0-4b92-9406-e39f7152854a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410943 Nov 24 14:42:16.773333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8262ab-47ae-419a-a3e9-b49988b3178e req-9088111d-512a-4255-b38e-6dcfc32d7676 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:16.774811 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9e8262ab-47ae-419a-a3e9-b49988b3178e req-9088111d-512a-4255-b38e-6dcfc32d7676 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0802112 Nov 24 14:42:16.821191 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9e8262ab-47ae-419a-a3e9-b49988b3178e req-4b1943e0-e2f5-4110-8d08-f7911ba5b545 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408456 Nov 24 14:42:18.021216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156e609e-4c90-4d28-a718-0d6d009ae1b2 req-1952cab4-fd69-4178-8332-392dafb63418 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:18.022641 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-156e609e-4c90-4d28-a718-0d6d009ae1b2 req-1952cab4-fd69-4178-8332-392dafb63418 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0791464 Nov 24 14:42:18.069113 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-156e609e-4c90-4d28-a718-0d6d009ae1b2 req-9d765507-233f-4b2e-8e2b-a894978de2f0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403235 Nov 24 14:42:18.202583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:19.270714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc512ab-368b-4d6b-9ff3-b71ded405492 req-4da644d9-fb72-4243-9803-3bcb68ba4179 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:19.272174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2cc512ab-368b-4d6b-9ff3-b71ded405492 req-4da644d9-fb72-4243-9803-3bcb68ba4179 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0794086 Nov 24 14:42:19.317475 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2cc512ab-368b-4d6b-9ff3-b71ded405492 req-61c2bbe1-9c11-49bd-b8a6-48a50ab4c7d0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388117 Nov 24 14:42:20.523514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-451f7c64-95e8-46af-838e-d14e315b51a6 req-7a28cc7e-bf5f-4875-8672-ad5e829c4ecf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:20.525623 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-451f7c64-95e8-46af-838e-d14e315b51a6 req-7a28cc7e-bf5f-4875-8672-ad5e829c4ecf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0809672 Nov 24 14:42:20.573446 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-451f7c64-95e8-46af-838e-d14e315b51a6 req-d0c2e3cf-3d3a-46b1-bd2a-574c2ee6ce7c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420809 Nov 24 14:42:21.777217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b951baee-7920-45d0-aa05-d9c01ebfd6b7 req-53d9a2e1-843a-4580-949b-20c861c42702 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:21.778639 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b951baee-7920-45d0-aa05-d9c01ebfd6b7 req-53d9a2e1-843a-4580-949b-20c861c42702 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0835619 Nov 24 14:42:21.824082 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b951baee-7920-45d0-aa05-d9c01ebfd6b7 req-d2db7026-e90c-41e3-95d4-09a29d109fd5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399909 Nov 24 14:42:23.020032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a537a6-7c53-40d3-bc90-f9d26f3de9c0 req-9c0cb2e4-64d9-4c78-ace7-b1340035626e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:23.021462 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c1a537a6-7c53-40d3-bc90-f9d26f3de9c0 req-9c0cb2e4-64d9-4c78-ace7-b1340035626e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0775084 Nov 24 14:42:23.171270 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c1a537a6-7c53-40d3-bc90-f9d26f3de9c0 req-964d2e76-514d-4b5c-a1a4-54e6f5ee7e59 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1441548 Nov 24 14:42:24.366344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a1e4d5f-6d38-429c-8bb5-53e67571beab req-9e9140b3-8730-4672-9fd4-b9ab67b2d090 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:24.367815 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a1e4d5f-6d38-429c-8bb5-53e67571beab req-9e9140b3-8730-4672-9fd4-b9ab67b2d090 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0754468 Nov 24 14:42:24.413490 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a1e4d5f-6d38-429c-8bb5-53e67571beab req-43b252b5-72aa-427e-89c7-2415aa9f87fb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402858 Nov 24 14:42:25.615183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d3d1d0a-6276-4d3a-9e5f-ea03de021dd4 req-daf5af39-b256-456d-bb5b-cd324144b87c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:25.616493 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d3d1d0a-6276-4d3a-9e5f-ea03de021dd4 req-daf5af39-b256-456d-bb5b-cd324144b87c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0772026 Nov 24 14:42:25.662057 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d3d1d0a-6276-4d3a-9e5f-ea03de021dd4 req-b3409200-83f1-429d-b1cb-f368a0d65eb0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395412 Nov 24 14:42:26.864542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00618002-45de-42ea-a1b4-913d33865196 req-472226b6-dbfe-4067-9651-61a8b5d94dfd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:26.865975 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-00618002-45de-42ea-a1b4-913d33865196 req-472226b6-dbfe-4067-9651-61a8b5d94dfd tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0805905 Nov 24 14:42:26.912669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-00618002-45de-42ea-a1b4-913d33865196 req-65788e7a-a9b6-4a72-8ea2-0dc781efc81a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405526 Nov 24 14:42:28.250626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ef8d5e-5718-4517-8659-e4e69b7e1a2d req-526827f8-be68-4e93-a970-36f19d4490e1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:28.251991 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-13ef8d5e-5718-4517-8659-e4e69b7e1a2d req-526827f8-be68-4e93-a970-36f19d4490e1 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0805023 Nov 24 14:42:28.298635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-13ef8d5e-5718-4517-8659-e4e69b7e1a2d req-169bff66-a94a-4f59-97e4-99f2f48f75c6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406215 Nov 24 14:42:29.505994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98e7345-25b7-4af8-8be7-dacc02a92a48 req-6c732bae-c04e-44fb-bc77-a1a7d809733d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:29.507419 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c98e7345-25b7-4af8-8be7-dacc02a92a48 req-6c732bae-c04e-44fb-bc77-a1a7d809733d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0754981 Nov 24 14:42:29.554475 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c98e7345-25b7-4af8-8be7-dacc02a92a48 req-1614301f-0e66-4c64-873d-fc7f1312f196 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405891 Nov 24 14:42:30.534454 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-29d6193b-8f00-4feb-a22a-52ce2130ccfd service neutron] 10.222.0.47 "GET /v2.0/ports/4b2a8819-f9a7-4bc2-90e0-08ef65759ab8/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0759041 Nov 24 14:42:30.756006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af94eed-1e25-45b8-81c8-991da719c585 req-08e8cc8d-41b5-4b04-bfca-b9bf9a780825 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:30.757437 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3af94eed-1e25-45b8-81c8-991da719c585 req-08e8cc8d-41b5-4b04-bfca-b9bf9a780825 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0799620 Nov 24 14:42:30.804687 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3af94eed-1e25-45b8-81c8-991da719c585 req-a2c58b63-b4e7-4889-8913-eedc545ba57a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416784 Nov 24 14:42:30.809648 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-dcf91a43-2d0c-4ca6-922e-2f6d4881e534 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 1099 time: 0.0745180 Nov 24 14:42:30.908716 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-544abffa-489f-4bce-a60a-85bce1f6553e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0773921 Nov 24 14:42:31.041382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0abaef-b97e-40db-a053-827cc7206149 req-996f4fa4-3542-4971-8311-1c26b1cd0daa service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:31.042824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-996f4fa4-3542-4971-8311-1c26b1cd0daa service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1275136 Nov 24 14:42:31.147012 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-889b8509-2239-4fa7-bac0-0d9cb65ed53e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1003 time: 0.0973017 Nov 24 14:42:31.209634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0abaef-b97e-40db-a053-827cc7206149 req-9acd80cf-c447-4991-945e-c87f85abf9b0 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:31.210962 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-9acd80cf-c447-4991-945e-c87f85abf9b0 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0567210 Nov 24 14:42:31.285136 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-83ee66a4-a7e4-456c-bf74-abd041ddd7cc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0674999 Nov 24 14:42:31.414512 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-c065eb47-d999-4e9a-acf7-7d33d96c0030 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231270 Nov 24 14:42:31.551134 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b0abaef-b97e-40db-a053-827cc7206149 req-9ca07f58-5472-417c-900b-9fb2501483bb service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300585 Nov 24 14:42:32.012891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd09d7e-12ac-49a3-8c64-131a4058da9e req-418efc72-556a-4442-b721-52742012e9da tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:32.014251 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6fd09d7e-12ac-49a3-8c64-131a4058da9e req-418efc72-556a-4442-b721-52742012e9da tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0859790 Nov 24 14:42:32.060655 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6fd09d7e-12ac-49a3-8c64-131a4058da9e req-171b6544-e553-40e5-bd35-8e39c86b9999 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407641 Nov 24 14:42:33.262305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04f2777-83f5-4921-bb02-3aad8df91dd8 req-5dfd6f4b-db2d-4004-9816-8200ca274cda tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:33.263641 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b04f2777-83f5-4921-bb02-3aad8df91dd8 req-5dfd6f4b-db2d-4004-9816-8200ca274cda tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0807796 Nov 24 14:42:33.308126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fde7c2b1-53a0-48cc-a229-89dfb71021ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:33.310026 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b04f2777-83f5-4921-bb02-3aad8df91dd8 req-0a57ce36-ff65-4555-becf-0f9c9d7df20c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406728 Nov 24 14:42:33.689170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:42:33.748213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:33.815246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:33.842957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:42:33.853877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:33.858227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:33.860847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:42:33.922111 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'code': 200} Nov 24 14:42:33.932383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:42:33.940553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.940892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.941227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.941551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.941877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.942200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.942519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.942838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.943153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.943464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.943805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:42:33.948267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:42:34.503686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44d074c-f6d7-4df7-89c5-e4229d9283b9 req-5c81b04b-9a9a-440e-8833-72e964f3bf05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:34.505132 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a44d074c-f6d7-4df7-89c5-e4229d9283b9 req-5c81b04b-9a9a-440e-8833-72e964f3bf05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 944 time: 0.0759470 Nov 24 14:42:34.554363 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a44d074c-f6d7-4df7-89c5-e4229d9283b9 req-df2ebbea-ccf2-44b6-80d0-19c569bf1c05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436213 Nov 24 14:42:35.701332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:42:35.754552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8869834-dde4-45cf-b1d7-21ff5f582e5b req-4ee1733c-6af1-40a5-962b-42de42f6073a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:35.756028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c8869834-dde4-45cf-b1d7-21ff5f582e5b req-4ee1733c-6af1-40a5-962b-42de42f6073a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 944 time: 0.0772843 Nov 24 14:42:35.851823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:35.866569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'mac_address': 'fa:16:3e:8c:b0:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:42:35.914822 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c8869834-dde4-45cf-b1d7-21ff5f582e5b req-2dc4b363-4592-40a8-a19e-781bd43f70f9 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1519842 Nov 24 14:42:35.923858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-13d4d919-2480-49fe-8f50-008b173c8c34 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:35.938809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:35.956343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:42:35.971715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:35.975668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:35.977628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:42:36.041484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:42:36.083004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:42:36.087702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:42:36.910304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:37.119248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43111098-9b48-48d4-afa5-e9b61d0fbd46 req-47ce86ea-4c5f-4184-b95e-d2f922204c71 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:37.120718 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-43111098-9b48-48d4-afa5-e9b61d0fbd46 req-47ce86ea-4c5f-4184-b95e-d2f922204c71 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 945 time: 0.0799012 Nov 24 14:42:37.167018 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-43111098-9b48-48d4-afa5-e9b61d0fbd46 req-b26e5f97-f96a-4d02-87d9-742555fc2e8e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407650 Nov 24 14:42:37.704611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:42:37.772552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:42:37.772944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:37.892854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:37.919886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:42:37.929569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:37.934004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:37.935948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:42:37.985050 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'code': 200} Nov 24 14:42:38.007494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:42:38.011899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:42:38.374178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6eba7c3-990c-4dd6-9a6c-5f334ed42d0b req-5d08d5a7-d076-4f46-8fbb-d46150ef09cf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:38.375616 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e6eba7c3-990c-4dd6-9a6c-5f334ed42d0b req-5d08d5a7-d076-4f46-8fbb-d46150ef09cf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0840547 Nov 24 14:42:38.420829 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e6eba7c3-990c-4dd6-9a6c-5f334ed42d0b req-492fda8e-2806-4152-b812-5e8c5483d3fe tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397830 Nov 24 14:42:38.607215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:39.625558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de42fbcc-6151-491c-a5b0-b27e1cf513ce req-2d670e64-e456-48a2-b05a-54ce3009a311 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:39.627045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-de42fbcc-6151-491c-a5b0-b27e1cf513ce req-2d670e64-e456-48a2-b05a-54ce3009a311 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0781746 Nov 24 14:42:39.673028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-de42fbcc-6151-491c-a5b0-b27e1cf513ce req-e246e097-ac7a-4699-bda0-74da232f0bf8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404887 Nov 24 14:42:40.886010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42eb03de-e2f0-4249-ae74-854c810ed739 req-4063e47c-2928-4022-a272-5f7fedd9078c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:40.887674 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42eb03de-e2f0-4249-ae74-854c810ed739 req-4063e47c-2928-4022-a272-5f7fedd9078c tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0906913 Nov 24 14:42:40.936008 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-42eb03de-e2f0-4249-ae74-854c810ed739 req-d5ddb140-5b9f-482a-b2a8-4c33ce82907e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424449 Nov 24 14:42:42.140672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b35a2ad-db91-45da-be49-afbd7eaccfe5 req-6504a634-3df6-4d2f-b357-303679be6f7b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:42.142120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b35a2ad-db91-45da-be49-afbd7eaccfe5 req-6504a634-3df6-4d2f-b357-303679be6f7b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0805938 Nov 24 14:42:42.187670 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b35a2ad-db91-45da-be49-afbd7eaccfe5 req-9a229b2c-ea1e-435d-bf00-f7c1e7964c36 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400867 Nov 24 14:42:42.649253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-370135b4-52c9-408a-8d0a-4074a6203710 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:42.650675 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-370135b4-52c9-408a-8d0a-4074a6203710 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe&tenant_id=644eeb3051394d9da6b3f5fb4139e803&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 946 time: 0.1286693 Nov 24 14:42:42.736541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47588a63-7b1e-47fe-923b-40056ee1cc18 req-99515cb3-07ba-472d-acfd-8996ac6d11d7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:42.737888 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47588a63-7b1e-47fe-923b-40056ee1cc18 req-99515cb3-07ba-472d-acfd-8996ac6d11d7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.1554704 Nov 24 14:42:42.767454 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-29185675-ae28-4b54-8649-5b20a1dd9ccd service neutron] 10.222.0.47 "GET /v2.0/ports/4b2a8819-f9a7-4bc2-90e0-08ef65759ab8/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.1092937 Nov 24 14:42:42.823149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47588a63-7b1e-47fe-923b-40056ee1cc18 req-52cc61ca-e302-443d-9267-4af55f620818 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0797698 Nov 24 14:42:42.872558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-2dbdffbd-69ad-4040-96b0-6bc9616b53ea service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0809536 Nov 24 14:42:43.004114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-ac7da886-c1a7-496f-b978-1880d6ee8b94 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:43.005466 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-ac7da886-c1a7-496f-b978-1880d6ee8b94 service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1270783 Nov 24 14:42:43.110028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-8e29b3be-295b-4ba0-ac0f-52304615f15f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1003 time: 0.0968542 Nov 24 14:42:43.180506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-ed446bc7-d67a-4ee0-9f46-bf33d9f0ee3f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:43.183071 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-ed446bc7-d67a-4ee0-9f46-bf33d9f0ee3f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0667300 Nov 24 14:42:43.266483 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-9ee97ee0-e4c3-418b-a326-2bcdff9f51c8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0770211 Nov 24 14:42:43.397645 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-6c454201-6419-47fd-9ee5-97a7ba778685 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1246424 Nov 24 14:42:43.531254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-9475346c-2add-449a-a063-89e25a000a01 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266854 Nov 24 14:42:44.031693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409c5907-4c5d-4e1c-b9b6-f04639c8f7b3 req-2c09cc2e-0e87-4c24-bb07-6e3c932fbf10 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:44.033191 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-409c5907-4c5d-4e1c-b9b6-f04639c8f7b3 req-2c09cc2e-0e87-4c24-bb07-6e3c932fbf10 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0810778 Nov 24 14:42:44.079185 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-409c5907-4c5d-4e1c-b9b6-f04639c8f7b3 req-a2126313-db0d-4950-9278-180379d809d4 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404799 Nov 24 14:42:45.276479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe47c0c4-87fd-4b6a-be23-8c249a03a36e req-7afd47aa-8988-4ae1-a529-aa076c24879e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:45.278024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fe47c0c4-87fd-4b6a-be23-8c249a03a36e req-7afd47aa-8988-4ae1-a529-aa076c24879e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0784805 Nov 24 14:42:45.325430 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fe47c0c4-87fd-4b6a-be23-8c249a03a36e req-9259f75e-a367-4f49-a9a9-1e8957985719 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419359 Nov 24 14:42:46.538598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec0189b-eb71-4513-a453-711ace588faa req-e5bf3c8e-4d27-4601-8b80-fc647a79af17 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:46.541420 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7ec0189b-eb71-4513-a453-711ace588faa req-e5bf3c8e-4d27-4601-8b80-fc647a79af17 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0918257 Nov 24 14:42:46.592942 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7ec0189b-eb71-4513-a453-711ace588faa req-6193b9c5-ede5-454b-bf7b-838368a3b2c7 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459001 Nov 24 14:42:46.847410 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-243e00a4-d09b-40a7-9f95-0465537a0245 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe&tenant_id=644eeb3051394d9da6b3f5fb4139e803 HTTP/1.1" status: 200 len: 1099 time: 0.0772820 Nov 24 14:42:46.942587 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-6b1f0010-4118-4615-8114-53996c4d9e2a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=644eeb3051394d9da6b3f5fb4139e803&device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 1099 time: 0.0732429 Nov 24 14:42:47.081754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-8bd46a42-91f7-462c-993f-931e53313c4e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:47.083199 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-8bd46a42-91f7-462c-993f-931e53313c4e service neutron] 10.222.0.47 "GET /v2.0/networks?id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 200 len: 913 time: 0.1344295 Nov 24 14:42:47.289427 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-1d3b9151-3c7b-4e11-b34b-87e9989ae9d6 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 200 len: 1003 time: 0.2000055 Nov 24 14:42:47.352487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-1c88d750-9273-4b4d-bddc-27e9fa5cef2b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:47.353904 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-1c88d750-9273-4b4d-bddc-27e9fa5cef2b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 200 len: 851 time: 0.0583425 Nov 24 14:42:47.432521 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-0caa3071-e448-4977-ac39-cd5c436fdd2a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0712538 Nov 24 14:42:47.569350 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-bf960c19-21ea-442d-a083-c7a8271c1f60 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1296408 Nov 24 14:42:47.707285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-75906b85-ea0e-435f-86d9-7b55c526d8ee req-a6bbfa8f-5e1f-4c4c-b464-bbb71f41b656 service neutron] 10.222.0.47 "GET /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1313360 Nov 24 14:42:47.743004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:42:47.809746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3291754-d840-49a4-acfc-6bcf74bab218 req-44277e34-da36-4148-b052-77ed50b2e846 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:47.811369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3291754-d840-49a4-acfc-6bcf74bab218 req-44277e34-da36-4148-b052-77ed50b2e846 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0882823 Nov 24 14:42:47.863617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:47.864209 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3291754-d840-49a4-acfc-6bcf74bab218 req-ea46129e-7db2-4fd6-ba57-9807d9a5370a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469096 Nov 24 14:42:47.892509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:42:47.904298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:47.908635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:47.911793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:42:47.958833 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'code': 200} Nov 24 14:42:47.983281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:42:47.986473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:42:48.199784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:49.073163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e16481-28c9-4e7b-8c67-7fa9c648b794 req-1514259b-cf57-4512-8884-47c9747e4f05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:49.074598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4e16481-28c9-4e7b-8c67-7fa9c648b794 req-1514259b-cf57-4512-8884-47c9747e4f05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 944 time: 0.0848010 Nov 24 14:42:49.124401 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4e16481-28c9-4e7b-8c67-7fa9c648b794 req-652181c9-8b7d-4040-aa35-26f9cfc13b19 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440259 Nov 24 14:42:49.747364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:42:49.922185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:49.936075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'port_id': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'mac_address': 'fa:16:3e:8c:b0:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 853, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:42:49.994015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:50.014454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:42:50.029383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:50.033447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:50.035124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:42:50.098909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:42:50.137334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=10']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:42:50.141785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:42:50.335306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0bf7cc5-ed6b-4107-8af9-dd66fbde887e req-edc6e506-3468-48e3-9009-4ea5fbaa2819 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:50.337572 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f0bf7cc5-ed6b-4107-8af9-dd66fbde887e req-edc6e506-3468-48e3-9009-4ea5fbaa2819 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0770447 Nov 24 14:42:50.382948 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f0bf7cc5-ed6b-4107-8af9-dd66fbde887e req-7409a1f9-748d-41be-a0fd-74d4c42dd414 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397573 Nov 24 14:42:51.580548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af29a93b-5513-4797-8318-b57e23484a27 req-8ca80d70-c391-4a67-995a-6aefcd39bbc2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:51.581890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af29a93b-5513-4797-8318-b57e23484a27 req-8ca80d70-c391-4a67-995a-6aefcd39bbc2 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 946 time: 0.0760210 Nov 24 14:42:51.628300 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af29a93b-5513-4797-8318-b57e23484a27 req-67f33576-d5ec-46a2-9e71-5f3fd11a3b69 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405996 Nov 24 14:42:51.752047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:42:51.819720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:42:51.820322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:51.830827 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:42:51.933067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:51.958593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:42:51.969439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:42:51.972737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:42:51.975911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:42:52.026201 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'code': 200} Nov 24 14:42:52.048598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=11']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:42:52.051842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:42:52.832582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3ed87e-e6e2-40c4-aa3d-f4ba78010df9 req-cd14f641-7de5-4cc9-97dc-d940ce04c2eb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:52.833996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f3ed87e-e6e2-40c4-aa3d-f4ba78010df9 req-cd14f641-7de5-4cc9-97dc-d940ce04c2eb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0827706 Nov 24 14:42:52.880891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1f3ed87e-e6e2-40c4-aa3d-f4ba78010df9 req-80413773-bf75-441c-acab-0ce2535e8d05 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408449 Nov 24 14:42:54.090965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6f8464-511e-4381-bc59-3d3a96a0a354 req-3c1babb6-63a4-47b8-b2f7-1e33726049ae tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:54.092448 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d6f8464-511e-4381-bc59-3d3a96a0a354 req-3c1babb6-63a4-47b8-b2f7-1e33726049ae tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0871432 Nov 24 14:42:54.138758 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d6f8464-511e-4381-bc59-3d3a96a0a354 req-214ad97b-3f2f-4569-a417-0bcbbb6733bb tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407901 Nov 24 14:42:55.338286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7698376c-eb1f-4bd9-a7dd-b9b965c817fd req-7e6f9484-d601-4df1-b554-165d3d81aea5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:55.339818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7698376c-eb1f-4bd9-a7dd-b9b965c817fd req-7e6f9484-d601-4df1-b554-165d3d81aea5 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0777335 Nov 24 14:42:55.387979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7698376c-eb1f-4bd9-a7dd-b9b965c817fd req-7f106faf-85ae-4b05-9ce4-52f3d3913e7a tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424745 Nov 24 14:42:56.608085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e631964a-2bda-49ae-83da-8d14c2c3532e req-b8c95552-b850-4802-af9f-e58f95cf1d55 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:56.610149 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e631964a-2bda-49ae-83da-8d14c2c3532e req-b8c95552-b850-4802-af9f-e58f95cf1d55 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0829337 Nov 24 14:42:56.658134 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e631964a-2bda-49ae-83da-8d14c2c3532e req-e28d03fe-51cb-4905-a6fa-b94b54ff0407 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416207 Nov 24 14:42:57.862867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17976bc-fb45-46ce-8731-680ae65eff61 req-879b2e09-c892-4840-a232-4f45e7c555f6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:57.864396 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a17976bc-fb45-46ce-8731-680ae65eff61 req-879b2e09-c892-4840-a232-4f45e7c555f6 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0846331 Nov 24 14:42:57.910196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a17976bc-fb45-46ce-8731-680ae65eff61 req-d90be48b-3d78-4c5b-9b77-fa3de0467285 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397756 Nov 24 14:42:58.115323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5802b9ec-e36e-417b-a6dc-3cf02e6811c0 req-fee2d4e9-0807-4d27-8d0c-49efefb0e802 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:58.117526 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5802b9ec-e36e-417b-a6dc-3cf02e6811c0 req-fee2d4e9-0807-4d27-8d0c-49efefb0e802 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0856740 Nov 24 14:42:58.162138 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5802b9ec-e36e-417b-a6dc-3cf02e6811c0 req-7e44f4d6-3b01-4a2f-a0cf-9220a4884f4e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392599 Nov 24 14:42:58.361335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5270380d-c765-424b-ae14-29ef444e1e58 req-1615f355-8a70-4638-97ed-ed4362d191cf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:58.362771 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5270380d-c765-424b-ae14-29ef444e1e58 req-1615f355-8a70-4638-97ed-ed4362d191cf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0771844 Nov 24 14:42:58.411789 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5270380d-c765-424b-ae14-29ef444e1e58 req-d6805573-f5f0-493f-b860-565215549173 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426548 Nov 24 14:42:58.847049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d192aa22-306a-4370-9a5d-c63f45ea1239 req-98f791d4-83b5-46bd-88ef-9a7e1484ca4b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:42:58.848425 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d192aa22-306a-4370-9a5d-c63f45ea1239 req-98f791d4-83b5-46bd-88ef-9a7e1484ca4b tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0989714 Nov 24 14:42:58.895226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d192aa22-306a-4370-9a5d-c63f45ea1239 req-d87accd2-feac-48fa-b878-987c011567f0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413020 Nov 24 14:43:00.095771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e44b44f4-50f4-4299-9a3b-1e1eecf547e4 req-ec2d855a-72da-41c9-9a76-bcb767ddbf96 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:00.097228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e44b44f4-50f4-4299-9a3b-1e1eecf547e4 req-ec2d855a-72da-41c9-9a76-bcb767ddbf96 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.0764003 Nov 24 14:43:00.144302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e44b44f4-50f4-4299-9a3b-1e1eecf547e4 req-5780933f-4263-4c19-9f78-e5f8060d5f30 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403268 Nov 24 14:43:01.398454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-f16fc5b8-9f28-4767-9a5e-cd485d591f43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:01.399912 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-f16fc5b8-9f28-4767-9a5e-cd485d591f43 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.1383960 Nov 24 14:43:01.406153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c52e48-1d66-4230-b594-835d0e5967c5 req-39044c33-b69e-42f7-9011-18bb31f43c52 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:01.407494 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80c52e48-1d66-4230-b594-835d0e5967c5 req-39044c33-b69e-42f7-9011-18bb31f43c52 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 947 time: 0.1158252 Nov 24 14:43:01.501343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Deleting port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:01.501565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:01.541462 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80c52e48-1d66-4230-b594-835d0e5967c5 req-aeef9c69-bdb6-4709-81ca-636b57cbce36 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups?id=7ef8b8e0-808b-4ac2-88ce-f247cce14b78&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1054676 Nov 24 14:43:01.751559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] For port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:01.751890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:02.147537 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:02.147994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:02.148850 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Floating IP 7522ecd4-9586-4e09-9875-65fffb502df1 disassociated. External IP: 172.26.4.246, port: 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8. Nov 24 14:43:02.149184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Calling delete_port for 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:02.292037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:02.297451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-823fefd7-279c-4d29-9451-b4ee9273614c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:02.339952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event deleted for resources: {'Port': ['ID=4b2a8819-f9a7-4bc2-90e0-08ef65759ab8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:02.353836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.354219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.354597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.354970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.355336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.355890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.356082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.356447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.356810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.357167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.357526 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:02.361014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:02.576436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:43:02.712770 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b551789d-e6cd-49f9-b696-a68a65994d8f req-748c429b-ac44-4365-adce-62d963662ae8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 210 time: 0.0491478 Nov 24 14:43:02.786012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:43:02.796073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:43:02.809391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:43:02.810011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:42:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:02.860155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] No DVR routers for this DVR port 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:43:02.862601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:02.865249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-deleted', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:02.886101 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb807c3b-a122-4b13-b315-d3cbc95a1260 req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.47 "DELETE /v2.0/ports/4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 HTTP/1.1" status: 204 len: 173 time: 1.4775896 Nov 24 14:43:03.007468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:43:03.010950 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c20b361-c289-409d-8467-1350dad743fe', 'name': 'network-vif-deleted', 'tag': '4b2a8819-f9a7-4bc2-90e0-08ef65759ab8', 'status': 'completed', 'code': 200} Nov 24 14:43:03.324159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-49f14f8d-c349-4477-95fd-70a2a0d364ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:03.350653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:03.355160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:43:03.366272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:43:03.366937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:42:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:03.556343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:43:03.766793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:03.826126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:43:03.869343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:43:03.869701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 4b2a8819-f9a7-4bc2-90e0-08ef65759ab8 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:43:03.906162 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-35b3af85-047d-4c74-8d08-35d3d62daa09 req-788fa184-e860-4528-8b11-30db9520e364 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/ports?device_id=0c20b361-c289-409d-8467-1350dad743fe HTTP/1.1" status: 200 len: 210 time: 0.0476694 Nov 24 14:43:03.975303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:03.980813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a75581ce-9056-4875-9d5e-e1100ae82af2 None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:06Z', 'revision_number': 4, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '265b3dc2-c548-421f-a223-c720c58278ad', 'name': '', 'network_id': 'b20ce7e1-47d2-4747-a9a3-ec140e6fcda1', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'mac_address': 'fa:16:3e:48:16:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:05Z', 'updated_at': '2021-11-24T14:34:23Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'subnets': [{'id': '22012fd4-20c7-4275-844f-7e901c9b102d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:43:04.208812 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91910857-f923-4e87-8c4f-c02f69375de8 None None] New status for floating IP 7522ecd4-9586-4e09-9875-65fffb502df1: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:43:05.886284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2dc4293b-aeef-44d6-af09-d793200739e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:06.915387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.326388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51960) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:08.391581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.419854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.473675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.478226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5446a186-9b05-4592-8990-a3ddf68f4a2c tempest-TestNetworkAdvancedServerOps-2072501418 tempest-TestNetworkAdvancedServerOps-2072501418-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:08.493231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ef8b8e0-808b-4ac2-88ce-f247cce14b78,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:08.495843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:08.504487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.505612 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0e0f1273-1e34-49ee-b98b-19330dffe47e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "DELETE /v2.0/security-groups/7ef8b8e0-808b-4ac2-88ce-f247cce14b78 HTTP/1.1" status: 204 len: 168 time: 0.1782060 Nov 24 14:43:08.508698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51964) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:08.526991 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.api.v2.resource [None req-8cf00f6f-c07d-44ef-af00-b22dd84705d0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] show failed (client error): The resource could not be found. Nov 24 14:43:08.528075 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8cf00f6f-c07d-44ef-af00-b22dd84705d0 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "GET /v2.0/security-groups/7ef8b8e0-808b-4ac2-88ce-f247cce14b78 HTTP/1.1" status: 404 len: 347 time: 0.0184367 Nov 24 14:43:08.530811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51968) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:08.609843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.690467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Deleting port b273c498-286f-4631-b1d1-b37cc26026f4 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:08.690690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.861163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.861493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:08.982606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Calling delete_port for b273c498-286f-4631-b1d1-b37cc26026f4 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:09.125036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:09.128843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f0c6c9d1-5343-4847-8f46-a53d65ccbcec tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:09.173892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Pushing event deleted for resources: {'Port': ['ID=b273c498-286f-4631-b1d1-b37cc26026f4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:09.176538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:09.373424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:09.387541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:09.388706 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] 10.222.0.70 "DELETE /v2.0/floatingips/7522ecd4-9586-4e09-9875-65fffb502df1 HTTP/1.1" status: 204 len: 168 time: 0.8570070 Nov 24 14:43:09.391609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51972) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:09.853551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:10.458382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Deleting port 265b3dc2-c548-421f-a223-c720c58278ad {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:10.459099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:10.630687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] For port 265b3dc2-c548-421f-a223-c720c58278ad, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=265b3dc2-c548-421f-a223-c720c58278ad,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:10.631042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:10.751980 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Calling delete_port for 265b3dc2-c548-421f-a223-c720c58278ad owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:11.036210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:11.040157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-475379a4-8d54-4a09-a56d-05c7da2281bf tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:11.081673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Pushing event deleted for resources: {'Port': ['ID=265b3dc2-c548-421f-a223-c720c58278ad,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:11.084084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:11.372673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:11.959026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Router a1f1cddf-2326-4df3-8968-7c34b02d9326 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:43:12.160634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:43:12.170849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] Sync routers for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:43:12.173313 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] 10.222.0.70 "PUT /v2.0/routers/a1f1cddf-2326-4df3-8968-7c34b02d9326/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7806821 Nov 24 14:43:12.175707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51980) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:12.183615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:43:12.184260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:43:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:12.386712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:43:12.521260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:12.736512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158'}], 'enable_snat': True}, 'gw_port_id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:43:10Z', 'revision_number': 5, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port': {'id': '3ff6c9a3-0d32-4e84-bed5-613455a850a8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:69:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:34:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:12.739173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:12.740447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] Checking router: a1f1cddf-2326-4df3-8968-7c34b02d9326 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:43:12.749983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Deleting port 3ff6c9a3-0d32-4e84-bed5-613455a850a8 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:12.750349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:12.753813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] Routers {'a1f1cddf-2326-4df3-8968-7c34b02d9326'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:43:12.754438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:43:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['a1f1cddf-2326-4df3-8968-7c34b02d9326'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:12.910241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] Set router a1f1cddf-2326-4df3-8968-7c34b02d9326 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:43:12.965214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] For port 3ff6c9a3-0d32-4e84-bed5-613455a850a8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=3ff6c9a3-0d32-4e84-bed5-613455a850a8,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:12.965902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.019591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:43:12Z', 'revision_number': 6, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:13.023990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee1f9ae3-1838-4143-aad7-ec904daa0479 None None] The sync data for ids ['a1f1cddf-2326-4df3-8968-7c34b02d9326'] in dv-neutron-818151-2-hyperv is: [{'id': 'a1f1cddf-2326-4df3-8968-7c34b02d9326', 'name': 'tempest-ServerActionsTestJSON-1381956282-router', 'tenant_id': '644eeb3051394d9da6b3f5fb4139e803', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:34:03Z', 'updated_at': '2021-11-24T14:43:12Z', 'revision_number': 6, 'project_id': '644eeb3051394d9da6b3f5fb4139e803', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:43:13.115069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Calling delete_port for 3ff6c9a3-0d32-4e84-bed5-613455a850a8 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:13.310880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.319230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:13.360052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Pushing event deleted for resources: {'Port': ['ID=3ff6c9a3-0d32-4e84-bed5-613455a850a8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:13.362444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:13.589560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.851326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.852632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3ff6c9a3-0d32-4e84-bed5-613455a850a8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:43:13.855910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.884073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.884765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a1f1cddf-2326-4df3-8968-7c34b02d9326 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:43:13.895359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 3ff6c9a3-0d32-4e84-bed5-613455a850a8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:43:13.895716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 3ff6c9a3-0d32-4e84-bed5-613455a850a8 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:43:13.896638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 265b3dc2-c548-421f-a223-c720c58278ad no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:43:13.902258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:13.903620 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] 10.222.0.70 "DELETE /v2.0/routers/a1f1cddf-2326-4df3-8968-7c34b02d9326 HTTP/1.1" status: 204 len: 168 time: 1.7268562 Nov 24 14:43:13.905913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 51984) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:13.934605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 265b3dc2-c548-421f-a223-c720c58278ad {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:43:13.935072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 265b3dc2-c548-421f-a223-c720c58278ad not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:43:14.120381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Deleting subnet 22012fd4-20c7-4275-844f-7e901c9b102d {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:43:14.123431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.174506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.260212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.350351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.354113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-36225de0-32b5-4fbf-9c7d-bc6834d5d0fb tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:14.389347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=22012fd4-20c7-4275-844f-7e901c9b102d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:14.393408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:14.396718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.402652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2f9a217-680e-4f1f-8e95-826f6a688f9f None None] Network b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:43:14.403607 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/22012fd4-20c7-4275-844f-7e901c9b102d HTTP/1.1" status: 204 len: 168 time: 0.4966493 Nov 24 14:43:14.406133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 51988) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:14.521476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.533737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Deleting port 8175b28d-cb4e-4c3a-9752-e61127a860d1 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:14.534510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.718987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] DHCP port deletion for b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:43:14.723344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Deleting port 8175b28d-cb4e-4c3a-9752-e61127a860d1 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:14.723723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.864334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] For port 8175b28d-cb4e-4c3a-9752-e61127a860d1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8175b28d-cb4e-4c3a-9752-e61127a860d1,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:14.864689 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.939056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] For port 8175b28d-cb4e-4c3a-9752-e61127a860d1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8175b28d-cb4e-4c3a-9752-e61127a860d1,segment=NetworkSegment(ccf8281b-cd10-426d-865a-cd4652bd2f44),segment_id=ccf8281b-cd10-426d-865a-cd4652bd2f44)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:14.939652 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:14.986144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Calling delete_port for 8175b28d-cb4e-4c3a-9752-e61127a860d1 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:15.060372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.062601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Calling delete_port for 8175b28d-cb4e-4c3a-9752-e61127a860d1 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:15.064275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1f47a052-5ba4-4396-97bb-89f2e2c6aae4 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:15.108333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Pushing event deleted for resources: {'Port': ['ID=8175b28d-cb4e-4c3a-9752-e61127a860d1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:15.120650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.121028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.121412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.121776 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.122145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.122509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.122876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.123238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.123603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.124004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.124367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:15.126922 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] No DVR routers for this DVR port 8175b28d-cb4e-4c3a-9752-e61127a860d1 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:43:15.128463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:15.135574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:43:15.135939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:43:15.247701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.273365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b20ce7e1-47d2-4747-a9a3-ec140e6fcda1']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:15.285673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ccf8281b-cd10-426d-865a-cd4652bd2f44') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:15.285965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ccf8281b-cd10-426d-865a-cd4652bd2f44') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:15.297892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.314409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.322110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Releasing vlan 853 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:43:15.322499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:43:15.336320 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:43:15.416817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.420303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4f79bbd0-78f4-450d-9543-42fe1aad1a97 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:15.434557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.445641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Pushing event deleted for resources: {'Network': ['ID=b20ce7e1-47d2-4747-a9a3-ec140e6fcda1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:15.449073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:15.460213 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] 10.222.0.70 "DELETE /v2.0/networks/b20ce7e1-47d2-4747-a9a3-ec140e6fcda1 HTTP/1.1" status: 204 len: 168 time: 1.0528445 Nov 24 14:43:15.599778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 51994) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:15.637166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Deleting port 8175b28d-cb4e-4c3a-9752-e61127a860d1 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:15.637646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.650935 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-004e5675-1f9b-49f3-b129-a5d702058f9a admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=644eeb3051394d9da6b3f5fb4139e803&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0493562 Nov 24 14:43:15.653456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 51998) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:15.705052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6f46b975-e85d-48e4-81c0-bf0393676f2e None None] The port '8175b28d-cb4e-4c3a-9752-e61127a860d1' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:43:15.718266 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.738967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8175b28d-cb4e-4c3a-9752-e61127a860d1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:43:15.750740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.770984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8175b28d-cb4e-4c3a-9752-e61127a860d1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:43:15.771245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8175b28d-cb4e-4c3a-9752-e61127a860d1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:43:15.806359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.810767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af16c649-78c8-483e-8369-ead8551c1d9f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:15.825607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93da3016-7a0f-4eb0-b255-157a859ca5be,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:15.828350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:15.834532 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:15.836160 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/93da3016-7a0f-4eb0-b255-157a859ca5be HTTP/1.1" status: 204 len: 168 time: 0.1818094 Nov 24 14:43:16.679431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52020) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:16.829729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-1847547561-network', 'tenant_id': 'b2b0aab5bcea48678554d79750d41205'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:16.834734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:16.840009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Usage tracker for resource:network and tenant:b2b0aab5bcea48678554d79750d41205 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:16.842846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:16.848521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:16.859852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Made reservation on behalf of b2b0aab5bcea48678554d79750d41205 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:16.862187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:16.876355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:16.909159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:16.913117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Usage tracker for resource:security_group_rule and tenant:b2b0aab5bcea48678554d79750d41205 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:16.916012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:16.921999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:16.996693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.000958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.003998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:17.041991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 878} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:43:17.047528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=084f136f-7388-4a76-8655-4c28f0628384,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:17.051158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:17.056198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.056563 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Added segment 9a520f71-32ff-4347-9dca-ccf087b975bb of type vlan for network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a Nov 24 14:43:17.083691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.113852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.114765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:17.115344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.119457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-77e811a6-3f81-4e6a-b3b0-df88508b9177 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:17.220389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Pushing event updated for resources: {'Network': ['ID=4fdd90ff-fb7f-4be3-856d-bc395fd8118a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:17.223156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:17.228564 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5479281 Nov 24 14:43:17.229320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52026) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:17.231356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:43:17.238898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Request body: {'subnet': {'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-1847547561-subnet', 'tenant_id': 'b2b0aab5bcea48678554d79750d41205', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:17.244146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:17.248183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Usage tracker for resource:subnet and tenant:b2b0aab5bcea48678554d79750d41205 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:17.251424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:17.257493 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:17.268926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Made reservation on behalf of b2b0aab5bcea48678554d79750d41205 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:17.271511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.490797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.494838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fd9839f5-6447-49bb-8863-e3243b6966f4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:17.563991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a57b3d80-e739-4efa-aa3a-595aa617a9c1,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:17.567594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:17.581704 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Checking segment: {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:43:17.582050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Network hostable DHCP agents. Network: 4fdd90ff-fb7f-4be3-856d-bc395fd8118a, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:43:17.605278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:43:17.614188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 4fdd90ff-fb7f-4be3-856d-bc395fd8118a) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:17.618871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:17.619436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:17.623201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1840ab47-dc4f-4105-b13e-0e1ff8b9cb2d None None] Network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:43:17.640234 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-15d370ea-cf26-4d42-8d0a-81dacd0f29a1 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4066982 Nov 24 14:43:17.840481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4ee3d5d-668d-4876-af42-a38091dfba2b None None] Network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:43:18.199723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-677a6d6d-b883-43c5-8e22-47a833f1bdef tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:18.201228 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-677a6d6d-b883-43c5-8e22-47a833f1bdef tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/networks?id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 200 len: 814 time: 0.1461229 Nov 24 14:43:18.202787 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:18.219338 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-3001b684-5d04-4aba-8be6-edcba7189b8b tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/quotas/b2b0aab5bcea48678554d79750d41205 HTTP/1.1" status: 200 len: 375 time: 0.0121667 Nov 24 14:43:18.268650 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-a3a9262c-856c-4bdd-9b8c-4f204c921b92 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=b2b0aab5bcea48678554d79750d41205&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0440042 Nov 24 14:43:18.279818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-7894311e-e099-45f7-b571-b33a8a99ac02 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:43:18.280841 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-7894311e-e099-45f7-b571-b33a8a99ac02 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0049984 Nov 24 14:43:18.418639 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-02e1fe35-0d63-49d2-8acd-a9bca3bc6009 service neutron] 10.222.0.70 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319745 Nov 24 14:43:18.560400 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-c8e0f366-fa3c-4aea-8b25-914b00cbe5f5 service neutron] 10.222.0.70 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358943 Nov 24 14:43:18.744238 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-00b10271-f9e3-4118-8bad-b9713cce5db8 req-ca41cee2-ebf7-41bb-939f-b0abe7808912 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 210 time: 0.0420408 Nov 24 14:43:19.753157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-06096d44-6376-4157-9e32-e8ed0e42957d tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:19.753871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-06096d44-6376-4157-9e32-e8ed0e42957d tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Synchronizing usage tracker for tenant:b2b0aab5bcea48678554d79750d41205 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:43:19.773960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-06096d44-6376-4157-9e32-e8ed0e42957d tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Unset dirty status for tenant:b2b0aab5bcea48678554d79750d41205 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:43:19.776219 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-06096d44-6376-4157-9e32-e8ed0e42957d tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "GET /v2.0/networks?id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 200 len: 814 time: 0.1711628 Nov 24 14:43:19.793547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Request body: {'port': {'device_id': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a', 'admin_state_up': True, 'tenant_id': 'b2b0aab5bcea48678554d79750d41205'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:19.936434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:19.940776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Usage tracker for resource:port and tenant:b2b0aab5bcea48678554d79750d41205 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:19.944561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Quota usage for port was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:19.951477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:19.962967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Made reservation on behalf of b2b0aab5bcea48678554d79750d41205 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:19.966000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:20.022651 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a94b923-9b1e-43cb-84f8-36e4e948a82a req-a24f0cad-a3f6-4cab-a2cd-6b87ca49bcc1 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 210 time: 0.1520414 Nov 24 14:43:20.134441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Allocated IP 172.20.0.7 (4fdd90ff-fb7f-4be3-856d-bc395fd8118a/a57b3d80-e739-4efa-aa3a-595aa617a9c1/2dea702d-7e67-419d-b69c-f5a1f619d17a) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:43:20.332646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:20.359311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:20.364721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-55de96ca-d3a6-4400-bb2b-15ff9f6948e8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:20.429436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:43:20.438487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:20.443535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:43:20.474262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Pushing event updated for resources: {'Port': ['ID=2dea702d-7e67-419d-b69c-f5a1f619d17a,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:20.481431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:20.508212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:20.508811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:20.528717 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7398946 Nov 24 14:43:20.540701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Request body: {'port': {'device_id': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:20.646259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:21.095377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2dea702d-7e67-419d-b69c-f5a1f619d17a {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:43:21.103305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:21.119782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Transition to ACTIVE for port object 2dea702d-7e67-419d-b69c-f5a1f619d17a will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:43:21.123111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:21.127407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d70bdcc7-1b2f-4ca1-ad9f-1aa45ea25439 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:21.300031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Pushing event updated for resources: {'Port': ['ID=2dea702d-7e67-419d-b69c-f5a1f619d17a,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:21.308274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:21.410993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7305142-492c-45df-8cb9-2570344dd149 req-c9e10dee-a949-4ead-a2a9-ffcefb79cd16 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:21.411680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d7305142-492c-45df-8cb9-2570344dd149 req-c9e10dee-a949-4ead-a2a9-ffcefb79cd16 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Synchronizing usage tracker for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:43:21.446130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Attempting to bind port 2dea702d-7e67-419d-b69c-f5a1f619d17a on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:43:21.446533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Attempting to bind port 2dea702d-7e67-419d-b69c-f5a1f619d17a by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:43:21.446926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Attempting to bind port 2dea702d-7e67-419d-b69c-f5a1f619d17a on network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:43:21.451069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d7305142-492c-45df-8cb9-2570344dd149 req-c9e10dee-a949-4ead-a2a9-ffcefb79cd16 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Unset dirty status for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:43:21.452229 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d7305142-492c-45df-8cb9-2570344dd149 req-c9e10dee-a949-4ead-a2a9-ffcefb79cd16 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 943 time: 0.2960570 Nov 24 14:43:21.454747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Port 2dea702d-7e67-419d-b69c-f5a1f619d17a on network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:43:21.455055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Attempting to bind port 2dea702d-7e67-419d-b69c-f5a1f619d17a on network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:43:21.477008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 43, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:43:21.477344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Checking segment: {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:43:21.477717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Bound using segment: {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:43:21.478143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Bound port: 2dea702d-7e67-419d-b69c-f5a1f619d17a, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:43:21.478483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:21.554826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d7305142-492c-45df-8cb9-2570344dd149 req-3d7742a5-0997-4c72-9970-b59629a073ad tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Synchronizing usage tracker for tenant:b2b0aab5bcea48678554d79750d41205 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:43:21.597468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] For port 2dea702d-7e67-419d-b69c-f5a1f619d17a, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:43:21.599213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d7305142-492c-45df-8cb9-2570344dd149 req-3d7742a5-0997-4c72-9970-b59629a073ad tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Unset dirty status for tenant:b2b0aab5bcea48678554d79750d41205 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:43:21.601157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d7305142-492c-45df-8cb9-2570344dd149 req-3d7742a5-0997-4c72-9970-b59629a073ad tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419766 Nov 24 14:43:21.602807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] For port 2dea702d-7e67-419d-b69c-f5a1f619d17a, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:43:21.610062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:21.610511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b43e9c2a-8a2f-4ee3-989a-f64fa8229b76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:21.676461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:21.677805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] 10.222.0.47 "PUT /v2.0/ports/2dea702d-7e67-419d-b69c-f5a1f619d17a HTTP/1.1" status: 200 len: 1093 time: 1.1417837 Nov 24 14:43:21.678751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'tag': '2dea702d-7e67-419d-b69c-f5a1f619d17a'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:21.694912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Pushing event updated for resources: {'Port': ['ID=2dea702d-7e67-419d-b69c-f5a1f619d17a,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:21.698074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:21.752258 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'tag': '2dea702d-7e67-419d-b69c-f5a1f619d17a', 'status': 'completed', 'code': 200} Nov 24 14:43:21.793067 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-dfc5616f-1630-4413-88a9-c82f1780b2cd service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b2b0aab5bcea48678554d79750d41205&device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 1096 time: 0.0732341 Nov 24 14:43:21.865806 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-c42599f5-4225-41c4-b6f0-987fecbc23d1 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a HTTP/1.1" status: 200 len: 217 time: 0.0654116 Nov 24 14:43:21.926898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-c146efc1-a5b6-474c-8b2b-38518f2a67f3 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:21.928336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-c146efc1-a5b6-474c-8b2b-38518f2a67f3 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a57b3d80-e739-4efa-aa3a-595aa617a9c1 HTTP/1.1" status: 200 len: 854 time: 0.0567706 Nov 24 14:43:21.978107 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-c0e54c11-1da7-4b9d-9e5c-ac68cc5c4a11 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0438304 Nov 24 14:43:22.113521 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-4485ed2c-8c38-4115-81fb-902ab00c52d1 service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278365 Nov 24 14:43:22.246409 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cd19e76-c4f9-478a-9145-038f2f5296c6 req-1a2aff59-b04a-46e3-9f14-fa1c939b049a service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266751 Nov 24 14:43:22.360037 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-11f01930-c4ab-472e-a1c5-edb6d848e7d2 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b2b0aab5bcea48678554d79750d41205&device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 1096 time: 0.0681269 Nov 24 14:43:22.493834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-1a361c0d-feee-4fc7-9c54-faaae301751b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:22.495254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-1a361c0d-feee-4fc7-9c54-faaae301751b service neutron] 10.222.0.47 "GET /v2.0/networks?id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 200 len: 915 time: 0.1291797 Nov 24 14:43:22.571002 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-5da04fc3-fe1c-4938-85a6-81c9ef57623e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a HTTP/1.1" status: 200 len: 217 time: 0.0689838 Nov 24 14:43:22.632488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-ad490db8-4136-40d7-bcc4-cfa04cb0030d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:22.633893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-ad490db8-4136-40d7-bcc4-cfa04cb0030d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a57b3d80-e739-4efa-aa3a-595aa617a9c1 HTTP/1.1" status: 200 len: 854 time: 0.0560639 Nov 24 14:43:22.679809 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-455ac0c5-9fbd-4ab7-aecc-9417d6323079 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0388169 Nov 24 14:43:22.961157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-6e16f29c-d683-45e7-ad1a-eea02d8021b9 service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2749717 Nov 24 14:43:23.055690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76e3659-4404-47d4-ac35-d8b7a637628f req-afcb30d2-ab30-4cd2-9172-693f0496a07d tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:23.057282 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c76e3659-4404-47d4-ac35-d8b7a637628f req-afcb30d2-ab30-4cd2-9172-693f0496a07d tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 943 time: 0.1980309 Nov 24 14:43:23.142683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c76e3659-4404-47d4-ac35-d8b7a637628f req-3683997d-6295-420d-a29f-2f548aee3777 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779929 Nov 24 14:43:23.149365 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-278e0667-14a2-4423-a5ae-b22c2f382764 req-08b49195-2191-442a-b444-90f5ca282ecb service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1793013 Nov 24 14:43:23.988901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 2dea702d-7e67-419d-b69c-f5a1f619d17a details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:43:24.127229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 2dea702d-7e67-419d-b69c-f5a1f619d17a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:24.141036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '2dea702d-7e67-419d-b69c-f5a1f619d17a', 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a', 'port_id': '2dea702d-7e67-419d-b69c-f5a1f619d17a', 'mac_address': 'fa:16:3e:d6:45:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 878, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a57b3d80-e739-4efa-aa3a-595aa617a9c1', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:43:24.199550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:24.217821 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2dea702d-7e67-419d-b69c-f5a1f619d17a {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:43:24.234002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 2dea702d-7e67-419d-b69c-f5a1f619d17a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:24.239478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:24.241590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:24.309472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=2dea702d-7e67-419d-b69c-f5a1f619d17a,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:24.312537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:24.354383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b98988-8316-4734-8d9d-5dcc5f94e275 req-cef3c4c5-33d6-4289-aae0-a8be06eaa3a3 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:24.355844 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-81b98988-8316-4734-8d9d-5dcc5f94e275 req-cef3c4c5-33d6-4289-aae0-a8be06eaa3a3 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 944 time: 0.0782850 Nov 24 14:43:24.401306 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-81b98988-8316-4734-8d9d-5dcc5f94e275 req-f9918973-c96f-4320-a56f-e26cc4fb3e3f tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399287 Nov 24 14:43:24.623938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['2dea702d-7e67-419d-b69c-f5a1f619d17a'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:43:25.607368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47bd62cd-fba7-4031-b922-8fdf5f1c6ee7 req-0a66b4a7-93ed-489e-8dfa-6cbd31ee4810 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:25.608714 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47bd62cd-fba7-4031-b922-8fdf5f1c6ee7 req-0a66b4a7-93ed-489e-8dfa-6cbd31ee4810 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 944 time: 0.0833638 Nov 24 14:43:25.653637 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47bd62cd-fba7-4031-b922-8fdf5f1c6ee7 req-080fef07-dae4-4b56-b699-46a3a07d758f tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395429 Nov 24 14:43:26.005088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 2dea702d-7e67-419d-b69c-f5a1f619d17a up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:43:26.071165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 2dea702d-7e67-419d-b69c-f5a1f619d17a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:43:26.075749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 2dea702d-7e67-419d-b69c-f5a1f619d17a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:43:26.076150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:26.194532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:26.220793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dea702d-7e67-419d-b69c-f5a1f619d17a'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:26.230649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 2dea702d-7e67-419d-b69c-f5a1f619d17a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:26.235248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:26.237056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:26.279811 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dea702d-7e67-419d-b69c-f5a1f619d17a', 'code': 200} Nov 24 14:43:26.306074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=2dea702d-7e67-419d-b69c-f5a1f619d17a,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:26.309021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:26.511206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c74249a-0e69-4f56-a33e-86e32c15b290 req-e79ee01a-3787-4565-a25e-283df7fd72f7 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 1098 time: 0.0746479 Nov 24 14:43:26.555226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c74249a-0e69-4f56-a33e-86e32c15b290 req-ff7fb82e-41a2-482d-aec3-93306e244339 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369129 Nov 24 14:43:26.853903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df15718a-fb70-4930-90cc-865f15b550e6 req-b253ef18-6544-4f2b-b759-5b4156067203 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:26.855552 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-df15718a-fb70-4930-90cc-865f15b550e6 req-b253ef18-6544-4f2b-b759-5b4156067203 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0841951 Nov 24 14:43:26.905595 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-df15718a-fb70-4930-90cc-865f15b550e6 req-d0aadfea-1dd8-4568-98ce-481ca2b32473 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445790 Nov 24 14:43:28.105054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc4c24a-28f3-442f-bfb3-ff37509fedbd req-cf6a1b4d-9c69-4333-83c8-0d920e0c8d51 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:28.106465 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1bc4c24a-28f3-442f-bfb3-ff37509fedbd req-cf6a1b4d-9c69-4333-83c8-0d920e0c8d51 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0798433 Nov 24 14:43:28.151480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1bc4c24a-28f3-442f-bfb3-ff37509fedbd req-2c12e737-564a-40a5-b35d-cd1c3abb6c13 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395923 Nov 24 14:43:28.444436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-ec8701cc-0770-4883-b672-2c832e6a9d74 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:28.446459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-ec8701cc-0770-4883-b672-2c832e6a9d74 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/networks?id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 200 len: 814 time: 0.1410334 Nov 24 14:43:28.466800 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-80fc2c10-c7cb-4410-872f-dfa716eff4ee tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/quotas/b2b0aab5bcea48678554d79750d41205 HTTP/1.1" status: 200 len: 375 time: 0.0149076 Nov 24 14:43:28.547489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-b308e9d9-1dab-4515-84f6-6a852be06972 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=b2b0aab5bcea48678554d79750d41205&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0755391 Nov 24 14:43:28.759643 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-aaad6f4e-7753-4450-b68c-c4427e629174 service neutron] 10.222.0.70 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2050271 Nov 24 14:43:28.830951 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:43:28.892841 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-0293c0c7-c936-493c-a3f7-71f0566b0d0c service neutron] 10.222.0.70 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272535 Nov 24 14:43:30.104288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-66979440-6d7d-437a-9e7a-166c672c35d3 req-ffa739dc-9957-4955-b14f-063d1692156f tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 210 time: 0.0428121 Nov 24 14:43:31.173822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-392eb57c-a189-489f-9127-a938ed43e0b0 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:31.175294 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-392eb57c-a189-489f-9127-a938ed43e0b0 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "GET /v2.0/networks?id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 200 len: 814 time: 0.1585915 Nov 24 14:43:31.192181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Request body: {'port': {'device_id': '8afea892-672a-41bd-92f1-03dc64041cc9', 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a', 'admin_state_up': True, 'tenant_id': 'b2b0aab5bcea48678554d79750d41205'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:31.325543 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b63ef692-c99d-4f39-8e82-bd122de63cc4 req-a36f00a2-d85a-45e2-8ce6-ed49f09b9e47 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 210 time: 0.0546565 Nov 24 14:43:31.377396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:31.386968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:31.397118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Made reservation on behalf of b2b0aab5bcea48678554d79750d41205 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:31.400933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:31.672599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Allocated IP 172.20.0.4 (4fdd90ff-fb7f-4be3-856d-bc395fd8118a/a57b3d80-e739-4efa-aa3a-595aa617a9c1/bf397b7c-dcaa-4b1a-b793-1196c3af355b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:43:31.881056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:31.910766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:31.916545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3eb53807-6386-4919-a0ab-bfd00cfffaa7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:31.922289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['2dea702d-7e67-419d-b69c-f5a1f619d17a'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:43:31.979913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:43:31.986890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:31.992099 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:43:32.028040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Pushing event updated for resources: {'Port': ['ID=bf397b7c-dcaa-4b1a-b793-1196c3af355b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:32.034610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:32.063555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:32.064184 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:32.090809 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9027030 Nov 24 14:43:32.102993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Request body: {'port': {'device_id': '8afea892-672a-41bd-92f1-03dc64041cc9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:32.211542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:32.542401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3090ee3-4761-4b4f-afe7-fdcf33a5e731 req-ed1b7840-fce0-437d-93ec-6ed690112656 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:32.543788 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b3090ee3-4761-4b4f-afe7-fdcf33a5e731 req-ed1b7840-fce0-437d-93ec-6ed690112656 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 931 time: 0.0933871 Nov 24 14:43:32.570155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf397b7c-dcaa-4b1a-b793-1196c3af355b {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:43:32.577501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:32.594063 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b3090ee3-4761-4b4f-afe7-fdcf33a5e731 req-6b5c8397-1f32-4721-b431-41c0e8db4c09 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441303 Nov 24 14:43:32.595532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Transition to ACTIVE for port object bf397b7c-dcaa-4b1a-b793-1196c3af355b will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:43:32.599890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:32.605357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-16796ef2-59b8-4e36-9ad5-ab821dc8876f tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:32.731830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Pushing event updated for resources: {'Port': ['ID=bf397b7c-dcaa-4b1a-b793-1196c3af355b,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:32.736204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:32.846080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Attempting to bind port bf397b7c-dcaa-4b1a-b793-1196c3af355b on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:43:32.846328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Attempting to bind port bf397b7c-dcaa-4b1a-b793-1196c3af355b by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:43:32.846653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Attempting to bind port bf397b7c-dcaa-4b1a-b793-1196c3af355b on network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:43:32.853096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Port bf397b7c-dcaa-4b1a-b793-1196c3af355b on network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:43:32.853411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Attempting to bind port bf397b7c-dcaa-4b1a-b793-1196c3af355b on network 4fdd90ff-fb7f-4be3-856d-bc395fd8118a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:43:32.859915 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 43, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:43:32.860247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Checking segment: {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:43:32.860629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Bound using segment: {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:43:32.861046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Bound port: bf397b7c-dcaa-4b1a-b793-1196c3af355b, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9a520f71-32ff-4347-9dca-ccf087b975bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 878, 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:43:32.861396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:32.954169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] For port bf397b7c-dcaa-4b1a-b793-1196c3af355b, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:43:32.960814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] For port bf397b7c-dcaa-4b1a-b793-1196c3af355b, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:43:32.968320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:32.972185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-139955c7-dc73-4d47-8fab-3e73bccdaf25 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:33.040270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:33.041674 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] 10.222.0.47 "PUT /v2.0/ports/bf397b7c-dcaa-4b1a-b793-1196c3af355b HTTP/1.1" status: 200 len: 1093 time: 0.9431121 Nov 24 14:43:33.042217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8afea892-672a-41bd-92f1-03dc64041cc9', 'tag': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:33.062137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Pushing event updated for resources: {'Port': ['ID=bf397b7c-dcaa-4b1a-b793-1196c3af355b,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:33.067456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:33.191873 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-8af35dd7-02f1-49d5-a505-1b5f840b3107 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b2b0aab5bcea48678554d79750d41205&device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 1096 time: 0.0888619 Nov 24 14:43:33.261684 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8afea892-672a-41bd-92f1-03dc64041cc9', 'tag': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b', 'status': 'completed', 'code': 200} Nov 24 14:43:33.270649 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-dcf99451-5d0e-4650-8881-16cca99233f8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b HTTP/1.1" status: 200 len: 217 time: 0.0712802 Nov 24 14:43:33.328266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-55f3f5ae-8065-4f58-835f-25a52a95473e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:33.355166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-42a59411-230a-4ab0-b302-0d1a8a9ef061 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:33.357347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-42a59411-230a-4ab0-b302-0d1a8a9ef061 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a57b3d80-e739-4efa-aa3a-595aa617a9c1 HTTP/1.1" status: 200 len: 854 time: 0.0810232 Nov 24 14:43:33.404256 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-5e439ec0-4ba2-4612-93fa-2fd677f31b3a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0401669 Nov 24 14:43:33.536943 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-27937fb4-7884-4d08-9634-dfdd871ec2a4 service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255212 Nov 24 14:43:33.739853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:33.784396 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e34cdfa6-1aae-4bc6-b592-d561643b0268 req-027c73e9-8337-4037-b378-a3ccfb0a3d2c service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2415140 Nov 24 14:43:33.816724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251e2b59-ac95-40a6-99c3-088f609c12be req-582c5a04-dcd3-44fc-9d7d-7ee8b03384ce tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:33.818490 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-251e2b59-ac95-40a6-99c3-088f609c12be req-582c5a04-dcd3-44fc-9d7d-7ee8b03384ce tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 943 time: 0.0850863 Nov 24 14:43:33.872074 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-251e2b59-ac95-40a6-99c3-088f609c12be req-428203e2-44c5-4b34-82d9-3f92eefd09e5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468671 Nov 24 14:43:33.922624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-f8c3f763-0515-4943-b316-b1c78ae8282b service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b2b0aab5bcea48678554d79750d41205&device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 1096 time: 0.0821722 Nov 24 14:43:34.060965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-04cd8f4c-f1f6-451d-9ba4-656d876644bd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:34.062392 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-04cd8f4c-f1f6-451d-9ba4-656d876644bd service neutron] 10.222.0.47 "GET /v2.0/networks?id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 200 len: 915 time: 0.1330769 Nov 24 14:43:34.128929 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-22cb053d-872b-4cc0-b478-8285e4345bb8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b HTTP/1.1" status: 200 len: 217 time: 0.0605619 Nov 24 14:43:34.198067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-35c09457-c317-47d4-90bd-a81c419ae0f0 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:34.199481 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-35c09457-c317-47d4-90bd-a81c419ae0f0 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a57b3d80-e739-4efa-aa3a-595aa617a9c1 HTTP/1.1" status: 200 len: 854 time: 0.0651734 Nov 24 14:43:34.246158 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-ea44a22b-84ef-4cbc-a780-cb69a1d67b97 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4fdd90ff-fb7f-4be3-856d-bc395fd8118a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0395029 Nov 24 14:43:34.382931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-d951da8d-d166-4a70-8600-d8440b22361a service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1300757 Nov 24 14:43:34.514411 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0622a203-1ad2-47fd-a6b5-15129faa021f req-bbe0e767-ba8c-4ecf-81df-e4622d7c1216 service neutron] 10.222.0.47 "GET /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236835 Nov 24 14:43:35.079495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7724000-8976-402f-9142-1e61bd8d582e req-9d2f3294-4e83-4d2d-8ec3-df696cb7d8d5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:35.079741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f7724000-8976-402f-9142-1e61bd8d582e req-9d2f3294-4e83-4d2d-8ec3-df696cb7d8d5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Synchronizing usage tracker for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:43:35.101460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f7724000-8976-402f-9142-1e61bd8d582e req-9d2f3294-4e83-4d2d-8ec3-df696cb7d8d5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Unset dirty status for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:43:35.102666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7724000-8976-402f-9142-1e61bd8d582e req-9d2f3294-4e83-4d2d-8ec3-df696cb7d8d5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 943 time: 0.1079884 Nov 24 14:43:35.150107 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f7724000-8976-402f-9142-1e61bd8d582e req-8c558130-c8e8-4abd-a0d7-7e375c775116 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415530 Nov 24 14:43:35.889759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc1ab2f4-3096-424a-9944-3595b6cc1ddd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:36.031503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bf397b7c-dcaa-4b1a-b793-1196c3af355b details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:43:36.171774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port bf397b7c-dcaa-4b1a-b793-1196c3af355b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:36.186475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b', 'network_id': '4fdd90ff-fb7f-4be3-856d-bc395fd8118a', 'port_id': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b', 'mac_address': 'fa:16:3e:56:88:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 878, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a57b3d80-e739-4efa-aa3a-595aa617a9c1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:43:36.246985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:36.266143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf397b7c-dcaa-4b1a-b793-1196c3af355b {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:43:36.283007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port bf397b7c-dcaa-4b1a-b793-1196c3af355b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:36.291019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:36.292989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:36.368468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=bf397b7c-dcaa-4b1a-b793-1196c3af355b,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:36.370013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8ed71f-8887-44ce-aece-68b12365d8d7 req-345a3e82-16bb-4c41-bddd-0ebe6d373415 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:36.371498 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bd8ed71f-8887-44ce-aece-68b12365d8d7 req-345a3e82-16bb-4c41-bddd-0ebe6d373415 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 944 time: 0.0936298 Nov 24 14:43:36.377854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.378193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.378575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.378890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.379160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.379476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.379814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.380132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.380443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.380963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.381074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:43:36.385299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:36.421434 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bd8ed71f-8887-44ce-aece-68b12365d8d7 req-5c6d48fa-0893-4c25-8c28-99dff27e8401 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431864 Nov 24 14:43:36.639303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['bf397b7c-dcaa-4b1a-b793-1196c3af355b'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:43:36.939027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:37.621786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578125ef-c9b2-4171-9832-cc2249e6703a req-5ff23804-17ba-4816-b729-37885657c0ec tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:37.623262 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-578125ef-c9b2-4171-9832-cc2249e6703a req-5ff23804-17ba-4816-b729-37885657c0ec tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 944 time: 0.0794637 Nov 24 14:43:37.669202 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-578125ef-c9b2-4171-9832-cc2249e6703a req-cfddd4aa-7a2d-42bf-a29c-df88128c9a18 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404794 Nov 24 14:43:38.051588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bf397b7c-dcaa-4b1a-b793-1196c3af355b up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:43:38.123862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port bf397b7c-dcaa-4b1a-b793-1196c3af355b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:43:38.128657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port bf397b7c-dcaa-4b1a-b793-1196c3af355b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:43:38.129030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:38.244530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:38.272666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8afea892-672a-41bd-92f1-03dc64041cc9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:38.284029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port bf397b7c-dcaa-4b1a-b793-1196c3af355b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:38.288906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:38.291671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:38.333887 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8afea892-672a-41bd-92f1-03dc64041cc9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b', 'code': 200} Nov 24 14:43:38.363206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=bf397b7c-dcaa-4b1a-b793-1196c3af355b,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:38.366662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:38.571464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f71546f1-f56b-487c-a779-bf1f15b8b773 req-32ca1a78-a9bb-4a4f-9e82-ae82969c549a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 1098 time: 0.0756845 Nov 24 14:43:38.613949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:38.619440 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f71546f1-f56b-487c-a779-bf1f15b8b773 req-461751fc-91ac-4282-8df1-686eb3bf385f service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406897 Nov 24 14:43:38.871629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9940aaf7-2210-43c7-9315-aa7fe29e854d req-79c10d89-26e3-4147-90a3-1a07f9d60df9 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:38.873111 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9940aaf7-2210-43c7-9315-aa7fe29e854d req-79c10d89-26e3-4147-90a3-1a07f9d60df9 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 945 time: 0.0789828 Nov 24 14:43:38.918718 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9940aaf7-2210-43c7-9315-aa7fe29e854d req-4cbcd7ba-b735-4a6b-aa80-f76ebd25db0f tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399888 Nov 24 14:43:40.141141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2527da0-0d93-415e-a49d-1db8c1fc871d req-f8cccb8d-13fb-4737-a730-31f74c423821 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:40.142608 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d2527da0-0d93-415e-a49d-1db8c1fc871d req-f8cccb8d-13fb-4737-a730-31f74c423821 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 945 time: 0.0816476 Nov 24 14:43:40.189384 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d2527da0-0d93-415e-a49d-1db8c1fc871d req-ab84ed8b-c7ef-40c4-ba8f-559a1973f727 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399013 Nov 24 14:43:41.394059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9960fc5e-bc9a-41d2-af2f-4aa84ffdb471 req-d45c9dec-dc35-4adb-8807-26a5b860e7f4 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:41.395550 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9960fc5e-bc9a-41d2-af2f-4aa84ffdb471 req-d45c9dec-dc35-4adb-8807-26a5b860e7f4 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 945 time: 0.0823512 Nov 24 14:43:41.441635 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9960fc5e-bc9a-41d2-af2f-4aa84ffdb471 req-2e3c8c61-dadb-4448-ad80-5f989319c3fe tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398524 Nov 24 14:43:41.857562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bd0e39-4e15-43e7-87fa-191b9d755233 req-337a5e42-b2e7-441a-9392-244929bd18bd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:41.858882 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f8bd0e39-4e15-43e7-87fa-191b9d755233 req-337a5e42-b2e7-441a-9392-244929bd18bd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 945 time: 0.0773859 Nov 24 14:43:41.906959 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f8bd0e39-4e15-43e7-87fa-191b9d755233 req-c365164d-015f-4fa0-a812-19fc5aa152a5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426085 Nov 24 14:43:43.114387 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f69d1b0-d135-4f6c-9948-a2a9e9dfe78a req-7a23b8de-448d-4792-9a8d-4abf2a981a88 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:43.115979 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9f69d1b0-d135-4f6c-9948-a2a9e9dfe78a req-7a23b8de-448d-4792-9a8d-4abf2a981a88 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 945 time: 0.0813239 Nov 24 14:43:43.165124 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9f69d1b0-d135-4f6c-9948-a2a9e9dfe78a req-97fb8724-d900-4b10-abfd-8f54ba41900e tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433893 Nov 24 14:43:43.389525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5964965-9c03-4053-8306-3f85ad398f2e req-b8835471-7b87-4e45-8dad-5e45c6241555 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:43.390967 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e5964965-9c03-4053-8306-3f85ad398f2e req-b8835471-7b87-4e45-8dad-5e45c6241555 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 945 time: 0.0779302 Nov 24 14:43:43.460459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Deleting port bf397b7c-dcaa-4b1a-b793-1196c3af355b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:43.460798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:43.811855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] For port bf397b7c-dcaa-4b1a-b793-1196c3af355b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bf397b7c-dcaa-4b1a-b793-1196c3af355b,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:43.812236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:43.938347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Calling delete_port for bf397b7c-dcaa-4b1a-b793-1196c3af355b owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:44.089940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:44.095973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-062e57cc-a94e-47dd-8142-af222375e29c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:44.102726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['2dea702d-7e67-419d-b69c-f5a1f619d17a', 'bf397b7c-dcaa-4b1a-b793-1196c3af355b'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:43:44.147862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Pushing event deleted for resources: {'Port': ['ID=bf397b7c-dcaa-4b1a-b793-1196c3af355b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:44.152146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:44.221676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] No DVR routers for this DVR port bf397b7c-dcaa-4b1a-b793-1196c3af355b on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:43:44.224161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:44.227505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8afea892-672a-41bd-92f1-03dc64041cc9', 'name': 'network-vif-deleted', 'tag': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:44.260100 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e5964965-9c03-4053-8306-3f85ad398f2e req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "DELETE /v2.0/ports/bf397b7c-dcaa-4b1a-b793-1196c3af355b HTTP/1.1" status: 204 len: 173 time: 0.8627570 Nov 24 14:43:44.325330 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8afea892-672a-41bd-92f1-03dc64041cc9', 'name': 'network-vif-deleted', 'tag': 'bf397b7c-dcaa-4b1a-b793-1196c3af355b', 'status': 'completed', 'code': 200} Nov 24 14:43:44.382774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bb64a6a7-594e-4628-a485-450ca42bf05a req-187ccecf-6fff-44a9-9432-ce02b54eb736 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Synchronizing usage tracker for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:43:44.400064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bb64a6a7-594e-4628-a485-450ca42bf05a req-187ccecf-6fff-44a9-9432-ce02b54eb736 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Unset dirty status for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:43:44.401305 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bb64a6a7-594e-4628-a485-450ca42bf05a req-187ccecf-6fff-44a9-9432-ce02b54eb736 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=8afea892-672a-41bd-92f1-03dc64041cc9 HTTP/1.1" status: 200 len: 210 time: 0.0627098 Nov 24 14:43:45.682591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e246352c-792e-4e17-a3e0-b904a0cef846 req-317723d3-b578-4802-bab8-dbb97f796fd1 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:45.684044 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e246352c-792e-4e17-a3e0-b904a0cef846 req-317723d3-b578-4802-bab8-dbb97f796fd1 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0773118 Nov 24 14:43:45.730984 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e246352c-792e-4e17-a3e0-b904a0cef846 req-7bbe778b-435e-4b60-9211-20f16dc13fed tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414112 Nov 24 14:43:45.962756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5fda464-a98e-480f-9050-1e3a1bf20bef req-c58fe201-2c5a-4662-9ed3-792253d24992 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:45.964451 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b5fda464-a98e-480f-9050-1e3a1bf20bef req-c58fe201-2c5a-4662-9ed3-792253d24992 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0813084 Nov 24 14:43:46.010550 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b5fda464-a98e-480f-9050-1e3a1bf20bef req-d4803758-a914-4e61-a498-cf555128200b tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406554 Nov 24 14:43:46.100129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bf397b7c-dcaa-4b1a-b793-1196c3af355b no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:43:46.134328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: bf397b7c-dcaa-4b1a-b793-1196c3af355b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:43:46.134673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bf397b7c-dcaa-4b1a-b793-1196c3af355b not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:43:46.223979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae7e0747-09d9-45c7-9f64-2f15c052e8df req-716abd6d-c20b-4505-9b9f-69029c4fa446 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:46.225452 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae7e0747-09d9-45c7-9f64-2f15c052e8df req-716abd6d-c20b-4505-9b9f-69029c4fa446 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0763056 Nov 24 14:43:46.274922 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ae7e0747-09d9-45c7-9f64-2f15c052e8df req-b0e285c4-fc42-44de-a53e-02988a2e4881 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435796 Nov 24 14:43:46.470204 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4ae6db91-641e-409a-a227-8788569d2cf3 req-2efc4c59-85ba-42b0-8f13-c595d89a106a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0689344 Nov 24 14:43:46.662667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de482fe-a5fe-45f9-8c16-6d991303e66b req-dcfb06b1-4bd7-4350-bbc9-9cfd5594193c tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:46.664099 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4de482fe-a5fe-45f9-8c16-6d991303e66b req-dcfb06b1-4bd7-4350-bbc9-9cfd5594193c tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0766540 Nov 24 14:43:46.709583 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4de482fe-a5fe-45f9-8c16-6d991303e66b req-383c7fdb-4464-4331-9825-b87f4a020ceb tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400269 Nov 24 14:43:46.909594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff8c37e-b16c-415d-a109-21b4368d45fd req-f3975eb0-7206-4ee9-850e-cb4cb32fe56a tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:46.911008 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5ff8c37e-b16c-415d-a109-21b4368d45fd req-f3975eb0-7206-4ee9-850e-cb4cb32fe56a tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0795915 Nov 24 14:43:46.957269 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5ff8c37e-b16c-415d-a109-21b4368d45fd req-58d23141-c042-4021-992e-d6513122f25b tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397868 Nov 24 14:43:47.171920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec6fc5a-b7f0-44d8-b814-d3ff42dcfbf2 req-19cfcceb-217c-4a62-b12b-7270b1a8a1a6 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:47.173372 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec6fc5a-b7f0-44d8-b814-d3ff42dcfbf2 req-19cfcceb-217c-4a62-b12b-7270b1a8a1a6 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0811036 Nov 24 14:43:47.219470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec6fc5a-b7f0-44d8-b814-d3ff42dcfbf2 req-b50f3d13-a3d5-4cd2-b97e-cc17919028c3 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400691 Nov 24 14:43:47.790690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801639f1-8d5e-4360-9fb6-1b5bafdb28f2 req-d7cf6549-0e66-43b9-a6cf-38e592a18376 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:47.792037 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-801639f1-8d5e-4360-9fb6-1b5bafdb28f2 req-d7cf6549-0e66-43b9-a6cf-38e592a18376 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0804756 Nov 24 14:43:47.838505 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-801639f1-8d5e-4360-9fb6-1b5bafdb28f2 req-0b6ca249-938b-4a4b-a56b-6c58c0aa09b9 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410502 Nov 24 14:43:48.196985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:49.049267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76864919-18d9-49b6-a241-b0811a486fb1 req-561bb391-fc02-4728-b272-704be1d43ee5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:49.050689 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76864919-18d9-49b6-a241-b0811a486fb1 req-561bb391-fc02-4728-b272-704be1d43ee5 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0833075 Nov 24 14:43:49.099040 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76864919-18d9-49b6-a241-b0811a486fb1 req-5ac1a20a-372e-4d23-9dde-f6f880e75de4 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/security-groups?id=084f136f-7388-4a76-8655-4c28f0628384&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407431 Nov 24 14:43:49.424515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-a5407c08-4578-40df-a6e6-f2d6532a4acc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:49.425980 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-a5407c08-4578-40df-a6e6-f2d6532a4acc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 945 time: 0.0764005 Nov 24 14:43:49.497839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Deleting port 2dea702d-7e67-419d-b69c-f5a1f619d17a {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:43:49.498175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:49.743708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] For port 2dea702d-7e67-419d-b69c-f5a1f619d17a, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=2dea702d-7e67-419d-b69c-f5a1f619d17a,segment=NetworkSegment(9a520f71-32ff-4347-9dca-ccf087b975bb),segment_id=9a520f71-32ff-4347-9dca-ccf087b975bb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:43:49.744083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:49.963505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Calling delete_port for 2dea702d-7e67-419d-b69c-f5a1f619d17a owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:43:50.104564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:50.110275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a4619d0a-3df3-45f0-840d-92dc75dea206 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:50.116529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['2dea702d-7e67-419d-b69c-f5a1f619d17a'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:43:50.153504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Pushing event deleted for resources: {'Port': ['ID=2dea702d-7e67-419d-b69c-f5a1f619d17a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:50.156055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:50.227887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] No DVR routers for this DVR port 2dea702d-7e67-419d-b69c-f5a1f619d17a on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:43:50.230917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:50.233607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'name': 'network-vif-deleted', 'tag': '2dea702d-7e67-419d-b69c-f5a1f619d17a'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:43:50.282074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-be21d573-0193-4773-8436-a040be669580 req-a599c3a9-318c-4e98-b080-f5f39c23efac tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Synchronizing usage tracker for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:43:50.290491 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c224c996-1f47-4481-bb66-fc8ab1b56ac6 req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.47 "DELETE /v2.0/ports/2dea702d-7e67-419d-b69c-f5a1f619d17a HTTP/1.1" status: 204 len: 173 time: 0.8582473 Nov 24 14:43:50.293222 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b3cb709a-ccc5-4b42-9fdc-160b3176b287', 'name': 'network-vif-deleted', 'tag': '2dea702d-7e67-419d-b69c-f5a1f619d17a', 'status': 'completed', 'code': 200} Nov 24 14:43:50.303006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-be21d573-0193-4773-8436-a040be669580 req-a599c3a9-318c-4e98-b080-f5f39c23efac tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Unset dirty status for tenant:b2b0aab5bcea48678554d79750d41205 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:43:50.303960 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-be21d573-0193-4773-8436-a040be669580 req-a599c3a9-318c-4e98-b080-f5f39c23efac tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] 10.222.0.70 "GET /v2.0/ports?device_id=b3cb709a-ccc5-4b42-9fdc-160b3176b287 HTTP/1.1" status: 200 len: 210 time: 0.0742812 Nov 24 14:43:51.411337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52162) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:51.470269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Deleting subnet a57b3d80-e739-4efa-aa3a-595aa617a9c1 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:43:51.473070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.524794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.580778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.645615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.650719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b9f9bc4-4ccf-45f6-8e1c-07d8fbd451b0 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:51.688479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a57b3d80-e739-4efa-aa3a-595aa617a9c1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:51.691556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:51.694422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.700974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/a57b3d80-e739-4efa-aa3a-595aa617a9c1 HTTP/1.1" status: 204 len: 168 time: 0.2885513 Nov 24 14:43:51.703293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52166) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:51.813552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.943747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:51.971255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4fdd90ff-fb7f-4be3-856d-bc395fd8118a']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:51.983623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a520f71-32ff-4347-9dca-ccf087b975bb') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:51.983945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a520f71-32ff-4347-9dca-ccf087b975bb') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:43:51.996095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.012231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.018102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Releasing vlan 878 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:43:52.018842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:43:52.032545 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:43:52.109069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.114079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.116480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-41c2d563-dd54-497d-ad19-87ea492aeb98 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:52.122567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 2dea702d-7e67-419d-b69c-f5a1f619d17a no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:43:52.140406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Pushing event deleted for resources: {'Network': ['ID=4fdd90ff-fb7f-4be3-856d-bc395fd8118a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:52.144026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:52.150648 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] 10.222.0.70 "DELETE /v2.0/networks/4fdd90ff-fb7f-4be3-856d-bc395fd8118a HTTP/1.1" status: 204 len: 168 time: 0.4462256 Nov 24 14:43:52.199702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 2dea702d-7e67-419d-b69c-f5a1f619d17a {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:43:52.200056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 2dea702d-7e67-419d-b69c-f5a1f619d17a not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:43:52.293773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52172) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:52.343499 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-95fc90ac-26e5-4c43-bf36-74a4111e9690 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=b2b0aab5bcea48678554d79750d41205&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0484772 Nov 24 14:43:52.345851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52176) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:52.402802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.427145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.486427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.494573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:52.510394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=084f136f-7388-4a76-8655-4c28f0628384,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:52.512985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:52.520070 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:52.521187 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6285d956-a7ef-4243-8724-23232957e443 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/084f136f-7388-4a76-8655-4c28f0628384 HTTP/1.1" status: 204 len: 168 time: 0.1744609 Nov 24 14:43:53.392686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52198) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:53.596793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-973180129'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:53.601721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:53.605707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:network and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:53.608684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:53.615272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:53.625298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:53.628422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.641411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.675784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:53.680352 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:security_group_rule and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:53.683121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:53.688743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:53.757065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.761277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.765243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4330feb4-0878-4920-92b3-04438b790470 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:53.790517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 867} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:43:53.802597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'SecurityGroup': ['ID=293720d4-f8e5-4218-9738-97b964845f30,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:53.806499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:53.807412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.807751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Added segment ef0d9a4f-61af-4373-9c49-5f7afab8c0ba of type vlan for network 536b40ff-83d6-49fc-961e-00229ccbad79 Nov 24 14:43:53.833821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.863151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.867737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:53.868330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:53.873388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bd31cf70-6e14-4942-9efc-52655055db4c tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:53.974587 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.5807917 Nov 24 14:43:53.980261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Network': ['ID=536b40ff-83d6-49fc-961e-00229ccbad79,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:53.983067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:53.991097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 536b40ff-83d6-49fc-961e-00229ccbad79 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:43:57.305203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52206) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:57.311025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'subnet': {'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:57.418868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:57.422609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:subnet and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:57.425455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:57.432606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:57.441334 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:57.550538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:57.765550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:57.768899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af45f1a0-0ff2-4c66-8f39-88a8e2d30fb8 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:57.842935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Subnet': ['ID=745e25e3-4828-4cf5-9795-cd90ba11b7d6,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:57.847303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:57.857303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Checking segment: {'id': 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:43:57.857650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network hostable DHCP agents. Network: 536b40ff-83d6-49fc-961e-00229ccbad79, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:43:57.879376 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network 536b40ff-83d6-49fc-961e-00229ccbad79 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:43:57.889024 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 536b40ff-83d6-49fc-961e-00229ccbad79) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:57.893075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:57.894084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:57.898505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fecd19e-c8a0-492a-8592-4a06ce29a143 None None] Network 536b40ff-83d6-49fc-961e-00229ccbad79 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:43:57.919806 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6100011 Nov 24 14:43:57.920490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52210) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:57.926085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1991725400'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:57.931650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:57.935469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:network and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:57.938285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:57.943864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:57.954920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:57.957804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:57.986229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 868} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:43:57.995718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:57.996106 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Added segment 3d3e73b4-2ae7-4384-94ec-20e0d1eca660 of type vlan for network 55d9ad11-3982-4eee-bafc-c89d62a0973b Nov 24 14:43:58.022264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.056452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.060365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:58.060934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.066079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd231c2f-ca11-4ea7-b87b-d7d79df152b4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:58.117485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-536b40ff-83d6-49fc-961e-00229ccbad79', 'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79', 'tenant_id': 'f5d2cb6ed63a4f96a93512657aa5da65', 'fixed_ips': [{'subnet_id': '745e25e3-4828-4cf5-9795-cd90ba11b7d6'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:43:58.118413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.259809 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3369243 Nov 24 14:43:58.261409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52214) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:58.269421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'subnet': {'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': True, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:43:58.280432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Network': ['ID=55d9ad11-3982-4eee-bafc-c89d62a0973b,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:58.283436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e487d4a8-362d-45bf-9647-136b7c133961 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:58.287856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Allocated IP 2001:db8:0:ffff::2 (536b40ff-83d6-49fc-961e-00229ccbad79/745e25e3-4828-4cf5-9795-cd90ba11b7d6/b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:43:58.294435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 55d9ad11-3982-4eee-bafc-c89d62a0973b details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:43:58.393064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:43:58.396837 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:subnet and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:43:58.400363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:43:58.406086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:43:58.416370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:43:58.605898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.615867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Transition to ACTIVE for port object b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:43:58.624909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.635023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Transition to ACTIVE for port object b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:43:58.641274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.644697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:58.712754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Network 536b40ff-83d6-49fc-961e-00229ccbad79 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:43:58.715946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Pushing event updated for resources: {'Port': ['ID=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:58.718442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:58.720113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:58.720815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:43:58.812233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Attempting to bind port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:43:58.812639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Attempting to bind port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:43:58.813588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Attempting to bind port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 on network 536b40ff-83d6-49fc-961e-00229ccbad79 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:43:58.819458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 43, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:43:58.820042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Checking segment: {'id': 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:43:58.820546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.821316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Bound using segment: {'id': 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:43:58.821788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Bound port: b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 867, 'network_id': '536b40ff-83d6-49fc-961e-00229ccbad79'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:43:58.822169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.875130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.878913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ac9e3e46-5353-4036-9ed0-609b050388ca tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:58.917517 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] For port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:43:58.921023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] For port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,segment=NetworkSegment(ef0d9a4f-61af-4373-9c49-5f7afab8c0ba),segment_id=ef0d9a4f-61af-4373-9c49-5f7afab8c0ba)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:43:58.928632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:58.934853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:58.965617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Subnet': ['ID=d5fe8094-78ea-4142-bfe5-719d1416b399,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:58.969810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:58.978961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Checking segment: {'id': '3d3e73b4-2ae7-4384-94ec-20e0d1eca660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:43:58.979340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network hostable DHCP agents. Network: 55d9ad11-3982-4eee-bafc-c89d62a0973b, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:43:59.003383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network 55d9ad11-3982-4eee-bafc-c89d62a0973b is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:43:59.013251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 55d9ad11-3982-4eee-bafc-c89d62a0973b) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:59.016367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Pushing event updated for resources: {'Port': ['ID=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:59.017372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:43:59.017958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.018756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:59.025609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ecfef60-2dd7-49ca-a412-863cd708572c None None] Network 55d9ad11-3982-4eee-bafc-c89d62a0973b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:43:59.051032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52218) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:43:59.052459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f549f894-2e5e-4ac5-b103-243c2cf78ba2 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 913 time: 0.7884943 Nov 24 14:43:59.241517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.295516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-55d9ad11-3982-4eee-bafc-c89d62a0973b', 'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b', 'tenant_id': 'f5d2cb6ed63a4f96a93512657aa5da65', 'fixed_ips': [{'subnet_id': 'd5fe8094-78ea-4142-bfe5-719d1416b399'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:43:59.296462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.335934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.471608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Allocated IP 2001:db8::2 (55d9ad11-3982-4eee-bafc-c89d62a0973b/d5fe8094-78ea-4142-bfe5-719d1416b399/b7466038-78af-461d-970c-a2842032328d) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:43:59.734939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.748963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Transition to ACTIVE for port object b7466038-78af-461d-970c-a2842032328d will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:43:59.769004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Transition to ACTIVE for port object b7466038-78af-461d-970c-a2842032328d will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:43:59.775426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.780077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:59.801036 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.805674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ff800de-319f-4251-baea-9b97fd46b722 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:43:59.819087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:43:59.846004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Subnet': ['ID=d5fe8094-78ea-4142-bfe5-719d1416b399,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:59.848984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:59.910541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Network 55d9ad11-3982-4eee-bafc-c89d62a0973b is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:43:59.911631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Pushing event updated for resources: {'Port': ['ID=b7466038-78af-461d-970c-a2842032328d,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:43:59.918238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:43:59.922484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:43:59.922631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:43:59.958793 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:43:59.990016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55d9ad11-3982-4eee-bafc-c89d62a0973b']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:00.004200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d3e73b4-2ae7-4384-94ec-20e0d1eca660') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:00.004372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d3e73b4-2ae7-4384-94ec-20e0d1eca660') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:00.004474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:00.016918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.032655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Attempting to bind port b7466038-78af-461d-970c-a2842032328d on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:00.033078 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Attempting to bind port b7466038-78af-461d-970c-a2842032328d by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '3d3e73b4-2ae7-4384-94ec-20e0d1eca660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:00.033440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Attempting to bind port b7466038-78af-461d-970c-a2842032328d on network 55d9ad11-3982-4eee-bafc-c89d62a0973b {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:00.036867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.041905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 43, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:00.042314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Checking segment: {'id': '3d3e73b4-2ae7-4384-94ec-20e0d1eca660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:00.042750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.043166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Bound using segment: {'id': '3d3e73b4-2ae7-4384-94ec-20e0d1eca660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:00.043666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Bound port: b7466038-78af-461d-970c-a2842032328d, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3d3e73b4-2ae7-4384-94ec-20e0d1eca660', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 868, 'network_id': '55d9ad11-3982-4eee-bafc-c89d62a0973b'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:00.044098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.045415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:00.046267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:00.062802 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:00.144889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] For port b7466038-78af-461d-970c-a2842032328d, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:00.149712 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Nov 24 14:44:00.149712 dv-neutron-818151-2-hyperv neutron-server[83525]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Nov 24 14:44:00.149712 dv-neutron-818151-2-hyperv neutron-server[83525]: [parameters: {'id': '55d9ad11-3982-4eee-bafc-c89d62a0973b'}] Nov 24 14:44:00.149712 dv-neutron-818151-2-hyperv neutron-server[83525]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:44:00.150149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] For port b7466038-78af-461d-970c-a2842032328d, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b7466038-78af-461d-970c-a2842032328d,segment=NetworkSegment(3d3e73b4-2ae7-4384-94ec-20e0d1eca660),segment_id=3d3e73b4-2ae7-4384-94ec-20e0d1eca660)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:00.150296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:44:00.155406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.160237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:00.191710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20beca37-c5dd-4e1d-9502-4c72f41fc211 None None] Network 536b40ff-83d6-49fc-961e-00229ccbad79 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:00.365630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Pushing event updated for resources: {'Port': ['ID=b7466038-78af-461d-970c-a2842032328d,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:00.375858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:00.412623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Provisioning for port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:00.424465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Provisioning complete for port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:00.424858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.448742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-573fe06f-8944-4725-8f82-18aff1dce519 None None] Network 55d9ad11-3982-4eee-bafc-c89d62a0973b requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:00.650899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.662267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Deleting port b7466038-78af-461d-970c-a2842032328d {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:00.662596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.786184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.853846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] For port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,segment=NetworkSegment(ef0d9a4f-61af-4373-9c49-5f7afab8c0ba),segment_id=ef0d9a4f-61af-4373-9c49-5f7afab8c0ba)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:00.858900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.860766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:00.883381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] For port b7466038-78af-461d-970c-a2842032328d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b7466038-78af-461d-970c-a2842032328d,segment=NetworkSegment(3d3e73b4-2ae7-4384-94ec-20e0d1eca660),segment_id=3d3e73b4-2ae7-4384-94ec-20e0d1eca660)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:00.883748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:00.941627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Pushing event updated for resources: {'Port': ['ID=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:00.945879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:01.013232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Calling delete_port for b7466038-78af-461d-970c-a2842032328d owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:01.051383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a612616a-3312-4579-821c-f212b4368d28 None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:44:01.090644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.096122 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:01.127462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-bd3c081c-1446-4412-a7a3-a4008a8dcb2f None None] Provisioning complete for port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:01.127781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bd3c081c-1446-4412-a7a3-a4008a8dcb2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.141915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Port': ['ID=b7466038-78af-461d-970c-a2842032328d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:01.146096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:01.149385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No DVR routers for this DVR port b7466038-78af-461d-970c-a2842032328d on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:44:01.200047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a612616a-3312-4579-821c-f212b4368d28 None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:44:01.282554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.316225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55d9ad11-3982-4eee-bafc-c89d62a0973b']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:01.330503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d3e73b4-2ae7-4384-94ec-20e0d1eca660') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:01.330794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d3e73b4-2ae7-4384-94ec-20e0d1eca660') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:01.343850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.360583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.368622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Releasing vlan 868 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:01.369098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:01.385387 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:01.468778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.472118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a320d654-8d4f-4660-93e6-e0893a15d400 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:01.486817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.498092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Network': ['ID=55d9ad11-3982-4eee-bafc-c89d62a0973b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:01.502286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:01.509116 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/55d9ad11-3982-4eee-bafc-c89d62a0973b HTTP/1.1" status: 204 len: 168 time: 2.4529800 Nov 24 14:44:01.509410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52222) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:01.514733 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1055270506'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:01.519611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:01.523400 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:network and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:01.526243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:01.532395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:01.542365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:01.545672 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.575949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 861} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:01.585257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.585626 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Added segment 8f21645b-4fd4-4987-994e-fa69489f232f of type vlan for network 3139dba5-db17-4034-94ab-f57f1251a236 Nov 24 14:44:01.622957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.652606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.656339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:01.656901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.660271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64f65c39-bba7-4c30-8bfc-34c19bb7a818 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:01.765195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:01.837297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:01.837675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:01.874476 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3615251 Nov 24 14:44:01.874684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52226) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:01.883926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'subnet': {'network_id': '3139dba5-db17-4034-94ab-f57f1251a236', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:01.908947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Network': ['ID=3139dba5-db17-4034-94ab-f57f1251a236,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:01.914476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:01.935160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 3139dba5-db17-4034-94ab-f57f1251a236 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:02.004296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:02.007953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:subnet and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:02.010723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:02.016341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:02.025957 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:02.127478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.217885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Performing IP validity checks on allocation pools {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:317}} Nov 24 14:44:02.218396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.ipam_backend_mixin [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Checking for overlaps among allocation pools and gateway ip {{(pid=83525) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:338}} Nov 24 14:44:02.344507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.348576 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-61d46664-03bc-4d97-af49-9ab6c20aeb8d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:02.426111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Subnet': ['ID=631b819c-908e-4d45-9ba9-82741e6a3a9e,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:02.429446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:02.436348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Checking segment: {'id': '8f21645b-4fd4-4987-994e-fa69489f232f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 861, 'network_id': '3139dba5-db17-4034-94ab-f57f1251a236'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:02.436703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network hostable DHCP agents. Network: 3139dba5-db17-4034-94ab-f57f1251a236, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:02.458649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network 3139dba5-db17-4034-94ab-f57f1251a236 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:02.468396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 3139dba5-db17-4034-94ab-f57f1251a236) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:02.472085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:02.472653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.476742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8533ff7f-ff95-4f30-a1a4-f9f739c3e71e None None] Network 3139dba5-db17-4034-94ab-f57f1251a236 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:02.495532 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.6197314 Nov 24 14:44:02.498166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52230) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:02.642525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.706832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-887001fb-017a-474c-b8e3-935e40b33462 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-3139dba5-db17-4034-94ab-f57f1251a236', 'network_id': '3139dba5-db17-4034-94ab-f57f1251a236', 'tenant_id': 'f5d2cb6ed63a4f96a93512657aa5da65', 'fixed_ips': [{'subnet_id': '631b819c-908e-4d45-9ba9-82741e6a3a9e'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:02.707686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-887001fb-017a-474c-b8e3-935e40b33462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.715208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.793468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.797150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3196cd04-b587-4bd2-afe7-f8239f291a36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server [None req-887001fb-017a-474c-b8e3-935e40b33462 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 631b819c-908e-4d45-9ba9-82741e6a3a9e: This subnet is being modified by another concurrent operation. Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 274, in create_dhcp_port Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 99, in _port_action Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 335, in create_port Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 685, in inner Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 233, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1423, in create_port Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1390, in _create_port_db Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1440, in create_port_db Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server self.force_reraise() Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/six.py", line 703, in reraise Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise value Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 669, in _ipam_get_subnets Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server subnet.lock_register( Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server raise exception Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 631b819c-908e-4d45-9ba9-82741e6a3a9e: This subnet is being modified by another concurrent operation. Nov 24 14:44:02.812609 dv-neutron-818151-2-hyperv neutron-server[83527]: ERROR oslo_messaging.rpc.server Nov 24 14:44:02.829515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-684b6c1e-6c5b-40cd-b6c3-b15e5a4ca4ce None None] Network 3139dba5-db17-4034-94ab-f57f1251a236 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:02.832761 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Subnet': ['ID=631b819c-908e-4d45-9ba9-82741e6a3a9e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:02.838524 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:02.938899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:02.964255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3139dba5-db17-4034-94ab-f57f1251a236']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:02.976415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f21645b-4fd4-4987-994e-fa69489f232f') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:02.976706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f21645b-4fd4-4987-994e-fa69489f232f') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:02.988044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.007736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.008836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33c39861-ccf9-492c-95c2-ef4d805b8e7f None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:44:03.016756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Releasing vlan 861 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:03.017153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:03.031456 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:03.101004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33c39861-ccf9-492c-95c2-ef4d805b8e7f None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:44:03.112838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.116264 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5ac284e8-7939-4fbd-801d-b80eafed8b58 tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:03.130813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.142800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Network': ['ID=3139dba5-db17-4034-94ab-f57f1251a236,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:03.145611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:03.147356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/3139dba5-db17-4034-94ab-f57f1251a236 HTTP/1.1" status: 204 len: 168 time: 0.6480529 Nov 24 14:44:03.151930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52234) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:03.157497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2007271539'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:03.162491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:03.166320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:network and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:03.169186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:03.174789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:03.185810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:03.188974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.217139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:03.226738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.227192 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Added segment 2ff7f12d-c963-41ee-a3bf-4289bc9961b4 of type vlan for network d8d50ad3-641a-4e3f-869b-cff474be3ebe Nov 24 14:44:03.254211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.289375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.293191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:03.293857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.299215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c672d0cb-24c0-4c85-a55f-b5abbc0b42f8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:03.329169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2559b453-d4bd-416c-bbfb-8f2cbb6c7f39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.382785 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2293892 Nov 24 14:44:03.386009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52238) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:03.391908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'subnet': {'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:03.404361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Network': ['ID=d8d50ad3-641a-4e3f-869b-cff474be3ebe,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:03.406945 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:03.416506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network d8d50ad3-641a-4e3f-869b-cff474be3ebe details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:03.505888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:03.509683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:subnet and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:03.512449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:03.518338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:03.527916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:03.629276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.731184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.847284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.851427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-34be1459-d1e6-41f0-b2ab-1c250a4fe758 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:03.929875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Subnet': ['ID=f4367efc-645d-4509-b87b-5b3ccab8eaf3,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:03.943170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.943551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.943952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.944326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.945461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.945760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.946129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.946489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.946844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.947202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.947560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:03.950487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Checking segment: {'id': '2ff7f12d-c963-41ee-a3bf-4289bc9961b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:03.950841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network hostable DHCP agents. Network: d8d50ad3-641a-4e3f-869b-cff474be3ebe, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:03.955105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:03.973503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network d8d50ad3-641a-4e3f-869b-cff474be3ebe is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:03.983210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, d8d50ad3-641a-4e3f-869b-cff474be3ebe) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:03.986987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:03.987558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:03.993172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73f6d587-7f57-41c7-b824-be03a88173bc None None] Network d8d50ad3-641a-4e3f-869b-cff474be3ebe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:04.009455 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1c290663-b73c-459f-b5cc-62b9649b08f4 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6223097 Nov 24 14:44:04.013017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52242) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:04.018589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1099329072'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:04.023514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:04.027704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:network and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:04.030701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for network was recalculated. Used quota:2. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:04.036632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource network. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:04.048413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:04.051551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.083678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 895} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:04.094981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.095334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Added segment f946af14-951a-4918-9446-d0b1bd94773f of type vlan for network 611bb21e-ca15-4598-a1f9-19f7a60b9189 Nov 24 14:44:04.127083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.166019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.170175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:04.170848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.174806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d488a7f-f257-4aaa-9ba5-500a4cb2bb55 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:04.271254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-d8d50ad3-641a-4e3f-869b-cff474be3ebe', 'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe', 'tenant_id': 'f5d2cb6ed63a4f96a93512657aa5da65', 'fixed_ips': [{'subnet_id': 'f4367efc-645d-4509-b87b-5b3ccab8eaf3'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:04.272340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.280801 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2640147 Nov 24 14:44:04.281123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52246) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:04.287840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Network': ['ID=611bb21e-ca15-4598-a1f9-19f7a60b9189,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:04.289461 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Request body: {'subnet': {'network_id': '611bb21e-ca15-4598-a1f9-19f7a60b9189', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:04.292500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-afe340bd-73e6-4acf-b1a4-9b2be293cb5d tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:04.331735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 611bb21e-ca15-4598-a1f9-19f7a60b9189 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:04.402063 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:04.405901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Usage tracker for resource:subnet and tenant:f5d2cb6ed63a4f96a93512657aa5da65 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:04.408680 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Quota usage for subnet was recalculated. Used quota:2. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:04.415098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attempting to reserve 1 items for resource subnet. Total usage: 2; quota limit: 100; headroom:98 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:04.424932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Made reservation on behalf of f5d2cb6ed63a4f96a93512657aa5da65 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:04.533992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Allocated IP 2001:db8::2 (d8d50ad3-641a-4e3f-869b-cff474be3ebe/f4367efc-645d-4509-b87b-5b3ccab8eaf3/50152a0b-585a-4fa8-bd57-36468af9abda) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:04.634571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.748736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.760380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Transition to ACTIVE for port object 50152a0b-585a-4fa8-bd57-36468af9abda will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:04.779088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Transition to ACTIVE for port object 50152a0b-585a-4fa8-bd57-36468af9abda will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:04.784171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.789568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:04.852107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Network d8d50ad3-641a-4e3f-869b-cff474be3ebe is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:04.854251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.858048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ec703014-3162-4fab-b685-52e52a306e81 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:04.859501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:04.862111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:04.871728 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Pushing event updated for resources: {'Port': ['ID=50152a0b-585a-4fa8-bd57-36468af9abda,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:04.874325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:04.925311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event updated for resources: {'Subnet': ['ID=bcf71145-3fc9-4fb9-99d2-1e103e36b315,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:04.934436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:04.950460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Checking segment: {'id': 'f946af14-951a-4918-9446-d0b1bd94773f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': '611bb21e-ca15-4598-a1f9-19f7a60b9189'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:04.950817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network hostable DHCP agents. Network: 611bb21e-ca15-4598-a1f9-19f7a60b9189, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:04.962301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Attempting to bind port 50152a0b-585a-4fa8-bd57-36468af9abda on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:04.962674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Attempting to bind port 50152a0b-585a-4fa8-bd57-36468af9abda by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '2ff7f12d-c963-41ee-a3bf-4289bc9961b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:04.963036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Attempting to bind port 50152a0b-585a-4fa8-bd57-36468af9abda on network d8d50ad3-641a-4e3f-869b-cff474be3ebe {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:04.969296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:04.969714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Checking segment: {'id': '2ff7f12d-c963-41ee-a3bf-4289bc9961b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:04.970180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.970627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Bound using segment: {'id': '2ff7f12d-c963-41ee-a3bf-4289bc9961b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:04.971145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Bound port: 50152a0b-585a-4fa8-bd57-36468af9abda, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2ff7f12d-c963-41ee-a3bf-4289bc9961b4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': 'd8d50ad3-641a-4e3f-869b-cff474be3ebe'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:04.971594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.972999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Network 611bb21e-ca15-4598-a1f9-19f7a60b9189 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:04.982658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 611bb21e-ca15-4598-a1f9-19f7a60b9189) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:04.986549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:04.987134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:04.995854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d6d68f2-9074-4380-801d-d529b6aeb687 None None] Network 611bb21e-ca15-4598-a1f9-19f7a60b9189 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:05.009902 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-508983f1-9641-490c-90f5-66bb8bac08df tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7271063 Nov 24 14:44:05.012367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52250) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:05.151667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.166700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] For port 50152a0b-585a-4fa8-bd57-36468af9abda, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:05.187076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] For port 50152a0b-585a-4fa8-bd57-36468af9abda, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=50152a0b-585a-4fa8-bd57-36468af9abda,segment=NetworkSegment(2ff7f12d-c963-41ee-a3bf-4289bc9961b4),segment_id=2ff7f12d-c963-41ee-a3bf-4289bc9961b4)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:05.217292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.221486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.225203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:05.301670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.306229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7323014c-169c-4dac-8722-fc516aca7337 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:05.352439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Subnet': ['ID=bcf71145-3fc9-4fb9-99d2-1e103e36b315,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:05.355838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:05.363862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Pushing event updated for resources: {'Port': ['ID=50152a0b-585a-4fa8-bd57-36468af9abda,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:05.369476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:05.371895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56b14162-0811-4f29-9aa3-6adaae2ab6a2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-611bb21e-ca15-4598-a1f9-19f7a60b9189', 'network_id': '611bb21e-ca15-4598-a1f9-19f7a60b9189', 'tenant_id': 'f5d2cb6ed63a4f96a93512657aa5da65', 'fixed_ips': [{'subnet_id': 'bcf71145-3fc9-4fb9-99d2-1e103e36b315'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:05.372782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-56b14162-0811-4f29-9aa3-6adaae2ab6a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.457476 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.483017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17c75da2-3034-413f-b22f-c892c7fc7cd5 None None] Network 611bb21e-ca15-4598-a1f9-19f7a60b9189 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:05.493558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['611bb21e-ca15-4598-a1f9-19f7a60b9189']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:05.508117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f946af14-951a-4918-9446-d0b1bd94773f') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:05.508579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f946af14-951a-4918-9446-d0b1bd94773f') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:05.524722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.542421 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.551381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Releasing vlan 895 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:05.551684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:05.574012 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:05.663448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.667736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-eef0ab3d-ebe5-44b8-a4f5-5379354667b1 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:05.683316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.696428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Network': ['ID=611bb21e-ca15-4598-a1f9-19f7a60b9189,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:05.699019 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/611bb21e-ca15-4598-a1f9-19f7a60b9189 HTTP/1.1" status: 204 len: 168 time: 0.6856742 Nov 24 14:44:05.699944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-412e64a6-133e-4a29-8501-fb2271c29fbb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:05.702168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52254) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:05.746966 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ba76a02-ae1f-4713-be70-0a05fc81be37 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] GET failed (client error): The resource could not be found. Nov 24 14:44:05.747403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4ba76a02-ae1f-4713-be70-0a05fc81be37 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Synchronizing usage tracker for tenant:f5d2cb6ed63a4f96a93512657aa5da65 on resource:subnet {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:44:05.765394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4ba76a02-ae1f-4713-be70-0a05fc81be37 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Unset dirty status for tenant:f5d2cb6ed63a4f96a93512657aa5da65 on resource:subnet {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:44:05.766662 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4ba76a02-ae1f-4713-be70-0a05fc81be37 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "GET /v2.0/subnets/bcf71145-3fc9-4fb9-99d2-1e103e36b315 HTTP/1.1" status: 404 len: 337 time: 0.0633914 Nov 24 14:44:05.769415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52258) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:05.784259 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 50152a0b-585a-4fa8-bd57-36468af9abda up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:05.796295 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.pecan_wsgi.hooks.translation [None req-cd406ab9-1a94-449a-96c6-95e6f67ca0ae tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:05.796657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cd406ab9-1a94-449a-96c6-95e6f67ca0ae tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83525) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:05.798428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cd406ab9-1a94-449a-96c6-95e6f67ca0ae tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/611bb21e-ca15-4598-a1f9-19f7a60b9189 HTTP/1.1" status: 404 len: 339 time: 0.0279109 Nov 24 14:44:05.802275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52262) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:05.833004 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:44:05.853578 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-1f63472b-4ace-40e5-be67-65885e5d3cc3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:05.854020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1f63472b-4ace-40e5-be67-65885e5d3cc3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:05.855683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1f63472b-4ace-40e5-be67-65885e5d3cc3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/subnets/bcf71145-3fc9-4fb9-99d2-1e103e36b315 HTTP/1.1" status: 404 len: 337 time: 0.0523913 Nov 24 14:44:05.858253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 50152a0b-585a-4fa8-bd57-36468af9abda completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:05.858411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52266) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:05.885997 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-06ba7733-b14f-4653-b7e2-712765aef081 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:05.886486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-06ba7733-b14f-4653-b7e2-712765aef081 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:05.888156 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-06ba7733-b14f-4653-b7e2-712765aef081 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/611bb21e-ca15-4598-a1f9-19f7a60b9189 HTTP/1.1" status: 404 len: 339 time: 0.0288174 Nov 24 14:44:05.890816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52270) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:05.893505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e79ec7ad-9a3c-477a-b68e-530bf76454e9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:05.955494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Deleting subnet f4367efc-645d-4509-b87b-5b3ccab8eaf3 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:44:05.958467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.018247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.104624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.183713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.187685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-86e3f875-ee61-49cc-b637-790f43c5797b tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:06.228673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Subnet': ['ID=f4367efc-645d-4509-b87b-5b3ccab8eaf3,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:06.232227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:06.235508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.250679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/subnets/f4367efc-645d-4509-b87b-5b3ccab8eaf3 HTTP/1.1" status: 204 len: 168 time: 0.3584719 Nov 24 14:44:06.253029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52274) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:06.332210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-535ac645-5170-4d58-85b5-e92d8379a37a None None] Network d8d50ad3-641a-4e3f-869b-cff474be3ebe requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:06.469245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.481476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Deleting port 50152a0b-585a-4fa8-bd57-36468af9abda {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:06.481817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.513669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Provisioning for port 50152a0b-585a-4fa8-bd57-36468af9abda completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:06.554739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Provisioning complete for port 50152a0b-585a-4fa8-bd57-36468af9abda triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:06.555041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.691579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] For port 50152a0b-585a-4fa8-bd57-36468af9abda, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=50152a0b-585a-4fa8-bd57-36468af9abda,segment=NetworkSegment(2ff7f12d-c963-41ee-a3bf-4289bc9961b4),segment_id=2ff7f12d-c963-41ee-a3bf-4289bc9961b4)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:06.691954 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.696791 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.720667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] DHCP port deletion for d8d50ad3-641a-4e3f-869b-cff474be3ebe request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:44:06.730693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Deleting port 50152a0b-585a-4fa8-bd57-36468af9abda {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:06.731069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.771008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] For port 50152a0b-585a-4fa8-bd57-36468af9abda, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=50152a0b-585a-4fa8-bd57-36468af9abda,segment=NetworkSegment(2ff7f12d-c963-41ee-a3bf-4289bc9961b4),segment_id=2ff7f12d-c963-41ee-a3bf-4289bc9961b4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:06.778688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:06.786369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:06.818332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Calling delete_port for 50152a0b-585a-4fa8-bd57-36468af9abda owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:06.892617 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:44:06.893043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:44:06.927663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Pushing event updated for resources: {'Port': ['ID=50152a0b-585a-4fa8-bd57-36468af9abda,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:06.933586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:06.992103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.011247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] For port 50152a0b-585a-4fa8-bd57-36468af9abda, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=50152a0b-585a-4fa8-bd57-36468af9abda,segment=NetworkSegment(2ff7f12d-c963-41ee-a3bf-4289bc9961b4),segment_id=2ff7f12d-c963-41ee-a3bf-4289bc9961b4)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:07.011639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.134099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Calling delete_port for 50152a0b-585a-4fa8-bd57-36468af9abda owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:07.213417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.217444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:07.258963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Pushing event deleted for resources: {'Port': ['ID=50152a0b-585a-4fa8-bd57-36468af9abda,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:07.261330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:07.264570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] No DVR routers for this DVR port 50152a0b-585a-4fa8-bd57-36468af9abda on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:44:07.394314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Deleting port 50152a0b-585a-4fa8-bd57-36468af9abda {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:07.394581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.461252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] The port '50152a0b-585a-4fa8-bd57-36468af9abda' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:44:07.579734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.604439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8d50ad3-641a-4e3f-869b-cff474be3ebe']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:07.616112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ff7f12d-c963-41ee-a3bf-4289bc9961b4') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:07.617601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ff7f12d-c963-41ee-a3bf-4289bc9961b4') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:07.628601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.647223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.654222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Releasing vlan 880 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:07.654604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:07.670369 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:07.752819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.756441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-66021cc3-a26f-43cf-a7b0-0e35ec3f1b58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:07.762994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 50152a0b-585a-4fa8-bd57-36468af9abda no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:44:07.770754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:07.782630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Network': ['ID=d8d50ad3-641a-4e3f-869b-cff474be3ebe,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:07.785296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:07.786995 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b5eb63bf-8ce7-48eb-8201-f0ec3eee2bcb tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/d8d50ad3-641a-4e3f-869b-cff474be3ebe HTTP/1.1" status: 204 len: 168 time: 1.5330026 Nov 24 14:44:07.790217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52278) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:07.800885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 50152a0b-585a-4fa8-bd57-36468af9abda {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:44:07.801487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 50152a0b-585a-4fa8-bd57-36468af9abda not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:44:07.827618 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-34e2b895-6c44-4944-9390-f4d85f7dc347 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:07.828199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-34e2b895-6c44-4944-9390-f4d85f7dc347 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:07.829676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-34e2b895-6c44-4944-9390-f4d85f7dc347 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/subnets/631b819c-908e-4d45-9ba9-82741e6a3a9e HTTP/1.1" status: 404 len: 337 time: 0.0385430 Nov 24 14:44:07.832276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52282) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:07.857805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c85f1fe-cf28-4d44-b4de-4c1128b6fae8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:07.858221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c85f1fe-cf28-4d44-b4de-4c1128b6fae8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:07.859725 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5c85f1fe-cf28-4d44-b4de-4c1128b6fae8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/3139dba5-db17-4034-94ab-f57f1251a236 HTTP/1.1" status: 404 len: 339 time: 0.0265958 Nov 24 14:44:07.862051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52286) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:07.902870 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8427c2f-0f71-4714-b2d7-cc1f509b3450 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:07.903238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a8427c2f-0f71-4714-b2d7-cc1f509b3450 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:07.904885 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a8427c2f-0f71-4714-b2d7-cc1f509b3450 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/subnets/d5fe8094-78ea-4142-bfe5-719d1416b399 HTTP/1.1" status: 404 len: 337 time: 0.0419905 Nov 24 14:44:07.907333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52290) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:07.932261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.pecan_wsgi.hooks.translation [None req-1ff5a364-f9ba-4eb8-b08c-2513089a1754 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] DELETE failed (client error): The resource could not be found. Nov 24 14:44:07.932688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1ff5a364-f9ba-4eb8-b08c-2513089a1754 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=83526) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Nov 24 14:44:07.934273 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1ff5a364-f9ba-4eb8-b08c-2513089a1754 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/55d9ad11-3982-4eee-bafc-c89d62a0973b HTTP/1.1" status: 404 len: 339 time: 0.0260475 Nov 24 14:44:07.936724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52294) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:08.122063 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Deleting subnet 745e25e3-4828-4cf5-9795-cd90ba11b7d6 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:44:08.124879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.182361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.270934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.350102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.355149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4a1116bd-b9aa-4024-a071-7fab60b49200 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:08.393054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Subnet': ['ID=745e25e3-4828-4cf5-9795-cd90ba11b7d6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:08.395784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:08.398901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.405467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-50145bbd-976e-4726-bfaa-b6ff8857cfb4 None None] Network 536b40ff-83d6-49fc-961e-00229ccbad79 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:08.414611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/subnets/745e25e3-4828-4cf5-9795-cd90ba11b7d6 HTTP/1.1" status: 204 len: 168 time: 0.4762497 Nov 24 14:44:08.416478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52298) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:08.626251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.633319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.644234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Deleting port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:08.644234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.670915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] DHCP port deletion for 536b40ff-83d6-49fc-961e-00229ccbad79 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:44:08.674820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Deleting port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:08.675198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.846061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] For port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,segment=NetworkSegment(ef0d9a4f-61af-4373-9c49-5f7afab8c0ba),segment_id=ef0d9a4f-61af-4373-9c49-5f7afab8c0ba)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:08.846808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.877373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] For port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,segment=NetworkSegment(ef0d9a4f-61af-4373-9c49-5f7afab8c0ba),segment_id=ef0d9a4f-61af-4373-9c49-5f7afab8c0ba)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:08.877974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:08.974857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Calling delete_port for b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:09.000068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Calling delete_port for b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:09.048188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.052597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dab72a86-f0e9-482c-8e2f-fcc42381fd03 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:09.074095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:44:09.074462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:44:09.093858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Port': ['ID=b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:09.096402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:09.099392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] No DVR routers for this DVR port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:44:09.228078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.252932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['536b40ff-83d6-49fc-961e-00229ccbad79']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:09.264930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:09.265220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ef0d9a4f-61af-4373-9c49-5f7afab8c0ba') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:09.277242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.293444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.299558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Releasing vlan 867 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:09.299968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:09.313790 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:09.393174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.396985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9fdf59d5-66f8-4301-b960-103c379e24c1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:09.414417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.422624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Pushing event deleted for resources: {'Network': ['ID=536b40ff-83d6-49fc-961e-00229ccbad79,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:09.426075 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:09.427838 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] 10.222.0.70 "DELETE /v2.0/networks/536b40ff-83d6-49fc-961e-00229ccbad79 HTTP/1.1" status: 204 len: 168 time: 1.0104294 Nov 24 14:44:09.576111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Deleting port b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:09.576663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:09.684487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b900a7a1-d202-4c82-86a3-ee49cb7029e9 None None] The port 'b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:44:09.761524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:44:09.780405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52306) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:09.797071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:44:09.797428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device b4bf63dc-17bc-4f6b-8ebe-5a3062a2d4f8 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:44:09.963408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b7a14483-cbe6-43e3-b654-ae7b57c5ff05 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=f5d2cb6ed63a4f96a93512657aa5da65&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1814868 Nov 24 14:44:09.965608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52312) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:10.027843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:10.054257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:10.104137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:10.107726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5baec619-3cae-46c7-8120-0881a448c478 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:10.122212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=293720d4-f8e5-4218-9738-97b964845f30,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:10.125989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:10.129179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:10.130264 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/293720d4-f8e5-4218-9738-97b964845f30 HTTP/1.1" status: 204 len: 168 time: 0.1637402 Nov 24 14:44:10.966808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52334) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:11.094364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-1939363887', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:11.102206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:11.107532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Usage tracker for resource:router and tenant:e8578c92cc4f4f58aef7272a8ae38d15 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:11.110667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:11.118851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:11.128770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.129752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.150058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.169670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.190166 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.191308 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a5ad505a-f53d-47b0-92f7-b92a96113f0a tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.2235162 Nov 24 14:44:11.194096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52340) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:11.199418 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1762848247'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:11.204353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:11.208106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Usage tracker for resource:network and tenant:e8578c92cc4f4f58aef7272a8ae38d15 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:11.211696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:11.217540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:11.227177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Made reservation on behalf of e8578c92cc4f4f58aef7272a8ae38d15 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:11.230066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.243140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.276064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:11.279927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Usage tracker for resource:security_group_rule and tenant:e8578c92cc4f4f58aef7272a8ae38d15 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:11.282771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:11.288975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:11.354967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.359244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.364152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fe9c164b-118a-47b1-8ce1-c09d4e50c9d0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:11.391612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 872} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:11.404819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f3900356-45e2-4704-bbb5-13ba7945701d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:11.408420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:11.410793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.411128 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Added segment 0efcf436-6769-41cc-8003-bb53b8df02a5 of type vlan for network fb0ed78d-af1c-4e16-87fe-a99882598847 Nov 24 14:44:11.438658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.468494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.472079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:11.472646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:11.478574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:11.586068 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.3898506 Nov 24 14:44:11.587301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event updated for resources: {'Network': ['ID=fb0ed78d-af1c-4e16-87fe-a99882598847,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:11.588669 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52344) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:11.590416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:11.594794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Request body: {'subnet': {'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:11.598538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network fb0ed78d-af1c-4e16-87fe-a99882598847 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:11.711934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:11.715685 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Usage tracker for resource:subnet and tenant:e8578c92cc4f4f58aef7272a8ae38d15 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:11.718453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:11.724111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:11.734260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Made reservation on behalf of e8578c92cc4f4f58aef7272a8ae38d15 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:11.839668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.051492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.055710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4095a365-20fc-4662-9f8b-04ac62b5c000 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:12.233423 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event updated for resources: {'Subnet': ['ID=d9901269-60eb-4d21-afdf-c4a2bc5f450c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:12.237641 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:12.245748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Checking segment: {'id': '0efcf436-6769-41cc-8003-bb53b8df02a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:12.246097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Network hostable DHCP agents. Network: fb0ed78d-af1c-4e16-87fe-a99882598847, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:12.269071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Network fb0ed78d-af1c-4e16-87fe-a99882598847 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:12.280352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, fb0ed78d-af1c-4e16-87fe-a99882598847) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:12.285309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:12.285796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.289697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09fdfc67-1871-4fcc-ba36-4df60a82e0bf None None] Network fb0ed78d-af1c-4e16-87fe-a99882598847 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:12.309281 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-612f5e11-2fe2-4942-a13d-f340f10933f5 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7192194 Nov 24 14:44:12.312735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52348) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:12.318940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-2128244189'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:12.324824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:12.328655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Usage tracker for resource:network and tenant:e8578c92cc4f4f58aef7272a8ae38d15 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:12.331544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Quota usage for network was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:12.338678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:12.349299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Made reservation on behalf of e8578c92cc4f4f58aef7272a8ae38d15 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:12.353347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.385475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:12.394822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.395164 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Added segment 5f99800d-0feb-4106-a679-82a8909cc8b3 of type vlan for network e3338b4f-8686-4a4a-9e54-2b08ab262c8c Nov 24 14:44:12.422187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.451675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.455670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:12.456328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.462739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0b6cc432-eed3-45dc-977f-418ca40630cd tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:12.509962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-fb0ed78d-af1c-4e16-87fe-a99882598847', 'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847', 'tenant_id': 'e8578c92cc4f4f58aef7272a8ae38d15', 'fixed_ips': [{'subnet_id': 'd9901269-60eb-4d21-afdf-c4a2bc5f450c'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:12.511012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.549389 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.2328262 Nov 24 14:44:12.549723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52352) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:12.556067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Request body: {'subnet': {'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:12.576335 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event updated for resources: {'Network': ['ID=e3338b4f-8686-4a4a-9e54-2b08ab262c8c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:12.578824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:12.588531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network e3338b4f-8686-4a4a-9e54-2b08ab262c8c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:12.679322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:12.683862 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Usage tracker for resource:subnet and tenant:e8578c92cc4f4f58aef7272a8ae38d15 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:12.686763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Quota usage for subnet was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:12.692636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:12.701657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Made reservation on behalf of e8578c92cc4f4f58aef7272a8ae38d15 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:12.761503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Allocated IP 172.20.0.2 (fb0ed78d-af1c-4e16-87fe-a99882598847/d9901269-60eb-4d21-afdf-c4a2bc5f450c/99c0d58b-4357-4a20-a0da-320239333b25) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:12.799767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.963100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:12.974155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Transition to ACTIVE for port object 99c0d58b-4357-4a20-a0da-320239333b25 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:12.994182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Transition to ACTIVE for port object 99c0d58b-4357-4a20-a0da-320239333b25 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:12.999897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.004045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:13.027564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.031960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d9d4b3aa-cdeb-4462-8225-2956e4fa44e7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:13.066412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Network fb0ed78d-af1c-4e16-87fe-a99882598847 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:13.073753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:13.076208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:13.087239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Pushing event updated for resources: {'Port': ['ID=99c0d58b-4357-4a20-a0da-320239333b25,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:13.090374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:13.106131 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event updated for resources: {'Subnet': ['ID=b1b5a5be-8549-4ae9-85c1-bdb649eda61b,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:13.109931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:13.118217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Checking segment: {'id': '5f99800d-0feb-4106-a679-82a8909cc8b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:13.118566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Network hostable DHCP agents. Network: e3338b4f-8686-4a4a-9e54-2b08ab262c8c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:13.140139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Network e3338b4f-8686-4a4a-9e54-2b08ab262c8c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:13.150719 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, e3338b4f-8686-4a4a-9e54-2b08ab262c8c) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:13.155226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:13.156116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.169261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0609ca79-a711-4b3a-9b52-5c8b53c12803 None None] Network e3338b4f-8686-4a4a-9e54-2b08ab262c8c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:13.180677 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d40fa7a0-ed32-49c6-adeb-df529ef3ed14 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6297545 Nov 24 14:44:13.183263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52356) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:13.189808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-3359b10e-11f6-42d0-af0b-60700848148c tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Request body: {'router': {'external_gateway_info': {'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:13.201355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Attempting to bind port 99c0d58b-4357-4a20-a0da-320239333b25 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:13.201724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Attempting to bind port 99c0d58b-4357-4a20-a0da-320239333b25 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '0efcf436-6769-41cc-8003-bb53b8df02a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:13.202085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Attempting to bind port 99c0d58b-4357-4a20-a0da-320239333b25 on network fb0ed78d-af1c-4e16-87fe-a99882598847 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:13.256762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:13.257082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Checking segment: {'id': '0efcf436-6769-41cc-8003-bb53b8df02a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:13.257446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.257839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Bound using segment: {'id': '0efcf436-6769-41cc-8003-bb53b8df02a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:13.258370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Bound port: 99c0d58b-4357-4a20-a0da-320239333b25, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0efcf436-6769-41cc-8003-bb53b8df02a5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 872, 'network_id': 'fb0ed78d-af1c-4e16-87fe-a99882598847'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:13.258748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.437704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] For port 99c0d58b-4357-4a20-a0da-320239333b25, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:13.477651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] For port 99c0d58b-4357-4a20-a0da-320239333b25, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=99c0d58b-4357-4a20-a0da-320239333b25,segment=NetworkSegment(0efcf436-6769-41cc-8003-bb53b8df02a5),segment_id=0efcf436-6769-41cc-8003-bb53b8df02a5)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:13.482823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.495587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:13.521454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-e3338b4f-8686-4a4a-9e54-2b08ab262c8c', 'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c', 'tenant_id': 'e8578c92cc4f4f58aef7272a8ae38d15', 'fixed_ips': [{'subnet_id': 'b1b5a5be-8549-4ae9-85c1-bdb649eda61b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:13.522279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.617012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3359b10e-11f6-42d0-af0b-60700848148c tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:13.645062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Pushing event updated for resources: {'Port': ['ID=99c0d58b-4357-4a20-a0da-320239333b25,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:13.651924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:13.794717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Allocated IP 172.21.0.2 (e3338b4f-8686-4a4a-9e54-2b08ab262c8c/b1b5a5be-8549-4ae9-85c1-bdb649eda61b/08536489-2452-4064-9737-932781864151) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:13.811385 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.api.v2.resource [None req-3359b10e-11f6-42d0-af0b-60700848148c tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Nov 24 14:44:13.829308 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3359b10e-11f6-42d0-af0b-60700848148c tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "PUT /v2.0/routers/bcb25638-59ff-4e73-a333-67e296d4bcf3 HTTP/1.1" status: 400 len: 364 time: 0.6282296 Nov 24 14:44:13.829308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52360) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:13.941748 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Deleting subnet b1b5a5be-8549-4ae9-85c1-bdb649eda61b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:44:14.081145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.094638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Transition to ACTIVE for port object 08536489-2452-4064-9737-932781864151 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:14.118670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Transition to ACTIVE for port object 08536489-2452-4064-9737-932781864151 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:14.124676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.125167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.133855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:14.201745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.221664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Network e3338b4f-8686-4a4a-9e54-2b08ab262c8c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:14.234874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:14.236742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:14.250644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Pushing event updated for resources: {'Port': ['ID=08536489-2452-4064-9737-932781864151,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:14.254986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:14.310579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.378099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Attempting to bind port 08536489-2452-4064-9737-932781864151 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:14.379455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Attempting to bind port 08536489-2452-4064-9737-932781864151 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '5f99800d-0feb-4106-a679-82a8909cc8b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:14.380379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Attempting to bind port 08536489-2452-4064-9737-932781864151 on network e3338b4f-8686-4a4a-9e54-2b08ab262c8c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:14.389430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:14.390341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Checking segment: {'id': '5f99800d-0feb-4106-a679-82a8909cc8b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:14.391145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.393814 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Bound using segment: {'id': '5f99800d-0feb-4106-a679-82a8909cc8b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:14.394575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Bound port: 08536489-2452-4064-9737-932781864151, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5f99800d-0feb-4106-a679-82a8909cc8b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'e3338b4f-8686-4a4a-9e54-2b08ab262c8c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:14.395158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.411397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.417940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2ee3c635-75d7-4753-b535-6344c2072b55 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:14.464447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event deleted for resources: {'Subnet': ['ID=b1b5a5be-8549-4ae9-85c1-bdb649eda61b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:14.469477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:14.479818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.487664 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "DELETE /v2.0/subnets/b1b5a5be-8549-4ae9-85c1-bdb649eda61b HTTP/1.1" status: 204 len: 168 time: 0.6621156 Nov 24 14:44:14.490214 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52364) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:14.532253 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] For port 08536489-2452-4064-9737-932781864151, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:14.537634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] For port 08536489-2452-4064-9737-932781864151, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=08536489-2452-4064-9737-932781864151,segment=NetworkSegment(5f99800d-0feb-4106-a679-82a8909cc8b3),segment_id=5f99800d-0feb-4106-a679-82a8909cc8b3)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:14.543157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.554749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:14.645873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Pushing event updated for resources: {'Port': ['ID=08536489-2452-4064-9737-932781864151,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:14.649695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:14.746043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.748279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7665381-e3f4-48dc-b0aa-4f4916a4ef8a None None] Network e3338b4f-8686-4a4a-9e54-2b08ab262c8c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:14.766910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Deleting port 08536489-2452-4064-9737-932781864151 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:14.767542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:14.829829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfc3ffea-7b9d-4c30-ae60-099e123d1d76 None None] Network fb0ed78d-af1c-4e16-87fe-a99882598847 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:14.975999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] For port 08536489-2452-4064-9737-932781864151, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=08536489-2452-4064-9737-932781864151,segment=NetworkSegment(5f99800d-0feb-4106-a679-82a8909cc8b3),segment_id=5f99800d-0feb-4106-a679-82a8909cc8b3)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:14.976790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.026152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e8969b19-0b9c-49f3-a099-85d9f794ee12 None None] Provisioning for port 99c0d58b-4357-4a20-a0da-320239333b25 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:15.107811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Calling delete_port for 08536489-2452-4064-9737-932781864151 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:15.191459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.198187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e97b890-aba4-4758-bb28-fed5f9ee784c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:15.240692 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event deleted for resources: {'Port': ['ID=08536489-2452-4064-9737-932781864151,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:15.247749 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] No DVR routers for this DVR port 08536489-2452-4064-9737-932781864151 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:44:15.301867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.302245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.302612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.302980 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.303913 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.304635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.305000 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.305360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.305717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.306070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.306420 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:15.311961 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:15.389118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.399033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-009b90aa-0d00-464a-9d8d-c3dfd473e80f None None] get_active_networks_info from dv-neutron-818151-2-hyperv {{(pid=83527) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:142}} Nov 24 14:44:15.418243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3338b4f-8686-4a4a-9e54-2b08ab262c8c']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:15.436242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5f99800d-0feb-4106-a679-82a8909cc8b3') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:15.436470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5f99800d-0feb-4106-a679-82a8909cc8b3') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:15.450896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.471986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.478098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Releasing vlan 854 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:15.478480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:15.493540 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:15.499745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-009b90aa-0d00-464a-9d8d-c3dfd473e80f None None] Resources bound (agent type, host, resource id): {{(pid=83527) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Nov 24 14:44:15.576860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.580153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1ac6ecf3-0163-463b-9ebf-e30ebb396bab tempest-NetworksTest-884938551 tempest-NetworksTest-884938551-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:15.597284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.608246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event deleted for resources: {'Network': ['ID=e3338b4f-8686-4a4a-9e54-2b08ab262c8c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:15.612510 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:15.615180 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "DELETE /v2.0/networks/e3338b4f-8686-4a4a-9e54-2b08ab262c8c HTTP/1.1" status: 204 len: 168 time: 1.1239319 Nov 24 14:44:15.618797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52368) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:15.685081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Deleting subnet d9901269-60eb-4d21-afdf-c4a2bc5f450c {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:44:15.688116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.750814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.811898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 99c0d58b-4357-4a20-a0da-320239333b25 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:15.852826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.884598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 99c0d58b-4357-4a20-a0da-320239333b25 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:15.890435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 99c0d58b-4357-4a20-a0da-320239333b25 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:15.891145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.926994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.932718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ea2400ad-d44a-4f0c-88c8-1012cec079c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:15.969013 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event deleted for resources: {'Subnet': ['ID=d9901269-60eb-4d21-afdf-c4a2bc5f450c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:15.971465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:15.974154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:15.981001 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "DELETE /v2.0/subnets/d9901269-60eb-4d21-afdf-c4a2bc5f450c HTTP/1.1" status: 204 len: 168 time: 0.3612165 Nov 24 14:44:15.983657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52372) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:15.994627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adfd0cf0-6d11-4d3f-839c-a21a3b1bf691 None None] Network fb0ed78d-af1c-4e16-87fe-a99882598847 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:16.102068 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.112988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Deleting port 99c0d58b-4357-4a20-a0da-320239333b25 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:16.113313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.153710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.251807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 99c0d58b-4357-4a20-a0da-320239333b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=99c0d58b-4357-4a20-a0da-320239333b25,segment=NetworkSegment(0efcf436-6769-41cc-8003-bb53b8df02a5),segment_id=0efcf436-6769-41cc-8003-bb53b8df02a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:16.256968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.259038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-b052082b-37b6-4a49-8bdb-dcd0aeec1da7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:16.330560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] For port 99c0d58b-4357-4a20-a0da-320239333b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=99c0d58b-4357-4a20-a0da-320239333b25,segment=NetworkSegment(0efcf436-6769-41cc-8003-bb53b8df02a5),segment_id=0efcf436-6769-41cc-8003-bb53b8df02a5)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:16.330929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.338196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=99c0d58b-4357-4a20-a0da-320239333b25,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:16.340990 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:16.407030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] DHCP port deletion for fb0ed78d-af1c-4e16-87fe-a99882598847 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:44:16.411341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Deleting port 99c0d58b-4357-4a20-a0da-320239333b25 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:16.411739 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.454678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Calling delete_port for 99c0d58b-4357-4a20-a0da-320239333b25 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:16.625714 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] For port 99c0d58b-4357-4a20-a0da-320239333b25, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=99c0d58b-4357-4a20-a0da-320239333b25,segment=NetworkSegment(0efcf436-6769-41cc-8003-bb53b8df02a5),segment_id=0efcf436-6769-41cc-8003-bb53b8df02a5)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:16.626069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.641512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:44:16.641831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:44:16.743777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Calling delete_port for 99c0d58b-4357-4a20-a0da-320239333b25 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:44:16.821829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:16.826178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-7dfa9859-d265-4929-b92e-5e10563554db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:16.874175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Pushing event deleted for resources: {'Port': ['ID=99c0d58b-4357-4a20-a0da-320239333b25,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:16.876593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:16.879638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] No DVR routers for this DVR port 99c0d58b-4357-4a20-a0da-320239333b25 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:44:17.143357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Deleting port 99c0d58b-4357-4a20-a0da-320239333b25 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:44:17.143975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.206880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] The port '99c0d58b-4357-4a20-a0da-320239333b25' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:44:17.326596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.357146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb0ed78d-af1c-4e16-87fe-a99882598847']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:17.369618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0efcf436-6769-41cc-8003-bb53b8df02a5') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:17.369902 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0efcf436-6769-41cc-8003-bb53b8df02a5') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:17.380769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.398389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.404458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Releasing vlan 872 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:44:17.405087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:44:17.419682 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:44:17.503560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.507397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ef1b5002-b5ef-4f09-a46b-8546471779cf tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:17.521373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.532106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Pushing event deleted for resources: {'Network': ['ID=fb0ed78d-af1c-4e16-87fe-a99882598847,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:17.534880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:17.536605 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9eefdaba-1147-4d1f-9dcc-48625fced7ea tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "DELETE /v2.0/networks/fb0ed78d-af1c-4e16-87fe-a99882598847 HTTP/1.1" status: 204 len: 168 time: 1.5520229 Nov 24 14:44:17.540119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52376) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:17.580937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b72dca0f-b2f0-403b-8ed3-63eaa3d98ea9 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Synchronizing usage tracker for tenant:e8578c92cc4f4f58aef7272a8ae38d15 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:44:17.596805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b72dca0f-b2f0-403b-8ed3-63eaa3d98ea9 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Unset dirty status for tenant:e8578c92cc4f4f58aef7272a8ae38d15 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:44:17.597917 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b72dca0f-b2f0-403b-8ed3-63eaa3d98ea9 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "GET /v2.0/ports?device_id=bcb25638-59ff-4e73-a333-67e296d4bcf3 HTTP/1.1" status: 200 len: 205 time: 0.0569060 Nov 24 14:44:17.600846 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52380) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:17.737367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:17.764964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 99c0d58b-4357-4a20-a0da-320239333b25 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:44:17.798831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 99c0d58b-4357-4a20-a0da-320239333b25 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:44:17.799266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 99c0d58b-4357-4a20-a0da-320239333b25 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:44:18.115113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.119272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.146860 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.148250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Fanout notify agent at l3_agent the message router_deleted on router bcb25638-59ff-4e73-a333-67e296d4bcf3 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:44:18.159386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.160582 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-899b21f1-8c7c-445a-9b64-09a41d9de1b6 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] 10.222.0.70 "DELETE /v2.0/routers/bcb25638-59ff-4e73-a333-67e296d4bcf3 HTTP/1.1" status: 204 len: 168 time: 0.5590265 Nov 24 14:44:18.206396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.448498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52388) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:18.622890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a13eff90-86cb-45b4-9c40-876a5897c08d admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=e8578c92cc4f4f58aef7272a8ae38d15&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1731603 Nov 24 14:44:18.625230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52394) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:18.682959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.707709 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.757284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.761137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a9fd718-c0ba-4d63-93e1-8a41f5e0b88f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:18.775167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3900356-45e2-4704-bbb5-13ba7945701d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:18.777972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:18.778818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:18.780048 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7a174fe4-977c-4110-8bf7-364a4b7d5bde admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/f3900356-45e2-4704-bbb5-13ba7945701d HTTP/1.1" status: 204 len: 168 time: 0.1538019 Nov 24 14:44:19.553825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52416) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:19.686900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-1756450006-network', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:19.691684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:19.696149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Usage tracker for resource:network and tenant:b85fa4ff0d164878b496c6b317d23fb8 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:19.698927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:19.705399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:19.716480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Made reservation on behalf of b85fa4ff0d164878b496c6b317d23fb8 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:19.718723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.731255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.765733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:19.769544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Usage tracker for resource:security_group_rule and tenant:b85fa4ff0d164878b496c6b317d23fb8 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:19.772726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:19.778272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:19.844106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.847854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.850677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ef09ba54-bcd1-4d15-a47a-320db294ed27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:19.880622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:19.886789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83db1899-702a-41eb-9bba-7f60d56b1bd4,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:19.890829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:19.895582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.895996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Added segment 34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e of type vlan for network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d Nov 24 14:44:19.923161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.953360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.954247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:19.954845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:19.959820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-466d3b48-a92f-41d6-a49b-91dac4c05a41 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:20.163289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Pushing event updated for resources: {'Network': ['ID=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:20.166351 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.6115246 Nov 24 14:44:20.167258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:20.169286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52422) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:20.173607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:20.174876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Request body: {'subnet': {'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-subnet', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:20.180792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:20.184681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Usage tracker for resource:subnet and tenant:b85fa4ff0d164878b496c6b317d23fb8 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:20.187503 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:20.193146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:20.203704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Made reservation on behalf of b85fa4ff0d164878b496c6b317d23fb8 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:20.206159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.410628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.415893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-17d3c485-1032-43d3-879e-8cb38ff4c737 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:20.489098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3e130406-a9f4-437f-8490-02c95f468a7f,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:20.492318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:20.499100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Checking segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:20.499449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Network hostable DHCP agents. Network: 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:20.520771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:20.531068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:20.534930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:20.535499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.543972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47f7d725-c143-4834-96ef-b89c507c3e0b None None] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:20.557856 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.3875086 Nov 24 14:44:20.560885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52426) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:20.566092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:20.570905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:20.574857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Usage tracker for resource:router and tenant:b85fa4ff0d164878b496c6b317d23fb8 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:20.577879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:20.583800 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:20.596201 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.597241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.618888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.763664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.768307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'fixed_ips': [{'subnet_id': '3e130406-a9f4-437f-8490-02c95f468a7f'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:20.769137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:20.937684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Allocated IP 172.20.0.2 (93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d/3e130406-a9f4-437f-8490-02c95f468a7f/027264b0-a2e5-4760-b488-26d4d4157388) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:21.081254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.112714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.195984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.206963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Transition to ACTIVE for port object 027264b0-a2e5-4760-b488-26d4d4157388 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:21.229741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Transition to ACTIVE for port object 027264b0-a2e5-4760-b488-26d4d4157388 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:21.236374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.241439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:21.255594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Allocated IP 172.26.4.102 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/07284ba8-7824-4b53-98a9-693c23b49c7d) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:21.319588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:21.323307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:21.325450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Pushing event updated for resources: {'Port': ['ID=027264b0-a2e5-4760-b488-26d4d4157388,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:21.327867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:21.330337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:21.405176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.426809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Attempting to bind port 027264b0-a2e5-4760-b488-26d4d4157388 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:21.427219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Attempting to bind port 027264b0-a2e5-4760-b488-26d4d4157388 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:21.427592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Attempting to bind port 027264b0-a2e5-4760-b488-26d4d4157388 on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:21.434130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.434507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:21.434913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Checking segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:21.435320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.435720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Bound using segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:21.436228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Bound port: 027264b0-a2e5-4760-b488-26d4d4157388, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:21.436587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.437818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8f9e9f46-fe4f-4c9f-bba1-2c09289305ba service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:21.507539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:21.510926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:21.513658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:21.526234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] For port 027264b0-a2e5-4760-b488-26d4d4157388, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:21.529703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] For port 027264b0-a2e5-4760-b488-26d4d4157388, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=027264b0-a2e5-4760-b488-26d4d4157388,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:21.534541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.540411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:21.554497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Pushing event updated for resources: {'Port': ['ID=07284ba8-7824-4b53-98a9-693c23b49c7d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:21.557843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:21.618943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Pushing event updated for resources: {'Port': ['ID=027264b0-a2e5-4760-b488-26d4d4157388,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:21.621584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:21.693231 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.694681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:21.945790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Router b479e2f5-594d-4f24-ba12-91af63a8335b is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:44:22.144543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:44:22.153021 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Sync routers for ids ['b479e2f5-594d-4f24-ba12-91af63a8335b'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:44:22.165305 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Routers {'b479e2f5-594d-4f24-ba12-91af63a8335b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:22.165913 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b479e2f5-594d-4f24-ba12-91af63a8335b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:22.169043 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:22.170576 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 1.6086311 Nov 24 14:44:22.173285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52430) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:22.362862 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Set router b479e2f5-594d-4f24-ba12-91af63a8335b gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:22.567858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37f3753e-42a8-46cb-b354-8b56a0e58e54 None None] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:22.667135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-2670870e-3010-4cb9-a68a-b968dc8c02cb None None] Provisioning for port 027264b0-a2e5-4760-b488-26d4d4157388 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:22.690799 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:44:21Z', 'revision_number': 3, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:22.694775 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Checking router: b479e2f5-594d-4f24-ba12-91af63a8335b for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:44:22.695141 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Updating router b479e2f5-594d-4f24-ba12-91af63a8335b port 07284ba8-7824-4b53-98a9-693c23b49c7d binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:44:22.748095 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:22.973268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.098353 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.114823 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Transition to ACTIVE for port object 07284ba8-7824-4b53-98a9-693c23b49c7d will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:23.121398 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.125904 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:23.199114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Allocated IP 172.20.0.1 (93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d/3e130406-a9f4-437f-8490-02c95f468a7f/671c3ba5-e465-4f25-8825-ee0f65fb1feb) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:23.218834 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Attempting to bind port 07284ba8-7824-4b53-98a9-693c23b49c7d on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:23.219567 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Attempting to bind port 07284ba8-7824-4b53-98a9-693c23b49c7d by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:23.219567 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Attempting to bind port 07284ba8-7824-4b53-98a9-693c23b49c7d on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:23.226828 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Pushing event updated for resources: {'Port': ['ID=07284ba8-7824-4b53-98a9-693c23b49c7d,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:23.235944 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:23.236319 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:23.236720 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.237112 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:23.237565 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Bound port: 07284ba8-7824-4b53-98a9-693c23b49c7d, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:23.237944 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.264845 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.265204 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.265491 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.265821 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.266147 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.266467 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.266785 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.267107 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.267420 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.267731 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.268069 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:23.276371 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:23.317824 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] For port 07284ba8-7824-4b53-98a9-693c23b49c7d, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:23.321068 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] For port 07284ba8-7824-4b53-98a9-693c23b49c7d, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07284ba8-7824-4b53-98a9-693c23b49c7d,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:23.325621 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.329634 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-3688ca7f-e4b3-4483-a6cb-652dc15f0239 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:23.349249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.365324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Transition to ACTIVE for port object 671c3ba5-e465-4f25-8825-ee0f65fb1feb will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:23.389154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.393426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-717ea532-67d8-4d51-8804-46a9ac5aeb89 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:23.405838 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Pushing event updated for resources: {'Port': ['ID=07284ba8-7824-4b53-98a9-693c23b49c7d,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:23.409171 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:23.411461 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Routers {'b479e2f5-594d-4f24-ba12-91af63a8335b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:23.412086 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b479e2f5-594d-4f24-ba12-91af63a8335b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:23.457578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:23.461549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:23.466054 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:23.616121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Pushing event updated for resources: {'Port': ['ID=671c3ba5-e465-4f25-8825-ee0f65fb1feb,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:23.621574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:23.639407 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] Set router b479e2f5-594d-4f24-ba12-91af63a8335b gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:23.646519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.739628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.744068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-598e8cd3-1399-4dcf-a2fc-a4858280afa4 None None] Provisioning for port 671c3ba5-e465-4f25-8825-ee0f65fb1feb completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:23.752217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-598e8cd3-1399-4dcf-a2fc-a4858280afa4 None None] Provisioning complete for port 671c3ba5-e465-4f25-8825-ee0f65fb1feb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:23.752602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-598e8cd3-1399-4dcf-a2fc-a4858280afa4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.812562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-598e8cd3-1399-4dcf-a2fc-a4858280afa4 None None] Port 671c3ba5-e465-4f25-8825-ee0f65fb1feb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:44:23.830125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 027264b0-a2e5-4760-b488-26d4d4157388 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:23.905056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 027264b0-a2e5-4760-b488-26d4d4157388 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:23.909914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 027264b0-a2e5-4760-b488-26d4d4157388 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:23.910289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:23.969966 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:44:21Z', 'revision_number': 3, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:23.973895 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d025744-8ef3-409d-9f46-cc7ad03f562c None None] The sync data for ids ['b479e2f5-594d-4f24-ba12-91af63a8335b'] in dv-neutron-818151-2-hyperv is: [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:44:21Z', 'revision_number': 3, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:44:24.001361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:24.006672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:24.033623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:24.035440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d577bf66-b33b-4930-b908-5ac5880fac3e tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:24.066678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 027264b0-a2e5-4760-b488-26d4d4157388, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=027264b0-a2e5-4760-b488-26d4d4157388,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:24.072679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:24.074573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:24.120096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Pushing event updated for resources: {'Port': ['ID=671c3ba5-e465-4f25-8825-ee0f65fb1feb,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:24.122422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:24.126258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:24.149575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=027264b0-a2e5-4760-b488-26d4d4157388,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:24.175929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:24.274547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:24.276412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:24.540197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-51bffa5e-d6d6-471a-b890-8af50301310f None None] Provisioning complete for port 671c3ba5-e465-4f25-8825-ee0f65fb1feb triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:24.540495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-51bffa5e-d6d6-471a-b890-8af50301310f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:24.597413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-51bffa5e-d6d6-471a-b890-8af50301310f None None] Port 671c3ba5-e465-4f25-8825-ee0f65fb1feb cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:44:24.690484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Router b479e2f5-594d-4f24-ba12-91af63a8335b has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:44:24.891827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:44:24.901492 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] 10.222.0.70 "PUT /v2.0/routers/b479e2f5-594d-4f24-ba12-91af63a8335b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7268958 Nov 24 14:44:25.732393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52452) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:25.737850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-2000151461-network', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:25.745284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:25.748336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Usage tracker for resource:network and tenant:71c62dab02eb44cba2c69ffea7160ed1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:25.751358 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:25.757718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:25.770268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Made reservation on behalf of 71c62dab02eb44cba2c69ffea7160ed1 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:25.773120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:25.787545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:25.821500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:25.825293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Usage tracker for resource:security_group_rule and tenant:71c62dab02eb44cba2c69ffea7160ed1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:25.831726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:25.838384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:25.852661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07284ba8-7824-4b53-98a9-693c23b49c7d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:25.905818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:25.909778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:25.915610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e097f0e2-ef16-4eed-bc80-f66f0e576bb3 tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:25.926162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 07284ba8-7824-4b53-98a9-693c23b49c7d completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:25.932446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 07284ba8-7824-4b53-98a9-693c23b49c7d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:25.932830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:25.938516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 880} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:44:25.951610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ccd363a-cda1-4889-8e60-010c857eadd9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:25.955354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:25.956250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:25.956582 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Added segment 61294373-ef6c-4df2-a00e-96d805638406 of type vlan for network 1ce75103-bb5d-4b6b-a901-0619484cf902 Nov 24 14:44:25.983416 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.013649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.014532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:26.015098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.018359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ca0ca054-73a8-445c-b50d-a17dbeca7b1d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:26.055264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.073349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 07284ba8-7824-4b53-98a9-693c23b49c7d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07284ba8-7824-4b53-98a9-693c23b49c7d,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:26.077170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.078058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 027264b0-a2e5-4760-b488-26d4d4157388 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:26.105768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:26.121730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Pushing event updated for resources: {'Network': ['ID=1ce75103-bb5d-4b6b-a901-0619484cf902,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:26.125046 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.3915646 Nov 24 14:44:26.125864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c2a714ef-e85a-4097-9b9b-be5a4f29e94d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:26.127778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52456) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:26.133859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Request body: {'subnet': {'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-subnet', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:26.138705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:26.142539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Usage tracker for resource:subnet and tenant:71c62dab02eb44cba2c69ffea7160ed1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:26.145888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:26.152514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:26.155807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:44:26.163517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Made reservation on behalf of 71c62dab02eb44cba2c69ffea7160ed1 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:26.165839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.296873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=07284ba8-7824-4b53-98a9-693c23b49c7d,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:26.301766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:26.315307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 027264b0-a2e5-4760-b488-26d4d4157388 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:26.315683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.501665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.506285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c99b6402-fc50-44cd-a18e-e48f5a3221e4 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:26.576999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a5eab138-c8df-4223-8bfd-72c6da6a3af9,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:26.580660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:26.589831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Checking segment: {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:26.590296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Network hostable DHCP agents. Network: 1ce75103-bb5d-4b6b-a901-0619484cf902, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:44:26.612476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:44:26.622045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 1ce75103-bb5d-4b6b-a901-0619484cf902) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:26.627028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:26.628267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.630002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b57c82f3-2a87-4cfb-9644-f4d8fd11f20c None None] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:26.651054 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.5221348 Nov 24 14:44:26.653712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52460) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:26.659338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:26.665085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:26.669096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Usage tracker for resource:router and tenant:71c62dab02eb44cba2c69ffea7160ed1 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:44:26.672122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:44:26.678457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:26.689253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.690248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.708765 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.861324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:26.883487 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-1ce75103-bb5d-4b6b-a901-0619484cf902', 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'fixed_ips': [{'subnet_id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:44:26.884360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.045818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Allocated IP 172.20.0.2 (1ce75103-bb5d-4b6b-a901-0619484cf902/a5eab138-c8df-4223-8bfd-72c6da6a3af9/43206f1e-b98a-4a76-93af-d6b31c9521c8) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:27.062602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.097505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.259569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Allocated IP 172.26.4.148 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/c19676ca-f0bd-4a0c-81b9-9945aee03eab) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:27.264454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.276109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Transition to ACTIVE for port object 43206f1e-b98a-4a76-93af-d6b31c9521c8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:27.295547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Transition to ACTIVE for port object 43206f1e-b98a-4a76-93af-d6b31c9521c8 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:27.302605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.308156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:27.367847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:27.375948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:27.378590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:27.389609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Pushing event updated for resources: {'Port': ['ID=43206f1e-b98a-4a76-93af-d6b31c9521c8,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:27.392809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:27.427095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.458487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.462618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5a89c699-24a6-422d-92ae-c1ea9a422f1c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:27.482666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Sync routers for ids ['b479e2f5-594d-4f24-ba12-91af63a8335b'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:44:27.487798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Attempting to bind port 43206f1e-b98a-4a76-93af-d6b31c9521c8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:27.488169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Attempting to bind port 43206f1e-b98a-4a76-93af-d6b31c9521c8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:27.488566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Attempting to bind port 43206f1e-b98a-4a76-93af-d6b31c9521c8 on network 1ce75103-bb5d-4b6b-a901-0619484cf902 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:27.501219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:27.501593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Checking segment: {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:27.502019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.502423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Bound using segment: {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:27.502925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Bound port: 43206f1e-b98a-4a76-93af-d6b31c9521c8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:27.503314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.520213 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Routers {'b479e2f5-594d-4f24-ba12-91af63a8335b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:27.520853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b479e2f5-594d-4f24-ba12-91af63a8335b'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:27.535506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:27.539076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:27.543454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:27.567894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Pushing event updated for resources: {'Port': ['ID=c19676ca-f0bd-4a0c-81b9-9945aee03eab,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:27.574549 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:27.708790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.710355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.757349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] For port 43206f1e-b98a-4a76-93af-d6b31c9521c8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:27.772534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] For port 43206f1e-b98a-4a76-93af-d6b31c9521c8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=43206f1e-b98a-4a76-93af-d6b31c9521c8,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:27.780090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:27.783895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Set router b479e2f5-594d-4f24-ba12-91af63a8335b gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:27.826864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-1ce5b428-1629-484c-a2aa-73e018cd84b8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:27.867068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07284ba8-7824-4b53-98a9-693c23b49c7d up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:27.951786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Router 7508d3f8-07b9-4053-9b01-8116ea071aa9 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:44:28.050458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Pushing event updated for resources: {'Port': ['ID=43206f1e-b98a-4a76-93af-d6b31c9521c8,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:28.060583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:28.172667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 07284ba8-7824-4b53-98a9-693c23b49c7d triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:28.173064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:28.325339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:44:28.338888 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Sync routers for ids ['7508d3f8-07b9-4053-9b01-8116ea071aa9'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:44:28.362614 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Routers {'7508d3f8-07b9-4053-9b01-8116ea071aa9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:28.363454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:28.363668 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7508d3f8-07b9-4053-9b01-8116ea071aa9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:28.364953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 1.7100124 Nov 24 14:44:28.367785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52464) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:44:28.459614 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:44:23Z', 'revision_number': 4, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '671c3ba5-e465-4f25-8825-ee0f65fb1feb', 'name': '', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'mac_address': 'fa:16:3e:5a:aa:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:23Z', 'updated_at': '2021-11-24T14:44:23Z', 'revision_number': 2, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'subnets': [{'id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:28.464898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Checking router: b479e2f5-594d-4f24-ba12-91af63a8335b for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:44:28.465383 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Updating router b479e2f5-594d-4f24-ba12-91af63a8335b port 671c3ba5-e465-4f25-8825-ee0f65fb1feb binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:44:28.525159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:28.586756 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Set router 7508d3f8-07b9-4053-9b01-8116ea071aa9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:28.924633 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:44:27Z', 'revision_number': 3, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:28.927519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:28.930335 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Checking router: 7508d3f8-07b9-4053-9b01-8116ea071aa9 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:44:28.930887 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Updating router 7508d3f8-07b9-4053-9b01-8116ea071aa9 port c19676ca-f0bd-4a0c-81b9-9945aee03eab binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:44:28.944294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Transition to ACTIVE for port object 671c3ba5-e465-4f25-8825-ee0f65fb1feb will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:28.952081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:28.957109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a167e146-93e0-4e55-a195-be35231209d0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:28.996737 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.148205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ad107d-b432-4178-9f14-47c0d1e08609 None None] Pushing event updated for resources: {'Port': ['ID=671c3ba5-e465-4f25-8825-ee0f65fb1feb,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:29.157836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e0ad107d-b432-4178-9f14-47c0d1e08609 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:29.207422 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f41513e2-3b9b-4d0e-8309-ea0d6a51e62b None None] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:44:29.362171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Attempting to bind port 671c3ba5-e465-4f25-8825-ee0f65fb1feb on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:29.362863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Attempting to bind port 671c3ba5-e465-4f25-8825-ee0f65fb1feb by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:29.363006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Attempting to bind port 671c3ba5-e465-4f25-8825-ee0f65fb1feb on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:29.392471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-244fbbbd-6c6d-47f9-92f3-6d394036266f None None] Provisioning for port 43206f1e-b98a-4a76-93af-d6b31c9521c8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:29.400401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:29.400401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Checking segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:29.400766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.401304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Bound using segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:29.401854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Bound port: 671c3ba5-e465-4f25-8825-ee0f65fb1feb, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:29.402305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.427213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.448425 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.461796 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Transition to ACTIVE for port object c19676ca-f0bd-4a0c-81b9-9945aee03eab will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:29.469626 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.473604 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c509318e-38c3-4e16-b966-4db3b930d8ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:29.565037 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Attempting to bind port c19676ca-f0bd-4a0c-81b9-9945aee03eab on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:29.565406 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Attempting to bind port c19676ca-f0bd-4a0c-81b9-9945aee03eab by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:29.565763 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Attempting to bind port c19676ca-f0bd-4a0c-81b9-9945aee03eab on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:29.567898 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535e60c8-7bc1-4ca6-a1c7-75355817c101 None None] Pushing event updated for resources: {'Port': ['ID=c19676ca-f0bd-4a0c-81b9-9945aee03eab,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:29.571490 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-535e60c8-7bc1-4ca6-a1c7-75355817c101 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:29.578027 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:29.578027 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:29.578400 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.578689 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:29.579236 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Bound port: c19676ca-f0bd-4a0c-81b9-9945aee03eab, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:29.579538 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.599633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] For port 671c3ba5-e465-4f25-8825-ee0f65fb1feb, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:29.614352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] For port 671c3ba5-e465-4f25-8825-ee0f65fb1feb, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=671c3ba5-e465-4f25-8825-ee0f65fb1feb,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:29.629655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.635082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:29.666490 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] For port c19676ca-f0bd-4a0c-81b9-9945aee03eab, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:29.670931 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] For port c19676ca-f0bd-4a0c-81b9-9945aee03eab, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c19676ca-f0bd-4a0c-81b9-9945aee03eab,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:29.678482 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:29.683320 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:29.708693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Allocated IP 172.20.0.1 (1ce75103-bb5d-4b6b-a901-0619484cf902/a5eab138-c8df-4223-8bfd-72c6da6a3af9/da530f5e-2130-4162-8175-80d1e2c3289a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:29.727659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ad107d-b432-4178-9f14-47c0d1e08609 None None] Pushing event updated for resources: {'Port': ['ID=671c3ba5-e465-4f25-8825-ee0f65fb1feb,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:29.736642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e0ad107d-b432-4178-9f14-47c0d1e08609 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:29.746329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Routers {'b479e2f5-594d-4f24-ba12-91af63a8335b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:29.747526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b479e2f5-594d-4f24-ba12-91af63a8335b'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:29.915212 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535e60c8-7bc1-4ca6-a1c7-75355817c101 None None] Pushing event updated for resources: {'Port': ['ID=c19676ca-f0bd-4a0c-81b9-9945aee03eab,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:29.918767 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-535e60c8-7bc1-4ca6-a1c7-75355817c101 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:29.919647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 43206f1e-b98a-4a76-93af-d6b31c9521c8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:29.925174 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Routers {'7508d3f8-07b9-4053-9b01-8116ea071aa9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:29.925806 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7508d3f8-07b9-4053-9b01-8116ea071aa9'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:30.007996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.029612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Transition to ACTIVE for port object da530f5e-2130-4162-8175-80d1e2c3289a will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:30.055751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.059979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-edb91732-f763-4bee-a94a-b3934096c590 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:30.138019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Pushing event updated for resources: {'Port': ['ID=da530f5e-2130-4162-8175-80d1e2c3289a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:30.141649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:30.166972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:30.168215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] Set router b479e2f5-594d-4f24-ba12-91af63a8335b gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:30.168683 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:30.176915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:30.212366 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] Set router 7508d3f8-07b9-4053-9b01-8116ea071aa9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:30.246297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.387285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.500262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 43206f1e-b98a-4a76-93af-d6b31c9521c8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:30.510413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5b83f475-3362-4ff5-b81f-d9f8ca8baaad None None] Provisioning complete for port 43206f1e-b98a-4a76-93af-d6b31c9521c8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:30.510926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b83f475-3362-4ff5-b81f-d9f8ca8baaad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.551368 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:44:27Z', 'revision_number': 3, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:30.558263 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bc5e58-bb6e-4ae2-9249-4ce02a882d6f None None] The sync data for ids ['7508d3f8-07b9-4053-9b01-8116ea071aa9'] in dv-neutron-818151-2-hyperv is: [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:44:27Z', 'revision_number': 3, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:44:30.600649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 43206f1e-b98a-4a76-93af-d6b31c9521c8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:30.601032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.650537 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.657722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.690890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:30.777814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.781203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Pushing event updated for resources: {'Port': ['ID=da530f5e-2130-4162-8175-80d1e2c3289a,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:30.784315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:30.887323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.899067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b83f475-3362-4ff5-b81f-d9f8ca8baaad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.940099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:30.941581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:30.956076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 43206f1e-b98a-4a76-93af-d6b31c9521c8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=43206f1e-b98a-4a76-93af-d6b31c9521c8,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:30.963931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:44:23Z', 'revision_number': 4, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '671c3ba5-e465-4f25-8825-ee0f65fb1feb', 'name': '', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'mac_address': 'fa:16:3e:5a:aa:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:23Z', 'updated_at': '2021-11-24T14:44:29Z', 'revision_number': 4, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'subnets': [{'id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:30.966713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:30.973029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:31.055177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-298b038a-ae01-498b-854e-d9a9a2335bd6 None None] The sync data for ids ['b479e2f5-594d-4f24-ba12-91af63a8335b'] in dv-neutron-818151-2-hyperv is: [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:44:23Z', 'revision_number': 4, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '671c3ba5-e465-4f25-8825-ee0f65fb1feb', 'name': '', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'mac_address': 'fa:16:3e:5a:aa:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:23Z', 'updated_at': '2021-11-24T14:44:29Z', 'revision_number': 4, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'subnets': [{'id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:44:31.159358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-5b83f475-3362-4ff5-b81f-d9f8ca8baaad None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:44:31.159878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-5b83f475-3362-4ff5-b81f-d9f8ca8baaad None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:44:31.166809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=43206f1e-b98a-4a76-93af-d6b31c9521c8,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:31.181584 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:31.581563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Router 7508d3f8-07b9-4053-9b01-8116ea071aa9 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:44:31.813506 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:44:31.825580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] 10.222.0.70 "PUT /v2.0/routers/7508d3f8-07b9-4053-9b01-8116ea071aa9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4561267 Nov 24 14:44:31.904828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-78890861-bade-4f4e-9378-adb50777fc27 None None] Provisioning for port da530f5e-2130-4162-8175-80d1e2c3289a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:31.911126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-78890861-bade-4f4e-9378-adb50777fc27 None None] Provisioning complete for port da530f5e-2130-4162-8175-80d1e2c3289a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:31.911681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-78890861-bade-4f4e-9378-adb50777fc27 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:31.945267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c19676ca-f0bd-4a0c-81b9-9945aee03eab up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:32.048089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-78890861-bade-4f4e-9378-adb50777fc27 None None] Port da530f5e-2130-4162-8175-80d1e2c3289a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:44:32.067913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c19676ca-f0bd-4a0c-81b9-9945aee03eab completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:32.073746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c19676ca-f0bd-4a0c-81b9-9945aee03eab triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:32.074126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.214968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.233760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port c19676ca-f0bd-4a0c-81b9-9945aee03eab, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c19676ca-f0bd-4a0c-81b9-9945aee03eab,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:32.240709 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.242161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 671c3ba5-e465-4f25-8825-ee0f65fb1feb up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:32.265548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:32.361146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=c19676ca-f0bd-4a0c-81b9-9945aee03eab,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:32.364597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:32.376547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 671c3ba5-e465-4f25-8825-ee0f65fb1feb completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:32.382740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 671c3ba5-e465-4f25-8825-ee0f65fb1feb triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:32.383291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.528586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.567742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 671c3ba5-e465-4f25-8825-ee0f65fb1feb, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=671c3ba5-e465-4f25-8825-ee0f65fb1feb,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:32.572875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.573914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 43206f1e-b98a-4a76-93af-d6b31c9521c8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:32.599050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:32.690941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=671c3ba5-e465-4f25-8825-ee0f65fb1feb,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:32.695504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:32.708328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 43206f1e-b98a-4a76-93af-d6b31c9521c8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:32.710011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:32.860639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5989572-b33b-4978-bbae-5dfca28944dd req-f10cb3e9-1871-4c1e-a28a-cc1ab269d134 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:32.862075 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-f10cb3e9-1871-4c1e-a28a-cc1ab269d134 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/networks?id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 200 len: 817 time: 0.1667516 Nov 24 14:44:32.881625 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-0f6bed30-4ede-4bf7-9589-ef979479dfad tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/quotas/b85fa4ff0d164878b496c6b317d23fb8 HTTP/1.1" status: 200 len: 375 time: 0.0116801 Nov 24 14:44:32.969380 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-8515607c-3d13-4b32-adda-1007226562f6 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0810468 Nov 24 14:44:33.125008 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-f5b2a07c-44ec-40e0-84a6-1bc55c951c7e service neutron] 10.222.0.70 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1435349 Nov 24 14:44:33.265810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-f96f25aa-70e0-44cd-bf03-e871ac91f088 service neutron] 10.222.0.70 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348841 Nov 24 14:44:33.322214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-69dd6f76-5378-47bf-a05c-5925ad11dfbf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:33.464752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-990f9a11-03c2-41c9-98f7-75ce6e851b4a req-e78427dd-6cea-452b-9f76-2716dc513f61 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Synchronizing usage tracker for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:44:33.485296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-990f9a11-03c2-41c9-98f7-75ce6e851b4a req-e78427dd-6cea-452b-9f76-2716dc513f61 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Unset dirty status for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:44:33.491658 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-990f9a11-03c2-41c9-98f7-75ce6e851b4a req-e78427dd-6cea-452b-9f76-2716dc513f61 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 210 time: 0.0719278 Nov 24 14:44:33.736609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:33.796393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c19676ca-f0bd-4a0c-81b9-9945aee03eab up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:33.869275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c19676ca-f0bd-4a0c-81b9-9945aee03eab triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:33.869653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:34.044105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 671c3ba5-e465-4f25-8825-ee0f65fb1feb up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:34.115098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 671c3ba5-e465-4f25-8825-ee0f65fb1feb triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:34.115499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:34.562671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5989572-b33b-4978-bbae-5dfca28944dd req-64aa61be-5e64-4edc-852b-6922745621d3 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:34.563360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f5989572-b33b-4978-bbae-5dfca28944dd req-64aa61be-5e64-4edc-852b-6922745621d3 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Synchronizing usage tracker for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:44:34.583173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f5989572-b33b-4978-bbae-5dfca28944dd req-64aa61be-5e64-4edc-852b-6922745621d3 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Unset dirty status for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:44:34.585194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-64aa61be-5e64-4edc-852b-6922745621d3 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "GET /v2.0/networks?id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 200 len: 817 time: 0.1697748 Nov 24 14:44:34.602136 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Request body: {'port': {'device_id': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'admin_state_up': True, 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:34.684143 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ad113f86-29e7-4d4a-9b5f-71a64bb12036 req-109fe361-dd3c-496a-8b3c-7d64f19b4d9b tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 210 time: 0.0428040 Nov 24 14:44:34.752766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:44:34.762966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:44:34.772548 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Made reservation on behalf of b85fa4ff0d164878b496c6b317d23fb8 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:44:34.775576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:34.945795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Allocated IP 172.20.0.3 (93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d/3e130406-a9f4-437f-8490-02c95f468a7f/906aaf1b-bc18-4466-9851-2ab76b7c5912) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:44:35.164242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.182257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Transition to ACTIVE for port object 906aaf1b-bc18-4466-9851-2ab76b7c5912 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:35.204937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.211584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:35.282689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:44:35.290011 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:44:35.294291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:44:35.327923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Pushing event updated for resources: {'Port': ['ID=906aaf1b-bc18-4466-9851-2ab76b7c5912,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:35.337142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:35.363318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:35.364057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.393153 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7949927 Nov 24 14:44:35.404923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Request body: {'port': {'device_id': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:44:35.523476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.590527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a13c593c-fb0f-42ca-95b1-76ed5465651c None None] Provisioning for port 906aaf1b-bc18-4466-9851-2ab76b7c5912 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:35.595185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a13c593c-fb0f-42ca-95b1-76ed5465651c None None] Provisioning complete for port 906aaf1b-bc18-4466-9851-2ab76b7c5912 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:35.595585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a13c593c-fb0f-42ca-95b1-76ed5465651c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.653026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a13c593c-fb0f-42ca-95b1-76ed5465651c None None] Port 906aaf1b-bc18-4466-9851-2ab76b7c5912 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:44:35.896311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5d3b8992-768a-4e0b-af37-fe267c801007 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.922232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 906aaf1b-bc18-4466-9851-2ab76b7c5912 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:44:35.930372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.956473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Transition to ACTIVE for port object 906aaf1b-bc18-4466-9851-2ab76b7c5912 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:35.964407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff705f82-0855-410b-9d95-64171e73cc97 req-43921658-c4f4-47ee-a9e0-894947551cc5 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:35.965081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ff705f82-0855-410b-9d95-64171e73cc97 req-43921658-c4f4-47ee-a9e0-894947551cc5 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Synchronizing usage tracker for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:44:35.968749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:35.973176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7a59daaf-21dd-4eeb-8160-d841d8d2c600 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:36.086112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ff705f82-0855-410b-9d95-64171e73cc97 req-43921658-c4f4-47ee-a9e0-894947551cc5 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Unset dirty status for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:44:36.087515 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ff705f82-0855-410b-9d95-64171e73cc97 req-43921658-c4f4-47ee-a9e0-894947551cc5 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 931 time: 0.2786252 Nov 24 14:44:36.096731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Pushing event updated for resources: {'Port': ['ID=906aaf1b-bc18-4466-9851-2ab76b7c5912,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:36.107563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:36.329434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ff705f82-0855-410b-9d95-64171e73cc97 req-03bad4c8-3d9c-44a0-8726-10f9b7c44fa9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Synchronizing usage tracker for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:44:36.373539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-ff705f82-0855-410b-9d95-64171e73cc97 req-03bad4c8-3d9c-44a0-8726-10f9b7c44fa9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Unset dirty status for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:44:36.374675 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ff705f82-0855-410b-9d95-64171e73cc97 req-03bad4c8-3d9c-44a0-8726-10f9b7c44fa9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2792408 Nov 24 14:44:36.375451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Attempting to bind port 906aaf1b-bc18-4466-9851-2ab76b7c5912 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:36.375809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Attempting to bind port 906aaf1b-bc18-4466-9851-2ab76b7c5912 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:36.376113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Attempting to bind port 906aaf1b-bc18-4466-9851-2ab76b7c5912 on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:36.382816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Port 906aaf1b-bc18-4466-9851-2ab76b7c5912 on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:44:36.383130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Attempting to bind port 906aaf1b-bc18-4466-9851-2ab76b7c5912 on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:36.389320 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:36.389646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Checking segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:36.390021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Bound using segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:36.390527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Bound port: 906aaf1b-bc18-4466-9851-2ab76b7c5912, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:36.390753 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:36.478252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] For port 906aaf1b-bc18-4466-9851-2ab76b7c5912, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:36.481357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] For port 906aaf1b-bc18-4466-9851-2ab76b7c5912, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:36.484849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:36.488939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-538d7c09-4157-4e90-a58f-1c4a74e969a7 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:36.549398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:36.550731 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] 10.222.0.47 "PUT /v2.0/ports/906aaf1b-bc18-4466-9851-2ab76b7c5912 HTTP/1.1" status: 200 len: 1093 time: 1.1500943 Nov 24 14:44:36.551251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'tag': '906aaf1b-bc18-4466-9851-2ab76b7c5912'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:44:36.582084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Pushing event updated for resources: {'Port': ['ID=906aaf1b-bc18-4466-9851-2ab76b7c5912,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:36.586055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:36.622686 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'tag': '906aaf1b-bc18-4466-9851-2ab76b7c5912', 'status': 'completed', 'code': 200} Nov 24 14:44:36.660739 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-9d2dc942-ad39-49cf-9f53-d3e06bc82b9a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 1096 time: 0.0734344 Nov 24 14:44:36.735607 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-491542f7-cc8e-49a0-a62a-849d343d44e8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912 HTTP/1.1" status: 200 len: 217 time: 0.0680017 Nov 24 14:44:36.799671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5989572-b33b-4978-bbae-5dfca28944dd req-af4cee83-bc0c-4f21-b049-2181f977116e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:36.801067 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-af4cee83-bc0c-4f21-b049-2181f977116e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=3e130406-a9f4-437f-8490-02c95f468a7f HTTP/1.1" status: 200 len: 856 time: 0.0599945 Nov 24 14:44:36.878165 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-df7f0af8-e1d3-4916-8392-39d4a3adb6fc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0711010 Nov 24 14:44:36.922514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:37.011245 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-a159a38e-d33d-4316-b037-5567f870d1e3 service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267686 Nov 24 14:44:37.143431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f5989572-b33b-4978-bbae-5dfca28944dd req-415c18a6-7c14-4883-b7f7-af387658567a service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256557 Nov 24 14:44:37.255419 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-4f9d71dd-92b4-4287-bd1b-7524ad24419a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 1096 time: 0.0688286 Nov 24 14:44:37.397080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-05283b7b-3986-4c9f-aca6-150e428c9737 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:37.399351 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-05283b7b-3986-4c9f-aca6-150e428c9737 service neutron] 10.222.0.47 "GET /v2.0/networks?id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 200 len: 918 time: 0.1369205 Nov 24 14:44:37.472694 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-7b5c3024-430f-4dbe-8f17-7e8ab29d3334 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912 HTTP/1.1" status: 200 len: 217 time: 0.0670795 Nov 24 14:44:37.585168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-03155692-bdf1-4836-9e45-f2a2fb2664ea service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:37.586842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-03155692-bdf1-4836-9e45-f2a2fb2664ea service neutron] 10.222.0.47 "GET /v2.0/subnets?id=3e130406-a9f4-437f-8490-02c95f468a7f HTTP/1.1" status: 200 len: 856 time: 0.1085038 Nov 24 14:44:37.654712 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc82902-250b-436a-a55d-38bf96b7aa7c req-c548ea05-09b6-4f5e-804d-61bd793063f2 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:37.656087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bdc82902-250b-436a-a55d-38bf96b7aa7c req-c548ea05-09b6-4f5e-804d-61bd793063f2 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 943 time: 0.1460984 Nov 24 14:44:37.712211 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-cda9028c-cfe2-4ae4-972e-8334ddfe339c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1170926 Nov 24 14:44:37.716905 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bdc82902-250b-436a-a55d-38bf96b7aa7c req-5776aab9-ab7f-4646-9333-b8b03392eb46 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542634 Nov 24 14:44:37.844347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-87e747a0-39e8-47b2-8486-05b3e9109cc1 service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255383 Nov 24 14:44:37.989798 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea5d31d1-4aea-4396-b090-b301628e9efb req-7d7fb81f-389a-4004-b772-7ed42a54aab4 service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1387944 Nov 24 14:44:38.624913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:38.924186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f40f4eb8-b9e3-4c50-a9e1-bba7b6a4c27e req-e73ceb2b-c477-4851-8a87-74de29625eaf tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:38.925636 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f40f4eb8-b9e3-4c50-a9e1-bba7b6a4c27e req-e73ceb2b-c477-4851-8a87-74de29625eaf tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 943 time: 0.0802848 Nov 24 14:44:38.973136 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f40f4eb8-b9e3-4c50-a9e1-bba7b6a4c27e req-f9bb7e05-8e4e-4147-8b8c-a6682c71e280 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411205 Nov 24 14:44:40.290864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0aebce3-b520-4029-a9b8-135792a80046 req-9a7cb56f-97d4-458d-b493-f4f47b701a56 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:40.292340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a0aebce3-b520-4029-a9b8-135792a80046 req-9a7cb56f-97d4-458d-b493-f4f47b701a56 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 943 time: 0.1960166 Nov 24 14:44:40.337300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 906aaf1b-bc18-4466-9851-2ab76b7c5912 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:44:40.341795 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a0aebce3-b520-4029-a9b8-135792a80046 req-efe58d17-af33-46c2-b720-4a1b6fa19783 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435910 Nov 24 14:44:40.479777 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 906aaf1b-bc18-4466-9851-2ab76b7c5912, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:40.493358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '906aaf1b-bc18-4466-9851-2ab76b7c5912', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'port_id': '906aaf1b-bc18-4466-9851-2ab76b7c5912', 'mac_address': 'fa:16:3e:4a:8e:64', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:44:40.553748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:40.574082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 906aaf1b-bc18-4466-9851-2ab76b7c5912 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:44:40.590386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 906aaf1b-bc18-4466-9851-2ab76b7c5912, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:40.594269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:40.596011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e2346d76-e02a-4267-bbc6-e0934b73ec78 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:40.659552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=906aaf1b-bc18-4466-9851-2ab76b7c5912,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:40.668135 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.668481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.668816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.669147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.669477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.669804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.670127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.670451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.670770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.671088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.671405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:44:40.675192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:40.933406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['906aaf1b-bc18-4466-9851-2ab76b7c5912'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:44:41.544740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac143ab9-8efc-4ca5-ab94-e4e9ddf0311b req-419ddaf7-7aaf-496b-917c-62aeafd2382c tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:41.546087 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ac143ab9-8efc-4ca5-ab94-e4e9ddf0311b req-419ddaf7-7aaf-496b-917c-62aeafd2382c tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 944 time: 0.0751016 Nov 24 14:44:41.598054 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ac143ab9-8efc-4ca5-ab94-e4e9ddf0311b req-cf68594f-d77b-4608-a59d-7ded46260aa9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465062 Nov 24 14:44:42.350186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 906aaf1b-bc18-4466-9851-2ab76b7c5912 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:42.418169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 906aaf1b-bc18-4466-9851-2ab76b7c5912 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:42.423220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 906aaf1b-bc18-4466-9851-2ab76b7c5912 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:42.424147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:42.543583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:42.572424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '906aaf1b-bc18-4466-9851-2ab76b7c5912'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:44:42.583088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 906aaf1b-bc18-4466-9851-2ab76b7c5912, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:42.589154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:42.591201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:42.647956 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '906aaf1b-bc18-4466-9851-2ab76b7c5912', 'code': 200} Nov 24 14:44:42.668087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=906aaf1b-bc18-4466-9851-2ab76b7c5912,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:42.671627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:42.824965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9667b3-700e-44d0-83e2-37279f1d41c4 req-58ac8b9f-2d25-4762-9374-de91daa2c3c6 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:42.826468 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cf9667b3-700e-44d0-83e2-37279f1d41c4 req-58ac8b9f-2d25-4762-9374-de91daa2c3c6 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.0848548 Nov 24 14:44:42.834244 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:44:42.879074 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cf9667b3-700e-44d0-83e2-37279f1d41c4 req-fec30b6a-e374-4b63-a614-be3b501ea3e3 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463293 Nov 24 14:44:42.914926 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2ce752d2-2f3c-4b1f-b929-95f8c5390e1b req-2740cd9f-07ad-4267-8668-c59f70dd7cf7 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 1098 time: 0.0844927 Nov 24 14:44:42.966478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2ce752d2-2f3c-4b1f-b929-95f8c5390e1b req-2b8f2ca8-4ec0-4073-8b97-58801e0c312a service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453660 Nov 24 14:44:44.092575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf8f6e4-2d8b-49e3-b850-f42f920a12dd req-c552ef1c-f012-4d3c-8a5d-3ccf1ab5a5b2 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:44.094172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2cf8f6e4-2d8b-49e3-b850-f42f920a12dd req-c552ef1c-f012-4d3c-8a5d-3ccf1ab5a5b2 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.0819440 Nov 24 14:44:44.142874 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2cf8f6e4-2d8b-49e3-b850-f42f920a12dd req-c1c1855c-084e-463d-b9c7-db336fd6730e tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410254 Nov 24 14:44:45.344742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3180f8-c029-445b-a606-b84846df5716 req-4d284271-b09b-4f94-8ecd-cd977081b4b7 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:45.346090 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8e3180f8-c029-445b-a606-b84846df5716 req-4d284271-b09b-4f94-8ecd-cd977081b4b7 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.0804086 Nov 24 14:44:45.393721 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8e3180f8-c029-445b-a606-b84846df5716 req-92d3a217-a7cd-4fdc-bed2-c4120c816605 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404665 Nov 24 14:44:45.736739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf8ad374-2901-401f-89dc-861c8af07c44 req-f98b74c5-e2a5-4107-a435-22c16fe5a495 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:44:45.738196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf8ad374-2901-401f-89dc-861c8af07c44 req-f98b74c5-e2a5-4107-a435-22c16fe5a495 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.2255476 Nov 24 14:44:45.787895 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf8ad374-2901-401f-89dc-861c8af07c44 req-b0d239c9-58bd-460c-a407-c0f597d265d9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432239 Nov 24 14:44:48.242808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:53.155545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Sync routers for ids ['7508d3f8-07b9-4053-9b01-8116ea071aa9'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:44:53.167275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Routers {'7508d3f8-07b9-4053-9b01-8116ea071aa9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:53.167914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7508d3f8-07b9-4053-9b01-8116ea071aa9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:53.350123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Set router 7508d3f8-07b9-4053-9b01-8116ea071aa9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:53.706578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:44:30Z', 'revision_number': 4, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'da530f5e-2130-4162-8175-80d1e2c3289a', 'name': '', 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'mac_address': 'fa:16:3e:ee:5b:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:29Z', 'updated_at': '2021-11-24T14:44:30Z', 'revision_number': 2, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'subnets': [{'id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:53.711113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Checking router: 7508d3f8-07b9-4053-9b01-8116ea071aa9 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:44:53.711721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Updating router 7508d3f8-07b9-4053-9b01-8116ea071aa9 port da530f5e-2130-4162-8175-80d1e2c3289a binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:44:53.762139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:54.101141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:54.112720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Transition to ACTIVE for port object da530f5e-2130-4162-8175-80d1e2c3289a will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:44:54.121438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:54.125086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:54.255774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5291fccb-6bea-4139-9e24-20daa24404d7 None None] Pushing event updated for resources: {'Port': ['ID=da530f5e-2130-4162-8175-80d1e2c3289a,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:54.259852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5291fccb-6bea-4139-9e24-20daa24404d7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:54.350438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Attempting to bind port da530f5e-2130-4162-8175-80d1e2c3289a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:44:54.350841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Attempting to bind port da530f5e-2130-4162-8175-80d1e2c3289a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:44:54.351297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Attempting to bind port da530f5e-2130-4162-8175-80d1e2c3289a on network 1ce75103-bb5d-4b6b-a901-0619484cf902 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:44:54.359023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:44:54.359402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Checking segment: {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:44:54.359835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:54.360236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Bound using segment: {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:44:54.360901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Bound port: da530f5e-2130-4162-8175-80d1e2c3289a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '61294373-ef6c-4df2-a00e-96d805638406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 880, 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:44:54.361297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:54.471181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] For port da530f5e-2130-4162-8175-80d1e2c3289a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:44:54.475680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] For port da530f5e-2130-4162-8175-80d1e2c3289a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=da530f5e-2130-4162-8175-80d1e2c3289a,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:44:54.480277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:54.483988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:54.567132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5291fccb-6bea-4139-9e24-20daa24404d7 None None] Pushing event updated for resources: {'Port': ['ID=da530f5e-2130-4162-8175-80d1e2c3289a,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:54.571606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5291fccb-6bea-4139-9e24-20daa24404d7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:54.572690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Routers {'7508d3f8-07b9-4053-9b01-8116ea071aa9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:44:54.573303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:44:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7508d3f8-07b9-4053-9b01-8116ea071aa9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:54.756382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] Set router 7508d3f8-07b9-4053-9b01-8116ea071aa9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:44:55.108921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:44:30Z', 'revision_number': 4, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'da530f5e-2130-4162-8175-80d1e2c3289a', 'name': '', 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'mac_address': 'fa:16:3e:ee:5b:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:29Z', 'updated_at': '2021-11-24T14:44:54Z', 'revision_number': 4, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'subnets': [{'id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:44:55.113578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cae0decf-15ff-4503-a6ae-04846d0bc2b4 None None] The sync data for ids ['7508d3f8-07b9-4053-9b01-8116ea071aa9'] in dv-neutron-818151-2-hyperv is: [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:44:30Z', 'revision_number': 4, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'da530f5e-2130-4162-8175-80d1e2c3289a', 'name': '', 'network_id': '1ce75103-bb5d-4b6b-a901-0619484cf902', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'mac_address': 'fa:16:3e:ee:5b:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:29Z', 'updated_at': '2021-11-24T14:44:54Z', 'revision_number': 4, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'subnets': [{'id': 'a5eab138-c8df-4223-8bfd-72c6da6a3af9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:44:55.821562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device da530f5e-2130-4162-8175-80d1e2c3289a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:55.897049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port da530f5e-2130-4162-8175-80d1e2c3289a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:44:55.903367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port da530f5e-2130-4162-8175-80d1e2c3289a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:55.903883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:56.094512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:56.133445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port da530f5e-2130-4162-8175-80d1e2c3289a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=da530f5e-2130-4162-8175-80d1e2c3289a,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:44:56.137420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:44:56.139689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:44:56.228473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=da530f5e-2130-4162-8175-80d1e2c3289a,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:44:56.231529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:44:57.797077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device da530f5e-2130-4162-8175-80d1e2c3289a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:44:57.870209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port da530f5e-2130-4162-8175-80d1e2c3289a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:44:57.870636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:01.808557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02cb05c-d475-413d-b9a6-59cf71977015 req-95d6a3c6-4d93-43b3-9fb2-b7a5c7a38465 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:01.809995 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f02cb05c-d475-413d-b9a6-59cf71977015 req-95d6a3c6-4d93-43b3-9fb2-b7a5c7a38465 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.0765736 Nov 24 14:45:01.856654 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f02cb05c-d475-413d-b9a6-59cf71977015 req-37fb5f9e-d482-438d-be2d-6f58de142b22 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409226 Nov 24 14:45:03.073622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0774c427-fb01-4871-b127-7b45be8637ea req-0da4d39b-e246-4514-85bf-9ede69887fe1 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:03.075194 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0774c427-fb01-4871-b127-7b45be8637ea req-0da4d39b-e246-4514-85bf-9ede69887fe1 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.0886300 Nov 24 14:45:03.124350 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0774c427-fb01-4871-b127-7b45be8637ea req-4c9779df-55cc-45fd-a4bd-14a70bc93609 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429153 Nov 24 14:45:03.327999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3d177c8e-c767-44d8-82cf-83b15736d747 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:03.609348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-360f515f-cc33-45a2-811e-05f41f14f8ed tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:03.610717 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-360f515f-cc33-45a2-811e-05f41f14f8ed tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 945 time: 0.0918024 Nov 24 14:45:03.685396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Deleting port 906aaf1b-bc18-4466-9851-2ab76b7c5912 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:03.685752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:03.736426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:03.960773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] For port 906aaf1b-bc18-4466-9851-2ab76b7c5912, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=906aaf1b-bc18-4466-9851-2ab76b7c5912,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:03.961375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:04.083919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Calling delete_port for 906aaf1b-bc18-4466-9851-2ab76b7c5912 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:04.241169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:04.253064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['906aaf1b-bc18-4466-9851-2ab76b7c5912'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:45:04.256154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4178e1a0-08bd-498b-8c29-1ec8f1c2e001 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:04.345630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Pushing event deleted for resources: {'Port': ['ID=906aaf1b-bc18-4466-9851-2ab76b7c5912,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:04.352152 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3a4731a9-29c1-48aa-b138-6e5c5f7850ba req-9069ceb6-cae7-4516-8153-1d3c27b593b6 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63 HTTP/1.1" status: 200 len: 210 time: 0.0653808 Nov 24 14:45:04.393348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.393736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.394645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.394645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.395012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.396057 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.396794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.396794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.397150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.397722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.398090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:04.406684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:04.445706 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] No DVR routers for this DVR port 906aaf1b-bc18-4466-9851-2ab76b7c5912 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:45:04.448921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:04.453569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'name': 'network-vif-deleted', 'tag': '906aaf1b-bc18-4466-9851-2ab76b7c5912'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:45:04.474362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f76e9eea-fd4f-4251-bfa8-d215928bdd28 req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "DELETE /v2.0/ports/906aaf1b-bc18-4466-9851-2ab76b7c5912 HTTP/1.1" status: 204 len: 173 time: 0.8577592 Nov 24 14:45:04.530552 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4c9b43b-a27e-4e80-a67b-e8a6b5a77a63', 'name': 'network-vif-deleted', 'tag': '906aaf1b-bc18-4466-9851-2ab76b7c5912', 'status': 'completed', 'code': 200} Nov 24 14:45:05.900444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-25cdd455-2e49-4973-b7a6-2b2a8409c534 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:06.267578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-3b1d8428-de8f-4a82-a630-1b5e73482726 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:06.269031 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-3b1d8428-de8f-4a82-a630-1b5e73482726 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/networks?id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 200 len: 817 time: 0.1434515 Nov 24 14:45:06.285304 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-aaaa7ba6-efd1-42d1-b55e-e06510f968f2 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/quotas/b85fa4ff0d164878b496c6b317d23fb8 HTTP/1.1" status: 200 len: 375 time: 0.0107591 Nov 24 14:45:06.495925 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-eae9b60c-851a-4065-be66-156ca3032ab8 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2048552 Nov 24 14:45:06.643078 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-c2e40b55-fbb4-4cc5-aec9-e2cb8d7204dd service neutron] 10.222.0.70 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1344345 Nov 24 14:45:06.786379 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-e0f46f37-e5b6-4082-af1b-1678806aec85 service neutron] 10.222.0.70 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1372416 Nov 24 14:45:06.929254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:06.972897 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-3f31819c-f847-4437-8705-5c551ede09c7 req-22f0fc05-8352-4542-8fee-3d0a9a069706 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Synchronizing usage tracker for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:45:06.989506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-3f31819c-f847-4437-8705-5c551ede09c7 req-22f0fc05-8352-4542-8fee-3d0a9a069706 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Unset dirty status for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:45:06.995445 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f31819c-f847-4437-8705-5c551ede09c7 req-22f0fc05-8352-4542-8fee-3d0a9a069706 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 210 time: 0.0646229 Nov 24 14:45:08.159111 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a5ebc9e1-bd08-4028-8162-f5d44ccd5b12 req-3f23ad6f-f361-46ad-9548-b03ae883af70 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 210 time: 0.0429192 Nov 24 14:45:08.204363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-9494e7d4-fe9a-478d-8a65-6ec7a5016b39 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:08.205766 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-9494e7d4-fe9a-478d-8a65-6ec7a5016b39 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "GET /v2.0/networks?id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 200 len: 817 time: 0.1611211 Nov 24 14:45:08.222819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Request body: {'port': {'device_id': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'admin_state_up': True, 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:45:08.466107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:45:08.473760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 906aaf1b-bc18-4466-9851-2ab76b7c5912 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:08.476158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:45:08.485919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Made reservation on behalf of b85fa4ff0d164878b496c6b317d23fb8 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:45:08.488939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:08.511798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 906aaf1b-bc18-4466-9851-2ab76b7c5912 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:08.512150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 906aaf1b-bc18-4466-9851-2ab76b7c5912 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:08.635946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:08.667028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Allocated IP 172.20.0.4 (93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d/3e130406-a9f4-437f-8490-02c95f468a7f/bcf86f86-2fed-4e81-bc9a-792769892dee) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:45:08.865929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:08.881587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Transition to ACTIVE for port object bcf86f86-2fed-4e81-bc9a-792769892dee will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:45:08.908132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:08.914367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:08.972732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:45:08.976366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:45:08.985109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:45:09.024967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Pushing event updated for resources: {'Port': ['ID=bcf86f86-2fed-4e81-bc9a-792769892dee,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:09.029440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:09.056426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:09.057047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:09.082963 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8638098 Nov 24 14:45:09.094639 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Request body: {'port': {'device_id': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:45:09.207374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:09.259404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-574c63a9-b0b8-4556-8048-a716bc6de791 None None] Provisioning for port bcf86f86-2fed-4e81-bc9a-792769892dee completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:45:09.265560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-574c63a9-b0b8-4556-8048-a716bc6de791 None None] Provisioning complete for port bcf86f86-2fed-4e81-bc9a-792769892dee triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:45:09.266216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-574c63a9-b0b8-4556-8048-a716bc6de791 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:09.328505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-574c63a9-b0b8-4556-8048-a716bc6de791 None None] Port bcf86f86-2fed-4e81-bc9a-792769892dee cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:45:09.510868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be560349-6d1e-47d6-987d-60aba720b438 req-3fd0fe2f-47ba-4120-93b1-20a85c22b360 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:09.511453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-be560349-6d1e-47d6-987d-60aba720b438 req-3fd0fe2f-47ba-4120-93b1-20a85c22b360 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Synchronizing usage tracker for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:45:09.554012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-be560349-6d1e-47d6-987d-60aba720b438 req-3fd0fe2f-47ba-4120-93b1-20a85c22b360 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Unset dirty status for tenant:b85fa4ff0d164878b496c6b317d23fb8 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:45:09.555160 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-be560349-6d1e-47d6-987d-60aba720b438 req-3fd0fe2f-47ba-4120-93b1-20a85c22b360 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 931 time: 0.2320347 Nov 24 14:45:09.659350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bcf86f86-2fed-4e81-bc9a-792769892dee {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:45:09.668223 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-be560349-6d1e-47d6-987d-60aba720b438 req-add18426-da22-470a-a4e6-f061142d5014 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066408 Nov 24 14:45:09.669853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:09.684665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Transition to ACTIVE for port object bcf86f86-2fed-4e81-bc9a-792769892dee will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:45:09.688769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:09.692582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a45fe795-1632-40fe-930b-27d2af17d07d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:09.817179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Pushing event updated for resources: {'Port': ['ID=bcf86f86-2fed-4e81-bc9a-792769892dee,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:09.822117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:09.927773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Attempting to bind port bcf86f86-2fed-4e81-bc9a-792769892dee on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:45:09.928117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Attempting to bind port bcf86f86-2fed-4e81-bc9a-792769892dee by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:45:09.928444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Attempting to bind port bcf86f86-2fed-4e81-bc9a-792769892dee on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:45:09.934183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Port bcf86f86-2fed-4e81-bc9a-792769892dee on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:45:09.934500 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Attempting to bind port bcf86f86-2fed-4e81-bc9a-792769892dee on network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:45:09.942942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 44, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:45:09.944477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Checking segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:45:09.944858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Bound using segment: {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:45:09.945275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Bound port: bcf86f86-2fed-4e81-bc9a-792769892dee, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:45:09.945614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:10.039288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] For port bcf86f86-2fed-4e81-bc9a-792769892dee, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:45:10.043005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] For port bcf86f86-2fed-4e81-bc9a-792769892dee, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bcf86f86-2fed-4e81-bc9a-792769892dee,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:45:10.046450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:10.050454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:10.104604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:10.106179 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] 10.222.0.47 "PUT /v2.0/ports/bcf86f86-2fed-4e81-bc9a-792769892dee HTTP/1.1" status: 200 len: 1093 time: 1.0159354 Nov 24 14:45:10.106842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'tag': 'bcf86f86-2fed-4e81-bc9a-792769892dee'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:45:10.145558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Pushing event updated for resources: {'Port': ['ID=bcf86f86-2fed-4e81-bc9a-792769892dee,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:10.150048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:10.203289 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'tag': 'bcf86f86-2fed-4e81-bc9a-792769892dee', 'status': 'completed', 'code': 200} Nov 24 14:45:10.246920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-db0aad15-2b34-49b3-b72f-4cd6eae19235 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 1096 time: 0.0811396 Nov 24 14:45:10.320525 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-63cdf87e-19c9-4664-a9ef-aa56dff0afda service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=bcf86f86-2fed-4e81-bc9a-792769892dee HTTP/1.1" status: 200 len: 217 time: 0.0651114 Nov 24 14:45:10.499497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-b9680571-7301-4656-aac3-20932868dbb1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:10.500953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-b9680571-7301-4656-aac3-20932868dbb1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=3e130406-a9f4-437f-8490-02c95f468a7f HTTP/1.1" status: 200 len: 856 time: 0.1742849 Nov 24 14:45:10.575496 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-055d01f9-92ee-4bc2-9f54-996578767549 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0679607 Nov 24 14:45:10.715382 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-cfac5e9f-7375-40bb-a84c-b2e008a0bbf6 service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1308780 Nov 24 14:45:10.899539 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1999c628-7667-48e1-a3d2-3c5cdc28f310 req-1aeda870-a11f-4d9b-9343-c85bcbb74626 service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1776352 Nov 24 14:45:10.923091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1ad73e-6bb1-4192-b809-1a613e6bd781 req-e1a46046-8d12-471d-8de4-61c4fd3f09d9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:10.924528 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b1ad73e-6bb1-4192-b809-1a613e6bd781 req-e1a46046-8d12-471d-8de4-61c4fd3f09d9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 943 time: 0.1228271 Nov 24 14:45:11.012203 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8b1ad73e-6bb1-4192-b809-1a613e6bd781 req-a048b1d9-ad60-4ca6-af9c-2c941f4d9d9a tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813496 Nov 24 14:45:11.037123 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-5653eef7-b379-46b3-85c0-5278500f96d6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 1096 time: 0.0856392 Nov 24 14:45:11.179918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-4d0933c7-9363-4a43-9477-e136244f0e27 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:11.181822 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-4d0933c7-9363-4a43-9477-e136244f0e27 service neutron] 10.222.0.47 "GET /v2.0/networks?id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 200 len: 918 time: 0.1387393 Nov 24 14:45:11.257384 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-6f81581c-d88f-4e7d-a0de-7a1f263e630d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=bcf86f86-2fed-4e81-bc9a-792769892dee HTTP/1.1" status: 200 len: 217 time: 0.0687385 Nov 24 14:45:11.320202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-1e20a821-c9f0-4c73-a220-cf9cc2951f30 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:11.321644 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-1e20a821-c9f0-4c73-a220-cf9cc2951f30 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=3e130406-a9f4-437f-8490-02c95f468a7f HTTP/1.1" status: 200 len: 856 time: 0.0580120 Nov 24 14:45:11.399689 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-c0c914c9-e959-49f2-9cd1-fc5d1abef68a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0720699 Nov 24 14:45:11.532553 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-0b4a9c92-5a11-4297-a915-fa48726aaa17 service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1254418 Nov 24 14:45:11.668632 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1fa29456-1a19-47f1-8bb8-342f7c0f5761 req-f152a006-e605-4280-9aff-b1a91f51193b service neutron] 10.222.0.47 "GET /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1297777 Nov 24 14:45:12.216176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a2219e-ce85-4f4c-a1f9-be570d216dce req-b7e61c48-9f91-461d-bf1f-203fcf6314ca tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:12.217687 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a7a2219e-ce85-4f4c-a1f9-be570d216dce req-b7e61c48-9f91-461d-bf1f-203fcf6314ca tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 943 time: 0.0816343 Nov 24 14:45:12.262046 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a7a2219e-ce85-4f4c-a1f9-be570d216dce req-900e723a-ae1e-4dfc-8ea2-e51a35e5bb34 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388253 Nov 24 14:45:13.463842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff3e09b-43d0-4763-8695-8aa1499a948b req-146499b3-7a13-4a5f-980e-12eb7086e985 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:13.465458 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ff3e09b-43d0-4763-8695-8aa1499a948b req-146499b3-7a13-4a5f-980e-12eb7086e985 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 943 time: 0.0795794 Nov 24 14:45:13.512827 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ff3e09b-43d0-4763-8695-8aa1499a948b req-60dd9ba8-f998-4e60-b402-6cde034f97ef tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411131 Nov 24 14:45:14.475926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bcf86f86-2fed-4e81-bc9a-792769892dee details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:45:14.629286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port bcf86f86-2fed-4e81-bc9a-792769892dee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bcf86f86-2fed-4e81-bc9a-792769892dee,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:14.644440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'bcf86f86-2fed-4e81-bc9a-792769892dee', 'network_id': '93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d', 'port_id': 'bcf86f86-2fed-4e81-bc9a-792769892dee', 'mac_address': 'fa:16:3e:0c:36:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 876, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3e130406-a9f4-437f-8490-02c95f468a7f', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:45:14.705307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:14.720087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dae0b9-9599-4718-a75b-13c8735d4043 req-0d795b6b-6228-4950-8f31-c1cefb93516d tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:14.721590 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-36dae0b9-9599-4718-a75b-13c8735d4043 req-0d795b6b-6228-4950-8f31-c1cefb93516d tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 943 time: 0.0810494 Nov 24 14:45:14.725256 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bcf86f86-2fed-4e81-bc9a-792769892dee {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:45:14.744329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port bcf86f86-2fed-4e81-bc9a-792769892dee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bcf86f86-2fed-4e81-bc9a-792769892dee,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:14.748693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:14.751199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:14.771336 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-36dae0b9-9599-4718-a75b-13c8735d4043 req-0e5d6816-fb35-4578-b58a-fe73c5d0f9f2 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438066 Nov 24 14:45:14.814761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=bcf86f86-2fed-4e81-bc9a-792769892dee,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:14.818298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:15.107441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['bcf86f86-2fed-4e81-bc9a-792769892dee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:45:15.986329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9079a6bd-ac33-45e7-a82d-d96c02988689 req-d12d5cc8-9541-439e-a02f-019f1a45a5d8 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:15.987788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9079a6bd-ac33-45e7-a82d-d96c02988689 req-d12d5cc8-9541-439e-a02f-019f1a45a5d8 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 944 time: 0.0877535 Nov 24 14:45:16.045176 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9079a6bd-ac33-45e7-a82d-d96c02988689 req-91323dff-87d8-4bc8-b86d-d335ad183902 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505724 Nov 24 14:45:16.475645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bcf86f86-2fed-4e81-bc9a-792769892dee up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:45:16.553122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port bcf86f86-2fed-4e81-bc9a-792769892dee completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:45:16.558352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port bcf86f86-2fed-4e81-bc9a-792769892dee triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:45:16.558727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:16.672887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:16.699346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bcf86f86-2fed-4e81-bc9a-792769892dee'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:45:16.710770 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port bcf86f86-2fed-4e81-bc9a-792769892dee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bcf86f86-2fed-4e81-bc9a-792769892dee,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:16.715193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:16.718121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8e78edab-fa59-4849-b493-29e197d94500 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:16.784469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=bcf86f86-2fed-4e81-bc9a-792769892dee,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:16.788794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:16.840511 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bcf86f86-2fed-4e81-bc9a-792769892dee', 'code': 200} Nov 24 14:45:17.084342 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1e154dbf-2d13-4f04-ae15-482518bb6572 req-30c0aed1-635f-492e-ab7c-a165a79a5efe service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 1098 time: 0.0661669 Nov 24 14:45:17.132210 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1e154dbf-2d13-4f04-ae15-482518bb6572 req-281be806-6fcc-4bc3-a1aa-910369249913 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420227 Nov 24 14:45:17.258919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3973fce8-aba7-4512-adde-f7a24b220367 req-36eb09ee-100a-4a1e-9aee-f3472c25fe4e tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:17.260547 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3973fce8-aba7-4512-adde-f7a24b220367 req-36eb09ee-100a-4a1e-9aee-f3472c25fe4e tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.0910230 Nov 24 14:45:17.325389 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3973fce8-aba7-4512-adde-f7a24b220367 req-b253d218-bfa2-4f0e-a0da-b6385416a37d tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585613 Nov 24 14:45:18.238039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:18.550259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21b6987-433a-43a7-b169-a7bedf862807 req-69299ecf-d164-427d-bae2-c7cb132d4510 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:18.551625 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b21b6987-433a-43a7-b169-a7bedf862807 req-69299ecf-d164-427d-bae2-c7cb132d4510 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.0836382 Nov 24 14:45:18.598184 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b21b6987-433a-43a7-b169-a7bedf862807 req-93874bfe-08d8-45d9-b35e-b73b218d1922 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403562 Nov 24 14:45:19.832963 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:45:19.914038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48bfd78a-06b8-4b03-a614-549604881167 req-8ad8ad12-11e2-4015-abda-d7b17afb01d8 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:19.915387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-48bfd78a-06b8-4b03-a614-549604881167 req-8ad8ad12-11e2-4015-abda-d7b17afb01d8 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.1928186 Nov 24 14:45:19.961855 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-48bfd78a-06b8-4b03-a614-549604881167 req-59c9d3df-8737-4634-b886-93ce0927e5ff tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406723 Nov 24 14:45:20.164674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b2c474-fc51-4996-b93b-c8bb2a4306cb req-42f9d2d7-f9eb-4791-a57a-c9efdf7cced6 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:20.166038 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-39b2c474-fc51-4996-b93b-c8bb2a4306cb req-42f9d2d7-f9eb-4791-a57a-c9efdf7cced6 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.0829952 Nov 24 14:45:20.211557 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-39b2c474-fc51-4996-b93b-c8bb2a4306cb req-8d560719-6a03-4c74-98ec-f6627803fb1c tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397842 Nov 24 14:45:33.331027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7923b157-61d5-48b6-909e-7260ac4e15c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:33.743157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:35.906511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e22cd678-4691-4943-8c05-96c246c53a45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:35.957324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd4e391-5cd1-40b0-ae64-fb5fd4ee575b req-e00184cb-b244-4e20-a982-9e44e3b8f7aa tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:35.959517 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6dd4e391-5cd1-40b0-ae64-fb5fd4ee575b req-e00184cb-b244-4e20-a982-9e44e3b8f7aa tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.0818913 Nov 24 14:45:36.006020 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6dd4e391-5cd1-40b0-ae64-fb5fd4ee575b req-686b41f1-1952-4f85-90c6-61664551c322 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405133 Nov 24 14:45:36.932139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:37.202062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c817d1a-9c97-425e-88b1-ba977c5b122a req-4458d433-db33-4668-a131-1c292e36db57 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:37.203400 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3c817d1a-9c97-425e-88b1-ba977c5b122a req-4458d433-db33-4668-a131-1c292e36db57 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.0764241 Nov 24 14:45:37.250429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3c817d1a-9c97-425e-88b1-ba977c5b122a req-79dc2c2c-84ec-4139-9d2f-4c54f891c9a9 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/security-groups?id=83db1899-702a-41eb-9bba-7f60d56b1bd4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409572 Nov 24 14:45:37.769141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-10329635-def4-43a5-bd7c-00ad7aee9e90 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:37.771687 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-10329635-def4-43a5-bd7c-00ad7aee9e90 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 945 time: 0.0853956 Nov 24 14:45:37.840472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Deleting port bcf86f86-2fed-4e81-bc9a-792769892dee {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:37.840820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:38.083844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] For port bcf86f86-2fed-4e81-bc9a-792769892dee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=bcf86f86-2fed-4e81-bc9a-792769892dee,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:38.084113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:38.204213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Calling delete_port for bcf86f86-2fed-4e81-bc9a-792769892dee owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:38.349807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:38.355339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0735d851-ec3d-46e1-b4a7-ef680792e449 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:38.363279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['bcf86f86-2fed-4e81-bc9a-792769892dee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:45:38.401833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Pushing event deleted for resources: {'Port': ['ID=bcf86f86-2fed-4e81-bc9a-792769892dee,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:38.405368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:38.428771 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-617bb2a5-4004-470c-9ccf-f985f654e080 req-5d7e2750-39ab-45ab-804c-e51ead8b60a1 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.70 "GET /v2.0/ports?device_id=b9e34d0a-06ea-4994-98a5-9116ce5d6b09 HTTP/1.1" status: 200 len: 210 time: 0.0487916 Nov 24 14:45:38.479493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] No DVR routers for this DVR port bcf86f86-2fed-4e81-bc9a-792769892dee on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:45:38.482313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:38.485263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'name': 'network-vif-deleted', 'tag': 'bcf86f86-2fed-4e81-bc9a-792769892dee'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:45:38.501922 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-feeeba7d-c34e-4beb-a539-8b70df85a533 req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] 10.222.0.47 "DELETE /v2.0/ports/bcf86f86-2fed-4e81-bc9a-792769892dee HTTP/1.1" status: 204 len: 173 time: 0.7249207 Nov 24 14:45:38.546177 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9e34d0a-06ea-4994-98a5-9116ce5d6b09', 'name': 'network-vif-deleted', 'tag': 'bcf86f86-2fed-4e81-bc9a-792769892dee', 'status': 'completed', 'code': 200} Nov 24 14:45:38.633904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:39.583483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52746) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:39.993198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:40.723828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Deleting port 671c3ba5-e465-4f25-8825-ee0f65fb1feb {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:40.724589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:40.906074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] For port 671c3ba5-e465-4f25-8825-ee0f65fb1feb, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=671c3ba5-e465-4f25-8825-ee0f65fb1feb,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:40.906559 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:41.037626 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Calling delete_port for 671c3ba5-e465-4f25-8825-ee0f65fb1feb owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:41.224569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:41.229307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:41.275654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Pushing event deleted for resources: {'Port': ['ID=671c3ba5-e465-4f25-8825-ee0f65fb1feb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:41.315509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.315931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.316328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.316934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.317374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.317796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.318177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.318544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.318905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.319261 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.319619 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:41.326953 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:41.582636 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:42.296643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Router b479e2f5-594d-4f24-ba12-91af63a8335b has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:45:42.501808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:45:42.516556 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] Sync routers for ids ['b479e2f5-594d-4f24-ba12-91af63a8335b'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:45:42.518692 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] 10.222.0.70 "PUT /v2.0/routers/b479e2f5-594d-4f24-ba12-91af63a8335b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9332726 Nov 24 14:45:42.521257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52750) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:42.524365 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] Routers {'b479e2f5-594d-4f24-ba12-91af63a8335b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:45:42.524984 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b479e2f5-594d-4f24-ba12-91af63a8335b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:42.585212 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bcf86f86-2fed-4e81-bc9a-792769892dee no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:42.621086 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: bcf86f86-2fed-4e81-bc9a-792769892dee {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:42.621433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device bcf86f86-2fed-4e81-bc9a-792769892dee not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:42.717789 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] Set router b479e2f5-594d-4f24-ba12-91af63a8335b gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:45:42.760694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:42.975284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:42.988896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Deleting port 07284ba8-7824-4b53-98a9-693c23b49c7d {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:42.989263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:43.017248 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102'}], 'enable_snat': True}, 'gw_port_id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:45:41Z', 'revision_number': 5, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port': {'id': '07284ba8-7824-4b53-98a9-693c23b49c7d', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:d9:b1:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:21Z', 'updated_at': '2021-11-24T14:44:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:43.022527 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] Checking router: b479e2f5-594d-4f24-ba12-91af63a8335b for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:45:43.039347 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] Routers {'b479e2f5-594d-4f24-ba12-91af63a8335b'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:45:43.040256 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b479e2f5-594d-4f24-ba12-91af63a8335b'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:43.179702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] For port 07284ba8-7824-4b53-98a9-693c23b49c7d, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=07284ba8-7824-4b53-98a9-693c23b49c7d,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:43.180078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:43.237217 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] Set router b479e2f5-594d-4f24-ba12-91af63a8335b gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:45:43.302673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Calling delete_port for 07284ba8-7824-4b53-98a9-693c23b49c7d owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:43.348921 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:45:42Z', 'revision_number': 6, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:43.353112 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48ba48a0-0d6c-4cce-8404-2b4b76079358 None None] The sync data for ids ['b479e2f5-594d-4f24-ba12-91af63a8335b'] in dv-neutron-818151-2-hyperv is: [{'id': 'b479e2f5-594d-4f24-ba12-91af63a8335b', 'name': 'tempest-TestEncryptedCinderVolumes-1756450006-router', 'tenant_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:20Z', 'updated_at': '2021-11-24T14:45:42Z', 'revision_number': 6, 'project_id': 'b85fa4ff0d164878b496c6b317d23fb8', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:45:43.486765 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:43.490583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:43.541126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Pushing event deleted for resources: {'Port': ['ID=07284ba8-7824-4b53-98a9-693c23b49c7d,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:43.543681 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:43.903971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.141812 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 671c3ba5-e465-4f25-8825-ee0f65fb1feb no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:44.176531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.182242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.184779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 671c3ba5-e465-4f25-8825-ee0f65fb1feb {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:44.185137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 671c3ba5-e465-4f25-8825-ee0f65fb1feb not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:44.209639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.210237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b479e2f5-594d-4f24-ba12-91af63a8335b {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:45:44.229690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.230905 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] 10.222.0.70 "DELETE /v2.0/routers/b479e2f5-594d-4f24-ba12-91af63a8335b HTTP/1.1" status: 204 len: 168 time: 1.7083397 Nov 24 14:45:44.234211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52754) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:44.299155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Deleting subnet 3e130406-a9f4-437f-8490-02c95f468a7f {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:45:44.303351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.359748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.444079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.518401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.522748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-edf9a1fa-11eb-45f4-b0b7-5da23ed53d70 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:44.558507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3e130406-a9f4-437f-8490-02c95f468a7f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:44.564450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:44.565446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.574996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2411f7c7-eb4e-4e68-a36e-9fcf74538b66 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/3e130406-a9f4-437f-8490-02c95f468a7f HTTP/1.1" status: 204 len: 168 time: 0.3378942 Nov 24 14:45:44.575214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33adfa0b-d1e5-429c-b558-711c9825ddcd None None] Network 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:45:44.576447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52758) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:44.686021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.698482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Deleting port 027264b0-a2e5-4760-b488-26d4d4157388 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:44.698817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.837075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] DHCP port deletion for 93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:45:44.841415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Deleting port 027264b0-a2e5-4760-b488-26d4d4157388 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:44.841793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:44.908488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] For port 027264b0-a2e5-4760-b488-26d4d4157388, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=027264b0-a2e5-4760-b488-26d4d4157388,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:44.908843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.094938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] For port 027264b0-a2e5-4760-b488-26d4d4157388, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=027264b0-a2e5-4760-b488-26d4d4157388,segment=NetworkSegment(34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e),segment_id=34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:45.095512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.152922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Calling delete_port for 027264b0-a2e5-4760-b488-26d4d4157388 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:45.223627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Calling delete_port for 027264b0-a2e5-4760-b488-26d4d4157388 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:45.236439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.241859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b7d4fff1-597d-4216-9c4a-f1e33cf68c4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:45.289318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Pushing event deleted for resources: {'Port': ['ID=027264b0-a2e5-4760-b488-26d4d4157388,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:45.294209 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:45.298679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] No DVR routers for this DVR port 027264b0-a2e5-4760-b488-26d4d4157388 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:45:45.310884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:45:45.311470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:45:45.417361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.444038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:45.456130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:45.456398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '34a10a2f-2ffe-4dc1-8c4a-69488ca51e2e') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:45.468958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.488720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.494862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Releasing vlan 876 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:45:45.495239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:45:45.508197 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:45:45.586455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.589812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:45.602816 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.613204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Pushing event deleted for resources: {'Network': ['ID=93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:45.616470 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:45.627095 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] 10.222.0.70 "DELETE /v2.0/networks/93a7d5a2-0136-480e-8c9b-ddb7a83d2d1d HTTP/1.1" status: 204 len: 168 time: 1.0496204 Nov 24 14:45:45.630847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52762) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:45.812613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Deleting port 027264b0-a2e5-4760-b488-26d4d4157388 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:45.813296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:45.843331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07284ba8-7824-4b53-98a9-693c23b49c7d no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:45.920357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 07284ba8-7824-4b53-98a9-693c23b49c7d {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:45.920721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 07284ba8-7824-4b53-98a9-693c23b49c7d not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:45.921116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 027264b0-a2e5-4760-b488-26d4d4157388 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:45.956626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c98ba622-4a64-4108-b17a-96123197e205 None None] The port '027264b0-a2e5-4760-b488-26d4d4157388' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:45:45.963050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 027264b0-a2e5-4760-b488-26d4d4157388 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:45.963470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 027264b0-a2e5-4760-b488-26d4d4157388 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:46.042444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:46.776463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Deleting port da530f5e-2130-4162-8175-80d1e2c3289a {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:46.777179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:46.952971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] For port da530f5e-2130-4162-8175-80d1e2c3289a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=da530f5e-2130-4162-8175-80d1e2c3289a,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:46.953324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:47.073308 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Calling delete_port for da530f5e-2130-4162-8175-80d1e2c3289a owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:47.256118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:47.260567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-db799422-3ff2-4c7a-ab8f-4577e437f9bc tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:47.306226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Pushing event deleted for resources: {'Port': ['ID=da530f5e-2130-4162-8175-80d1e2c3289a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:47.308886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:47.605133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:48.246262 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:48.297938 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Router 7508d3f8-07b9-4053-9b01-8116ea071aa9 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:45:48.496052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:45:48.504901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] Sync routers for ids ['7508d3f8-07b9-4053-9b01-8116ea071aa9'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:45:48.506296 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] 10.222.0.70 "PUT /v2.0/routers/7508d3f8-07b9-4053-9b01-8116ea071aa9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8735199 Nov 24 14:45:48.507893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52766) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:48.515901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] Routers {'7508d3f8-07b9-4053-9b01-8116ea071aa9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:45:48.516529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7508d3f8-07b9-4053-9b01-8116ea071aa9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:48.700248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] Set router 7508d3f8-07b9-4053-9b01-8116ea071aa9 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:45:48.723528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:48.916851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:48.927072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Deleting port c19676ca-f0bd-4a0c-81b9-9945aee03eab {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:48.927527 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:49.001363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148'}], 'enable_snat': True}, 'gw_port_id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:45:47Z', 'revision_number': 5, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port': {'id': 'c19676ca-f0bd-4a0c-81b9-9945aee03eab', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:13:22:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:44:27Z', 'updated_at': '2021-11-24T14:44:32Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:49.007001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] Checking router: 7508d3f8-07b9-4053-9b01-8116ea071aa9 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:45:49.018004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] Routers {'7508d3f8-07b9-4053-9b01-8116ea071aa9'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:45:49.018601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7508d3f8-07b9-4053-9b01-8116ea071aa9'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:49.107907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] For port c19676ca-f0bd-4a0c-81b9-9945aee03eab, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c19676ca-f0bd-4a0c-81b9-9945aee03eab,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:49.108259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:49.180581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] Set router 7508d3f8-07b9-4053-9b01-8116ea071aa9 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:45:49.231079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Calling delete_port for c19676ca-f0bd-4a0c-81b9-9945aee03eab owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:49.346941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:45:48Z', 'revision_number': 6, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:49.352844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97f301fc-e9e7-4a37-908f-4e699027eb8b None None] The sync data for ids ['7508d3f8-07b9-4053-9b01-8116ea071aa9'] in dv-neutron-818151-2-hyperv is: [{'id': '7508d3f8-07b9-4053-9b01-8116ea071aa9', 'name': 'tempest-TestEncryptedCinderVolumes-2000151461-router', 'tenant_id': '71c62dab02eb44cba2c69ffea7160ed1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:44:26Z', 'updated_at': '2021-11-24T14:45:48Z', 'revision_number': 6, 'project_id': '71c62dab02eb44cba2c69ffea7160ed1', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:45:49.433805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:49.437600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:49.479809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Pushing event deleted for resources: {'Port': ['ID=c19676ca-f0bd-4a0c-81b9-9945aee03eab,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:49.482307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:49.846827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.106755 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.110891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.145462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.145968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7508d3f8-07b9-4053-9b01-8116ea071aa9 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:45:50.151623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device da530f5e-2130-4162-8175-80d1e2c3289a no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:50.160403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.164325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52770) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:50.168324 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] 10.222.0.70 "DELETE /v2.0/routers/7508d3f8-07b9-4053-9b01-8116ea071aa9 HTTP/1.1" status: 204 len: 168 time: 1.6593931 Nov 24 14:45:50.190429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: da530f5e-2130-4162-8175-80d1e2c3289a {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:50.190780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device da530f5e-2130-4162-8175-80d1e2c3289a not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:50.229269 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Deleting subnet a5eab138-c8df-4223-8bfd-72c6da6a3af9 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:45:50.232397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.292369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.381828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.457235 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.461381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c97deb0b-b576-4ae7-9a5b-cbc72fc31f26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:50.499029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a5eab138-c8df-4223-8bfd-72c6da6a3af9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:50.502502 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:50.510054 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.516188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9c6c19d-7af2-497a-8c02-85fe0689f99c None None] Network 1ce75103-bb5d-4b6b-a901-0619484cf902 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:45:50.518267 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ab9ca0b5-5dd4-4495-ac19-4bf02477b6b9 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/a5eab138-c8df-4223-8bfd-72c6da6a3af9 HTTP/1.1" status: 204 len: 168 time: 0.3526826 Nov 24 14:45:50.524567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52774) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:50.634951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.646516 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Deleting port 43206f1e-b98a-4a76-93af-d6b31c9521c8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:50.646868 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.776423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] DHCP port deletion for 1ce75103-bb5d-4b6b-a901-0619484cf902 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:45:50.781032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Deleting port 43206f1e-b98a-4a76-93af-d6b31c9521c8 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:50.781434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.874912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] For port 43206f1e-b98a-4a76-93af-d6b31c9521c8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=43206f1e-b98a-4a76-93af-d6b31c9521c8,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:50.875263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:50.999115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] For port 43206f1e-b98a-4a76-93af-d6b31c9521c8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=43206f1e-b98a-4a76-93af-d6b31c9521c8,segment=NetworkSegment(61294373-ef6c-4df2-a00e-96d805638406),segment_id=61294373-ef6c-4df2-a00e-96d805638406)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:50.999332 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Calling delete_port for 43206f1e-b98a-4a76-93af-d6b31c9521c8 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:50.999436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.127858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Calling delete_port for 43206f1e-b98a-4a76-93af-d6b31c9521c8 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:45:51.199877 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.db.api [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 24 14:45:51.199877 dv-neutron-818151-2-hyperv neutron-server[83525]: [SQL: DELETE FROM portsecuritybindings WHERE portsecuritybindings.port_id = %(port_id)s] Nov 24 14:45:51.199877 dv-neutron-818151-2-hyperv neutron-server[83525]: [parameters: {'port_id': '43206f1e-b98a-4a76-93af-d6b31c9521c8'}] Nov 24 14:45:51.199877 dv-neutron-818151-2-hyperv neutron-server[83525]: (Background on this error at: http://sqlalche.me/e/13/e3q8) {{(pid=83525) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:45:51.200744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_db.api [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:45:51.205711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.210241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:51.255021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Pushing event deleted for resources: {'Port': ['ID=43206f1e-b98a-4a76-93af-d6b31c9521c8,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:51.266548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.266892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.267229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.267562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.267915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.268240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.268569 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.268890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.269846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.270296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.270666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:51.273398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] No DVR routers for this DVR port 43206f1e-b98a-4a76-93af-d6b31c9521c8 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:45:51.274775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:51.702032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Deleting port 43206f1e-b98a-4a76-93af-d6b31c9521c8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:45:51.702352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.768622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] The port '43206f1e-b98a-4a76-93af-d6b31c9521c8' was deleted {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:45:51.819894 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c19676ca-f0bd-4a0c-81b9-9945aee03eab no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:51.855038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c19676ca-f0bd-4a0c-81b9-9945aee03eab {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:51.855387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c19676ca-f0bd-4a0c-81b9-9945aee03eab not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:51.855840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 43206f1e-b98a-4a76-93af-d6b31c9521c8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:45:51.887733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 43206f1e-b98a-4a76-93af-d6b31c9521c8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:45:51.888094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.888276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 43206f1e-b98a-4a76-93af-d6b31c9521c8 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:45:51.918971 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1ce75103-bb5d-4b6b-a901-0619484cf902']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:51.933016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '61294373-ef6c-4df2-a00e-96d805638406') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:51.933304 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '61294373-ef6c-4df2-a00e-96d805638406') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:51.944963 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.962580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.969239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Releasing vlan 880 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:45:51.969635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:45:51.983720 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:45:52.063919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:52.068975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bec85e0c-50c4-4449-9fee-bc7896cd0c9e tempest-RoutersTest-898552691 tempest-RoutersTest-898552691-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:52.082787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:52.092014 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Pushing event deleted for resources: {'Network': ['ID=1ce75103-bb5d-4b6b-a901-0619484cf902,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:52.095143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:52.096675 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cbd8fd52-69f7-4f5d-bf52-00d04c9ca4b9 admin admin] 10.222.0.70 "DELETE /v2.0/networks/1ce75103-bb5d-4b6b-a901-0619484cf902 HTTP/1.1" status: 204 len: 168 time: 1.5711298 Nov 24 14:45:52.304853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52780) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:52.359186 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-577aec53-4964-4038-8496-14c527caa80c admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=b85fa4ff0d164878b496c6b317d23fb8&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0528748 Nov 24 14:45:52.361571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52784) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:52.427784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:52.454437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:52.513369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:52.518656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b9d165af-acec-43c6-9184-439a5b6d05f8 tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:52.533167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83db1899-702a-41eb-9bba-7f60d56b1bd4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:52.537032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:52.544684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:52.545794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/83db1899-702a-41eb-9bba-7f60d56b1bd4 HTTP/1.1" status: 204 len: 168 time: 0.1832964 Nov 24 14:45:52.959416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52792) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:53.011852 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d7155655-2729-44cf-bfcf-89896fbb76db admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=71c62dab02eb44cba2c69ffea7160ed1&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0511217 Nov 24 14:45:53.014478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52796) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:53.078265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:53.105655 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:53.162154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:53.166070 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c56277b3-6495-4a86-bcfc-9b9dd7fb360f tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:53.180929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ccd363a-cda1-4889-8e60-010c857eadd9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:53.184469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:53.187818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:53.188937 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9e9a58d7-5b55-46bc-b9f9-02046e87aa7a admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/4ccd363a-cda1-4889-8e60-010c857eadd9 HTTP/1.1" status: 204 len: 168 time: 0.1737728 Nov 24 14:45:54.047803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52818) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:54.262474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1726705708-network', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:45:54.267413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:45:54.271931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Usage tracker for resource:network and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:45:54.274863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:45:54.282176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:45:54.292562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Made reservation on behalf of 1ec805494cfe48e7b3b437f76c8c3ec4 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:45:54.294809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.307436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.340592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:45:54.344573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:45:54.348065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:45:54.353899 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:45:54.426779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.430426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.433718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-31d49979-6e48-4f02-b244-14af85149aae tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:54.463972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 894} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:45:54.473444 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86544101-7a2a-4765-a2eb-64e2f04c60d0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:54.476983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:54.481624 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.481624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Added segment b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c of type vlan for network e8822aff-2fcb-45e7-b9e7-82f074050f9e Nov 24 14:45:54.509731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.543914 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.544857 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:54.545446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.549029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d3218e51-edb5-4301-889d-fc9b054a6ab8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:54.654167 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6046124 Nov 24 14:45:54.657592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52826) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:54.659309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Pushing event updated for resources: {'Network': ['ID=e8822aff-2fcb-45e7-b9e7-82f074050f9e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:54.662686 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-87cffc25-4758-4951-98b8-ba2fce9cd20b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:54.663751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Request body: {'subnet': {'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1726705708-subnet', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:45:54.668899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:45:54.669533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:45:54.675941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Usage tracker for resource:subnet and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:45:54.679208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:45:54.685144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:45:54.699314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Made reservation on behalf of 1ec805494cfe48e7b3b437f76c8c3ec4 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:45:54.701886 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.914315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:54.917906 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c5b429e3-4a3d-4057-8e46-b4fc044dc84f tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:54.981910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:54.990922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:55.006931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Checking segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:45:55.007283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Network hostable DHCP agents. Network: e8822aff-2fcb-45e7-b9e7-82f074050f9e, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:45:55.031545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:45:55.042278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, e8822aff-2fcb-45e7-b9e7-82f074050f9e) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:45:55.047289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:45:55.049305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.050780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa77075b-4980-4bb8-a28d-17ca8aa47955 None None] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:45:55.073053 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1a1d631c-47f7-430f-8994-6f622f09bd87 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4143357 Nov 24 14:45:55.075941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52830) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:55.081118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:45:55.086801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:45:55.091546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Usage tracker for resource:router and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:45:55.094254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:45:55.100763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:45:55.112400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.114498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.135589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.280249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:45:55.281096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.288369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.486840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Allocated IP 172.20.0.2 (e8822aff-2fcb-45e7-b9e7-82f074050f9e/fb38b9a3-dbb7-4096-9f7a-0ba3e693203b/e7b581bb-fe30-4433-821d-213337e892c1) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:45:55.496383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.528750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.669831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Allocated IP 172.26.4.48 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/87322f84-4537-401c-82dc-6a415099e457) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:45:55.691885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.702563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Transition to ACTIVE for port object e7b581bb-fe30-4433-821d-213337e892c1 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:45:55.720820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Transition to ACTIVE for port object e7b581bb-fe30-4433-821d-213337e892c1 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:45:55.726899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.731861 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-12dd3384-3a00-445a-9709-1466463fcc08 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:55.795108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:45:55.803085 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:45:55.807424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:45:55.812888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Pushing event updated for resources: {'Port': ['ID=e7b581bb-fe30-4433-821d-213337e892c1,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:55.817056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:55.902021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Attempting to bind port e7b581bb-fe30-4433-821d-213337e892c1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:45:55.902411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Attempting to bind port e7b581bb-fe30-4433-821d-213337e892c1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:45:55.902772 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Attempting to bind port e7b581bb-fe30-4433-821d-213337e892c1 on network e8822aff-2fcb-45e7-b9e7-82f074050f9e {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:45:55.909499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 45, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:45:55.909930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Checking segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:45:55.910817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.910817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Bound using segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:45:55.911194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Bound port: e7b581bb-fe30-4433-821d-213337e892c1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:45:55.911577 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.943313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.978053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:55.982493 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c5c989a-e899-40db-bdb9-160a01d449b8 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:56.016371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] For port e7b581bb-fe30-4433-821d-213337e892c1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:45:56.019727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] For port e7b581bb-fe30-4433-821d-213337e892c1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e7b581bb-fe30-4433-821d-213337e892c1,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:45:56.024987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:56.029373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-316fffc7-da69-4983-8c49-08bd8440c5d3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:56.051287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:45:56.054929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:45:56.057847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:45:56.092350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Pushing event updated for resources: {'Port': ['ID=87322f84-4537-401c-82dc-6a415099e457,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:56.095701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:56.110013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Pushing event updated for resources: {'Port': ['ID=e7b581bb-fe30-4433-821d-213337e892c1,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:56.115391 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:56.254491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:56.255236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:56.526675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Router e67a3273-1d78-4da5-86a4-eccb913356fe is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:45:56.726081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:45:56.741394 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Sync routers for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:45:56.753122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:56.755247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.6782553 Nov 24 14:45:56.757367 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:45:56.757983 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:56.759142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 52834) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:45:56.856787 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:45:56.964425 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:45:57.217223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43dda0a4-20d8-4bb6-9503-24c3c1337a5c None None] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:45:57.300024 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:56Z', 'revision_number': 3, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:57.304615 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Checking router: e67a3273-1d78-4da5-86a4-eccb913356fe for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:45:57.304971 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Updating router e67a3273-1d78-4da5-86a4-eccb913356fe port 87322f84-4537-401c-82dc-6a415099e457 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:45:57.352899 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b2b3abc5-931c-4579-8919-b04b5a33c35c None None] Provisioning for port e7b581bb-fe30-4433-821d-213337e892c1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:45:57.361393 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.654786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.718269 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.730430 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Transition to ACTIVE for port object 87322f84-4537-401c-82dc-6a415099e457 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:45:57.738055 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.741944 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-fa77086c-f1ca-4b10-b605-773a49f232c5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:57.823836 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Pushing event updated for resources: {'Port': ['ID=87322f84-4537-401c-82dc-6a415099e457,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:57.853805 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.854224 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.854475 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.854807 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.855131 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.855470 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.855794 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.856122 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.856437 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.856757 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.857071 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:45:57.861261 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:57.868835 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Attempting to bind port 87322f84-4537-401c-82dc-6a415099e457 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:45:57.870484 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Attempting to bind port 87322f84-4537-401c-82dc-6a415099e457 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:45:57.870484 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Attempting to bind port 87322f84-4537-401c-82dc-6a415099e457 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:45:57.880089 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 45, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:45:57.880482 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:45:57.880962 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.882130 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:45:57.885082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e7b581bb-fe30-4433-821d-213337e892c1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:45:57.888449 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Bound port: 87322f84-4537-401c-82dc-6a415099e457, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:45:57.888947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.960282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port e7b581bb-fe30-4433-821d-213337e892c1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:45:57.965817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e7b581bb-fe30-4433-821d-213337e892c1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:45:57.966157 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] For port 87322f84-4537-401c-82dc-6a415099e457, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:45:57.966369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.970299 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] For port 87322f84-4537-401c-82dc-6a415099e457, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=87322f84-4537-401c-82dc-6a415099e457,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:45:57.975224 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:57.979255 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-d0bdae8e-b7c7-4ef6-9676-578940d672ac None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:58.002291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Allocated IP 172.20.0.1 (e8822aff-2fcb-45e7-b9e7-82f074050f9e/fb38b9a3-dbb7-4096-9f7a-0ba3e693203b/0c91878e-812f-4396-b778-a258810dcf59) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:45:58.082606 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Pushing event updated for resources: {'Port': ['ID=87322f84-4537-401c-82dc-6a415099e457,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:58.086164 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:58.087577 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:45:58.088209 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:58.113420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.157973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port e7b581bb-fe30-4433-821d-213337e892c1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e7b581bb-fe30-4433-821d-213337e892c1,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:45:58.163021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.169308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-be4c653d-6c50-48da-8db9-3856f110413c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:58.174645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.198364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Transition to ACTIVE for port object 0c91878e-812f-4396-b778-a258810dcf59 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:45:58.226271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.231472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8090c91a-2998-4f76-8c0f-11023b273a76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:58.242681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=e7b581bb-fe30-4433-821d-213337e892c1,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:58.245851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:58.310437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:45:58.311258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Pushing event updated for resources: {'Port': ['ID=0c91878e-812f-4396-b778-a258810dcf59,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:58.313785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:45:58.314061 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:45:58.315532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:58.316748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:45:58.372088 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.468337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.549264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5f7fccde-1170-4683-b289-7375c089558f None None] Provisioning for port 0c91878e-812f-4396-b778-a258810dcf59 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:45:58.561704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5f7fccde-1170-4683-b289-7375c089558f None None] Provisioning complete for port 0c91878e-812f-4396-b778-a258810dcf59 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:45:58.562287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5f7fccde-1170-4683-b289-7375c089558f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.633570 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:56Z', 'revision_number': 3, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:45:58.638626 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6e15703-85ca-4cae-b234-89346d1269c5 None None] The sync data for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv is: [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:56Z', 'revision_number': 3, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:45:58.662647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5f7fccde-1170-4683-b289-7375c089558f None None] Port 0c91878e-812f-4396-b778-a258810dcf59 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:45:58.757665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.763772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.788424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c74d8cb3-42a3-494b-81fc-409593051403 tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:45:58.875741 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Pushing event updated for resources: {'Port': ['ID=0c91878e-812f-4396-b778-a258810dcf59,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:45:58.878248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:58.882625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:45:59.030820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:45:59.031993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:45:59.293156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d7c09cd6-1b5d-482d-a782-50ed9feccf2f None None] Provisioning complete for port 0c91878e-812f-4396-b778-a258810dcf59 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:45:59.294202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d7c09cd6-1b5d-482d-a782-50ed9feccf2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:45:59.355247 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d7c09cd6-1b5d-482d-a782-50ed9feccf2f None None] Port 0c91878e-812f-4396-b778-a258810dcf59 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:45:59.461400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Router e67a3273-1d78-4da5-86a4-eccb913356fe has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:45:59.782858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:45:59.796394 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] 10.222.0.70 "PUT /v2.0/routers/e67a3273-1d78-4da5-86a4-eccb913356fe/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0360398 Nov 24 14:45:59.893746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 87322f84-4537-401c-82dc-6a415099e457 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:45:59.968612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 87322f84-4537-401c-82dc-6a415099e457 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:45:59.974231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 87322f84-4537-401c-82dc-6a415099e457 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:45:59.974509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.098521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.118174 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 87322f84-4537-401c-82dc-6a415099e457, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=87322f84-4537-401c-82dc-6a415099e457,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:00.122368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.123398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e7b581bb-fe30-4433-821d-213337e892c1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:00.147412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:00.239512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=87322f84-4537-401c-82dc-6a415099e457,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:00.242854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:00.257331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e7b581bb-fe30-4433-821d-213337e892c1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:00.257920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.678551 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52856) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:00.684127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2042147552-network', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:00.689018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:00.694094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Usage tracker for resource:network and tenant:f63c42f2f18c430c8376e71e241959c0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:00.696975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:00.702580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:00.715794 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Made reservation on behalf of f63c42f2f18c430c8376e71e241959c0 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:46:00.718239 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.732064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.766546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:00.771369 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Usage tracker for resource:security_group_rule and tenant:f63c42f2f18c430c8376e71e241959c0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:00.774290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:00.780110 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:00.853656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.857466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.860526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8a827b9f-774f-489e-8df0-a6483b86ea49 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:00.888016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 895} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:46:00.897011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4af99a80-5ba5-4f2f-800d-2179283aa4ba,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:00.900568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:00.903185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.903522 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Added segment c2814cad-7444-44e7-b6ff-45aabf50a342 of type vlan for network b00e3f5c-f577-45fe-8561-f758f2bcdb66 Nov 24 14:46:00.930907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.966016 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.966937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:00.967500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:00.970924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5fe26d85-73e6-4cae-87ea-c1162cbd96c8 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:01.071318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Pushing event updated for resources: {'Network': ['ID=b00e3f5c-f577-45fe-8561-f758f2bcdb66,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:01.077178 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3949664 Nov 24 14:46:01.077178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:01.077452 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52860) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:01.082755 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Request body: {'subnet': {'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2042147552-subnet', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:01.082930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:46:01.088056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:01.091888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Usage tracker for resource:subnet and tenant:f63c42f2f18c430c8376e71e241959c0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:01.094893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:01.103011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:01.117985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Made reservation on behalf of f63c42f2f18c430c8376e71e241959c0 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:46:01.120337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.332663 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.336564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ff8f2cfa-3ca0-407f-ad33-dec8e9839296 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:01.407160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Pushing event updated for resources: {'Subnet': ['ID=52335652-408a-447d-acb1-5d1e0387fabd,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:01.409901 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:01.430175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Checking segment: {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:46:01.430530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Network hostable DHCP agents. Network: b00e3f5c-f577-45fe-8561-f758f2bcdb66, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:46:01.455584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:46:01.466208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, b00e3f5c-f577-45fe-8561-f758f2bcdb66) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:01.471284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:01.473923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.474951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae5b319a-8ed8-408b-838c-9051f8349e51 None None] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:46:01.495420 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4170322 Nov 24 14:46:01.497996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52864) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:01.503395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:01.509654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:01.514389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Usage tracker for resource:router and tenant:f63c42f2f18c430c8376e71e241959c0 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:01.517097 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:01.523171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:01.533717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.535623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.556658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.693218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-b00e3f5c-f577-45fe-8561-f758f2bcdb66', 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'fixed_ips': [{'subnet_id': '52335652-408a-447d-acb1-5d1e0387fabd'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:46:01.694068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.710325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:01.854107 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 87322f84-4537-401c-82dc-6a415099e457 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:01.939792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Allocated IP 172.20.0.2 (b00e3f5c-f577-45fe-8561-f758f2bcdb66/52335652-408a-447d-acb1-5d1e0387fabd/5bef47f0-4286-4bc0-96e6-afe1a4e4f258) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:46:01.976088 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 87322f84-4537-401c-82dc-6a415099e457 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:01.976376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.041867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.078313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.231523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Sync routers for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:46:02.246302 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Allocated IP 172.26.4.201 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/f3064e14-d1fb-4012-afca-23739ab14e08) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:46:02.278199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.290282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:02.290917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:02.340742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Transition to ACTIVE for port object 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:02.385975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Transition to ACTIVE for port object 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:02.418613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.439443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.449888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.450114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:02.454404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:02.522388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:46:02.525654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Pushing event updated for resources: {'Port': ['ID=f3064e14-d1fb-4012-afca-23739ab14e08,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:02.529305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:46:02.529520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:02.530267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:02.533437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:46:02.545317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:02.552167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:46:02.561707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Pushing event updated for resources: {'Port': ['ID=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:02.568456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:02.610628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:02.709471 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.711285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.714833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Attempting to bind port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:46:02.715216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Attempting to bind port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:46:02.715606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Attempting to bind port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 on network b00e3f5c-f577-45fe-8561-f758f2bcdb66 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:46:02.734735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 45, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:46:02.735121 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Checking segment: {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:46:02.735527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.735962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Bound using segment: {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:46:02.736434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Bound port: 5bef47f0-4286-4bc0-96e6-afe1a4e4f258, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:46:02.736818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:02.962565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Router 7caf63c6-7039-4be0-81eb-a14785bb1c9e is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:46:03.038737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] For port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:46:03.075158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] For port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:46:03.084936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.090929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e0ad107d-b432-4178-9f14-47c0d1e08609 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:03.183285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Pushing event updated for resources: {'Port': ['ID=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:03.184688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:46:03.187061 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:03.196795 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Sync routers for ids ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:46:03.211732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 2, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:03.216067 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Checking router: e67a3273-1d78-4da5-86a4-eccb913356fe for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:46:03.216356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Updating router e67a3273-1d78-4da5-86a4-eccb913356fe port 0c91878e-812f-4396-b778-a258810dcf59 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:46:03.217104 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Routers {'7caf63c6-7039-4be0-81eb-a14785bb1c9e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:03.217966 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:03.235200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.236564 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.7375491 Nov 24 14:46:03.239388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 52868) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:03.301672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.420964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-be60ca01-f58e-4228-8b90-900485f0473d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.505528 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Set router 7caf63c6-7039-4be0-81eb-a14785bb1c9e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:03.786115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.798284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.834823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Transition to ACTIVE for port object 0c91878e-812f-4396-b778-a258810dcf59 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:03.845098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.851697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:03.900335 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:46:02Z', 'revision_number': 3, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:03.904572 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Checking router: 7caf63c6-7039-4be0-81eb-a14785bb1c9e for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:46:03.904934 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Updating router 7caf63c6-7039-4be0-81eb-a14785bb1c9e port f3064e14-d1fb-4012-afca-23739ab14e08 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:46:03.940875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49a02ef4-b387-489a-adfe-450b00c75faa None None] Pushing event updated for resources: {'Port': ['ID=0c91878e-812f-4396-b778-a258810dcf59,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:03.944842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:03.973013 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:03.979004 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49a02ef4-b387-489a-adfe-450b00c75faa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:04.230345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Attempting to bind port 0c91878e-812f-4396-b778-a258810dcf59 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:46:04.230734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Attempting to bind port 0c91878e-812f-4396-b778-a258810dcf59 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:46:04.231104 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Attempting to bind port 0c91878e-812f-4396-b778-a258810dcf59 on network e8822aff-2fcb-45e7-b9e7-82f074050f9e {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:46:04.248457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 46, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:46:04.249356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Checking segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:46:04.250057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.250621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Bound using segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:46:04.251214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Bound port: 0c91878e-812f-4396-b778-a258810dcf59, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:46:04.251996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.283841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:04.454274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] For port 0c91878e-812f-4396-b778-a258810dcf59, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:46:04.459890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] For port 0c91878e-812f-4396-b778-a258810dcf59, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0c91878e-812f-4396-b778-a258810dcf59,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:46:04.465670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.467026 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.471497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e0ad107d-b432-4178-9f14-47c0d1e08609 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:04.482431 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Transition to ACTIVE for port object f3064e14-d1fb-4012-afca-23739ab14e08 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:04.495139 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.498772 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-8dafaf68-0a93-4067-bef9-28383b798509 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:04.500064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.593600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:04.594362 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:04.621949 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Attempting to bind port f3064e14-d1fb-4012-afca-23739ab14e08 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:46:04.622318 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Attempting to bind port f3064e14-d1fb-4012-afca-23739ab14e08 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:46:04.622689 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Attempting to bind port f3064e14-d1fb-4012-afca-23739ab14e08 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:46:04.646712 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 46, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:46:04.647071 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:46:04.647740 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.648145 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:46:04.648623 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Bound port: f3064e14-d1fb-4012-afca-23739ab14e08, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:46:04.649187 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.670062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49a02ef4-b387-489a-adfe-450b00c75faa None None] Pushing event updated for resources: {'Port': ['ID=0c91878e-812f-4396-b778-a258810dcf59,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:04.682158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c9d0364-5e03-4220-a1d3-10bbbebb2164 None None] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:46:04.699960 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b1eb64-8b4c-4007-a339-12a295868db0 None None] Pushing event updated for resources: {'Port': ['ID=f3064e14-d1fb-4012-afca-23739ab14e08,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:04.713726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49a02ef4-b387-489a-adfe-450b00c75faa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:04.718696 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a5b1eb64-8b4c-4007-a339-12a295868db0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.220s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:04.751505 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] For port f3064e14-d1fb-4012-afca-23739ab14e08, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:46:04.759592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] For port f3064e14-d1fb-4012-afca-23739ab14e08, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f3064e14-d1fb-4012-afca-23739ab14e08,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:46:04.768492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:04.774969 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:04.839221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Allocated IP 172.20.0.1 (b00e3f5c-f577-45fe-8561-f758f2bcdb66/52335652-408a-447d-acb1-5d1e0387fabd/0a22c9dc-4b87-4064-881a-ca553ff2404e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:46:04.899481 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b1eb64-8b4c-4007-a339-12a295868db0 None None] Pushing event updated for resources: {'Port': ['ID=f3064e14-d1fb-4012-afca-23739ab14e08,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:04.902692 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a5b1eb64-8b4c-4007-a339-12a295868db0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:04.903674 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Routers {'7caf63c6-7039-4be0-81eb-a14785bb1c9e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:04.904299 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:45:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:05.013872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.033166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Transition to ACTIVE for port object 0a22c9dc-4b87-4064-881a-ca553ff2404e will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:05.061106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:05.062848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.068353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:05.101709 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] Set router 7caf63c6-7039-4be0-81eb-a14785bb1c9e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:05.139689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Provisioning for port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:05.142361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:46:05.147077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:05.152840 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:46:05.179350 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Pushing event updated for resources: {'Port': ['ID=0a22c9dc-4b87-4064-881a-ca553ff2404e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:05.186181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:05.189437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Provisioning complete for port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:05.189823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.211275 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.325593 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.407564 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:46:02Z', 'revision_number': 3, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:05.412230 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a676f9c-a9bc-45e3-b951-92e7eb0f6d3a None None] The sync data for ids ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'] in dv-neutron-818151-2-hyperv is: [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:46:02Z', 'revision_number': 3, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:46:05.557513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.580952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.586786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.604981 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] For port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:05.611281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.618845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-27965cb1-81a1-4b6d-92a4-9997587dffef None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:05.620252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a1035b8e-6238-4b61-b387-a016dc04052b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:05.655090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:04Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:05.669767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b49c7068-5532-46f3-8207-68eff6b99662 None None] The sync data for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv is: [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:04Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:46:05.711184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Pushing event updated for resources: {'Port': ['ID=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:05.716499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:05.810412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Pushing event updated for resources: {'Port': ['ID=0a22c9dc-4b87-4064-881a-ca553ff2404e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:05.813270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.818950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:05.919609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f439691f-75d7-41c5-a71d-cbf16144775d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:05.931645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-aeb22fff-5b8f-4c84-85a0-3646130b53e6 None None] Provisioning for port 0a22c9dc-4b87-4064-881a-ca553ff2404e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:05.938345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-aeb22fff-5b8f-4c84-85a0-3646130b53e6 None None] Provisioning complete for port 0a22c9dc-4b87-4064-881a-ca553ff2404e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:05.939801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aeb22fff-5b8f-4c84-85a0-3646130b53e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.052356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-aeb22fff-5b8f-4c84-85a0-3646130b53e6 None None] Port 0a22c9dc-4b87-4064-881a-ca553ff2404e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:46:06.065914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:06.076880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:46:06.078128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:06.138113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-aeb22fff-5b8f-4c84-85a0-3646130b53e6 None None] Provisioning complete for port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:06.138798 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-aeb22fff-5b8f-4c84-85a0-3646130b53e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.365888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:06.366345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.517298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-95bda3b9-d552-44e5-bb75-3e4487eb749d None None] Provisioning complete for port 0a22c9dc-4b87-4064-881a-ca553ff2404e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:06.518370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-95bda3b9-d552-44e5-bb75-3e4487eb749d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.570465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0c91878e-812f-4396-b778-a258810dcf59 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:06.643288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-95bda3b9-d552-44e5-bb75-3e4487eb749d None None] Port 0a22c9dc-4b87-4064-881a-ca553ff2404e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:46:06.680600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 0c91878e-812f-4396-b778-a258810dcf59 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:06.688632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0c91878e-812f-4396-b778-a258810dcf59 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:06.689224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.778763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Router 7caf63c6-7039-4be0-81eb-a14785bb1c9e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:46:06.905241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.966984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.979779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 0c91878e-812f-4396-b778-a258810dcf59, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0c91878e-812f-4396-b778-a258810dcf59,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:06.986503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:06.991374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:07.072428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=0c91878e-812f-4396-b778-a258810dcf59,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:07.075198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:07.088684 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:46:07.099464 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] 10.222.0.70 "PUT /v2.0/routers/7caf63c6-7039-4be0-81eb-a14785bb1c9e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8578510 Nov 24 14:46:07.901527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f3064e14-d1fb-4012-afca-23739ab14e08 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:07.977407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port f3064e14-d1fb-4012-afca-23739ab14e08 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:07.982928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f3064e14-d1fb-4012-afca-23739ab14e08 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:07.983316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:08.110435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:08.129468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port f3064e14-d1fb-4012-afca-23739ab14e08, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f3064e14-d1fb-4012-afca-23739ab14e08,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:08.133904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:08.134838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0c91878e-812f-4396-b778-a258810dcf59 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:08.165357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49a02ef4-b387-489a-adfe-450b00c75faa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:08.297519 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=f3064e14-d1fb-4012-afca-23739ab14e08,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:08.301602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:08.312632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0c91878e-812f-4396-b778-a258810dcf59 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:08.313010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:08.636707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:09.841827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f3064e14-d1fb-4012-afca-23739ab14e08 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:09.920220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port f3064e14-d1fb-4012-afca-23739ab14e08 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:09.920747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:18.253554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:18.274402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-1b1e4cd4-f6c5-4557-831a-53a45d336446 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:18.274402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-1b1e4cd4-f6c5-4557-831a-53a45d336446 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 815 time: 0.1531529 Nov 24 14:46:18.293340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-6e6d26fe-e3f7-4625-81de-9fed3562cea5 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/quotas/1ec805494cfe48e7b3b437f76c8c3ec4 HTTP/1.1" status: 200 len: 375 time: 0.0120249 Nov 24 14:46:18.379394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-bafd5bfc-d5f7-475e-ab21-dca91b607d57 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Synchronizing usage tracker for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:46:18.396893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-bafd5bfc-d5f7-475e-ab21-dca91b607d57 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Unset dirty status for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:46:18.398191 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-bafd5bfc-d5f7-475e-ab21-dca91b607d57 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0994344 Nov 24 14:46:18.414570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-e26f12a6-a4df-412a-8893-5a890d6105f3 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:46:18.415521 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-e26f12a6-a4df-412a-8893-5a890d6105f3 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0052969 Nov 24 14:46:18.566974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-3300f1c7-56d0-4043-9266-653c6b0a6c70 service neutron] 10.222.0.70 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1453114 Nov 24 14:46:18.701596 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-e5a19cd9-591c-4d5b-932c-3bce73bd7c72 service neutron] 10.222.0.70 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288841 Nov 24 14:46:18.887957 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c03f5769-e1f4-4306-8e9b-3392bdab1d14 req-fb1e24ce-753f-42b8-aa35-ad24ad62ac77 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 210 time: 0.0438445 Nov 24 14:46:20.063820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-930e858a-b2d3-4437-9909-ce4c5b342828 req-9bc12cdd-2773-4078-ab0a-e784e360d43d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 210 time: 0.0475030 Nov 24 14:46:20.304997 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-6d83a408-65cc-4e9b-8398-4abf667a7915 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:20.306406 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-6d83a408-65cc-4e9b-8398-4abf667a7915 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 815 time: 0.1702292 Nov 24 14:46:20.324459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'port': {'device_id': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'admin_state_up': True, 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:20.474004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:20.484038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:20.500165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Made reservation on behalf of 1ec805494cfe48e7b3b437f76c8c3ec4 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:46:20.503967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:20.686045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Allocated IP 172.20.0.8 (e8822aff-2fcb-45e7-b9e7-82f074050f9e/fb38b9a3-dbb7-4096-9f7a-0ba3e693203b/eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:46:21.006168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:21.025805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Transition to ACTIVE for port object eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:21.060502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:21.068578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:21.145468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:46:21.149152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:21.151977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:46:21.196137 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:21.231355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.243480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.244033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.244408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.244782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.245145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.245507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.245933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.246296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.246663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.247021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:21.251515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:21.277569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:21.278233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:21.352357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0316854 Nov 24 14:46:21.390351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1d4f67-d26f-457f-ace0-e402e45f68c8 req-cd29398b-afa8-409f-b518-73ac172db4be tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:21.392085 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3d1d4f67-d26f-457f-ace0-e402e45f68c8 req-cd29398b-afa8-409f-b518-73ac172db4be tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.1719649 Nov 24 14:46:21.447349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-3d1d4f67-d26f-457f-ace0-e402e45f68c8 req-a244b412-a054-4d71-9c23-22f54950e67d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Synchronizing usage tracker for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:46:21.484578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-3d1d4f67-d26f-457f-ace0-e402e45f68c8 req-a244b412-a054-4d71-9c23-22f54950e67d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Unset dirty status for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:46:21.486133 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3d1d4f67-d26f-457f-ace0-e402e45f68c8 req-a244b412-a054-4d71-9c23-22f54950e67d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872290 Nov 24 14:46:21.602346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7e06a790-3026-4999-bbff-ed76d7184088 None None] Provisioning for port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:21.607866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7e06a790-3026-4999-bbff-ed76d7184088 None None] Provisioning complete for port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:21.608243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7e06a790-3026-4999-bbff-ed76d7184088 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:21.666303 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7e06a790-3026-4999-bbff-ed76d7184088 None None] Port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:46:22.733940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e32602-c6e2-4071-a54c-6bd1485a921d req-c9b6e141-8370-404f-9f65-49e25572f4f9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:22.734699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-10e32602-c6e2-4071-a54c-6bd1485a921d req-c9b6e141-8370-404f-9f65-49e25572f4f9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Synchronizing usage tracker for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:46:22.755542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-10e32602-c6e2-4071-a54c-6bd1485a921d req-c9b6e141-8370-404f-9f65-49e25572f4f9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Unset dirty status for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:46:22.757568 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10e32602-c6e2-4071-a54c-6bd1485a921d req-c9b6e141-8370-404f-9f65-49e25572f4f9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.1104681 Nov 24 14:46:22.823008 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10e32602-c6e2-4071-a54c-6bd1485a921d req-d2aa7e70-4b42-4176-80aa-e902cab6dbbd tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583820 Nov 24 14:46:24.072121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-728cd04a-4946-4922-ba59-4eb2e72f41c8 req-9cf8df00-9373-4d6b-856d-e83621de11a8 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:24.073528 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-728cd04a-4946-4922-ba59-4eb2e72f41c8 req-9cf8df00-9373-4d6b-856d-e83621de11a8 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.1006134 Nov 24 14:46:24.122644 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-728cd04a-4946-4922-ba59-4eb2e72f41c8 req-9f6836f3-abc3-4177-9607-f0cac6451e89 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432031 Nov 24 14:46:25.341536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acb99ed-8fc2-4853-90b3-47fb859f6a74 req-c9d3da4d-7a6b-4fc0-8b9e-6aa5e7ac7b1b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:25.343048 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1acb99ed-8fc2-4853-90b3-47fb859f6a74 req-c9d3da4d-7a6b-4fc0-8b9e-6aa5e7ac7b1b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.0892732 Nov 24 14:46:25.411691 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1acb99ed-8fc2-4853-90b3-47fb859f6a74 req-61243b7e-b60b-4caf-8336-861d449bbd0b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616677 Nov 24 14:46:26.634267 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12641f31-8a84-4b15-91a5-957fcdaa9d82 req-35cf6992-81d4-4b91-b66c-bdb48f8deeff tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:26.635746 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-12641f31-8a84-4b15-91a5-957fcdaa9d82 req-35cf6992-81d4-4b91-b66c-bdb48f8deeff tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.0929558 Nov 24 14:46:26.697057 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-12641f31-8a84-4b15-91a5-957fcdaa9d82 req-effc1df3-2828-46c0-a017-d11ff2a8bfce tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549316 Nov 24 14:46:27.915118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f99a2f-9b3b-4c32-a13a-23bc3b2afdef req-e03001e5-e580-4104-85a3-c58fed338606 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:27.917527 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-90f99a2f-9b3b-4c32-a13a-23bc3b2afdef req-e03001e5-e580-4104-85a3-c58fed338606 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.0841770 Nov 24 14:46:27.967651 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-90f99a2f-9b3b-4c32-a13a-23bc3b2afdef req-83016d63-d7fd-48dd-8f7b-696593487062 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444295 Nov 24 14:46:28.113759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Sync routers for ids ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:46:28.130684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Routers {'7caf63c6-7039-4be0-81eb-a14785bb1c9e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:28.131413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:46:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:28.324602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Set router 7caf63c6-7039-4be0-81eb-a14785bb1c9e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:28.675785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:46:05Z', 'revision_number': 4, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a22c9dc-4b87-4064-881a-ca553ff2404e', 'name': '', 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'mac_address': 'fa:16:3e:e5:0f:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '52335652-408a-447d-acb1-5d1e0387fabd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:04Z', 'updated_at': '2021-11-24T14:46:05Z', 'revision_number': 2, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'subnets': [{'id': '52335652-408a-447d-acb1-5d1e0387fabd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:28.680036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Checking router: 7caf63c6-7039-4be0-81eb-a14785bb1c9e for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:46:28.680390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Updating router 7caf63c6-7039-4be0-81eb-a14785bb1c9e port 0a22c9dc-4b87-4064-881a-ca553ff2404e binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:46:28.738919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:29.157349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:29.173416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Transition to ACTIVE for port object 0a22c9dc-4b87-4064-881a-ca553ff2404e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:29.190541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:29.203038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:29.204325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8f4be42-909a-4023-8dd4-d7bb994dc45c req-c16d60b8-fe8f-4be2-ac84-608abc44e003 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:29.207007 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a8f4be42-909a-4023-8dd4-d7bb994dc45c req-c16d60b8-fe8f-4be2-ac84-608abc44e003 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.0997715 Nov 24 14:46:29.304277 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a8f4be42-909a-4023-8dd4-d7bb994dc45c req-21b5ca53-e2c1-4c70-9e94-f36ebd0dc5fe tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908880 Nov 24 14:46:29.451945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8a78fd-f43e-4b5e-93c2-895a02710be7 None None] Pushing event updated for resources: {'Port': ['ID=0a22c9dc-4b87-4064-881a-ca553ff2404e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:29.455974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-aa8a78fd-f43e-4b5e-93c2-895a02710be7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:29.570047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Attempting to bind port 0a22c9dc-4b87-4064-881a-ca553ff2404e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:46:29.570324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Attempting to bind port 0a22c9dc-4b87-4064-881a-ca553ff2404e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:46:29.570693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Attempting to bind port 0a22c9dc-4b87-4064-881a-ca553ff2404e on network b00e3f5c-f577-45fe-8561-f758f2bcdb66 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:46:29.577929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 46, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:46:29.578308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Checking segment: {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:46:29.578708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:29.579096 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Bound using segment: {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:46:29.579558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Bound port: 0a22c9dc-4b87-4064-881a-ca553ff2404e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c2814cad-7444-44e7-b6ff-45aabf50a342', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 895, 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:46:29.579965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:29.743457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] For port 0a22c9dc-4b87-4064-881a-ca553ff2404e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:46:29.746938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] For port 0a22c9dc-4b87-4064-881a-ca553ff2404e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0a22c9dc-4b87-4064-881a-ca553ff2404e,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:46:29.754910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:29.759554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:29.866933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8a78fd-f43e-4b5e-93c2-895a02710be7 None None] Pushing event updated for resources: {'Port': ['ID=0a22c9dc-4b87-4064-881a-ca553ff2404e,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:29.871149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-aa8a78fd-f43e-4b5e-93c2-895a02710be7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:29.874958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Routers {'7caf63c6-7039-4be0-81eb-a14785bb1c9e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:29.875600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:46:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:30.097557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] Set router 7caf63c6-7039-4be0-81eb-a14785bb1c9e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:30.443634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:46:05Z', 'revision_number': 4, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a22c9dc-4b87-4064-881a-ca553ff2404e', 'name': '', 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'mac_address': 'fa:16:3e:e5:0f:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '52335652-408a-447d-acb1-5d1e0387fabd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:04Z', 'updated_at': '2021-11-24T14:46:29Z', 'revision_number': 4, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'subnets': [{'id': '52335652-408a-447d-acb1-5d1e0387fabd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:30.448142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1342ad59-b424-4dc1-b73d-5de450df70a2 None None] The sync data for ids ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'] in dv-neutron-818151-2-hyperv is: [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:46:05Z', 'revision_number': 4, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a22c9dc-4b87-4064-881a-ca553ff2404e', 'name': '', 'network_id': 'b00e3f5c-f577-45fe-8561-f758f2bcdb66', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'mac_address': 'fa:16:3e:e5:0f:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '52335652-408a-447d-acb1-5d1e0387fabd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:04Z', 'updated_at': '2021-11-24T14:46:29Z', 'revision_number': 4, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'subnets': [{'id': '52335652-408a-447d-acb1-5d1e0387fabd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:46:30.698818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ca2e49-5cb8-47c7-b6d2-24c285617ad7 req-f69e295e-cf42-422e-8ef0-128a6e0ef76e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:30.700448 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b0ca2e49-5cb8-47c7-b6d2-24c285617ad7 req-f69e295e-cf42-422e-8ef0-128a6e0ef76e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.2571290 Nov 24 14:46:30.750026 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b0ca2e49-5cb8-47c7-b6d2-24c285617ad7 req-547ac99d-2c22-4c29-bbb4-0803d1cd6f5c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425529 Nov 24 14:46:31.789395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Request body: {'port': {'device_id': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:31.898950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a22c9dc-4b87-4064-881a-ca553ff2404e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:31.917720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:31.980660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633e5b1a-de26-424c-a2b5-6eaf8f56996e req-42802409-1c3d-4b21-b5cf-1b030c2521a3 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:31.985436 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-633e5b1a-de26-424c-a2b5-6eaf8f56996e req-42802409-1c3d-4b21-b5cf-1b030c2521a3 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 931 time: 0.0976360 Nov 24 14:46:32.007604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 0a22c9dc-4b87-4064-881a-ca553ff2404e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:32.015886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0a22c9dc-4b87-4064-881a-ca553ff2404e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:32.016452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.058377 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-633e5b1a-de26-424c-a2b5-6eaf8f56996e req-baa721e3-4419-45cf-affd-c048f2123b0c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663509 Nov 24 14:46:32.154405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.190373 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 0a22c9dc-4b87-4064-881a-ca553ff2404e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0a22c9dc-4b87-4064-881a-ca553ff2404e,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:32.193736 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.196698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-24b49ea4-1851-4f0a-a1d6-d5972b54ffb6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:32.279691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=0a22c9dc-4b87-4064-881a-ca553ff2404e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:32.283550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:32.288289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:46:32.296354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.311960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Transition to ACTIVE for port object eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:46:32.316620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.320384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad00644c-e36f-4ea6-8a16-0e99916961dd tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:32.456256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:32.461434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:32.586041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Attempting to bind port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:46:32.586364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Attempting to bind port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:46:32.586687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Attempting to bind port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee on network e8822aff-2fcb-45e7-b9e7-82f074050f9e {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:46:32.593332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee on network e8822aff-2fcb-45e7-b9e7-82f074050f9e not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:46:32.593680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Attempting to bind port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee on network e8822aff-2fcb-45e7-b9e7-82f074050f9e {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:46:32.600973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 46, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:46:32.601296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Checking segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:46:32.601676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Bound using segment: {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:46:32.602095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Bound port: eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:46:32.602439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.699995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:46:32.703032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:46:32.707349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.711385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a01fadd2-946b-4936-815b-683d3d8b77bc tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:32.765489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:32.766979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] 10.222.0.47 "PUT /v2.0/ports/eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 1093 time: 0.9821024 Nov 24 14:46:32.767513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:46:32.793221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:32.797043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:32.842319 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'status': 'completed', 'code': 200} Nov 24 14:46:32.890669 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-614ca89a-3800-4f03-8518-8ce68618db6c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1096 time: 0.0804989 Nov 24 14:46:32.961816 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-6493e787-004e-4f27-8c77-5e4390e891d6 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 217 time: 0.0633013 Nov 24 14:46:33.029834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-9410ff7d-1029-489a-9907-ed1ca298ad53 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:33.031261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-9410ff7d-1029-489a-9907-ed1ca298ad53 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0635774 Nov 24 14:46:33.110459 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-e2386cf5-efe6-464d-8c2b-1ab95d1251b6 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0724430 Nov 24 14:46:33.266614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-e5e7c07a-c989-4324-8f81-4088acb5a910 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1485782 Nov 24 14:46:33.290249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb7d7b9-5905-42aa-b691-263328082418 req-13035d70-88c1-4903-93f8-578cc778214a tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:33.291858 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afb7d7b9-5905-42aa-b691-263328082418 req-13035d70-88c1-4903-93f8-578cc778214a tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 943 time: 0.0882428 Nov 24 14:46:33.343671 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-37ed2e9c-501a-4edf-8f5f-04f22a7549b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:33.344766 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-afb7d7b9-5905-42aa-b691-263328082418 req-0b8191bf-d469-4731-a434-6c245cfbf431 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434771 Nov 24 14:46:33.413132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-47079559-b8ad-4eeb-bfc4-91059ce89862 req-5028fcf5-4782-4f7a-aa6c-7c50d18154d7 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1397390 Nov 24 14:46:33.530321 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-a2c69d39-6834-4a09-a936-91914f0d8db0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1096 time: 0.0702415 Nov 24 14:46:33.740975 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:33.783797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a66d37-0c90-408b-9409-06425fac618b req-acfb53f7-3026-4164-8f15-596b5319a267 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:33.785256 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-acfb53f7-3026-4164-8f15-596b5319a267 service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.2492018 Nov 24 14:46:33.840051 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:46:33.857187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a22c9dc-4b87-4064-881a-ca553ff2404e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:33.857532 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-a2578030-2c67-4d02-bae3-46284cbece43 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 217 time: 0.0656743 Nov 24 14:46:33.924538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a66d37-0c90-408b-9409-06425fac618b req-541c92de-f363-43a1-9b9b-324f2828be92 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:33.926118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-541c92de-f363-43a1-9b9b-324f2828be92 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0626493 Nov 24 14:46:33.932495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0a22c9dc-4b87-4064-881a-ca553ff2404e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:33.932890 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:34.029268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-997f3180-3c9d-48bb-a7c5-12fc674469db service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0957756 Nov 24 14:46:34.187801 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-8be9aff9-d238-4bb4-9d9b-885deccf3e87 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1478555 Nov 24 14:46:34.330540 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-42a66d37-0c90-408b-9409-06425fac618b req-b9ba80ab-2a83-4e98-b1a2-85b40e159e8f service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1351299 Nov 24 14:46:34.552762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec3c698-d2de-44a2-ad08-6e88c9550954 req-6314b720-b96a-4486-a4b8-5ee5d75df1c8 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:34.554174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7ec3c698-d2de-44a2-ad08-6e88c9550954 req-6314b720-b96a-4486-a4b8-5ee5d75df1c8 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 943 time: 0.0779514 Nov 24 14:46:34.606891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7ec3c698-d2de-44a2-ad08-6e88c9550954 req-9f590344-4756-4537-bb9d-97338a0ca4b7 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467815 Nov 24 14:46:35.831077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4695bb95-c7b9-4c98-98a3-88c99905178f req-de4ac561-d0b0-43c5-9981-2d7b5176c680 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:35.832627 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4695bb95-c7b9-4c98-98a3-88c99905178f req-de4ac561-d0b0-43c5-9981-2d7b5176c680 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 943 time: 0.0976951 Nov 24 14:46:35.878674 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4695bb95-c7b9-4c98-98a3-88c99905178f req-96f88d82-5030-47a1-b2ef-80725c0f407e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401828 Nov 24 14:46:35.905936 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bd1e5f4f-6849-448c-8b79-9132dae2408a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:36.853794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:46:36.962204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:37.005197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:37.020060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'port_id': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'mac_address': 'fa:16:3e:6b:5b:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 894, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:46:37.080886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:37.094772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e068bb-bc04-4871-94f8-2a8625cde712 req-88c9a3ef-7d60-4027-a868-f1897dcff77b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:37.096506 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10e068bb-bc04-4871-94f8-2a8625cde712 req-88c9a3ef-7d60-4027-a868-f1897dcff77b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 943 time: 0.0864921 Nov 24 14:46:37.150081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-10e068bb-bc04-4871-94f8-2a8625cde712 req-7b5a4d23-06ff-41ef-919d-5fd6b5fed42d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476930 Nov 24 14:46:37.155960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:46:37.173074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:37.178745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:37.180695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:37.245417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:37.248368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:37.539619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:46:38.369010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9ce8097-b369-4264-a9de-65844da492f4 req-f761dfdc-90fe-4ac3-9c8d-8f83a613761b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:38.370480 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d9ce8097-b369-4264-a9de-65844da492f4 req-f761dfdc-90fe-4ac3-9c8d-8f83a613761b tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 944 time: 0.0915892 Nov 24 14:46:38.423348 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d9ce8097-b369-4264-a9de-65844da492f4 req-10606bd6-0e7e-4a21-beba-12e18adf626c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467191 Nov 24 14:46:38.632600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:38.869118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:46:38.938756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:46:38.948245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:38.948618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:39.071407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:39.098648 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:46:39.108776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:39.116696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:39.118564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-aa8a78fd-f43e-4b5e-93c2-895a02710be7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:39.162519 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'code': 200} Nov 24 14:46:39.192084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:39.194965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:39.394033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6c61b46c-7003-4789-a08f-701eb9efbd28 req-db2395c1-8aa9-4a62-b7dd-5f3f821e5af6 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1098 time: 0.0737691 Nov 24 14:46:39.439020 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6c61b46c-7003-4789-a08f-701eb9efbd28 req-a474078b-11ab-49ca-89c2-8b8bf0c4464a service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380483 Nov 24 14:46:39.628108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640378f9-7356-439f-b7ca-631f92a4c1f7 req-a1ef48be-59b9-4ba2-89f8-0527377bc7df tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:39.629580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-640378f9-7356-439f-b7ca-631f92a4c1f7 req-a1ef48be-59b9-4ba2-89f8-0527377bc7df tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0789380 Nov 24 14:46:39.679983 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-640378f9-7356-439f-b7ca-631f92a4c1f7 req-146a5281-fa06-497a-a421-4b6a05ecf4fb tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447090 Nov 24 14:46:40.890550 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55f9703-fdd3-4422-9ca9-664f326f563a req-e1ecf426-596b-4b58-8d79-7a1b77dd63d4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:40.892593 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b55f9703-fdd3-4422-9ca9-664f326f563a req-e1ecf426-596b-4b58-8d79-7a1b77dd63d4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0817475 Nov 24 14:46:40.939124 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b55f9703-fdd3-4422-9ca9-664f326f563a req-36d7cdb0-f6b6-421a-a073-2f0259f54a0e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407722 Nov 24 14:46:41.139307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8d55e1-5091-4913-9eca-5e761fb990bb req-104fbc93-45ec-4f18-b657-c116e078799c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:41.140946 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a8d55e1-5091-4913-9eca-5e761fb990bb req-104fbc93-45ec-4f18-b657-c116e078799c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0816488 Nov 24 14:46:41.194830 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7a8d55e1-5091-4913-9eca-5e761fb990bb req-f0f3fe8d-7555-49ad-828d-1f0b82dabd33 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461109 Nov 24 14:46:41.632389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1af8b73b-64a0-4ac6-b099-f141495e6107 req-e68dd783-2bb2-427c-86fb-dccb7d7d946e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:41.633870 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1af8b73b-64a0-4ac6-b099-f141495e6107 req-e68dd783-2bb2-427c-86fb-dccb7d7d946e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0832293 Nov 24 14:46:41.682135 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1af8b73b-64a0-4ac6-b099-f141495e6107 req-ed3cb781-95f5-4673-9371-218e26e0c312 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426390 Nov 24 14:46:48.252370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:52.242318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d953c67-ef4c-4e7a-96a5-d27bfdb8f4ec req-6ccafeac-cac5-40f6-b338-9f641094a1be tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:52.243872 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6d953c67-ef4c-4e7a-96a5-d27bfdb8f4ec req-6ccafeac-cac5-40f6-b338-9f641094a1be tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.2699387 Nov 24 14:46:52.289441 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6d953c67-ef4c-4e7a-96a5-d27bfdb8f4ec req-1f33414f-dd60-42a4-abaf-33f913c19ecb tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401332 Nov 24 14:46:52.317670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53056) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:52.558342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0d8735bd-4e07-4911-a417-c3b5a2821e7d tempest-TestMinimumBasicScenario-1203451461 tempest-TestMinimumBasicScenario-1203451461-project-admin] Synchronizing usage tracker for tenant:f63c42f2f18c430c8376e71e241959c0 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:46:52.575937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0d8735bd-4e07-4911-a417-c3b5a2821e7d tempest-TestMinimumBasicScenario-1203451461 tempest-TestMinimumBasicScenario-1203451461-project-admin] Unset dirty status for tenant:f63c42f2f18c430c8376e71e241959c0 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:46:52.577079 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0d8735bd-4e07-4911-a417-c3b5a2821e7d tempest-TestMinimumBasicScenario-1203451461 tempest-TestMinimumBasicScenario-1203451461-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1093 time: 0.2584724 Nov 24 14:46:52.580105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53062) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:52.585324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'fixed_ip_address': '172.20.0.8'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:52.591041 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:52.594773 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:floatingip and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:52.597664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:52.603296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:52.613667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:52.759603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:52.892752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Allocated IP 172.26.4.159 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/f4534320-ff06-4875-8aac-3352ee928f98) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:46:53.050995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:53.078770 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:53.082600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2561ae39-8072-448f-9f55-22a1fac1bfef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:53.149966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:46:53.153333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:46:53.155310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'Port': ['ID=f4534320-ff06-4875-8aac-3352ee928f98,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:53.157533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:46:53.196889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.197274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.197662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.198027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.198394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.198762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.199126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.199486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.199879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.200243 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.200604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:46:53.206445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:53.681754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:53.736890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:53.947256 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:53.951804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:53.956941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb5ef4e3-71b3-42e5-8519-649ddb7b1747 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:54.066280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'Port': ['ID=f4534320-ff06-4875-8aac-3352ee928f98,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:54.078507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:54.088515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:54.403377 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Floating IP ed8910af-b22a-41b1-ba62-812d19d2ef42 associated. External IP: 172.26.4.159, port: eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee. Nov 24 14:46:54.801778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Router e67a3273-1d78-4da5-86a4-eccb913356fe has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:46:55.010591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:46:55.021372 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c922350-b923-452b-8135-bfda07577eef None None] Sync routers for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:46:55.034500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:55.035097 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:46:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:55.036935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.092840 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5115781 Nov 24 14:46:55.093508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:46:55.096854 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53066) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:55.108723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-792847140', 'description': 'tempest-secgroup-smoke-792847140 description', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:55.116653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:55.128112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:55.140994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.184699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:55.189264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:55.196636 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:55.202649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:55.216856 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:55.252210 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'status': 'completed', 'code': 200} Nov 24 14:46:55.264564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.270576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.276516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-56ee1ccb-9443-4347-9cfc-a592f04642f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:55.366295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroup': ['ID=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:55.369776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:55.373124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.374484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.2763202 Nov 24 14:46:55.378098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53074) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:55.385053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group_rule': {'security_group_id': '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:55.393899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:55.405185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:55.409049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:55.417281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:55.421836 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-aea6440d-a324-4fb0-b114-98d004794c3b service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1098 time: 0.1369107 Nov 24 14:46:55.464959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.581922 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'ed8910af-b22a-41b1-ba62-812d19d2ef42', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'floating_ip_address': '172.26.4.159', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'port_id': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'mac_address': 'fa:16:3e:6b:5b:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:46:53Z', 'updated_at': '2021-11-24T14:46:53Z', 'revision_number': 0, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:06Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:55.585812 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c922350-b923-452b-8135-bfda07577eef None None] Checking router: e67a3273-1d78-4da5-86a4-eccb913356fe for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:46:55.600042 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:46:55.600773 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:46:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:55.604740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-914c64c5-1acb-46dc-9c1a-ceb047c27dbb service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:55.606249 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-914c64c5-1acb-46dc-9c1a-ceb047c27dbb service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1776962 Nov 24 14:46:55.676647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.693143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.696744 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b11b23d-2b22-445c-ac3d-aaeca4aafc6b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:55.741959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6052e7ce-71e6-40ad-93f9-f78300d563d3,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:55.749305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:55.754991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:55.758910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4f2ea1e3-2120-4662-af6f-2068501b9677 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.3771663 Nov 24 14:46:55.758910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-bb50df8a-4c04-4719-9e01-ba029b65d556 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 999 time: 0.1409488 Nov 24 14:46:55.759164 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53078) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:55.764331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group_rule': {'security_group_id': '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:55.801786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:55.810768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:55.815787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:55.825900 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:46:55.827735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:55.842781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-dff879d2-43be-408f-b858-547755ebf428 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:55.844306 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-dff879d2-43be-408f-b858-547755ebf428 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0752852 Nov 24 14:46:55.884346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.082095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.087034 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-6ae7c553-847c-45e6-a854-075bcc33dc2e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2355938 Nov 24 14:46:56.088107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.089862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-811b9145-baec-4de9-b022-ec5d7d2782b1 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:56.136064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c076ad45-53b5-45ee-8783-f45d77c51818,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:56.140879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:56.186087 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7c922350-b923-452b-8135-bfda07577eef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'ed8910af-b22a-41b1-ba62-812d19d2ef42', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'floating_ip_address': '172.26.4.159', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'port_id': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'mac_address': 'fa:16:3e:6b:5b:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:46:53Z', 'updated_at': '2021-11-24T14:46:53Z', 'revision_number': 0, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:06Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:46:56.190818 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c922350-b923-452b-8135-bfda07577eef None None] The sync data for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv is: [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'ed8910af-b22a-41b1-ba62-812d19d2ef42', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'floating_ip_address': '172.26.4.159', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'port_id': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'mac_address': 'fa:16:3e:6b:5b:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:46:53Z', 'updated_at': '2021-11-24T14:46:53Z', 'revision_number': 0, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:06Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:46:56.198533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.199714 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.4398386 Nov 24 14:46:56.202403 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53082) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:56.210714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group_rule': {'security_group_id': '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:56.225874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:56.232911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:56.237937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:56.255192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:56.279692 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-e1ba6b9a-59c9-4658-a51d-b1c91438779e service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1800084 Nov 24 14:46:56.307698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.420308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae63616e-9b47-41a2-b751-0aeb8dbd9413 None None] New status for floating IP ed8910af-b22a-41b1-ba62-812d19d2ef42: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:46:56.467643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.472116 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-265c5821-3f1a-4a6d-8b30-5be288eef84b req-c27aaefd-a3a2-4975-b78d-919eb3050e70 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1850116 Nov 24 14:46:56.473155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.474909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adcb0100-1970-4328-b338-032be1686a31 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:56.499441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a7b9f9e5-9be5-4609-9eb7-20992723e919,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:56.502389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:56.510573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.514448 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.3085914 Nov 24 14:46:56.514642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53086) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:56.521199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group_rule': {'security_group_id': '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:56.527380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:56.531169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:56.534730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:56.540584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:56.566887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.631349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.635244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.637067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e326252d-9c6c-4b92-b6c1-01cf730d8678 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:56.660159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d59b25e-4e4c-494a-96c1-8d139f4f430e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:56.662579 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:56.670022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.673907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1556456 Nov 24 14:46:56.674116 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53090) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:56.679743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group_rule': {'security_group_id': '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:56.685867 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:56.690480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:56.693446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:56.699062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:56.709151 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Project 1ec805494cfe48e7b3b437f76c8c3ec4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:46:56.715588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.785430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.789591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.793825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ea787ba0-a23c-4647-931b-0bbbe4a3f8f5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:56.816543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c5c17185-3395-4d93-86d3-972cc06112fe,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:56.819432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:56.825914 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.827737 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-88d98456-d593-43f3-85c5-6f81e6b8004d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1521044 Nov 24 14:46:56.830720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53094) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:46:56.837096 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'security_group_rule': {'security_group_id': '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e', 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:56.843879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:46:56.850273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Usage tracker for resource:security_group_rule and tenant:1ec805494cfe48e7b3b437f76c8c3ec4 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:46:56.850273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:46:56.855781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:46:56.877085 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Project 1ec805494cfe48e7b3b437f76c8c3ec4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:46:56.877085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.948567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.952065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.953811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fd78b6e1-fbae-4f6b-a1f6-850a62cedc3c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:56.976736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64df6baf-578e-4e47-95ff-40a4c79a3bc3,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:56.979028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:56.986862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:56.987999 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1561439 Nov 24 14:46:57.119008 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-ecd1c7ea-156b-41b2-814b-9f3817e5f013 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-792847140&fields=id&tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4 HTTP/1.1" status: 200 len: 267 time: 0.0415576 Nov 24 14:46:57.202780 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-4f105d08-1d29-4dd5-9f49-68e546503738 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:57.204330 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-4f105d08-1d29-4dd5-9f49-68e546503738 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0799835 Nov 24 14:46:57.215129 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'port': {'security_groups': ['86544101-7a2a-4765-a2eb-64e2f04c60d0', '85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:46:57.330960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:57.589270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:46:57.614168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:57.618736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:57.624416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b29b94e6-a128-4012-87f0-7effa4e6a3f5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:46:57.630617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:46:57.695514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:57.696165 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:57.697538 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4ae9a002-ade9-472e-9eeb-dffb180128fe req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "PUT /v2.0/ports/eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 981 time: 0.4869351 Nov 24 14:46:57.698085 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:46:57.726597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=6']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:46:57.729975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:46:57.763197 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'status': 'completed', 'code': 200} Nov 24 14:46:57.775381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:46:57.911659 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-22eabcda-1a97-4bca-9308-d6bd5bdce9e0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1137 time: 0.1195028 Nov 24 14:46:57.967409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3cf00b8-2ccd-4038-bcb3-1d14756184bb req-67a828e8-66ab-4f39-9c3b-144f3f688dc2 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:57.968941 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c3cf00b8-2ccd-4038-bcb3-1d14756184bb req-67a828e8-66ab-4f39-9c3b-144f3f688dc2 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0887156 Nov 24 14:46:58.021433 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c3cf00b8-2ccd-4038-bcb3-1d14756184bb req-7ee65267-548e-42d2-812e-5a1c9f9c9503 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0450783 Nov 24 14:46:58.070949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-9a6bcfbe-9625-49d0-b98d-a25f83c7587f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:58.072415 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-9a6bcfbe-9625-49d0-b98d-a25f83c7587f service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1533928 Nov 24 14:46:58.098948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-07e3e7cb-6b6d-41c5-a535-30e77479eaca None None] Provisioning complete for port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:46:58.099327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-07e3e7cb-6b6d-41c5-a535-30e77479eaca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:46:58.183838 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-80be4315-97ba-43af-b0a1-f4f264c1c0ad service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 1001 time: 0.1044996 Nov 24 14:46:58.250884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-26d46b13-45fc-4151-986a-02c4be0dbe79 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:46:58.252958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-26d46b13-45fc-4151-986a-02c4be0dbe79 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0629573 Nov 24 14:46:58.334761 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-6613950f-d26f-4e5c-a40a-e099aab0f8a1 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0755265 Nov 24 14:46:58.468432 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-e1fe4472-3fb6-4ba4-953e-a19b1bd9cc7e service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269786 Nov 24 14:46:58.605069 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9c0a3631-97e5-4094-bc8d-dc0641715333 req-526c83fe-96b8-4c24-9f1c-a219db9bbc2e service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1289527 Nov 24 14:47:03.341470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9afdba5a-abb7-4a80-a3ec-b91567a5ea46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:03.742922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:05.908528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-96ade7a8-7905-4799-9353-8afaca707a31 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:06.939880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:08.634255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:10.842430 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:47:14.019671 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-4b19c947-de52-44db-ae89-479e4df2f2c8 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1776209 Nov 24 14:47:14.165606 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-a2be7785-9c74-4b1e-97e7-af228a99d833 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1137 time: 0.0753486 Nov 24 14:47:14.435370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-47842f93-5d26-4591-af30-c4a9e525af7f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:14.436823 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-47842f93-5d26-4591-af30-c4a9e525af7f service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.2518415 Nov 24 14:47:14.541988 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-a23ba531-00af-4b3a-8a76-74a093755043 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 1001 time: 0.0985875 Nov 24 14:47:14.604868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-fea6b7ea-44db-4481-a75c-b4847c1bf87b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:14.606275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-fea6b7ea-44db-4481-a75c-b4847c1bf87b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0580146 Nov 24 14:47:14.690118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-ab307c55-17f7-4973-bd52-16377d804ed5 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0774817 Nov 24 14:47:14.699990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-f3407233-bdf6-4a5c-83c9-1f6011ec69dc service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:47:14.700939 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-f3407233-bdf6-4a5c-83c9-1f6011ec69dc service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0049269 Nov 24 14:47:14.837351 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-327040bb-ebdf-4af6-a2b0-94d3045de760 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293249 Nov 24 14:47:14.973985 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d3ca88-a0ae-46e6-bd7e-188821fa99c3 req-bddd7bd3-64e6-461c-9f26-be443ed8d8fe service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306837 Nov 24 14:47:18.256838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:33.344630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f34de8c-c869-4191-95c6-ec3c54d94810 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:33.746624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:35.911834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ab525514-ce53-412d-a4c2-f6dc9576a5d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:36.943710 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:38.637448 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:47.843011 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:47:48.254592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:47:55.840518 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-14ba819f-6830-492d-b0df-ed325d1b1d9c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1137 time: 0.0871215 Nov 24 14:47:55.979547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-f3372b58-e54b-4ac4-b254-e4c5d97a4773 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:55.980918 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-f3372b58-e54b-4ac4-b254-e4c5d97a4773 service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1340644 Nov 24 14:47:56.068443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c90bfb-fe4f-43a0-9a67-f0bb80247b1c req-641f8588-c3ac-48df-884f-b0336cd532fa tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:56.069898 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-47c90bfb-fe4f-43a0-9a67-f0bb80247b1c req-641f8588-c3ac-48df-884f-b0336cd532fa tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.1047204 Nov 24 14:47:56.098917 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-389cd30f-dd51-4adf-adbd-3b523d1b4907 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 1001 time: 0.1116619 Nov 24 14:47:56.121669 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-47c90bfb-fe4f-43a0-9a67-f0bb80247b1c req-1b1ea188-6a30-4c0f-b800-f5887e152ac9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0439761 Nov 24 14:47:56.173301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-8b367075-7d76-4f08-80c2-faf60800f9fe service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:56.175079 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-8b367075-7d76-4f08-80c2-faf60800f9fe service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0700583 Nov 24 14:47:56.266155 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-95d6018c-852b-4960-b4a1-fe7888dc3f73 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0846426 Nov 24 14:47:56.401628 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-17e1eb1f-f470-4199-a826-3a6bd13c0877 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1286151 Nov 24 14:47:56.536091 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c2c50bb-83c2-4f8d-9f7c-5ff76b762fa2 req-cee7e55a-9d66-449f-9d46-53084e74e9c9 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1272628 Nov 24 14:47:57.330673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07be9fbd-d7ab-4b7a-b502-854c41f83589 req-9eeda210-9c3e-49c5-a1d4-16469bf6b396 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:57.332128 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-07be9fbd-d7ab-4b7a-b502-854c41f83589 req-9eeda210-9c3e-49c5-a1d4-16469bf6b396 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0859849 Nov 24 14:47:57.379024 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-07be9fbd-d7ab-4b7a-b502-854c41f83589 req-2117ec5e-8237-4495-9fe2-0bac93c170ea tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Synchronizing usage tracker for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:47:57.394631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-07be9fbd-d7ab-4b7a-b502-854c41f83589 req-2117ec5e-8237-4495-9fe2-0bac93c170ea tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Unset dirty status for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:47:57.395836 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-07be9fbd-d7ab-4b7a-b502-854c41f83589 req-2117ec5e-8237-4495-9fe2-0bac93c170ea tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0574801 Nov 24 14:47:58.611362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa819b1-2c5d-4c1e-9246-5ac11b204123 req-02019b72-c9ef-4686-a72b-059d94808965 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:58.612813 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aaa819b1-2c5d-4c1e-9246-5ac11b204123 req-02019b72-c9ef-4686-a72b-059d94808965 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0846136 Nov 24 14:47:58.661108 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aaa819b1-2c5d-4c1e-9246-5ac11b204123 req-ade58e12-48d3-4c71-b87b-29f7bd726891 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0427773 Nov 24 14:47:59.868902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78e0b61-5312-4be2-beb7-d314ca427537 req-8915587d-6b85-4284-ba13-e83ab4b1afe9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:47:59.870336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c78e0b61-5312-4be2-beb7-d314ca427537 req-8915587d-6b85-4284-ba13-e83ab4b1afe9 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0769529 Nov 24 14:47:59.919537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c78e0b61-5312-4be2-beb7-d314ca427537 req-26181aa3-2473-4858-9589-3daf933e7739 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0434711 Nov 24 14:48:01.232907 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d48dea-5975-4a3c-9191-bbcf908f6767 req-2168d1b4-cd57-4a0e-b698-26908801d24c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:01.234291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-91d48dea-5975-4a3c-9191-bbcf908f6767 req-2168d1b4-cd57-4a0e-b698-26908801d24c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.1933374 Nov 24 14:48:01.282666 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-91d48dea-5975-4a3c-9191-bbcf908f6767 req-e7eff55f-44d9-401f-a197-d7177f130cfc tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0420206 Nov 24 14:48:02.504497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24bbc6a0-afa8-4040-88bd-d7dd9b1f3ffe req-b07e8a8b-bc1f-46b9-8899-9f608e0c09fd tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:02.505958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-24bbc6a0-afa8-4040-88bd-d7dd9b1f3ffe req-b07e8a8b-bc1f-46b9-8899-9f608e0c09fd tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0810783 Nov 24 14:48:02.554024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-24bbc6a0-afa8-4040-88bd-d7dd9b1f3ffe req-9af7d6e0-916b-41bd-8343-dcdd1954158e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0422137 Nov 24 14:48:03.346857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-12cf6a51-14df-4500-aa99-80076cd0f94b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:03.753002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:03.756917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff0ca26-71f5-4ec4-89a4-7399f2c5b34d req-742bed30-3fe2-429e-ba06-4856fa33842e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:03.758463 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fff0ca26-71f5-4ec4-89a4-7399f2c5b34d req-742bed30-3fe2-429e-ba06-4856fa33842e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0860367 Nov 24 14:48:03.808654 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-fff0ca26-71f5-4ec4-89a4-7399f2c5b34d req-3cd46c34-62b7-4f3f-91ea-f0fec05178b4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0438330 Nov 24 14:48:05.122879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e41fe8-ef9f-4116-8e29-ada025ad0e5f req-e6df3221-0655-4658-9f41-d17702e73b4c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:05.124810 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a1e41fe8-ef9f-4116-8e29-ada025ad0e5f req-e6df3221-0655-4658-9f41-d17702e73b4c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.1918433 Nov 24 14:48:05.174402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a1e41fe8-ef9f-4116-8e29-ada025ad0e5f req-e47f032e-c240-4e8d-9903-d0f3f1e4ee50 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0427599 Nov 24 14:48:05.915154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6c8cf46e-95c5-41f4-91f3-1afbcdab394d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:06.378916 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4620b86-7a2c-4f4d-bde8-a1210477bc49 req-36c5035b-9123-4168-8ee6-49169561f69c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:06.380423 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e4620b86-7a2c-4f4d-bde8-a1210477bc49 req-36c5035b-9123-4168-8ee6-49169561f69c tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0781662 Nov 24 14:48:06.429596 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e4620b86-7a2c-4f4d-bde8-a1210477bc49 req-b3f5a449-4ba1-431a-b9c4-79d632bc1c39 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0435317 Nov 24 14:48:06.946105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:07.634502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd52a1a-7612-424a-a24c-ce5e2c396f0a req-bc27a518-9d95-405a-8b43-0f62be9e6844 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:07.636014 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bdd52a1a-7612-424a-a24c-ce5e2c396f0a req-bc27a518-9d95-405a-8b43-0f62be9e6844 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0795524 Nov 24 14:48:07.684243 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bdd52a1a-7612-424a-a24c-ce5e2c396f0a req-782fb48b-ef33-4aa0-a9b4-d8b5641f3fdb tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e&id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0418401 Nov 24 14:48:08.639281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:09.152711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-1628ed03-c572-47ec-8f87-b8a5669a8f8e req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] (83525) timed out ('10.222.0.47', 52603) {{(pid=83525) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} Nov 24 14:48:13.915204 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-7ee40311-959f-425a-8384-e62123f21dd1 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0808744 Nov 24 14:48:14.054336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-535f23de-1460-4535-9595-faea5c354d5f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1137 time: 0.0704975 Nov 24 14:48:14.202413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-76440417-be78-4446-94e6-6d344fb9df5e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:14.204977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-76440417-be78-4446-94e6-6d344fb9df5e service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1311727 Nov 24 14:48:14.316190 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-d8ba882d-0ef9-4aec-bfdb-039e65db01f7 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 1001 time: 0.1050363 Nov 24 14:48:14.380325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-d7eabfe8-4daa-464f-8581-da937c285897 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:48:14.381764 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-d7eabfe8-4daa-464f-8581-da937c285897 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0600119 Nov 24 14:48:14.465489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-a3f6cf7a-f473-425a-86dd-173744a765ef service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0769694 Nov 24 14:48:14.608450 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-3857edbd-9979-487e-963f-b4f06eb22d29 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1358631 Nov 24 14:48:14.751865 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f9a1b3ff-4c4b-4690-b602-36251020b46e req-f853883b-e35d-483f-ba79-e062c676ac71 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1333616 Nov 24 14:48:18.252801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:24.844135 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:48:33.351099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1f6e3063-58f7-4ce0-8c16-cff20296ee23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:33.756146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:35.920538 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-66b520af-d9f6-493f-bb5d-d01f30415062 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:36.948974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:38.641801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:48:48.261081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:01.845205 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:49:03.355208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c3f339e-05c9-41de-8ef9-74c48464fcb6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:03.752361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:05.922202 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6e4df1ce-c5ed-4565-b3f8-2896b7cd8d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:06.951865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:08.644165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:11.164352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-01f91f54-e873-46d9-bfec-d016ed30cd97 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-792847140&fields=id&tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4 HTTP/1.1" status: 200 len: 267 time: 0.0440857 Nov 24 14:49:11.247286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8f71f8e4-b8b9-4ed6-ae16-f259d08e0585 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:11.248773 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8f71f8e4-b8b9-4ed6-ae16-f259d08e0585 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 984 time: 0.0787773 Nov 24 14:49:11.259897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Request body: {'port': {'security_groups': ['86544101-7a2a-4765-a2eb-64e2f04c60d0']}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:11.397687 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:11.640234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:11.666523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:11.674251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:11.680695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-64f9d7ec-9c9c-4762-8503-fb17982bb736 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:11.686261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:49:11.746525 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:11.747157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:11.748581 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b71e0ab1-7ba1-4862-a50b-685c57b78983 req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "PUT /v2.0/ports/eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 942 time: 0.4938285 Nov 24 14:49:11.749130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:49:11.755934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53214) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:11.811073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event updated for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=7']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:11.831639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.832294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.835152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.835831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.837309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.838759 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.840152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.840769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.841374 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.841983 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.843534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:11.847880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:11.867171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8714d3d5-1908-43a1-9448-db0f2a44b511 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:11.872497 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'status': 'completed', 'code': 200} Nov 24 14:49:11.880897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:49:11.888978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.021728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-8625a1c5-6f5e-4c01-a967-bb1b37615894 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1098 time: 0.1162543 Nov 24 14:49:12.059394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.065955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1daa5de1-15aa-4693-92d6-c22def937d09 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:12.132715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:12.138875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9d5b2e6e-9382-424f-af9f-99d7fd723811 None None] Provisioning complete for port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:12.139260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d5b2e6e-9382-424f-af9f-99d7fd723811 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.157899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.158285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.158663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.159033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.159424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.159788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.160174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.160515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.160872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.161231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.161590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:12.167145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:12.168168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.169295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a2460bc8-b781-4119-92e0-cfadb8bbcbee tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "DELETE /v2.0/security-groups/85af37ae-0ab9-4ee7-a2e8-ca7eb47ebf5e HTTP/1.1" status: 204 len: 168 time: 0.4115393 Nov 24 14:49:12.172174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53218) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:12.201589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-ffb1d942-1fb0-4036-877d-6445f72c98ce service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:12.202923 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-ffb1d942-1fb0-4036-877d-6445f72c98ce service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1740899 Nov 24 14:49:12.323897 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-cce90457-5ec9-451c-a8ed-f7a13be80122 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 1001 time: 0.1126003 Nov 24 14:49:12.391700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-6d4b3724-1151-4e2b-9d1a-3b567fe01814 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:12.393225 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-6d4b3724-1151-4e2b-9d1a-3b567fe01814 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0629718 Nov 24 14:49:12.436312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Deleting port f4534320-ff06-4875-8aac-3352ee928f98 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:12.436654 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.480429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-d8620484-4ff7-4c3c-bfd8-3ac63cc86391 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0793962 Nov 24 14:49:12.616348 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.616676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.732403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-efe49637-2090-45e6-b264-dc543e712cc6 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2457957 Nov 24 14:49:12.757241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Calling delete_port for f4534320-ff06-4875-8aac-3352ee928f98 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:12.868646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a51f2e1e-263d-469e-b5c8-8bb826cc2be8 req-b972f322-e47e-4acd-9c60-a4191c076fd5 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1305490 Nov 24 14:49:12.913535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:12.918726 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a06ac1a0-16d7-41f7-84f2-75188301d168 tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:12.963257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event deleted for resources: {'Port': ['ID=f4534320-ff06-4875-8aac-3352ee928f98,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:12.965814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:13.171171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:13.576175 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Router e67a3273-1d78-4da5-86a4-eccb913356fe has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:49:13.782955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:49:13.795211 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] Sync routers for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:49:13.804088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:13.809115 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:13.809739 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:13.865747 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "DELETE /v2.0/floatingips/ed8910af-b22a-41b1-ba62-812d19d2ef42 HTTP/1.1" status: 204 len: 168 time: 1.6918092 Nov 24 14:49:13.878351 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:49:13.899344 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-2a78928f-21d9-4bdb-bee1-f1db64279c0d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0837722 Nov 24 14:49:13.990841 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'status': 'completed', 'code': 200} Nov 24 14:49:14.054303 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:14.061939 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-196660e0-90d5-45fe-813b-2679fca254fe service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1098 time: 0.0895872 Nov 24 14:49:14.234644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-3d6bff78-9066-4ad4-9c2b-1f7ba3d7f5ce service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:14.236664 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-3d6bff78-9066-4ad4-9c2b-1f7ba3d7f5ce service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1534786 Nov 24 14:49:14.390017 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-21b3c440-428c-4fce-b09c-b67da65cd2af service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 217 time: 0.1452591 Nov 24 14:49:14.417477 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:06Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:14.421915 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] Checking router: e67a3273-1d78-4da5-86a4-eccb913356fe for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:49:14.433418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:14.434038 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:14.466127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-381757a1-b847-48fa-86c4-281e6790ec40 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:14.467570 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-381757a1-b847-48fa-86c4-281e6790ec40 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0649722 Nov 24 14:49:14.547575 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-9c59f004-52ba-4f2c-a60a-6df41121c703 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0740628 Nov 24 14:49:14.682254 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:14.694690 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-cb3e96a8-af7c-4d1c-a5d2-95ab2926bd99 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353743 Nov 24 14:49:14.841902 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7218f8ba-1fbc-451e-a12f-f8f722fec44b req-e38ae10d-cf84-4de9-9850-c82939214da7 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1401894 Nov 24 14:49:14.979042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-3c4d32c4-4ab5-4461-9d39-3c5628a0be29 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 1098 time: 0.0816145 Nov 24 14:49:15.015087 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:06Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:15.019478 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-006491f1-f7c1-441a-beb0-d7f912a0b312 None None] The sync data for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv is: [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:45:58Z', 'revision_number': 4, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0c91878e-812f-4396-b778-a258810dcf59', 'name': '', 'network_id': 'e8822aff-2fcb-45e7-b9e7-82f074050f9e', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'mac_address': 'fa:16:3e:cd:b5:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:57Z', 'updated_at': '2021-11-24T14:46:06Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'subnets': [{'id': 'fb38b9a3-dbb7-4096-9f7a-0ba3e693203b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:49:15.126080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f083ce-49ea-4e22-8456-088aff867422 req-ce1454a7-6ced-4a2c-bb20-ed0c175d0934 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:15.127534 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-ce1454a7-6ced-4a2c-bb20-ed0c175d0934 service neutron] 10.222.0.47 "GET /v2.0/networks?id=e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 200 len: 916 time: 0.1427784 Nov 24 14:49:15.199610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-30cbe903-7fb4-477a-9f99-7fcefb5a54a8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 200 len: 217 time: 0.0645483 Nov 24 14:49:15.277659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f083ce-49ea-4e22-8456-088aff867422 req-25e4d8e8-4360-445f-b565-af48b263920e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:15.279447 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-25e4d8e8-4360-445f-b565-af48b263920e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 200 len: 854 time: 0.0737584 Nov 24 14:49:15.295109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b561c35c-ef77-455b-b93d-8a577a72bb11 None None] New status for floating IP ed8910af-b22a-41b1-ba62-812d19d2ef42: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:49:15.412305 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-e5d4818f-58df-4214-9bca-46dedaa4a912 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=e8822aff-2fcb-45e7-b9e7-82f074050f9e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1248870 Nov 24 14:49:15.571646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-9cf0cd9a-104a-41f3-b725-c29005aa0539 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1513588 Nov 24 14:49:15.817909 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-81f083ce-49ea-4e22-8456-088aff867422 req-f980f04c-c06a-4b34-9aeb-d38df6330998 service neutron] 10.222.0.47 "GET /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2409329 Nov 24 14:49:18.267931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:19.552485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbce1fbc-27a6-4f23-9a55-96a7d71b5e53 req-2899de68-1789-48e1-a475-ea3d8e229672 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:19.553573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-dbce1fbc-27a6-4f23-9a55-96a7d71b5e53 req-2899de68-1789-48e1-a475-ea3d8e229672 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Synchronizing usage tracker for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:49:19.569215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-dbce1fbc-27a6-4f23-9a55-96a7d71b5e53 req-2899de68-1789-48e1-a475-ea3d8e229672 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Unset dirty status for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:49:19.570766 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dbce1fbc-27a6-4f23-9a55-96a7d71b5e53 req-2899de68-1789-48e1-a475-ea3d8e229672 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.1024473 Nov 24 14:49:19.620730 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-dbce1fbc-27a6-4f23-9a55-96a7d71b5e53 req-40a5a7d7-a0a2-403b-80e0-02dd3df65f43 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433829 Nov 24 14:49:20.835734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-500f7791-b4e7-4efd-af90-32fd6d54a530 req-75fa09d4-2db3-47ea-a571-68a545761e54 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:20.837842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-500f7791-b4e7-4efd-af90-32fd6d54a530 req-75fa09d4-2db3-47ea-a571-68a545761e54 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0859270 Nov 24 14:49:20.886913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-500f7791-b4e7-4efd-af90-32fd6d54a530 req-77b4e51e-3d22-4e32-be43-e397c78dc20e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Synchronizing usage tracker for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:49:20.904316 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-500f7791-b4e7-4efd-af90-32fd6d54a530 req-77b4e51e-3d22-4e32-be43-e397c78dc20e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Unset dirty status for tenant:1ec805494cfe48e7b3b437f76c8c3ec4 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:49:20.905479 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-500f7791-b4e7-4efd-af90-32fd6d54a530 req-77b4e51e-3d22-4e32-be43-e397c78dc20e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/security-groups?id=86544101-7a2a-4765-a2eb-64e2f04c60d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618696 Nov 24 14:49:21.485802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8c22b9c6-53d2-4f37-aad1-f1f50a8482fb tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:21.487209 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8c22b9c6-53d2-4f37-aad1-f1f50a8482fb tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.47 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 945 time: 0.0757551 Nov 24 14:49:21.559296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Deleting port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:21.559543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:21.795095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] For port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:21.795451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:21.920429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Calling delete_port for eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:22.067962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:22.074774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-60b8463a-b653-41fd-8244-46fd676d58ab service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:22.080141 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-36e4add5-cefa-49b6-a714-d5090811bb65 req-8258732d-7816-406b-b49e-cdb202e34fc5 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.70 "GET /v2.0/ports?device_id=cdc0d88e-d892-4469-a3e4-eeec170851f9 HTTP/1.1" status: 200 len: 210 time: 0.0436409 Nov 24 14:49:22.081191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:49:22.118882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Pushing event deleted for resources: {'Port': ['ID=eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:22.122904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:22.192918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] No DVR routers for this DVR port eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:49:22.195331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:22.198485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'name': 'network-vif-deleted', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:49:22.221828 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e4823b8e-3499-4c0c-b23c-a67ba097425a req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] 10.222.0.47 "DELETE /v2.0/ports/eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee HTTP/1.1" status: 204 len: 173 time: 0.7280090 Nov 24 14:49:22.424298 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cdc0d88e-d892-4469-a3e4-eeec170851f9', 'name': 'network-vif-deleted', 'tag': 'eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee', 'status': 'completed', 'code': 200} Nov 24 14:49:24.943501 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53314) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:25.347205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:25.715338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:25.748937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:49:25.749284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device eefd3b01-1eb7-4503-abf0-aeb92a3aa0ee not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:26.048767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Deleting port 0c91878e-812f-4396-b778-a258810dcf59 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:26.049344 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:26.235186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] For port 0c91878e-812f-4396-b778-a258810dcf59, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0c91878e-812f-4396-b778-a258810dcf59,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:26.235556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:26.356449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Calling delete_port for 0c91878e-812f-4396-b778-a258810dcf59 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:26.537273 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:26.541290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cc05f8c1-f028-4927-9211-ee73f5e4d27d tempest-ServersAdminNegativeTestJSON-1884069755 tempest-ServersAdminNegativeTestJSON-1884069755-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:26.588947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Pushing event deleted for resources: {'Port': ['ID=0c91878e-812f-4396-b778-a258810dcf59,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:26.623511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:26.899591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:27.620555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Router e67a3273-1d78-4da5-86a4-eccb913356fe has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:49:27.820835 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:49:27.830471 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] Sync routers for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:49:27.834109 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] 10.222.0.70 "PUT /v2.0/routers/e67a3273-1d78-4da5-86a4-eccb913356fe/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8895173 Nov 24 14:49:27.836834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53318) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:27.842779 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:27.843398 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:28.026437 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:28.043146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:28.246745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:28.256460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Deleting port 87322f84-4537-401c-82dc-6a415099e457 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:28.257119 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:28.320005 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48'}], 'enable_snat': True}, 'gw_port_id': '87322f84-4537-401c-82dc-6a415099e457', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:49:26Z', 'revision_number': 5, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port': {'id': '87322f84-4537-401c-82dc-6a415099e457', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:65:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:46:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:28.324924 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] Checking router: e67a3273-1d78-4da5-86a4-eccb913356fe for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:49:28.335530 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] Routers {'e67a3273-1d78-4da5-86a4-eccb913356fe'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:28.336133 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e67a3273-1d78-4da5-86a4-eccb913356fe'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:28.436457 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] For port 87322f84-4537-401c-82dc-6a415099e457, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=87322f84-4537-401c-82dc-6a415099e457,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:28.436810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:28.486886 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] Set router e67a3273-1d78-4da5-86a4-eccb913356fe gateway port host: None {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:28.560126 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Calling delete_port for 87322f84-4537-401c-82dc-6a415099e457 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:28.593672 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:49:28Z', 'revision_number': 6, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:28.597762 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b95d1e4-6a9f-4bc2-8935-7aae25055a68 None None] The sync data for ids ['e67a3273-1d78-4da5-86a4-eccb913356fe'] in dv-neutron-818151-2-hyperv is: [{'id': 'e67a3273-1d78-4da5-86a4-eccb913356fe', 'name': 'tempest-TestMinimumBasicScenario-1726705708-router', 'tenant_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:45:55Z', 'updated_at': '2021-11-24T14:49:28Z', 'revision_number': 6, 'project_id': '1ec805494cfe48e7b3b437f76c8c3ec4', 'gw_port_host': None}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:49:28.857391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:28.860941 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8b994773-c848-49a9-a6f8-dbceeec64f21 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:28.902662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Pushing event deleted for resources: {'Port': ['ID=87322f84-4537-401c-82dc-6a415099e457,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:28.905409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:29.125985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.386223 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.390530 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.415561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.416221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e67a3273-1d78-4da5-86a4-eccb913356fe {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:49:29.429886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.431056 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] 10.222.0.70 "DELETE /v2.0/routers/e67a3273-1d78-4da5-86a4-eccb913356fe HTTP/1.1" status: 204 len: 168 time: 1.5933030 Nov 24 14:49:29.434402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53322) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:29.504296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Deleting subnet fb38b9a3-dbb7-4096-9f7a-0ba3e693203b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:49:29.507415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.557257 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.638924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.706209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.710660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-160859e1-3f97-4d49-a512-0e351004a848 tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:29.747771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fb38b9a3-dbb7-4096-9f7a-0ba3e693203b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:29.750995 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:29.751982 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.757164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbb174e3-6b85-4317-89e2-6741604d3599 None None] Network e8822aff-2fcb-45e7-b9e7-82f074050f9e requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:49:29.758306 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-da4eeeb3-0a0a-45f5-ad72-6f14909a81bc admin admin] 10.222.0.70 "DELETE /v2.0/subnets/fb38b9a3-dbb7-4096-9f7a-0ba3e693203b HTTP/1.1" status: 204 len: 168 time: 0.3229997 Nov 24 14:49:29.761379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53326) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:29.866111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.877219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Deleting port e7b581bb-fe30-4433-821d-213337e892c1 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:29.877546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:29.955405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 87322f84-4537-401c-82dc-6a415099e457 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:29.997027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 87322f84-4537-401c-82dc-6a415099e457 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:49:29.997553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 87322f84-4537-401c-82dc-6a415099e457 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:29.998005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0c91878e-812f-4396-b778-a258810dcf59 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:30.026545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] DHCP port deletion for e8822aff-2fcb-45e7-b9e7-82f074050f9e request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:49:30.037285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 0c91878e-812f-4396-b778-a258810dcf59 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:49:30.037637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0c91878e-812f-4396-b778-a258810dcf59 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:30.039195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Deleting port e7b581bb-fe30-4433-821d-213337e892c1 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:30.039704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.103545 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] For port e7b581bb-fe30-4433-821d-213337e892c1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e7b581bb-fe30-4433-821d-213337e892c1,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:30.104416 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.257033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] For port e7b581bb-fe30-4433-821d-213337e892c1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e7b581bb-fe30-4433-821d-213337e892c1,segment=NetworkSegment(b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c),segment_id=b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:30.257493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.337621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Calling delete_port for e7b581bb-fe30-4433-821d-213337e892c1 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:30.414810 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.419406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:30.424877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Calling delete_port for e7b581bb-fe30-4433-821d-213337e892c1 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:30.460477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Pushing event deleted for resources: {'Port': ['ID=e7b581bb-fe30-4433-821d-213337e892c1,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:30.463403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:30.465632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] No DVR routers for this DVR port e7b581bb-fe30-4433-821d-213337e892c1 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:49:30.505468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:49:30.506181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:49:30.582449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.607638 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e8822aff-2fcb-45e7-b9e7-82f074050f9e']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:30.619789 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:30.620071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b1ec7a2e-6a5f-4e9a-9f9b-1f57be7c707c') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:30.631317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.646890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.653859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Releasing vlan 894 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:49:30.654271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:49:30.667690 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:49:30.746820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.750572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0029ad72-1fee-4f38-be6d-6b060ae931a9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:30.764435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:30.776801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Pushing event deleted for resources: {'Network': ['ID=e8822aff-2fcb-45e7-b9e7-82f074050f9e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:30.780891 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:30.784508 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] 10.222.0.70 "DELETE /v2.0/networks/e8822aff-2fcb-45e7-b9e7-82f074050f9e HTTP/1.1" status: 204 len: 168 time: 1.0221403 Nov 24 14:49:30.787466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53330) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:31.007683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Deleting port e7b581bb-fe30-4433-821d-213337e892c1 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:31.008342 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:31.077000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8f9faf7d-9074-4dd8-8d2b-48f9edeaa80f None None] The port 'e7b581bb-fe30-4433-821d-213337e892c1' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:49:31.171558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:31.755244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Deleting port 0a22c9dc-4b87-4064-881a-ca553ff2404e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:31.755574 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:31.944083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e7b581bb-fe30-4433-821d-213337e892c1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:31.980014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: e7b581bb-fe30-4433-821d-213337e892c1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:49:31.980371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e7b581bb-fe30-4433-821d-213337e892c1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:32.044694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] For port 0a22c9dc-4b87-4064-881a-ca553ff2404e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0a22c9dc-4b87-4064-881a-ca553ff2404e,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:32.044955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:32.176311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Calling delete_port for 0a22c9dc-4b87-4064-881a-ca553ff2404e owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:32.359565 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:32.363171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e7f9ef19-a0ee-4e5e-adb7-cb3db29a1526 tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:32.408212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Pushing event deleted for resources: {'Port': ['ID=0a22c9dc-4b87-4064-881a-ca553ff2404e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:32.410979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:32.695946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:33.358183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e21dd127-d325-46de-851d-04bc38bbbd30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:33.393306 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Router 7caf63c6-7039-4be0-81eb-a14785bb1c9e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:49:33.593432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:49:33.601860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] Sync routers for ids ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:49:33.610094 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] 10.222.0.70 "PUT /v2.0/routers/7caf63c6-7039-4be0-81eb-a14785bb1c9e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8215983 Nov 24 14:49:33.612594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53334) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:33.613974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] Routers {'7caf63c6-7039-4be0-81eb-a14785bb1c9e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:33.614600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:33.781430 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:33.805228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] Set router 7caf63c6-7039-4be0-81eb-a14785bb1c9e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:33.814489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:34.020170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:34.030479 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Deleting port f3064e14-d1fb-4012-afca-23739ab14e08 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:34.031081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:34.091400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201'}], 'enable_snat': True}, 'gw_port_id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:49:32Z', 'revision_number': 5, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port': {'id': 'f3064e14-d1fb-4012-afca-23739ab14e08', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:70:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.201', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:46:02Z', 'updated_at': '2021-11-24T14:46:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:34.095548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] Checking router: 7caf63c6-7039-4be0-81eb-a14785bb1c9e for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:49:34.107249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] Routers {'7caf63c6-7039-4be0-81eb-a14785bb1c9e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:34.107900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:34.223728 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] For port f3064e14-d1fb-4012-afca-23739ab14e08, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=f3064e14-d1fb-4012-afca-23739ab14e08,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:34.224118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:34.263687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] Set router 7caf63c6-7039-4be0-81eb-a14785bb1c9e gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:34.345406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Calling delete_port for f3064e14-d1fb-4012-afca-23739ab14e08 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:34.372442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:49:34Z', 'revision_number': 6, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:34.376868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-723a00a1-1d9e-4f09-b8fb-a6ff063268db None None] The sync data for ids ['7caf63c6-7039-4be0-81eb-a14785bb1c9e'] in dv-neutron-818151-2-hyperv is: [{'id': '7caf63c6-7039-4be0-81eb-a14785bb1c9e', 'name': 'tempest-TestMinimumBasicScenario-2042147552-router', 'tenant_id': 'f63c42f2f18c430c8376e71e241959c0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:46:01Z', 'updated_at': '2021-11-24T14:49:34Z', 'revision_number': 6, 'project_id': 'f63c42f2f18c430c8376e71e241959c0', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:49:34.512082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:34.515523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-105197b1-863d-4190-aa92-5944a88da0f4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:34.557032 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Pushing event deleted for resources: {'Port': ['ID=f3064e14-d1fb-4012-afca-23739ab14e08,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:34.560499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:34.783595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.183361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.187621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.219338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.220183 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7caf63c6-7039-4be0-81eb-a14785bb1c9e {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:49:35.234314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.235550 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-9da51143-25a9-4ae2-9c57-e48a1baacb02 admin admin] 10.222.0.70 "DELETE /v2.0/routers/7caf63c6-7039-4be0-81eb-a14785bb1c9e HTTP/1.1" status: 204 len: 168 time: 1.6219397 Nov 24 14:49:35.237931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53338) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:35.304177 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Deleting subnet 52335652-408a-447d-acb1-5d1e0387fabd {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:49:35.307580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.359279 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.444944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.513513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.517144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-161dc78e-1037-464f-a8cc-14b211bb8616 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:35.551417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=52335652-408a-447d-acb1-5d1e0387fabd,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:35.554813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:35.559321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.564638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1564246d-9bff-47ca-a020-aa69c511b252 None None] Network b00e3f5c-f577-45fe-8561-f758f2bcdb66 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:49:35.565187 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/52335652-408a-447d-acb1-5d1e0387fabd HTTP/1.1" status: 204 len: 168 time: 0.3262990 Nov 24 14:49:35.567611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53342) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:35.673816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.685047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Deleting port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:35.685377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.812958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] DHCP port deletion for b00e3f5c-f577-45fe-8561-f758f2bcdb66 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:49:35.817128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Deleting port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:35.817534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.898073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] For port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:35.898380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:35.955335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f3064e14-d1fb-4012-afca-23739ab14e08 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:36.005059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: f3064e14-d1fb-4012-afca-23739ab14e08 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:49:36.005405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device f3064e14-d1fb-4012-afca-23739ab14e08 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:36.005822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:36.034838 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Calling delete_port for 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:36.058278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-700ce26a-d711-47e4-8fdc-683f3af8366f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.117225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.121648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3ed068cb-d284-436d-9f50-6a2049a042c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:36.154720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No active binding found for port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 {{(pid=83527) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:222}} Nov 24 14:49:36.155129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:36.155556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a22c9dc-4b87-4064-881a-ca553ff2404e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:49:36.161104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Pushing event deleted for resources: {'Port': ['ID=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:36.165064 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:36.170018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] No DVR routers for this DVR port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:49:36.198903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 0a22c9dc-4b87-4064-881a-ca553ff2404e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:49:36.199173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a22c9dc-4b87-4064-881a-ca553ff2404e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:49:36.205209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] For port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5bef47f0-4286-4bc0-96e6-afe1a4e4f258,segment=NetworkSegment(c2814cad-7444-44e7-b6ff-45aabf50a342),segment_id=c2814cad-7444-44e7-b6ff-45aabf50a342)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:36.205520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.301523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.329872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b00e3f5c-f577-45fe-8561-f758f2bcdb66']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:36.343550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Calling delete_port for 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:49:36.344281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c2814cad-7444-44e7-b6ff-45aabf50a342') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:36.344579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c2814cad-7444-44e7-b6ff-45aabf50a342') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:36.357644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.375818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.383453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Releasing vlan 895 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:49:36.383886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:49:36.397423 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:49:36.424507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:49:36.424898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:49:36.591594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.596268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.598935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5b44ace8-f4b0-4e98-beab-1925368fb2a3 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:36.620597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Pushing event deleted for resources: {'Network': ['ID=b00e3f5c-f577-45fe-8561-f758f2bcdb66,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:36.623217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:36.631025 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] 10.222.0.70 "DELETE /v2.0/networks/b00e3f5c-f577-45fe-8561-f758f2bcdb66 HTTP/1.1" status: 204 len: 168 time: 1.0623958 Nov 24 14:49:36.822752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53348) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:36.877847 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b07a2325-fce4-4254-a239-d3f05683f9ae admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=1ec805494cfe48e7b3b437f76c8c3ec4&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0538504 Nov 24 14:49:36.880230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53352) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:36.925815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Deleting port 5bef47f0-4286-4bc0-96e6-afe1a4e4f258 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:49:36.926429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.941046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:36.968098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.002093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-b7c27f2c-18fb-49b3-9a6d-8d7f08866bd4 None None] The port '5bef47f0-4286-4bc0-96e6-afe1a4e4f258' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:49:37.006689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.022392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.026855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c7184405-a8a9-4020-bef0-b000ab8685a3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:37.041080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86544101-7a2a-4765-a2eb-64e2f04c60d0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:37.043722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:37.053710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.054827 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/86544101-7a2a-4765-a2eb-64e2f04c60d0 HTTP/1.1" status: 204 len: 168 time: 0.1737175 Nov 24 14:49:37.455665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53360) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:37.508449 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-09bbba84-37df-418f-a2af-d9aa5e651b28 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=f63c42f2f18c430c8376e71e241959c0&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0515046 Nov 24 14:49:37.511137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53364) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:37.573412 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.599440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.652850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.657805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-360cf72a-19e4-428b-a28f-2aea53fa343e tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:37.669536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4af99a80-5ba5-4f2f-800d-2179283aa4ba,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:37.671845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:37.677415 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:37.678519 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/4af99a80-5ba5-4f2f-800d-2179283aa4ba HTTP/1.1" status: 204 len: 168 time: 0.1664894 Nov 24 14:49:38.646273 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:38.846902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:49:39.780179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53410) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:39.785882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-6293447', 'description': 'tempest-secgroup-smoke-6293447 description', 'project_id': '9482331cd77d4af992b911b12f253611'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:39.792711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:39.796757 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:39.799567 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:39.805465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:39.816048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:39.828278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:39.860005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:39.863694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:39.866441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:39.872320 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:39.944426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:39.948602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:39.952386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-e01ca8ca-5a0b-40d2-9172-43bf5c80452b tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:39.997189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bf2b9406-8b1e-4dc9-a393-a13448872681,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:39.999847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.002138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.004336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.007244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.013600 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.068604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.073330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.076834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-58bb6085-32f9-47de-859a-d62bfd772851 tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:40.114959 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:40.117984 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.119385 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.120595 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1622 time: 0.3394308 Nov 24 14:49:40.123459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53414) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:40.129025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': 'b88a8fb6-952b-4cb9-a5bb-0f706e5550f9', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:40.135490 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.139333 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.142199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.147926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.165873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.229539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.233209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.239042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-73a4d67a-7022-4ba0-8cba-c4cf7db3713c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:40.261427 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=874c96d8-7b7b-49f9-b90c-b1341e51bc35,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:40.265087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.277526 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.278727 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1543202 Nov 24 14:49:40.282890 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53418) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:40.289964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': 'b88a8fb6-952b-4cb9-a5bb-0f706e5550f9', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:40.297646 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.301908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.306310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.314931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.335627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.415606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.420443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.422226 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f92be998-aa00-49ab-baeb-3ab0d61955cc tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:40.445077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7432d89a-dd0c-4b04-8ab8-e9a0d6f6f07a,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:40.448674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.456153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.457314 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-24de8612-2836-44f2-bfa6-8c17ffa6212d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1733725 Nov 24 14:49:40.460972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53422) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:40.467091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': 'b88a8fb6-952b-4cb9-a5bb-0f706e5550f9', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:40.472946 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.476671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.480255 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.485883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.503291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.567477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.571212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.573509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0c6f28b1-97ae-40db-ba6b-e44b12cc7cc9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:40.595509 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b2d7ec48-1d5e-4fcf-b9a1-462133b6cde8,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:40.599841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.609998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.609998 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8ed1b3ac-408c-4ac3-8edb-a258a48bf90f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1442511 Nov 24 14:49:40.609998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53426) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:40.614222 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': 'b88a8fb6-952b-4cb9-a5bb-0f706e5550f9', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:40.621055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.625814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.629310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.637179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.654492 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.723478 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.727308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.733583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-53bb59fd-bb1a-44d8-9476-a1b081b2dbce tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:40.753358 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bcc41462-bafc-42e4-85dd-4f1dccea9bc0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:40.756233 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.764451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.765614 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f644d108-cb7c-4d33-b2ab-02537c9b1b40 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1559517 Nov 24 14:49:40.768292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53430) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:40.773745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': 'b88a8fb6-952b-4cb9-a5bb-0f706e5550f9', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:40.780046 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.783738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.786612 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.793390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.804310 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:49:40.811584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.880591 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.883966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.885818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e03aedf-3987-4c65-bace-d419d157d0bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:40.908260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d6daaa78-f1f2-4100-9330-4abf6073fb5a,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:40.910817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:40.919212 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:40.920471 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1e9cb5aa-e4ad-46f9-a493-8ed3be52d622 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1512723 Nov 24 14:49:40.923310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53434) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:40.928910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': 'b88a8fb6-952b-4cb9-a5bb-0f706e5550f9', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:40.935661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:40.939656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:40.942644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:40.948617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:40.959441 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:49:40.966937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.037503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.041720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.049384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-aada23d1-3b9b-4e0d-9f24-0c2c02d3c7ed tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:41.072661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e9896bfb-1bdf-4329-8fab-f14b77a8a4e9,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:41.075230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:41.080994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.082418 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-75c3b7d1-6ebf-404d-8286-82d38e3d7bdb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1581104 Nov 24 14:49:41.085799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53438) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:41.091807 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'network': {'name': 'tempest-network-smoke--190953026', 'project_id': '9482331cd77d4af992b911b12f253611', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:41.097186 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:41.101330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:network and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:41.105116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:41.111124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:41.125079 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:49:41.128051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.160270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 874} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:49:41.171508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.171951 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Added segment d1aaec42-0654-4f35-8278-c50c2a9bdc40 of type vlan for network fa61f407-ca48-4803-8fa7-06251497b1d0 Nov 24 14:49:41.199729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.232637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.236676 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:41.237285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.246316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-868f924e-ebd8-47e3-b66a-df75d3903873 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:41.338920 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2519536 Nov 24 14:49:41.341819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53442) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:41.347860 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'admin_state_up': True, 'project_id': '9482331cd77d4af992b911b12f253611', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:41.348105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Network': ['ID=fa61f407-ca48-4803-8fa7-06251497b1d0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:41.350942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-37922ff2-5e8e-4768-a7f1-4c70715fe9a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:41.356251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:41.359195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network fa61f407-ca48-4803-8fa7-06251497b1d0 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:49:41.360315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:router and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:41.363190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:41.370635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:41.380653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.381729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.403323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.554291 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.727554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.755692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:41.996448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.215 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/4af557d1-48bd-47db-b366-1e45d344e9ad) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:49:42.145813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:42.173398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:42.177066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:42.245356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:49:42.248604 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:49:42.252665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:49:42.277010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=4af557d1-48bd-47db-b366-1e45d344e9ad,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:42.281868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:42.408748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:42.409652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:42.639613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router b4392774-2b51-474e-8fbb-fa85c77976c0 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:49:42.844348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:49:42.855318 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Sync routers for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:49:42.869053 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:42.870104 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:42.873892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:42.877981 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.5316517 Nov 24 14:49:42.878242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53446) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:43.053381 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-61a0efc9-c8ae-4580-98e8-f66812b0647a tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=9482331cd77d4af992b911b12f253611&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1739078 Nov 24 14:49:43.056824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53452) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:43.084916 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:43.187038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cd9d0ee-4c06-4ea2-90f1-4b7c46c672d6 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:43.188666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5cd9d0ee-4c06-4ea2-90f1-4b7c46c672d6 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1308331 Nov 24 14:49:43.191620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53456) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:43.232311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-215f6b56-80f0-4ad1-b684-f452fbf99f7d tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0393302 Nov 24 14:49:43.235025 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53460) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:43.241295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2060761025', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'project_id': '9482331cd77d4af992b911b12f253611', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:43.358878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:43.362667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:subnet and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:49:43.365512 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:49:43.371740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:43.382474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:49:43.389835 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:43.394515 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Checking router: b4392774-2b51-474e-8fbb-fa85c77976c0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:49:43.394869 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Updating router b4392774-2b51-474e-8fbb-fa85c77976c0 port 4af557d1-48bd-47db-b366-1e45d344e9ad binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:49:43.448218 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.501932 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.747217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.751652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6f94b72f-4400-49d3-9757-deb1879cfb40 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:43.786262 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.798487 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Transition to ACTIVE for port object 4af557d1-48bd-47db-b366-1e45d344e9ad will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:43.806535 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.810678 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-c0b3ae86-466f-41ce-b779-598586333f31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:43.826062 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Subnet': ['ID=df1d7059-f31b-4b7b-8160-8065fe19385d,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:43.830305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:43.848272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Checking segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:49:43.848623 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network hostable DHCP agents. Network: fa61f407-ca48-4803-8fa7-06251497b1d0, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:49:43.872886 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network fa61f407-ca48-4803-8fa7-06251497b1d0 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:49:43.883745 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, fa61f407-ca48-4803-8fa7-06251497b1d0) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:49:43.892151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-191b07ee-950e-4c2c-8ead-840d3a1c5c32 None None] Network fa61f407-ca48-4803-8fa7-06251497b1d0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:49:43.892667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:43.892934 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.894166 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Attempting to bind port 4af557d1-48bd-47db-b366-1e45d344e9ad on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:49:43.894609 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Attempting to bind port 4af557d1-48bd-47db-b366-1e45d344e9ad by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:49:43.894906 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Attempting to bind port 4af557d1-48bd-47db-b366-1e45d344e9ad on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:49:43.900122 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Pushing event updated for resources: {'Port': ['ID=4af557d1-48bd-47db-b366-1e45d344e9ad,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:43.910160 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.910496 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.911046 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.911231 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.911507 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.911853 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.912194 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.912500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.912898 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.913227 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.913588 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:43.918027 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:43.921346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-278aab2a-ae5c-4633-868a-c6a640f3ced5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.6822212 Nov 24 14:49:43.921985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53464) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:49:43.922101 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 49, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:49:43.922658 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:49:43.923105 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.923733 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:49:43.924377 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Bound port: 4af557d1-48bd-47db-b366-1e45d344e9ad, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:49:43.924729 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:43.996968 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] For port 4af557d1-48bd-47db-b366-1e45d344e9ad, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:49:44.000410 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] For port 4af557d1-48bd-47db-b366-1e45d344e9ad, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4af557d1-48bd-47db-b366-1e45d344e9ad,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:49:44.005042 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.009714 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a92d6091-43a6-45f2-aaf4-0497b90ebe84 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:44.091502 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Pushing event updated for resources: {'Port': ['ID=4af557d1-48bd-47db-b366-1e45d344e9ad,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:44.094968 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:44.111152 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:44.112777 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:44.132843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-fa61f407-ca48-4803-8fa7-06251497b1d0', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:49:44.133756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.317470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Allocated IP 172.20.0.2 (fa61f407-ca48-4803-8fa7-06251497b1d0/df1d7059-f31b-4b7b-8160-8065fe19385d/30797820-1f2d-4f88-9af5-73374847139b) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:49:44.318539 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:44.532748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.546868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Transition to ACTIVE for port object 30797820-1f2d-4f88-9af5-73374847139b will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:44.570775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Transition to ACTIVE for port object 30797820-1f2d-4f88-9af5-73374847139b will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:44.582424 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.590444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:44.671808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Network fa61f407-ca48-4803-8fa7-06251497b1d0 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:49:44.673555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:49:44.675520 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Pushing event updated for resources: {'Port': ['ID=30797820-1f2d-4f88-9af5-73374847139b,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:44.677939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:49:44.686048 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:44.689813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.690166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.690503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.690836 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.691123 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecf8f91e-12a6-40ea-b3a5-5605a7b5afcf None None] The sync data for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv is: [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:49:44.691282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.691486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.691856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.692170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.692516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.692813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.693131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:49:44.722357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:44.784999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Attempting to bind port 30797820-1f2d-4f88-9af5-73374847139b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:49:44.785377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Attempting to bind port 30797820-1f2d-4f88-9af5-73374847139b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:49:44.785748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Attempting to bind port 30797820-1f2d-4f88-9af5-73374847139b on network fa61f407-ca48-4803-8fa7-06251497b1d0 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:49:44.793279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 49, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:49:44.793702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Checking segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:49:44.794117 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.794510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Bound using segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:49:44.794983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Bound port: 30797820-1f2d-4f88-9af5-73374847139b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:49:44.795363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.886827 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.945819 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] For port 30797820-1f2d-4f88-9af5-73374847139b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:49:44.952982 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] For port 30797820-1f2d-4f88-9af5-73374847139b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30797820-1f2d-4f88-9af5-73374847139b,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:49:44.962716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:44.967132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:45.053731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Pushing event updated for resources: {'Port': ['ID=30797820-1f2d-4f88-9af5-73374847139b,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:45.059541 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:45.370404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.1 (fa61f407-ca48-4803-8fa7-06251497b1d0/df1d7059-f31b-4b7b-8160-8065fe19385d/c1ba90d7-a385-4392-9a9a-968f34259690) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:49:45.549721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:45.570196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object c1ba90d7-a385-4392-9a9a-968f34259690 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:45.596053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:45.601973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d5d22de4-3152-4cfd-ad63-bd4121079945 tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:45.679141 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network fa61f407-ca48-4803-8fa7-06251497b1d0 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:49:45.683002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:49:45.685590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:49:45.718536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=c1ba90d7-a385-4392-9a9a-968f34259690,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:45.723820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:45.757252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:45.851775 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.017070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4af557d1-48bd-47db-b366-1e45d344e9ad up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:49:46.087208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0dc41c65-f751-492e-959d-fe69feab0a8c None None] Network fa61f407-ca48-4803-8fa7-06251497b1d0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:49:46.204762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4af557d1-48bd-47db-b366-1e45d344e9ad completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:49:46.215572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4af557d1-48bd-47db-b366-1e45d344e9ad triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:46.216044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.250352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7f91da92-850c-4eee-ae88-99b036f1599a None None] Provisioning for port 30797820-1f2d-4f88-9af5-73374847139b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:49:46.430447 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.436455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.437318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.464417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 4af557d1-48bd-47db-b366-1e45d344e9ad, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4af557d1-48bd-47db-b366-1e45d344e9ad,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:46.468287 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-18a2e01d-6077-484d-a15b-3d81ae997309 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:46.470862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.471828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30797820-1f2d-4f88-9af5-73374847139b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:49:46.499435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:46.566769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=c1ba90d7-a385-4392-9a9a-968f34259690,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:46.569878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:46.570911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.594713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=4af557d1-48bd-47db-b366-1e45d344e9ad,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:46.598319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:46.613516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 30797820-1f2d-4f88-9af5-73374847139b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:49:46.620484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 30797820-1f2d-4f88-9af5-73374847139b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:46.630716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.716546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-08fa77fc-3e83-421e-bf6d-ffbf3eec3fce None None] Provisioning for port c1ba90d7-a385-4392-9a9a-968f34259690 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:49:46.723732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-08fa77fc-3e83-421e-bf6d-ffbf3eec3fce None None] Provisioning complete for port c1ba90d7-a385-4392-9a9a-968f34259690 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:46.724141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-08fa77fc-3e83-421e-bf6d-ffbf3eec3fce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.738869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network fa61f407-ca48-4803-8fa7-06251497b1d0 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:49:46.740508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:49:46.825845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-08fa77fc-3e83-421e-bf6d-ffbf3eec3fce None None] Port c1ba90d7-a385-4392-9a9a-968f34259690 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:49:46.829872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.870600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-08fa77fc-3e83-421e-bf6d-ffbf3eec3fce None None] Provisioning complete for port 30797820-1f2d-4f88-9af5-73374847139b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:46.871000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-08fa77fc-3e83-421e-bf6d-ffbf3eec3fce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.913856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 30797820-1f2d-4f88-9af5-73374847139b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30797820-1f2d-4f88-9af5-73374847139b,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:46.920623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:46.926055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a9f323a2-03c6-4d81-b64e-a70a528d3935 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:47.045480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=30797820-1f2d-4f88-9af5-73374847139b,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:47.048689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:47.157154 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router b4392774-2b51-474e-8fbb-fa85c77976c0 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:49:47.193563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-7d364c04-fbc0-47f6-9ecb-080bfaa857b3 None None] Provisioning complete for port c1ba90d7-a385-4392-9a9a-968f34259690 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:47.193941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7d364c04-fbc0-47f6-9ecb-080bfaa857b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:47.254102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-7d364c04-fbc0-47f6-9ecb-080bfaa857b3 None None] Port c1ba90d7-a385-4392-9a9a-968f34259690 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:49:47.365211 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:49:47.376403 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/b4392774-2b51-474e-8fbb-fa85c77976c0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4539206 Nov 24 14:49:47.770338 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-e5b0246c-d471-40f0-a706-d6a33acbb6b5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-6293447&fields=id&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 267 time: 0.0449035 Nov 24 14:49:47.920272 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-a51378bf-00bc-4bc5-8faf-b8334c4deb9a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:47.921939 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-a51378bf-00bc-4bc5-8faf-b8334c4deb9a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 796 time: 0.1440032 Nov 24 14:49:47.939381 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-883f83f2-c0b3-4a3d-8f7d-1f2f1fb24eca tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/quotas/9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 375 time: 0.0118742 Nov 24 14:49:47.958315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4af557d1-48bd-47db-b366-1e45d344e9ad up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:49:48.024940 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-450c75e3-e51c-49c8-a25d-965a50bb7de8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0802372 Nov 24 14:49:48.031291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4af557d1-48bd-47db-b366-1e45d344e9ad triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:48.031672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:48.154761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30797820-1f2d-4f88-9af5-73374847139b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:49:48.226581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 30797820-1f2d-4f88-9af5-73374847139b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:48.226964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:48.254716 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-51aea598-3e4d-4b52-9f8e-b958f89776a3 service neutron] 10.222.0.70 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2153440 Nov 24 14:49:48.282971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Sync routers for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:49:48.302154 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:48.318581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:48.319123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:48.512890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-d2a25ceb-353c-438e-ac06-790cdf7c5685 service neutron] 10.222.0.70 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2502174 Nov 24 14:49:48.597773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:48.705429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-592d45f9-94f1-49d8-88c6-3854552d9903 req-884e5b84-5505-48b6-b6cd-3e5ebe269abd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:49:48.723802 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-592d45f9-94f1-49d8-88c6-3854552d9903 req-884e5b84-5505-48b6-b6cd-3e5ebe269abd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:49:48.724976 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-592d45f9-94f1-49d8-88c6-3854552d9903 req-884e5b84-5505-48b6-b6cd-3e5ebe269abd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0636377 Nov 24 14:49:48.920040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 2, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:48.924084 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Checking router: b4392774-2b51-474e-8fbb-fa85c77976c0 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:49:48.924445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Updating router b4392774-2b51-474e-8fbb-fa85c77976c0 port c1ba90d7-a385-4392-9a9a-968f34259690 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:49:48.975006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:49.314000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:49.326433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Transition to ACTIVE for port object c1ba90d7-a385-4392-9a9a-968f34259690 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:49.332997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:49.337011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5291fccb-6bea-4139-9e24-20daa24404d7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:49.461269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b81bc1-1007-4306-9238-e22171153e07 None None] Pushing event updated for resources: {'Port': ['ID=c1ba90d7-a385-4392-9a9a-968f34259690,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:49.465230 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d6b81bc1-1007-4306-9238-e22171153e07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:49.552009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Attempting to bind port c1ba90d7-a385-4392-9a9a-968f34259690 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:49:49.552390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Attempting to bind port c1ba90d7-a385-4392-9a9a-968f34259690 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:49:49.552762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Attempting to bind port c1ba90d7-a385-4392-9a9a-968f34259690 on network fa61f407-ca48-4803-8fa7-06251497b1d0 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:49:49.560232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 49, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:49:49.560616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Checking segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:49:49.561087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:49.561412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Bound using segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:49:49.561881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Bound port: c1ba90d7-a385-4392-9a9a-968f34259690, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:49:49.562264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:49.687143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] For port c1ba90d7-a385-4392-9a9a-968f34259690, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:49:49.690509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] For port c1ba90d7-a385-4392-9a9a-968f34259690, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c1ba90d7-a385-4392-9a9a-968f34259690,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:49:49.746046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:49.756376 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:49.845021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b81bc1-1007-4306-9238-e22171153e07 None None] Pushing event updated for resources: {'Port': ['ID=c1ba90d7-a385-4392-9a9a-968f34259690,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:49.849687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d6b81bc1-1007-4306-9238-e22171153e07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:49.856862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:49:49.857558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:49:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:49.885352 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5d5c09a4-ccb8-49e6-86de-95f26f2a32bc req-40bf00c7-7219-42fd-883e-9f558f16f2a0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0732129 Nov 24 14:49:50.190465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:49:50.520434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:49Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:49:50.524307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d6ccf27-867a-46e1-ae22-d88713b21574 None None] The sync data for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv is: [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:49Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:49:50.996867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-037bad10-78fc-4134-9171-f61468f56ef9 req-46e0b647-95bd-4f37-9ac5-e641a9a7b659 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0442839 Nov 24 14:49:51.972097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c1ba90d7-a385-4392-9a9a-968f34259690 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:49:52.046350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c1ba90d7-a385-4392-9a9a-968f34259690 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:49:52.051332 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c1ba90d7-a385-4392-9a9a-968f34259690 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:52.051715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:52.113350 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29b68238-3170-4e47-bfa2-41626306847a req-da0f3684-ec8d-455e-9fc0-4b2e4d8ebce3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0432692 Nov 24 14:49:52.167270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:52.200044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port c1ba90d7-a385-4392-9a9a-968f34259690, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c1ba90d7-a385-4392-9a9a-968f34259690,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:49:52.203750 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:52.205568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:52.284582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=c1ba90d7-a385-4392-9a9a-968f34259690,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:52.288301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:53.277968 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8ebf3838-40e9-4a23-91eb-e1d5cb635f68 req-e1d62458-cf7d-4207-93a0-3c35220cc203 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0438578 Nov 24 14:49:53.957206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c1ba90d7-a385-4392-9a9a-968f34259690 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:49:54.027619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c1ba90d7-a385-4392-9a9a-968f34259690 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:54.028195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:54.176477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-289071e4-3ffe-4519-85b7-54e36f4c22f2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:54.178329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-289071e4-3ffe-4519-85b7-54e36f4c22f2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 796 time: 0.1600742 Nov 24 14:49:54.235338 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-40fd6e7e-759a-471b-8377-da3644408e23 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 377 time: 0.0443943 Nov 24 14:49:54.244883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'port': {'device_id': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'admin_state_up': True, 'tenant_id': '9482331cd77d4af992b911b12f253611', 'security_groups': ['b88a8fb6-952b-4cb9-a5bb-0f706e5550f9']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:54.390582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:49:54.401680 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:49:54.457105 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-401bfd44-39c2-4d8a-bdd8-de3960035b46 req-9b350bd6-6db8-4dce-903a-f3dfbc838315 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0563939 Nov 24 14:49:54.463532 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:49:54.467786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:54.623786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.7 (fa61f407-ca48-4803-8fa7-06251497b1d0/df1d7059-f31b-4b7b-8160-8065fe19385d/fd6dab02-17f7-422e-b8e9-2b0ed29d34c7) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:49:54.815267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:54.833801 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:54.857058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:54.862919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f61ca1cd-2724-40b3-93a8-a82bf135c0f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:54.930097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network fa61f407-ca48-4803-8fa7-06251497b1d0 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:49:54.933898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:49:54.936445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:49:54.974440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:54.978436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:55.009802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:55.010447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:55.037042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7963820 Nov 24 14:49:55.049238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Request body: {'port': {'device_id': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:49:55.162103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:55.232591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d1c31c3d-bc4a-4a26-9ed2-e58ed4955669 None None] Provisioning for port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:49:55.238614 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d1c31c3d-bc4a-4a26-9ed2-e58ed4955669 None None] Provisioning complete for port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:49:55.239160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1c31c3d-bc4a-4a26-9ed2-e58ed4955669 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:55.301000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1c31c3d-bc4a-4a26-9ed2-e58ed4955669 None None] Port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:49:55.500366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:49:55.507788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:55.524825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Transition to ACTIVE for port object fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:49:55.530144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:55.534496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1f6f4bbd-5fcd-4e04-9943-86cbfef8491d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:55.679156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84edc5eb-4e6a-4ba6-a704-9cd2cc995396 req-083739e7-5f54-4984-a228-9bdd2a1a23e2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:55.681652 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-84edc5eb-4e6a-4ba6-a704-9cd2cc995396 req-083739e7-5f54-4984-a228-9bdd2a1a23e2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 943 time: 0.0926318 Nov 24 14:49:55.733936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-84edc5eb-4e6a-4ba6-a704-9cd2cc995396 req-9376b3ac-4d97-412d-8a4a-29350104046d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:49:55.753659 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-84edc5eb-4e6a-4ba6-a704-9cd2cc995396 req-9376b3ac-4d97-412d-8a4a-29350104046d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:49:55.755106 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-84edc5eb-4e6a-4ba6-a704-9cd2cc995396 req-9376b3ac-4d97-412d-8a4a-29350104046d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0670655 Nov 24 14:49:55.783097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Pushing event updated for resources: {'Port': ['ID=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:55.785920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:55.890878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Attempting to bind port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:49:55.891207 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Attempting to bind port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:49:55.891529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Attempting to bind port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 on network fa61f407-ca48-4803-8fa7-06251497b1d0 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:49:55.897282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 on network fa61f407-ca48-4803-8fa7-06251497b1d0 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:49:55.897596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Attempting to bind port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 on network fa61f407-ca48-4803-8fa7-06251497b1d0 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:49:55.904841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 49, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:49:55.905150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Checking segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:49:55.905533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Bound using segment: {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:49:55.905953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Bound port: fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1aaec42-0654-4f35-8278-c50c2a9bdc40', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:49:55.906381 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:55.999392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] For port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:49:56.002319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] For port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:49:56.006841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:56.011633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2dbc2d73-79cc-40a2-b8e1-aa7c7d44b034 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:49:56.063153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:49:56.064568 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] 10.222.0.47 "PUT /v2.0/ports/fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 1093 time: 1.0197253 Nov 24 14:49:56.065091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:49:56.092375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Pushing event updated for resources: {'Port': ['ID=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:49:56.095512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:49:56.146464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'status': 'completed', 'code': 200} Nov 24 14:49:56.193678 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-2f1feaa3-6b21-4470-9694-22654f50a343 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1096 time: 0.0808296 Nov 24 14:49:56.269974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-035c4cbb-9917-45ef-900c-ba599c0ff8a7 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 217 time: 0.0691328 Nov 24 14:49:56.335847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-07302e6a-7a9d-4165-ab22-a31c90b2076b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:56.338161 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-07302e6a-7a9d-4165-ab22-a31c90b2076b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 200 len: 835 time: 0.0613976 Nov 24 14:49:56.410803 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-ebc3d878-8fb5-4a15-9089-8e71dbd151aa service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=fa61f407-ca48-4803-8fa7-06251497b1d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0669179 Nov 24 14:49:56.545304 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-318df1bd-a2d8-4ae8-ae0e-590c6cf6ec77 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275799 Nov 24 14:49:56.682734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-fd67ea65-5078-4a37-9e92-d8725213fb93 req-31aac5d6-8111-441e-b6ad-821969da5949 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1312017 Nov 24 14:49:56.802841 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-68353d78-1273-4753-bfec-0a7e52ebb628 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1096 time: 0.0731781 Nov 24 14:49:56.942333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-563853de-437c-4c16-b782-62e565424699 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:56.943780 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-563853de-437c-4c16-b782-62e565424699 service neutron] 10.222.0.47 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 897 time: 0.1340964 Nov 24 14:49:56.957738 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa6ffe4-19e3-4fe1-9964-2523c9e75922 req-5e49343d-7b27-4e9b-ac89-2d1c155218d4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:56.960084 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daa6ffe4-19e3-4fe1-9964-2523c9e75922 req-5e49343d-7b27-4e9b-ac89-2d1c155218d4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 943 time: 0.0791655 Nov 24 14:49:57.013169 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-daa6ffe4-19e3-4fe1-9964-2523c9e75922 req-1aa5fcbe-1995-48cb-8b60-5c530eea897a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0469234 Nov 24 14:49:57.016858 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-59484a8e-70a7-4e1d-b37e-f9e784d386a0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 217 time: 0.0668142 Nov 24 14:49:57.086180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-a0bb26ce-3dc6-45de-93d6-1e2069fde519 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:57.088205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-a0bb26ce-3dc6-45de-93d6-1e2069fde519 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 200 len: 835 time: 0.0636845 Nov 24 14:49:57.161440 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-78da07ec-19fc-45b2-aed9-c5258ac92e98 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=fa61f407-ca48-4803-8fa7-06251497b1d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0676117 Nov 24 14:49:57.294658 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-ab5a55f3-c43f-4a0c-9ba7-1be0c19a103f service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1249588 Nov 24 14:49:57.426956 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6b351783-f29d-4a8c-9b68-b0100b54ae19 req-848f0b38-8a0d-410f-af11-d361586956f8 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1260064 Nov 24 14:49:58.219945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58228b41-f57f-41bf-9bd6-dc3068637faa req-f2199ffc-92aa-4d44-ae42-f83d03892cd7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:58.220599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-58228b41-f57f-41bf-9bd6-dc3068637faa req-f2199ffc-92aa-4d44-ae42-f83d03892cd7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:49:58.237410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-58228b41-f57f-41bf-9bd6-dc3068637faa req-f2199ffc-92aa-4d44-ae42-f83d03892cd7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:49:58.238768 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-58228b41-f57f-41bf-9bd6-dc3068637faa req-f2199ffc-92aa-4d44-ae42-f83d03892cd7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 943 time: 0.0937514 Nov 24 14:49:58.394502 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-58228b41-f57f-41bf-9bd6-dc3068637faa req-ad4a0847-3fb3-4650-9602-26ce3abe8aea tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.1476576 Nov 24 14:49:59.711440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761cda3e-ed7f-4d33-a28e-8f03a76b4cc1 req-6ab85e49-49ad-4974-9943-f45ab538d1f2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:49:59.713177 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-761cda3e-ed7f-4d33-a28e-8f03a76b4cc1 req-6ab85e49-49ad-4974-9943-f45ab538d1f2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 943 time: 0.1954038 Nov 24 14:49:59.757994 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-761cda3e-ed7f-4d33-a28e-8f03a76b4cc1 req-69bbee0d-cf6d-4e8c-8063-6592fd183c38 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0394287 Nov 24 14:49:59.899983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:50:00.032095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:50:00.046477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'port_id': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'mac_address': 'fa:16:3e:f9:33:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:50:00.101074 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:00.119942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:50:00.134751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:50:00.138727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:00.140693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:50:00.206839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:50:00.210143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:50:00.509882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['fd6dab02-17f7-422e-b8e9-2b0ed29d34c7'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:50:00.953691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2607aa68-7162-47e8-b781-3470c9bb1f48 req-ff101086-acd3-4e81-a2e1-fe335bda9078 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:00.955109 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2607aa68-7162-47e8-b781-3470c9bb1f48 req-ff101086-acd3-4e81-a2e1-fe335bda9078 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 944 time: 0.0767353 Nov 24 14:50:01.002227 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2607aa68-7162-47e8-b781-3470c9bb1f48 req-f52dea49-0458-4b9d-b339-0a8c4501a0fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0413189 Nov 24 14:50:01.918473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:50:01.986381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:50:01.991039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:50:01.991419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:02.155664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:02.183658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:50:02.193529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:50:02.198809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:02.200920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:50:02.210394 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9487df35-5486-4a45-8d6d-1d671551753f req-3af63a3b-f51c-4d64-aa72-9a96b4b8e85f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:02.212091 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9487df35-5486-4a45-8d6d-1d671551753f req-3af63a3b-f51c-4d64-aa72-9a96b4b8e85f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 944 time: 0.0876646 Nov 24 14:50:02.251007 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'code': 200} Nov 24 14:50:02.282878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:50:02.286389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:50:02.296376 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9487df35-5486-4a45-8d6d-1d671551753f req-506ffdb9-164e-4839-bc54-f1ffb9f1a6c5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0753102 Nov 24 14:50:02.480422 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8289bbbe-9d2c-4dea-9518-7a1a18f457be req-6275c9cb-9d9e-4e7f-942b-f11b20e7b2b3 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1098 time: 0.0729177 Nov 24 14:50:02.524841 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8289bbbe-9d2c-4dea-9518-7a1a18f457be req-44784f18-5171-4597-83ab-23c913f048cc service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0376818 Nov 24 14:50:03.360310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bf26e1e4-d28e-4f03-8fd9-5c496ea29820 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:03.486281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d73835c-927c-43f4-bc1b-fb93b29dfcdc req-4a5139c0-dcb7-4d21-b3fa-23620b55fcc3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:03.487625 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d73835c-927c-43f4-bc1b-fb93b29dfcdc req-4a5139c0-dcb7-4d21-b3fa-23620b55fcc3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0756726 Nov 24 14:50:03.533112 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d73835c-927c-43f4-bc1b-fb93b29dfcdc req-3eb94a8e-b02f-4e92-af90-03a4db8b7d26 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0395167 Nov 24 14:50:03.760438 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:04.730627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-394bf5bb-64d5-4788-b39f-6c4e40d737ac req-fc0f297b-1904-4ce4-9b62-9db5eec59689 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:04.732079 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-394bf5bb-64d5-4788-b39f-6c4e40d737ac req-fc0f297b-1904-4ce4-9b62-9db5eec59689 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0766063 Nov 24 14:50:04.777766 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-394bf5bb-64d5-4788-b39f-6c4e40d737ac req-fcd87949-4b5a-4ed2-97fd-8ff4cc0fd376 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0402694 Nov 24 14:50:04.975742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fb1a0d-7521-4c52-8b2b-15fcbc494411 req-81c2acf1-a773-45a7-9c04-66fe96614db0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:04.977857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c8fb1a0d-7521-4c52-8b2b-15fcbc494411 req-81c2acf1-a773-45a7-9c04-66fe96614db0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0789635 Nov 24 14:50:05.023038 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c8fb1a0d-7521-4c52-8b2b-15fcbc494411 req-412d547a-bed9-4616-a7b8-bddccd705983 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0397573 Nov 24 14:50:05.050018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53542) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:50:05.125260 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f05a1662-e5a1-4afb-a9a7-d4cd3275c2d2 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1093 time: 0.0740073 Nov 24 14:50:05.127743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53546) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:50:05.132665 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address': '172.20.0.7'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:50:05.138905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:50:05.142678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:floatingip and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:50:05.145466 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:50:05.152249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:50:05.162456 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:05.307408 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:05.444337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.148 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/e91d0f0d-b35d-4ae9-92f0-fa3e32868381) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:50:05.592286 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:05.620409 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:05.623991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bfc8f082-e382-42fd-a6ae-f84377c45272 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:50:05.691242 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:50:05.694272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:50:05.699095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:50:05.725791 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=e91d0f0d-b35d-4ae9-92f0-fa3e32868381,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:50:05.736402 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:50:05.921414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4f1d387c-a3c8-4bb3-a58b-4cdf7d1528da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:06.210727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:06.274701 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:06.587296 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:06.591718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:06.595316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:50:06.713202 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=e91d0f0d-b35d-4ae9-92f0-fa3e32868381,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:50:06.717474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:50:06.724272 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:06.917565 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Floating IP f2da972a-811b-4613-9d81-4a4333887c5d associated. External IP: 172.26.4.148, port: fd6dab02-17f7-422e-b8e9-2b0ed29d34c7. Nov 24 14:50:06.958595 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:07.317575 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router b4392774-2b51-474e-8fbb-fa85c77976c0 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:50:07.519688 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:50:07.529948 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] Sync routers for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:50:07.543604 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:50:07.544244 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:50:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:50:07.544396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:07.602742 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4739730 Nov 24 14:50:07.603499 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:50:07.663852 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'status': 'completed', 'code': 200} Nov 24 14:50:07.722384 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:50:07.759646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-ffd3c97b-4243-4248-b2b4-e037779e76b3 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1098 time: 0.0735586 Nov 24 14:50:07.783180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c898c47-75fc-432c-87fd-fa3cffcba179 req-eeb6a1cb-ca06-4445-b60b-9cce529c0f48 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:07.784668 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9c898c47-75fc-432c-87fd-fa3cffcba179 req-eeb6a1cb-ca06-4445-b60b-9cce529c0f48 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0792220 Nov 24 14:50:07.832749 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9c898c47-75fc-432c-87fd-fa3cffcba179 req-dfa55134-8bc5-4291-9f9f-46e456c773f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0411425 Nov 24 14:50:07.862647 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53554) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:50:07.899634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-527364b4-6657-4ef7-b3fc-3e4c3110f4ea service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:07.901232 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-527364b4-6657-4ef7-b3fc-3e4c3110f4ea service neutron] 10.222.0.47 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 897 time: 0.1356699 Nov 24 14:50:07.974894 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4f528dd9-2d7d-4af9-95c1-7f703bd79e14 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f2da972a-811b-4613-9d81-4a4333887c5d HTTP/1.1" status: 200 len: 991 time: 0.1094408 Nov 24 14:50:08.003809 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-51595448-182a-4467-94ca-8a9f7d784c48 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 999 time: 0.0966682 Nov 24 14:50:08.071775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-cd145306-6c2a-49b3-862f-c2b698eb2a93 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:08.073380 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-cd145306-6c2a-49b3-862f-c2b698eb2a93 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 200 len: 835 time: 0.0632701 Nov 24 14:50:08.080426 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'f2da972a-811b-4613-9d81-4a4333887c5d', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.148', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'port_id': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'mac_address': 'fa:16:3e:f9:33:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:50:06Z', 'updated_at': '2021-11-24T14:50:06Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:50:08.084452 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] Checking router: b4392774-2b51-474e-8fbb-fa85c77976c0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:50:08.095863 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:50:08.096453 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:50:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:50:08.147721 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-7fbdcade-980f-4658-b8b4-9ea6d68c052f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=fa61f407-ca48-4803-8fa7-06251497b1d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0682507 Nov 24 14:50:08.277582 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:50:08.280602 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-5f1003bd-eee4-41d8-9911-d8390fbd72b0 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261277 Nov 24 14:50:08.436860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-602e1a31-8549-4f8b-b12e-266179ca2c39 req-68168f25-bb24-4b74-8365-0b8da94ad20c service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1490932 Nov 24 14:50:08.621929 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'f2da972a-811b-4613-9d81-4a4333887c5d', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.148', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'port_id': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'mac_address': 'fa:16:3e:f9:33:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:50:06Z', 'updated_at': '2021-11-24T14:50:06Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:50:08.625850 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5ff4396-70f8-4b04-ab41-3c2803a04a90 None None] The sync data for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv is: [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'f2da972a-811b-4613-9d81-4a4333887c5d', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.148', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'port_id': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'mac_address': 'fa:16:3e:f9:33:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:50:06Z', 'updated_at': '2021-11-24T14:50:06Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:50:08.648375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:08.813927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f81b4b15-d235-4b1d-adc4-aa127f9bd13e None None] New status for floating IP f2da972a-811b-4613-9d81-4a4333887c5d: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:50:08.977769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53558) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:50:09.088501 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fdd113cb-f558-42cb-a15b-537ad48e7949 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f2da972a-811b-4613-9d81-4a4333887c5d HTTP/1.1" status: 200 len: 991 time: 0.1095865 Nov 24 14:50:10.092105 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53564) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:50:10.321722 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-da7b244c-12f7-4cd7-8f65-0cea81bd0a1a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f2da972a-811b-4613-9d81-4a4333887c5d HTTP/1.1" status: 200 len: 993 time: 0.2275605 Nov 24 14:50:14.899360 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-4c14db08-0caf-4386-8b42-43bfa7437e74 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0699942 Nov 24 14:50:15.041440 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-a0acc009-f499-42eb-8f4b-b7d85c12dfa0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1098 time: 0.0690727 Nov 24 14:50:15.183155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-1ed15835-225a-4dd2-ac4e-f0487b465599 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:15.184622 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-1ed15835-225a-4dd2-ac4e-f0487b465599 service neutron] 10.222.0.47 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 897 time: 0.1247163 Nov 24 14:50:15.295221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-8c1d8219-38db-4e29-a527-04b7fb8311f0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 1001 time: 0.1034286 Nov 24 14:50:15.358761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-321bf77d-d714-4b33-bcf4-d2a5a1879e4c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:50:15.360176 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-321bf77d-d714-4b33-bcf4-d2a5a1879e4c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 200 len: 835 time: 0.0581872 Nov 24 14:50:15.535369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-4067dcef-f530-4449-af77-0413461c849a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=fa61f407-ca48-4803-8fa7-06251497b1d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1670218 Nov 24 14:50:15.676326 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-686037e9-b59b-48ac-9dae-227ae00e29ec service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1332929 Nov 24 14:50:15.818174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-91dbdeda-c81b-41dd-a11d-86f214b01664 req-eeece7ac-210b-4bdf-acf4-24bac030b9eb service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1323736 Nov 24 14:50:15.848874 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:50:18.289071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:33.363395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-694ca2c9-0ca7-4fb2-a1aa-4d8f5be94625 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:33.752875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:35.923108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dadceabf-4d68-4b03-9553-097b8286f36c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:36.962997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:38.651167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:48.315670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:50:52.849350 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:51:03.367406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-efa2905e-02b3-4e18-9e9d-064df945a920 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:03.755242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:05.924080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c19589b3-1474-4089-b87a-bfe610328ec6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:06.965017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:08.655116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:16.893219 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-987bc4fb-beed-4816-a59d-f1eaa16dddb4 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0669034 Nov 24 14:51:17.032732 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-05bbdce2-87e1-46da-ba6d-6cf2f3030ab4 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1098 time: 0.0680332 Nov 24 14:51:17.180213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-c2c64ce3-2059-464d-9d73-8b6a06a2de0f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:17.181537 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-c2c64ce3-2059-464d-9d73-8b6a06a2de0f service neutron] 10.222.0.47 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 897 time: 0.1274931 Nov 24 14:51:17.287998 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-211ec85b-cbaf-492c-b590-8f14ee9bcbb6 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 1001 time: 0.1004329 Nov 24 14:51:17.353004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-f8df0272-4dc5-40f6-b35e-d60e12e0ed49 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:17.354439 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-f8df0272-4dc5-40f6-b35e-d60e12e0ed49 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 200 len: 835 time: 0.0605938 Nov 24 14:51:17.427237 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-1b1dec6a-d4d9-43b6-9f3a-beb5b8e534d3 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=fa61f407-ca48-4803-8fa7-06251497b1d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0669334 Nov 24 14:51:17.556353 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-9d2634ff-0de6-4eaf-ba71-4150f8cd8b59 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1229377 Nov 24 14:51:17.687942 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b57801ce-6c45-4b1d-8d4f-a47b65953de0 req-b3c5c77a-9b2a-4ea1-8095-3850180220d7 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258965 Nov 24 14:51:18.342141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:22.957757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6794fa3-d52b-4bd0-abc9-b157cbee2ad5 req-59ff25cc-e192-45cc-9553-027c545f7631 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:22.960041 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6794fa3-d52b-4bd0-abc9-b157cbee2ad5 req-59ff25cc-e192-45cc-9553-027c545f7631 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0831528 Nov 24 14:51:23.006974 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6794fa3-d52b-4bd0-abc9-b157cbee2ad5 req-ceeb139d-066a-4569-af40-858971833fde tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0401058 Nov 24 14:51:24.234730 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f172062a-96cc-4a25-bf67-fb4e4c52249e req-8b9d618c-9cc8-4f87-aba0-841b1ce8e94c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:24.236200 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f172062a-96cc-4a25-bf67-fb4e4c52249e req-8b9d618c-9cc8-4f87-aba0-841b1ce8e94c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0881774 Nov 24 14:51:24.283415 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f172062a-96cc-4a25-bf67-fb4e4c52249e req-5135b9cd-ac69-484c-b26c-05c58c1917f5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0407584 Nov 24 14:51:24.310769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53600) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:24.418218 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-107c7f38-9aea-4854-8e7d-0b7d81a3922f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f2da972a-811b-4613-9d81-4a4333887c5d HTTP/1.1" status: 200 len: 993 time: 0.1062958 Nov 24 14:51:25.944191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf7cb60f-51a5-499d-add1-b96d9dcd17e8 req-e9cc17d7-d4dc-4abe-9ee7-ee16db5f117f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:25.945662 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf7cb60f-51a5-499d-add1-b96d9dcd17e8 req-e9cc17d7-d4dc-4abe-9ee7-ee16db5f117f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0883131 Nov 24 14:51:25.994716 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf7cb60f-51a5-499d-add1-b96d9dcd17e8 req-be12ed34-4d4c-4649-b529-97f8da135fe6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0436161 Nov 24 14:51:27.203489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e08f82-956a-442f-bcaa-2cdbdc994cd9 req-8c26541c-d46c-443c-95b7-0a0263a1356e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:27.205024 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c6e08f82-956a-442f-bcaa-2cdbdc994cd9 req-8c26541c-d46c-443c-95b7-0a0263a1356e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0868433 Nov 24 14:51:27.252824 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c6e08f82-956a-442f-bcaa-2cdbdc994cd9 req-a5ef4032-b4cf-4296-9c2f-7d08e3023d3e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0408678 Nov 24 14:51:27.282431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53612) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:27.388466 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f606a5a6-d5a0-45b5-b13a-15f6df2e2f7f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f2da972a-811b-4613-9d81-4a4333887c5d HTTP/1.1" status: 200 len: 993 time: 0.1047878 Nov 24 14:51:27.671034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53620) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:27.879005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port e91d0f0d-b35d-4ae9-92f0-fa3e32868381 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:51:27.879351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:28.158883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:28.159208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:28.284251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for e91d0f0d-b35d-4ae9-92f0-fa3e32868381 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:51:28.429446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:28.433994 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70924a09-dfd9-4f46-b2c1-5eb3d8c76151 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:28.479318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=e91d0f0d-b35d-4ae9-92f0-fa3e32868381,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:28.518691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.519080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.519462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.519880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.520255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.520624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.520999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.521413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.522027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.522554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.523006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:28.530066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:28.585085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:28.998888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router b4392774-2b51-474e-8fbb-fa85c77976c0 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:51:29.198841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:51:29.209946 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] Sync routers for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:51:29.220799 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:29.223875 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:29.225183 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:29.280062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/floatingips/f2da972a-811b-4613-9d81-4a4333887c5d HTTP/1.1" status: 204 len: 168 time: 1.6076937 Nov 24 14:51:29.280675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:51:29.339785 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'status': 'completed', 'code': 200} Nov 24 14:51:29.418425 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:29.441445 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-e68e1d15-26e8-4230-83a5-53792f76005a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 1098 time: 0.0729020 Nov 24 14:51:29.586372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-d7ac6694-a807-4717-be87-4e1d4d0edea9 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:29.587784 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-d7ac6694-a807-4717-be87-4e1d4d0edea9 service neutron] 10.222.0.47 "GET /v2.0/networks?id=fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 200 len: 897 time: 0.1396611 Nov 24 14:51:29.661328 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-a63b0c9d-7ca1-43d0-a6e3-fe4142d0cbb9 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 200 len: 217 time: 0.0656404 Nov 24 14:51:29.758629 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:29.763425 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] Checking router: b4392774-2b51-474e-8fbb-fa85c77976c0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:51:29.775459 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:29.776119 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:29.862981 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:51:29.888312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-09f1d123-81b4-4865-ab95-4eb2262244f1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:29.889728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-09f1d123-81b4-4865-ab95-4eb2262244f1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 200 len: 835 time: 0.2207987 Nov 24 14:51:29.963749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04b321b-4a44-4b5b-84fd-4a9e8e1343df req-699b81fa-68d9-4a63-ad31-107b29f00eef tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:29.964484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b04b321b-4a44-4b5b-84fd-4a9e8e1343df req-699b81fa-68d9-4a63-ad31-107b29f00eef tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:51:29.965933 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:29.995804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b04b321b-4a44-4b5b-84fd-4a9e8e1343df req-699b81fa-68d9-4a63-ad31-107b29f00eef tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:51:29.996979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b04b321b-4a44-4b5b-84fd-4a9e8e1343df req-699b81fa-68d9-4a63-ad31-107b29f00eef tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.1729116 Nov 24 14:51:30.003469 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-5cfdf554-a99f-45e6-8044-14aaec48f458 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=fa61f407-ca48-4803-8fa7-06251497b1d0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1059580 Nov 24 14:51:30.122831 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b04b321b-4a44-4b5b-84fd-4a9e8e1343df req-10c3e88a-00cf-47d0-bddc-d06714d15f5b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.1181858 Nov 24 14:51:30.172868 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-4026c748-c0dc-40a1-958b-6ab68a9f9ede service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1531453 Nov 24 14:51:30.296315 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:30.300905 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1887f543-8bc3-4fdd-be8a-55428295c9ae None None] The sync data for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv is: [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'c1ba90d7-a385-4392-9a9a-968f34259690', 'name': '', 'network_id': 'fa61f407-ca48-4803-8fa7-06251497b1d0', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:20:5e:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:45Z', 'updated_at': '2021-11-24T14:49:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'df1d7059-f31b-4b7b-8160-8065fe19385d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:51:30.316326 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30e3ad-6bf1-4dc7-8b61-420f05497819 req-f9ca32c4-8080-45b5-adb4-ae1cc104e379 service neutron] 10.222.0.47 "GET /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1357188 Nov 24 14:51:30.525897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcb175cb-eedc-4e51-989a-757e8284bc71 None None] New status for floating IP f2da972a-811b-4613-9d81-4a4333887c5d: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:51:31.330060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38db24a-53ce-4173-a104-caaf03fff065 req-f198aa82-2193-46f7-a1e5-480ae90c2cb0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:31.331515 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a38db24a-53ce-4173-a104-caaf03fff065 req-f198aa82-2193-46f7-a1e5-480ae90c2cb0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0830510 Nov 24 14:51:31.378676 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a38db24a-53ce-4173-a104-caaf03fff065 req-3702a568-aaa2-43c6-870f-56a8825d1b6c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9&fields=id&fields=name HTTP/1.1" status: 200 len: 310 time: 0.0405641 Nov 24 14:51:31.517338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-2b66fac5-b82f-4b09-8de2-7d21a7bd7a69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:31.518671 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-2b66fac5-b82f-4b09-8de2-7d21a7bd7a69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 945 time: 0.0808415 Nov 24 14:51:31.586696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:51:31.587032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:31.832554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:31.832794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:31.956992 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:51:32.107248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:32.113482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2220121f-1996-4592-a4cb-d5fffcf0d641 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:32.157645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=fd6dab02-17f7-422e-b8e9-2b0ed29d34c7,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:32.160198 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:32.238697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] No DVR routers for this DVR port fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:51:32.242006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:32.244843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'name': 'network-vif-deleted', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:51:32.261860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e4b91a5c-1c60-4f8a-93a3-cddc7278034e req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "DELETE /v2.0/ports/fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 HTTP/1.1" status: 204 len: 173 time: 0.7379522 Nov 24 14:51:32.302858 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3', 'name': 'network-vif-deleted', 'tag': 'fd6dab02-17f7-422e-b8e9-2b0ed29d34c7', 'status': 'completed', 'code': 200} Nov 24 14:51:32.562410 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ef35c0f5-5f1f-4c44-add2-8668ad085f70 req-f220ba17-b061-4c07-b26d-a9e65d518115 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e1a9fde3-a59b-4e46-886b-ee8dfba2f9c3 HTTP/1.1" status: 200 len: 210 time: 0.0470023 Nov 24 14:51:33.368708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5f1e75c6-a7cd-4204-8a22-762d526ac407 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:33.670773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53640) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:33.758973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:34.181478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:34.796878 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port c1ba90d7-a385-4392-9a9a-968f34259690 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:51:34.797596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:34.986940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port c1ba90d7-a385-4392-9a9a-968f34259690, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c1ba90d7-a385-4392-9a9a-968f34259690,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:34.987266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:35.106679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for c1ba90d7-a385-4392-9a9a-968f34259690 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:51:35.296912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:35.304711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8d507f3d-373b-48a0-ad9b-099d1cceff4d tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:35.357703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=c1ba90d7-a385-4392-9a9a-968f34259690,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:35.361736 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:35.782930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:35.925349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4b5552e1-ec47-40dd-aafa-f69fa247ddf1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:36.318280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:51:36.351452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:51:36.351822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd6dab02-17f7-422e-b8e9-2b0ed29d34c7 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:51:36.369487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router b4392774-2b51-474e-8fbb-fa85c77976c0 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:51:36.569818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:51:36.579220 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] Sync routers for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:51:36.582752 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/b4392774-2b51-474e-8fbb-fa85c77976c0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9109366 Nov 24 14:51:36.586382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53644) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:36.591546 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:36.592178 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:36.770249 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:36.775395 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting subnet df1d7059-f31b-4b7b-8160-8065fe19385d {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:51:36.778349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:36.836923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:36.921721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:36.969055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:36.995408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:36.999432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a3592ff-e7ef-4b7f-8e1d-daa565f86417 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:37.039374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Subnet': ['ID=df1d7059-f31b-4b7b-8160-8065fe19385d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:37.041987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:37.047554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.055320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45ffc521-de13-49ff-a7aa-4d55ae45844a None None] Network fa61f407-ca48-4803-8fa7-06251497b1d0 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:51:37.055790 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b04ae126-f011-44b9-8f1b-082d5d8c71a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/subnets/df1d7059-f31b-4b7b-8160-8065fe19385d HTTP/1.1" status: 204 len: 168 time: 0.4681253 Nov 24 14:51:37.058185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53648) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:37.091819 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:51:35Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:37.095620 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] Checking router: b4392774-2b51-474e-8fbb-fa85c77976c0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:51:37.106820 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] Routers {'b4392774-2b51-474e-8fbb-fa85c77976c0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:37.107427 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['b4392774-2b51-474e-8fbb-fa85c77976c0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:37.294136 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] Set router b4392774-2b51-474e-8fbb-fa85c77976c0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:37.328320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] DHCP port deletion for fa61f407-ca48-4803-8fa7-06251497b1d0 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:51:37.332989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Deleting port 30797820-1f2d-4f88-9af5-73374847139b {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:51:37.333574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.422589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.557196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] For port 30797820-1f2d-4f88-9af5-73374847139b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=30797820-1f2d-4f88-9af5-73374847139b,segment=NetworkSegment(d1aaec42-0654-4f35-8278-c50c2a9bdc40),segment_id=d1aaec42-0654-4f35-8278-c50c2a9bdc40)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:37.557601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.588285 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:51:35Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:37.591926 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c1254de-462a-44da-a62c-77b5c5075775 None None] The sync data for ids ['b4392774-2b51-474e-8fbb-fa85c77976c0'] in dv-neutron-818151-2-hyperv is: [{'id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1343428023', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215'}], 'enable_snat': True}, 'gw_port_id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:51:35Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4af557d1-48bd-47db-b366-1e45d344e9ad', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:80:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4392774-2b51-474e-8fbb-fa85c77976c0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.215', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:49:41Z', 'updated_at': '2021-11-24T14:49:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:51:37.634754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.644577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 4af557d1-48bd-47db-b366-1e45d344e9ad {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:51:37.644909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.686225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Calling delete_port for 30797820-1f2d-4f88-9af5-73374847139b owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:51:37.760888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.764704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-aa8a78fd-f43e-4b5e-93c2-895a02710be7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:37.807437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Pushing event deleted for resources: {'Port': ['ID=30797820-1f2d-4f88-9af5-73374847139b,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:37.818705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] No DVR routers for this DVR port 30797820-1f2d-4f88-9af5-73374847139b on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:51:37.822115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.822470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.822786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.823188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.823516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.823878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.824198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.824514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.827983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.827983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.827983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:37.828733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:37.829336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 4af557d1-48bd-47db-b366-1e45d344e9ad, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4af557d1-48bd-47db-b366-1e45d344e9ad,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:37.829711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:37.958282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 4af557d1-48bd-47db-b366-1e45d344e9ad owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:51:38.012755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30797820-1f2d-4f88-9af5-73374847139b no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:51:38.095446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 30797820-1f2d-4f88-9af5-73374847139b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:51:38.095837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 30797820-1f2d-4f88-9af5-73374847139b not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:51:38.096227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c1ba90d7-a385-4392-9a9a-968f34259690 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:51:38.129984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c1ba90d7-a385-4392-9a9a-968f34259690 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:51:38.130898 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c1ba90d7-a385-4392-9a9a-968f34259690 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:51:38.157525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.161479 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0ca6fdf9-5ffd-4894-8af8-3c5c2a571bca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:38.205043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=4af557d1-48bd-47db-b366-1e45d344e9ad,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:38.207930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:38.432193 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.658243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.808505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.812572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.836233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.836731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Fanout notify agent at l3_agent the message router_deleted on router b4392774-2b51-474e-8fbb-fa85c77976c0 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:51:38.851730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:38.855317 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/routers/b4392774-2b51-474e-8fbb-fa85c77976c0 HTTP/1.1" status: 204 len: 168 time: 1.7936549 Nov 24 14:51:38.855544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53654) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:38.972109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.100959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.127126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fa61f407-ca48-4803-8fa7-06251497b1d0']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:39.139624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1aaec42-0654-4f35-8278-c50c2a9bdc40') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:39.139949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1aaec42-0654-4f35-8278-c50c2a9bdc40') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:39.151988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.168234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.174216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Releasing vlan 874 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:51:39.174595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:51:39.189038 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:51:39.273856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.278962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.282640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-085daa0e-56d7-49a7-bd2f-948129ae1fba tempest-RoutersIpV6Test-128241411 tempest-RoutersIpV6Test-128241411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:39.304233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Network': ['ID=fa61f407-ca48-4803-8fa7-06251497b1d0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:39.307394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:39.308987 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-310d0eb1-11d2-418d-af1c-6682eb5ca974 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/networks/fa61f407-ca48-4803-8fa7-06251497b1d0 HTTP/1.1" status: 204 len: 168 time: 0.4524992 Nov 24 14:51:39.313944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53658) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:39.387737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.418365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.482145 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.486151 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ca299795-2665-4be6-b56f-68405e826b6b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:39.501690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b88a8fb6-952b-4cb9-a5bb-0f706e5550f9,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:39.512092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.512480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.512863 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.513234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.513602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.513967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.514327 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.514772 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.515045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.515403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.515787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:39.521336 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:39.524700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:39.525810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/security-groups/b88a8fb6-952b-4cb9-a5bb-0f706e5550f9 HTTP/1.1" status: 204 len: 168 time: 0.2107477 Nov 24 14:51:39.997504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53666) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.004540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1355885804', 'description': 'tempest-secgroup-smoke-1355885804 description', 'project_id': '9482331cd77d4af992b911b12f253611'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.008703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4af557d1-48bd-47db-b366-1e45d344e9ad no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:51:40.013291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.019049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.024172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.031425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.043887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.048010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 4af557d1-48bd-47db-b366-1e45d344e9ad {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:51:40.048368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4af557d1-48bd-47db-b366-1e45d344e9ad not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:51:40.081356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.085732 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.088667 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.094491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.153215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.157311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.161087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-661d655c-1937-4509-915e-aafb270b549b tempest-NegativeSecGroupTest-713008622 tempest-NegativeSecGroupTest-713008622-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:40.203930 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5d0c6087-e7df-4663-9e92-ad5ce35c270f,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:40.206517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:40.207321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.212360 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2138302 Nov 24 14:51:40.213396 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53670) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.219049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '5d0c6087-e7df-4663-9e92-ad5ce35c270f', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.225318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.229200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.232093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.238110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.255509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.321750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.325436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.331369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8b814dca-e654-4bb1-9420-47c0e70cbae4 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:40.351374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d0faa003-b140-4329-8c7e-b41da09a46a0,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:40.354364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:40.363944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.365659 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1512589 Nov 24 14:51:40.368590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53674) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.374288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '5d0c6087-e7df-4663-9e92-ad5ce35c270f', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.380948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.384792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.387654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.393498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.412018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.476739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.480321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.482167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-941a4524-6bbf-4c27-a061-ce4c1f5a974d tempest-ServerActionsTestJSON-1598905428 tempest-ServerActionsTestJSON-1598905428-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:40.503808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17f29cba-337b-4dc9-8ff9-39cfc0d3cf8d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:40.507002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:40.514321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.515557 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3de616b5-e407-416a-b7ae-fc669d5e02a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1459680 Nov 24 14:51:40.518345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53678) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.523887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '5d0c6087-e7df-4663-9e92-ad5ce35c270f', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.530051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.533827 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.537100 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.542641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.558539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.621762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.625630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.627461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2dd69a96-7e02-46b0-bbcc-973b75197628 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:40.653505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba79c267-b685-4be5-a532-201bfbd572c9,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:40.657977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:40.662791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.663983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1446869 Nov 24 14:51:40.666733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53682) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.672117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '5d0c6087-e7df-4663-9e92-ad5ce35c270f', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.678778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.682688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.685724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.691368 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.708334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.772180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.776212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.777999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7eb65d39-77c8-4399-8df1-7726e1f6d7eb tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:40.802103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98f54a9b-e76c-4b0c-a172-773c15fc96c2,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:40.804638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:40.812052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.813304 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1456745 Nov 24 14:51:40.816050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53686) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.822113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '5d0c6087-e7df-4663-9e92-ad5ce35c270f', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.828177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.832045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.836510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.842284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:40.852552 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:51:40.859038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.922698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.926386 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.928371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-356fa134-3bae-4fa3-bc0e-585eaaf27170 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:40.950194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff1ddc30-7f21-425f-a13c-0c0860562aaa,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:40.952730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:40.960742 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:40.961944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fea4995b-1167-41f8-835e-fa8d6c7d299e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1449783 Nov 24 14:51:40.964764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53690) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:40.970217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '5d0c6087-e7df-4663-9e92-ad5ce35c270f', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:40.976511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:40.980456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:40.983355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:40.989163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:41.000246 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:51:41.007230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.076048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.079663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.086074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6a8c7ef5-7d02-4378-9c2c-7027b74468e0 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:41.105225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d7fbd80-4049-4d9c-9eec-f38f22009f1c,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:41.108239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:41.115941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.117102 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1514313 Nov 24 14:51:41.120128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53694) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:41.125938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'network': {'name': 'tempest-network-smoke--1563427184', 'project_id': '9482331cd77d4af992b911b12f253611', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:41.131330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:41.135227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:network and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:41.138138 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:41.143931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:41.155871 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:51:41.158849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.187921 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 850} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:51:41.196717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.197056 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Added segment bce80912-55b0-46c7-9948-16f7b5144ab9 of type vlan for network 5a3e3145-f139-4830-a9ff-23e6fe787a7a Nov 24 14:51:41.223660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.255950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.259795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:41.260498 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.264436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:41.363346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2418516 Nov 24 14:51:41.366804 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53698) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:41.372421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'admin_state_up': True, 'project_id': '9482331cd77d4af992b911b12f253611', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:41.372974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Network': ['ID=5a3e3145-f139-4830-a9ff-23e6fe787a7a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:41.375744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-44848be4-4a63-4690-a1c0-f39912a99a64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:41.379695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:41.383718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:51:41.386061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:router and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:41.389834 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:41.397068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:41.408307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.409217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.428543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.572115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.749309 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.781186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:41.914478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.177 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:51:42.070662 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:42.097147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:42.100683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-311de314-0cc5-414d-8d6c-a3f58dc530a1 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:42.163651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:51:42.166985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:51:42.171264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:51:42.198452 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:42.205130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:42.333670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:42.334575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:42.666990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 6a40b499-6f4a-41ae-9e73-62176f12181e is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:51:42.867139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:51:42.877127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Sync routers for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:51:42.889931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:42.890677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:42.893764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:42.894962 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.5270915 Nov 24 14:51:42.898101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53702) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:42.938036 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e3af6efb-1cf4-4774-a3c1-805585147a0f tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=9482331cd77d4af992b911b12f253611&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0385144 Nov 24 14:51:42.940233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53706) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:43.079686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d481038e-34e9-4304-b47c-57e6d144a653 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:43.081197 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d481038e-34e9-4304-b47c-57e6d144a653 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1400449 Nov 24 14:51:43.083900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:43.084697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53710) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:43.132114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8bebcb03-668a-4fef-9f8c-1f8c48fb3fd6 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0461268 Nov 24 14:51:43.134638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53714) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:43.140212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-703473801', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'project_id': '9482331cd77d4af992b911b12f253611', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:43.251097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:43.254907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:subnet and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:51:43.258032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:51:43.263953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:43.280900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:51:43.390187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:41Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:43.393786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:43.394785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Checking router: 6a40b499-6f4a-41ae-9e73-62176f12181e for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:51:43.395131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Updating router 6a40b499-6f4a-41ae-9e73-62176f12181e port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:51:43.452136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:43.617210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:43.621076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-76ad247b-41ae-4f90-b9f5-d0398f23dda7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:43.696988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Subnet': ['ID=4398f716-5afc-4513-ac4a-1e3b100e3da4,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:43.701576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:43.712077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Checking segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:51:43.712435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network hostable DHCP agents. Network: 5a3e3145-f139-4830-a9ff-23e6fe787a7a, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:51:43.734045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:51:43.744573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 5a3e3145-f139-4830-a9ff-23e6fe787a7a) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:51:43.749411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:43.750588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:43.760395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e49dcba7-28fb-45b4-9ae3-fc8e849dedb4 None None] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:51:43.773004 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-515bd240-67a4-435a-af78-4e33ae9e6301 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6373165 Nov 24 14:51:43.775773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53718) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:51:43.860935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:43.885377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Transition to ACTIVE for port object bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:43.902782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:43.914379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-97dc77a9-b9e8-4756-a755-9dc93fb85af4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:44.042513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Attempting to bind port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:51:44.042888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Attempting to bind port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:51:44.043252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Attempting to bind port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:51:44.047158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10676166-7e3b-4cd4-9470-acaedaab7e77 None None] Pushing event updated for resources: {'Port': ['ID=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:44.052691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-10676166-7e3b-4cd4-9470-acaedaab7e77 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:44.090142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 51, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:51:44.090588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:51:44.090933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:44.091323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:51:44.091851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Bound port: bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:51:44.092216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:44.118080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:51:44.118907 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:44.298347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] For port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:51:44.314423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] For port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:51:44.352363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:44.359737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d6b81bc1-1007-4306-9238-e22171153e07 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:44.452236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Allocated IP 172.20.0.2 (5a3e3145-f139-4830-a9ff-23e6fe787a7a/4398f716-5afc-4513-ac4a-1e3b100e3da4/8174ebd9-6fb1-4bcf-a019-e4c46cdb3181) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:51:44.462877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10676166-7e3b-4cd4-9470-acaedaab7e77 None None] Pushing event updated for resources: {'Port': ['ID=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:44.471371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-10676166-7e3b-4cd4-9470-acaedaab7e77 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:44.498168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:44.498816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:44.695947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:44.818099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:44.926643 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:44.960322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Transition to ACTIVE for port object 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:45.031839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Transition to ACTIVE for port object 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:45.046996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.053200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:45.103225 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.1 (5a3e3145-f139-4830-a9ff-23e6fe787a7a/4398f716-5afc-4513-ac4a-1e3b100e3da4/bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:51:45.180116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Pushing event updated for resources: {'Port': ['ID=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:45.185933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:45.188115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:51:45.189781 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:51:45.193640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:51:45.269307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.287244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:45.301585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Attempting to bind port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:51:45.302505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Attempting to bind port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:51:45.302873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Attempting to bind port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 on network 5a3e3145-f139-4830-a9ff-23e6fe787a7a {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:51:45.308187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:45.310007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.314278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 51, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:51:45.314560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2493bcf9-a859-4245-83b6-5f1b4ae868cd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:45.314681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Checking segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:51:45.315055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.315454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Bound using segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:51:45.315950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Bound port: 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:51:45.316334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.325395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac573e2-ea8b-48df-af78-92735138dca0 None None] The sync data for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv is: [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:51:45.394771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:51:45.398879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:51:45.401645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:51:45.416684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:51:45.420068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:51:45.428209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.432843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-84c6fa5d-7ff3-4d67-9826-9d49695ed4fb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:45.436729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:45.439714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:45.472609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:45.516793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Pushing event updated for resources: {'Port': ['ID=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:45.522653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:45.587993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.073481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:51:46.170066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:51:46.183592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:51:46.203653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.210117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.238546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c79ea566-aaa2-425a-8bda-2692447a288f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:46.299040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:51:46.306941 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:46.307934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.335319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.339112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:46.342344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:46.442059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.462509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:46.470797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.473277 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:46.494194 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:51:46.495402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:51:46.608459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:46.611697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:46.684105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-586be584-1331-427c-9877-68175625828e None None] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:51:46.791806 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Provisioning for port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:51:46.811499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Provisioning complete for port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:46.811906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:46.896798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 6a40b499-6f4a-41ae-9e73-62176f12181e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:51:47.017516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:47.066508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:47.071501 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:47.073664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5291fccb-6bea-4139-9e24-20daa24404d7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:47.104764 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:51:47.118556 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/6a40b499-6f4a-41ae-9e73-62176f12181e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3415060 Nov 24 14:51:47.143934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Pushing event updated for resources: {'Port': ['ID=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:47.147794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:47.299361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-414448b1-7125-45f3-849f-81dc8ccb647e None None] Provisioning for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:51:47.305571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-414448b1-7125-45f3-849f-81dc8ccb647e None None] Provisioning complete for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:47.306204 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-414448b1-7125-45f3-849f-81dc8ccb647e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:47.308098 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-962c0534-d402-4a31-94fc-bc219f2be468 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:51:47.326790 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-962c0534-d402-4a31-94fc-bc219f2be468 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:51:47.328627 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-962c0534-d402-4a31-94fc-bc219f2be468 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1355885804&fields=id&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 267 time: 0.0689385 Nov 24 14:51:47.373388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-414448b1-7125-45f3-849f-81dc8ccb647e None None] Port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:51:47.387276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-414448b1-7125-45f3-849f-81dc8ccb647e None None] Provisioning complete for port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:47.387662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-414448b1-7125-45f3-849f-81dc8ccb647e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:47.512144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-ac9af31f-c623-404f-a544-3cd4a1874fb8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:47.512834 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-ac9af31f-c623-404f-a544-3cd4a1874fb8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:51:47.533908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-ac9af31f-c623-404f-a544-3cd4a1874fb8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:51:47.535056 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-ac9af31f-c623-404f-a544-3cd4a1874fb8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 797 time: 0.1985710 Nov 24 14:51:47.552778 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-8344f2b7-e9ad-49f0-b7c0-70e2e56ab3d3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/quotas/9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 375 time: 0.0120413 Nov 24 14:51:47.642297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a3bf5dfd-51f6-4345-addc-d232ea26162c None None] Provisioning complete for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:47.642744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a3bf5dfd-51f6-4345-addc-d232ea26162c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:47.643816 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-7e021325-b71a-4b69-aef6-7e7d8322980e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0850651 Nov 24 14:51:47.699034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-a3bf5dfd-51f6-4345-addc-d232ea26162c None None] Port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:51:47.819925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d4397f3e-1d6e-4b2b-9e1d-792e92e3ec33 None None] Provisioning complete for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:47.820308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d4397f3e-1d6e-4b2b-9e1d-792e92e3ec33 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:47.857007 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-dc0bd49f-6274-456a-a0fb-7e7a8f206497 service neutron] 10.222.0.70 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2004533 Nov 24 14:51:47.873704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d4397f3e-1d6e-4b2b-9e1d-792e92e3ec33 None None] Port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:51:47.993867 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b1c27205-6742-4251-b71e-cd5034cb363c service neutron] 10.222.0.70 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1284609 Nov 24 14:51:48.016396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:51:48.097708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:48.097708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:48.187051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-a9986155-9194-4d12-9a0b-085c7b8d5998 req-3d625539-afe6-46cb-b465-39d152c7169c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:51:48.203501 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-a9986155-9194-4d12-9a0b-085c7b8d5998 req-3d625539-afe6-46cb-b465-39d152c7169c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:51:48.204777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a9986155-9194-4d12-9a0b-085c7b8d5998 req-3d625539-afe6-46cb-b465-39d152c7169c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 210 time: 0.0632615 Nov 24 14:51:48.212157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:51:48.282774 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:48.283177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:48.346170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:49.017548 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Sync routers for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:51:49.030014 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:49.030630 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:49.225117 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:49.335223 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d772fe5a-4f20-4544-a851-5016393fcb09 req-d078add4-01a2-46b0-8b21-d25e60120310 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 210 time: 0.0554776 Nov 24 14:51:49.570737 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 2, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:49.575814 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Checking router: 6a40b499-6f4a-41ae-9e73-62176f12181e for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:51:49.576193 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Updating router 6a40b499-6f4a-41ae-9e73-62176f12181e port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:51:49.628302 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:49.996230 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:50.008137 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Transition to ACTIVE for port object bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:50.013665 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:50.017060 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-bad70451-3e4d-4c7b-af2e-bcd510117ed7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:50.143001 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Pushing event updated for resources: {'Port': ['ID=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:50.178367 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.178705 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.179035 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.179358 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.179682 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.180030 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.180349 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.180665 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.180978 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.181300 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.181607 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:51:50.189002 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:50.243902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Attempting to bind port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:51:50.244278 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Attempting to bind port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:51:50.244642 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Attempting to bind port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 on network 5a3e3145-f139-4830-a9ff-23e6fe787a7a {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:51:50.251717 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 51, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:51:50.252118 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Checking segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:51:50.252517 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:50.252982 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Bound using segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:51:50.253357 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Bound port: bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:51:50.253733 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:50.346122 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] For port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:51:50.349992 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] For port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:51:50.354820 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:50.358795 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a5b1eb64-8b4c-4007-a339-12a295868db0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:50.444174 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Pushing event updated for resources: {'Port': ['ID=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:50.448446 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:50.450723 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:51:50.451356 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:51:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:50.519934 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5a2bcc24-b0d5-489c-8eea-da48e55ae7eb req-ba448a33-c5a6-44c4-abc9-a6857667704a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 210 time: 0.0572541 Nov 24 14:51:50.642607 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:51:50.957653 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:50Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:51:50.962020 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9e8fc84-ab5a-420a-9a2c-0996e2db42b5 None None] The sync data for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv is: [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:50Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:51:51.497375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-cc3e19f2-b72d-4247-80fd-7c478dff20c0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:51.498083 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-cc3e19f2-b72d-4247-80fd-7c478dff20c0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:51:51.511773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-cc3e19f2-b72d-4247-80fd-7c478dff20c0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:51:51.512982 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-cc3e19f2-b72d-4247-80fd-7c478dff20c0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 797 time: 0.1693742 Nov 24 14:51:51.572235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-17cef933-73c5-48f0-98df-b8ccf466c7df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 380 time: 0.0458524 Nov 24 14:51:51.585346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'port': {'device_id': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'admin_state_up': True, 'tenant_id': '9482331cd77d4af992b911b12f253611', 'security_groups': ['5d0c6087-e7df-4663-9e92-ad5ce35c270f']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:51.740847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:51:51.750511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:51:51.762009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:51:51.765069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:51.781494 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-92761422-e5f5-4df9-819a-320438d7bd2d req-43b495f5-7e38-45fc-a724-081417ce6f99 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 210 time: 0.1171603 Nov 24 14:51:51.940160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.5 (5a3e3145-f139-4830-a9ff-23e6fe787a7a/4398f716-5afc-4513-ac4a-1e3b100e3da4/fd04ff56-7710-40c4-a85e-a496c316f051) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:51:52.035064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:51:52.110624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:51:52.116160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:52.116530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.236932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.259943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.279400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object fd04ff56-7710-40c4-a85e-a496c316f051 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:52.303651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.310975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f51894f8-b8aa-42a7-9030-dfcd47d58939 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:52.318986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:52.323358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.325239 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:52.386611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:51:52.390254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:51:52.390411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:52.393280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:52.393466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:51:52.425763 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=fd04ff56-7710-40c4-a85e-a496c316f051,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:52.430228 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:52.468268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:52.468885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.497711 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9167628 Nov 24 14:51:52.510874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Request body: {'port': {'device_id': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:51:52.626259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.677680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c8e90a26-4a7a-4677-befa-2b85a0b14ee3 None None] Provisioning for port fd04ff56-7710-40c4-a85e-a496c316f051 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:51:52.682809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c8e90a26-4a7a-4677-befa-2b85a0b14ee3 None None] Provisioning complete for port fd04ff56-7710-40c4-a85e-a496c316f051 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:52.683272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c8e90a26-4a7a-4677-befa-2b85a0b14ee3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:52.743089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c8e90a26-4a7a-4677-befa-2b85a0b14ee3 None None] Port fd04ff56-7710-40c4-a85e-a496c316f051 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:51:53.046039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fd04ff56-7710-40c4-a85e-a496c316f051 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:51:53.055675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:53.062899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eb05cff-01b7-4965-b761-eb717a52e2de req-584f0985-ce3d-4d7c-9ad9-eadc5f4fee26 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:53.063582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0eb05cff-01b7-4965-b761-eb717a52e2de req-584f0985-ce3d-4d7c-9ad9-eadc5f4fee26 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:51:53.084792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Transition to ACTIVE for port object fd04ff56-7710-40c4-a85e-a496c316f051 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:51:53.089091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:53.095041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:53.125118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0eb05cff-01b7-4965-b761-eb717a52e2de req-584f0985-ce3d-4d7c-9ad9-eadc5f4fee26 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:51:53.126266 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0eb05cff-01b7-4965-b761-eb717a52e2de req-584f0985-ce3d-4d7c-9ad9-eadc5f4fee26 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 931 time: 0.2158198 Nov 24 14:51:53.253911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15554311-21d1-4321-aad8-90638138412a service neutron] Pushing event updated for resources: {'Port': ['ID=fd04ff56-7710-40c4-a85e-a496c316f051,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:53.259027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15554311-21d1-4321-aad8-90638138412a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:53.297958 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0eb05cff-01b7-4965-b761-eb717a52e2de req-09045547-083b-4dd8-9d0f-8b5609576804 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1656182 Nov 24 14:51:53.382017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Attempting to bind port fd04ff56-7710-40c4-a85e-a496c316f051 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:51:53.382350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Attempting to bind port fd04ff56-7710-40c4-a85e-a496c316f051 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:51:53.382673 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Attempting to bind port fd04ff56-7710-40c4-a85e-a496c316f051 on network 5a3e3145-f139-4830-a9ff-23e6fe787a7a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:51:53.388343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Port fd04ff56-7710-40c4-a85e-a496c316f051 on network 5a3e3145-f139-4830-a9ff-23e6fe787a7a not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:51:53.388659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Attempting to bind port fd04ff56-7710-40c4-a85e-a496c316f051 on network 5a3e3145-f139-4830-a9ff-23e6fe787a7a {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:51:53.394825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 51, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:51:53.395750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Checking segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:51:53.396217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Bound using segment: {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:51:53.396668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Bound port: fd04ff56-7710-40c4-a85e-a496c316f051, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bce80912-55b0-46c7-9948-16f7b5144ab9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 850, 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:51:53.396982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:53.487224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] For port fd04ff56-7710-40c4-a85e-a496c316f051, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:51:53.490519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] For port fd04ff56-7710-40c4-a85e-a496c316f051, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd04ff56-7710-40c4-a85e-a496c316f051,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:51:53.494062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:53.497757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-379344d0-461e-4f6d-b84d-67464f309f78 tempest-ServersNegativeTestJSON-302259581 tempest-ServersNegativeTestJSON-302259581-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:53.555105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:53.556516 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-15554311-21d1-4321-aad8-90638138412a service neutron] 10.222.0.47 "PUT /v2.0/ports/fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 1093 time: 1.0500567 Nov 24 14:51:53.557065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:51:53.586000 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15554311-21d1-4321-aad8-90638138412a service neutron] Pushing event updated for resources: {'Port': ['ID=fd04ff56-7710-40c4-a85e-a496c316f051,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:53.589264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15554311-21d1-4321-aad8-90638138412a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:53.636728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'status': 'completed', 'code': 200} Nov 24 14:51:53.680883 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-bf8a441b-5c65-46f5-b9a2-a2197fe68848 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1096 time: 0.0771618 Nov 24 14:51:53.758542 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-abc94c70-32a5-459b-9591-66b59d7d8d8c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 217 time: 0.0694978 Nov 24 14:51:53.825444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-8df89440-d096-44da-bbfa-5fd3ad9337d0 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:53.826813 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-8df89440-d096-44da-bbfa-5fd3ad9337d0 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0620790 Nov 24 14:51:53.911886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-60e1098b-8f7a-41a4-b118-a0f2647351c3 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0788994 Nov 24 14:51:54.015688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:51:54.049114 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-99c9d801-fcb6-4e03-82b7-6561b4cd1c9d service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1309772 Nov 24 14:51:54.085582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:51:54.085958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:54.292013 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b876ed89-bf3c-44b7-8700-e829279bedf1 req-4af5da76-97b4-4da1-9831-9a2a4fc3f189 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2353318 Nov 24 14:51:54.403384 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-589cb5c9-c56b-4f2b-8b30-2cd4bc93bce7 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1096 time: 0.0694032 Nov 24 14:51:54.603771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d965da3-34bd-452a-984f-146f6762fd07 req-a2c6dfda-ab0b-424b-a84e-ed51de0ed8b4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:54.605205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-a2c6dfda-ab0b-424b-a84e-ed51de0ed8b4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.1950884 Nov 24 14:51:54.616487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36655f8-87bc-4042-8301-17a33030efb0 req-b506e4c6-c88f-44f6-ba00-2a3d670ca39f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:54.617826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a36655f8-87bc-4042-8301-17a33030efb0 req-b506e4c6-c88f-44f6-ba00-2a3d670ca39f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 943 time: 0.1882434 Nov 24 14:51:54.697830 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-6b878b38-7b7b-4c60-866e-d82f0d11b5d0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 217 time: 0.0788291 Nov 24 14:51:54.765654 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a36655f8-87bc-4042-8301-17a33030efb0 req-17cda7f8-d36d-4fb8-9847-46a56ca06598 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0991404 Nov 24 14:51:54.780985 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d965da3-34bd-452a-984f-146f6762fd07 req-d5696cc7-68f5-41c1-8b3c-1df5e469446a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:54.782375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-d5696cc7-68f5-41c1-8b3c-1df5e469446a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0716639 Nov 24 14:51:54.859297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-d8e67cfa-d1b8-410b-8c8d-1fc300dccba0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0696335 Nov 24 14:51:54.993314 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-cb03ef73-bd02-4d78-a38c-01329538e313 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261256 Nov 24 14:51:55.127914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3d965da3-34bd-452a-984f-146f6762fd07 req-106f86c4-1893-41dc-84a4-b0d6025dd4b3 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256840 Nov 24 14:51:56.095649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab055c36-14f5-4f4d-882b-f6efce1693f5 req-62fb6558-dbe8-4800-8096-831c86157651 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:56.097039 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ab055c36-14f5-4f4d-882b-f6efce1693f5 req-62fb6558-dbe8-4800-8096-831c86157651 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 943 time: 0.1909301 Nov 24 14:51:56.144486 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ab055c36-14f5-4f4d-882b-f6efce1693f5 req-488b344e-9491-48b1-9a63-beaee54811e3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406272 Nov 24 14:51:57.354252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bafd7127-7b6c-4371-93d2-75758f19dc49 req-ebd7259b-e00a-4980-b5f0-9a52cb046557 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:57.355705 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bafd7127-7b6c-4371-93d2-75758f19dc49 req-ebd7259b-e00a-4980-b5f0-9a52cb046557 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 943 time: 0.0815749 Nov 24 14:51:57.401113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bafd7127-7b6c-4371-93d2-75758f19dc49 req-00d2a0f7-5436-41f1-9a30-2865748f2d91 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399494 Nov 24 14:51:58.418479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd04ff56-7710-40c4-a85e-a496c316f051 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:51:58.568731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port fd04ff56-7710-40c4-a85e-a496c316f051, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd04ff56-7710-40c4-a85e-a496c316f051,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:58.587378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'port_id': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'mac_address': 'fa:16:3e:00:59:4e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 850, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:51:58.604429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daf02d0-06d4-4c19-84e0-2f0c8a574444 req-8aaaa571-7d4b-4d5b-b397-fcea7a0429da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:58.605932 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1daf02d0-06d4-4c19-84e0-2f0c8a574444 req-8aaaa571-7d4b-4d5b-b397-fcea7a0429da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 943 time: 0.0835373 Nov 24 14:51:58.652132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:58.653301 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1daf02d0-06d4-4c19-84e0-2f0c8a574444 req-b7eb2421-c74e-4340-9450-b922ea8bae30 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418429 Nov 24 14:51:58.670120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fd04ff56-7710-40c4-a85e-a496c316f051 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:51:58.686738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port fd04ff56-7710-40c4-a85e-a496c316f051, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd04ff56-7710-40c4-a85e-a496c316f051,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:51:58.693089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:51:58.694977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:51:58.758766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=fd04ff56-7710-40c4-a85e-a496c316f051,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:51:58.761852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:51:59.079180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['fd04ff56-7710-40c4-a85e-a496c316f051'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:51:59.851740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c94d6b-f87e-4746-9311-931b17ba0f2f req-aeac8c5c-da12-4eec-b6f7-65a1630f83a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:51:59.853249 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50c94d6b-f87e-4746-9311-931b17ba0f2f req-aeac8c5c-da12-4eec-b6f7-65a1630f83a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 944 time: 0.0783582 Nov 24 14:51:59.902172 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50c94d6b-f87e-4746-9311-931b17ba0f2f req-8bdf4fe5-b837-409c-aed2-aa2ac23d3bf7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432901 Nov 24 14:52:00.432956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd04ff56-7710-40c4-a85e-a496c316f051 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:52:00.509674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port fd04ff56-7710-40c4-a85e-a496c316f051 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:52:00.514951 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port fd04ff56-7710-40c4-a85e-a496c316f051 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:52:00.515336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:00.630762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:00.660161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:52:00.670549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port fd04ff56-7710-40c4-a85e-a496c316f051, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd04ff56-7710-40c4-a85e-a496c316f051,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:52:00.674043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:00.675881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:52:00.741669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=fd04ff56-7710-40c4-a85e-a496c316f051,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:52:00.744887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:52:00.795813 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'code': 200} Nov 24 14:52:01.063094 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-689ce8ca-e8a3-40a9-b396-510db3004487 req-280e1271-fc75-4ee5-920a-5c23159fee8f service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.1015022 Nov 24 14:52:01.123595 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-689ce8ca-e8a3-40a9-b396-510db3004487 req-2eb74acf-5176-4697-bae5-0aa1e0cc2c09 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544293 Nov 24 14:52:01.141720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518da473-9030-41ae-9a49-49680208af8e req-c54c6650-e7d0-44b2-9323-ab6be81e7cbd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:01.143162 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-518da473-9030-41ae-9a49-49680208af8e req-c54c6650-e7d0-44b2-9323-ab6be81e7cbd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.1128287 Nov 24 14:52:01.192761 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-518da473-9030-41ae-9a49-49680208af8e req-51754e2f-1b62-4cdf-ba75-98e435d93982 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430701 Nov 24 14:52:02.405083 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04caf1b-7181-46da-a34b-4dddfc92677d req-4c0834a5-7c97-46aa-8161-fa3b4cffec27 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:02.406533 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f04caf1b-7181-46da-a34b-4dddfc92677d req-4c0834a5-7c97-46aa-8161-fa3b4cffec27 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0823197 Nov 24 14:52:02.454322 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f04caf1b-7181-46da-a34b-4dddfc92677d req-dc8d9a41-1cdf-46d5-99b8-f17ebbafeccb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410316 Nov 24 14:52:03.371227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-01b2ec50-6e6c-4b03-a322-d8eae16c36c3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:03.664277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d646a4-8c80-4e19-bc44-ef4fdfa1ec00 req-4e973f9c-1a62-42e9-9b2c-934c2b6d6fd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:03.665737 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a1d646a4-8c80-4e19-bc44-ef4fdfa1ec00 req-4e973f9c-1a62-42e9-9b2c-934c2b6d6fd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0788348 Nov 24 14:52:03.710881 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a1d646a4-8c80-4e19-bc44-ef4fdfa1ec00 req-37260ccc-9e53-4a03-8c94-bd2e1f05a8cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396912 Nov 24 14:52:03.762908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:03.918092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe9dbbf-8969-4c4a-8791-429e37f938eb req-a17371bf-ea1a-4d3e-9cd9-cf4a04dc5de6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:03.919547 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2fe9dbbf-8969-4c4a-8791-429e37f938eb req-a17371bf-ea1a-4d3e-9cd9-cf4a04dc5de6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0772893 Nov 24 14:52:03.969988 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2fe9dbbf-8969-4c4a-8791-429e37f938eb req-fc030ce2-9ac8-4652-908f-d029b59492e0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448349 Nov 24 14:52:03.999464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53786) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:52:04.071568 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-146b8357-7b35-42e0-9f5a-c4cd82425a8e tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1093 time: 0.0706294 Nov 24 14:52:04.074149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53790) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:52:04.079330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address': '172.20.0.5'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:52:04.085618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:52:04.089424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:floatingip and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:52:04.092305 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:52:04.098496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:52:04.109171 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:04.251434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:04.391582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.194 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/9bea2bf2-2a78-4517-a00f-156b4d2b2c28) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:52:04.540285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:04.566909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:04.571092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6139223f-f00b-43d3-93ea-09cca1cb9478 tempest-ServerDiskConfigTestJSON-520081010 tempest-ServerDiskConfigTestJSON-520081010-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:52:04.640970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:52:04.644411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:52:04.647053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=9bea2bf2-2a78-4517-a00f-156b4d2b2c28,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:52:04.649143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:52:04.677727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:52:05.159399 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:05.219455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:05.559968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:05.564746 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:05.569604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:52:05.677898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=9bea2bf2-2a78-4517-a00f-156b4d2b2c28,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:52:05.680724 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:52:05.696674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:05.894518 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Floating IP f884cf06-78dd-428f-8df5-98da88ff0ab7 associated. External IP: 172.26.4.194, port: fd04ff56-7710-40c4-a85e-a496c316f051. Nov 24 14:52:05.930137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36030ad1-c2d4-4749-a93f-4231df63d77a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:06.301383 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 6a40b499-6f4a-41ae-9e73-62176f12181e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:52:06.505142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:52:06.514532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] Sync routers for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:52:06.526844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:52:06.527464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:52:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:52:06.531285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:06.591561 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5162914 Nov 24 14:52:06.592170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:52:06.723103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:52:06.745192 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'status': 'completed', 'code': 200} Nov 24 14:52:06.825664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af4474f5-3e6b-466b-a4c8-af9ebfb7562b req-aa62f463-41ad-4db4-8c8f-34facf8e66b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:06.827117 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af4474f5-3e6b-466b-a4c8-af9ebfb7562b req-aa62f463-41ad-4db4-8c8f-34facf8e66b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.1269231 Nov 24 14:52:06.853401 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:52:06.895053 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-af4474f5-3e6b-466b-a4c8-af9ebfb7562b req-2f67f3b6-f99d-4c90-8911-faa9fd95acae tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616410 Nov 24 14:52:06.897981 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-02d0e5e8-bf79-42c8-abc2-7ddf55873aac service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.1292415 Nov 24 14:52:06.924393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53800) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:52:07.044420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:07.151428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'f884cf06-78dd-428f-8df5-98da88ff0ab7', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.194', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'port_id': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'mac_address': 'fa:16:3e:00:59:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:52:04Z', 'updated_at': '2021-11-24T14:52:04Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:52:07.155499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] Checking router: 6a40b499-6f4a-41ae-9e73-62176f12181e for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:52:07.167210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:52:07.167878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:52:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:52:07.219650 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d6a23df6-8350-4221-b2d0-0c5c849da4ab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f884cf06-78dd-428f-8df5-98da88ff0ab7 HTTP/1.1" status: 200 len: 991 time: 0.2940605 Nov 24 14:52:07.238122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-566f17e0-0c53-4bdc-a438-4b83f47e4b4d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:07.240654 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-566f17e0-0c53-4bdc-a438-4b83f47e4b4d service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.3360531 Nov 24 14:52:07.342843 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-ebf283ff-1bf8-4515-bc7c-0372c961a513 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 999 time: 0.0950067 Nov 24 14:52:07.350344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:52:07.408810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-7bcfe101-92da-40e3-ba36-62a131ae95d2 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:07.410791 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-7bcfe101-92da-40e3-ba36-62a131ae95d2 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0611641 Nov 24 14:52:07.488323 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-b2bb8f4e-881a-413a-99f0-7bcb002a8eed service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0717204 Nov 24 14:52:07.625983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-15d6902f-f3f2-4b8f-beb0-941c8b714faa service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304679 Nov 24 14:52:07.705194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'f884cf06-78dd-428f-8df5-98da88ff0ab7', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.194', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'port_id': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'mac_address': 'fa:16:3e:00:59:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:52:04Z', 'updated_at': '2021-11-24T14:52:04Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:52:07.710483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0536687-91ad-41d6-874a-e8b7ca8547c8 None None] The sync data for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv is: [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'f884cf06-78dd-428f-8df5-98da88ff0ab7', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.194', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'port_id': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'mac_address': 'fa:16:3e:00:59:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:52:04Z', 'updated_at': '2021-11-24T14:52:04Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:52:07.763298 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f4db507-98a4-4f47-acd7-a60e37e6e3e2 req-13e947bf-9b4a-436f-a384-6b7c02efb61d service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1311173 Nov 24 14:52:07.905876 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-259bda69-94ba-4e1f-8713-bf8fe5a7b0a3 None None] New status for floating IP f884cf06-78dd-428f-8df5-98da88ff0ab7: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:52:08.223338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53806) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:52:08.340582 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dd4ee6b8-2c94-4996-a8be-9de83e072b45 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f884cf06-78dd-428f-8df5-98da88ff0ab7 HTTP/1.1" status: 200 len: 993 time: 0.1159775 Nov 24 14:52:08.659318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:18.340987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:18.958322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-9b11dde6-da60-49b1-ba2c-07ed894f5828 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1352413 Nov 24 14:52:19.103458 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-c2df536f-3a08-44c2-a3e3-a5846e8137c8 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.0731876 Nov 24 14:52:19.256508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-2a4c982c-ed65-4f3a-b6b1-9735b918acdd service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:19.257942 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-2a4c982c-ed65-4f3a-b6b1-9735b918acdd service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.1321068 Nov 24 14:52:19.365159 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-6671619d-1f00-48fe-8e7c-1efdf9d23bd3 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 1001 time: 0.0989375 Nov 24 14:52:19.428254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-c759b780-59c9-481e-9b52-8702c6a66cdc service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:52:19.429681 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-c759b780-59c9-481e-9b52-8702c6a66cdc service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0574996 Nov 24 14:52:19.506127 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-af96496e-e472-4eb3-83ef-6c06f2c7c02a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0689664 Nov 24 14:52:19.640152 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-eaf0f56d-bd5d-4abb-883d-8fea3ccb71b3 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262414 Nov 24 14:52:19.881085 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ed0e0199-542d-494c-b4d3-a9ed1159df23 req-6ba37ca0-31cb-4648-8bfd-31a1decd895c service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2349126 Nov 24 14:52:33.373220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2eb762c3-7258-471d-8132-792400c325e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:33.765852 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:35.935226 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fa0ddcfb-bc30-41e3-893f-af53d345b995 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:36.974037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:38.662850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:43.854421 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:52:48.362476 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:52:54.219814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-16dcd496-7704-4792-a7b3-3573ca8437d3 req-5f32a5ea-c698-49c5-abbf-221cab428908 service neutron] (83526) timed out ('10.222.0.70', 50070) {{(pid=83526) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} Nov 24 14:53:03.375047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-af0a130b-80ed-4001-aea2-89ebea1abee9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:03.769526 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:05.936578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bd736682-2344-4b4b-bdf9-7436e5f1e1cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:06.977112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:08.666763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:17.629117 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-ce3ac876-6076-4dea-b24d-143ef8641a5f service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.0725305 Nov 24 14:53:17.675268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9890024f-5f73-455c-8ed1-acff6e46dbd9 req-d7522d50-9c00-444d-8a1c-b508ed3eae90 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:17.676780 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9890024f-5f73-455c-8ed1-acff6e46dbd9 req-d7522d50-9c00-444d-8a1c-b508ed3eae90 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0789268 Nov 24 14:53:17.724202 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9890024f-5f73-455c-8ed1-acff6e46dbd9 req-9ef9d910-c826-4dbc-ab69-467b39923d8c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419176 Nov 24 14:53:17.772732 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-8a8a70cc-f057-47e1-af9a-8d8681788898 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:17.774143 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-8a8a70cc-f057-47e1-af9a-8d8681788898 service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.1374934 Nov 24 14:53:17.878365 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-2aefe673-94b4-4ae7-8ac6-47b91fe5f658 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 1001 time: 0.0957990 Nov 24 14:53:17.940984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-96476308-2175-434b-940a-d4580709cbaa service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:17.942316 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-96476308-2175-434b-940a-d4580709cbaa service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0584676 Nov 24 14:53:18.022709 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-33d6498f-813b-4727-a4a9-44d4e58f4d05 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0725513 Nov 24 14:53:18.154471 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-d139b920-132e-4d07-b75e-e66c73e47dcf service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1241419 Nov 24 14:53:18.284341 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aec84bce-0025-4e91-aa88-2af4a7e4c8ca req-842268b9-1760-47e8-b123-53d9a35cc501 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1232128 Nov 24 14:53:18.357715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:19.091538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5584e93-1269-4fe0-bc0c-22e4102b5c29 req-a4d2eadd-835f-4bdb-856e-8c0b2928080c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:19.093028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a5584e93-1269-4fe0-bc0c-22e4102b5c29 req-a4d2eadd-835f-4bdb-856e-8c0b2928080c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.1513622 Nov 24 14:53:19.138871 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a5584e93-1269-4fe0-bc0c-22e4102b5c29 req-f001ddad-62fa-4d05-a7a3-36d6a4351492 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400691 Nov 24 14:53:19.952426 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-3fb5f6c2-6d76-4220-9f57-e4696c757f61 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.0732749 Nov 24 14:53:20.100355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-efa5956b-ec49-4de5-a9c9-ecb87602b349 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:20.101775 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-efa5956b-ec49-4de5-a9c9-ecb87602b349 service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.1307187 Nov 24 14:53:20.204804 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-8999ac9f-9762-4278-8a66-a3b0e7acc900 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 1001 time: 0.0951912 Nov 24 14:53:20.273786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-4e1e21c3-fcd5-4706-94a7-114178f27ca7 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:20.275223 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-4e1e21c3-fcd5-4706-94a7-114178f27ca7 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0627849 Nov 24 14:53:20.352441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-70534362-6b32-4080-a2cd-7d0281f1438e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0702188 Nov 24 14:53:20.453656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4485c47c-7a16-4e80-a168-20752bb2db21 req-858a27e6-8c39-4c3e-b5f5-77bdb903e9d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:20.456450 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4485c47c-7a16-4e80-a168-20752bb2db21 req-858a27e6-8c39-4c3e-b5f5-77bdb903e9d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.1512299 Nov 24 14:53:20.486747 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-d53d8dcf-dac7-43d8-9657-06283f1a8fa1 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272521 Nov 24 14:53:20.503095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4485c47c-7a16-4e80-a168-20752bb2db21 req-4761b8f2-1ae2-4456-ae12-a13689fc689b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409417 Nov 24 14:53:20.727013 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-754c6d45-c17b-41e2-8bfc-2ed98b58de54 req-e5acf891-fa78-4e38-aa28-58a0cb3ad7d4 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2335396 Nov 24 14:53:20.854060 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:53:21.741601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe8bc41-58f4-42ea-9b49-db5ee9f3b72a req-fcb71cdc-9326-4303-90f7-0ea6745774c8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:21.743164 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbe8bc41-58f4-42ea-9b49-db5ee9f3b72a req-fcb71cdc-9326-4303-90f7-0ea6745774c8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0986006 Nov 24 14:53:21.804325 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbe8bc41-58f4-42ea-9b49-db5ee9f3b72a req-bd143450-f17b-4077-b7b3-ebcd5abb8896 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479727 Nov 24 14:53:23.009911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76bdd7e5-d388-4832-af0f-24d98cdad2ac req-2eec99aa-07bc-461e-8dc1-18d685bbb2af tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:23.011355 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76bdd7e5-d388-4832-af0f-24d98cdad2ac req-2eec99aa-07bc-461e-8dc1-18d685bbb2af tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0814450 Nov 24 14:53:23.056352 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-76bdd7e5-d388-4832-af0f-24d98cdad2ac req-d7cc2ca3-d253-473e-97aa-7033fbf534c1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394483 Nov 24 14:53:24.254400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9a96042-09bd-4868-b7c9-b87245c5c154 req-b60ccdf1-89a3-4698-a42d-cfa119990f1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:24.255821 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d9a96042-09bd-4868-b7c9-b87245c5c154 req-b60ccdf1-89a3-4698-a42d-cfa119990f1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0797312 Nov 24 14:53:24.314038 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d9a96042-09bd-4868-b7c9-b87245c5c154 req-5d68779e-60eb-462a-90b1-08c897c3e112 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521963 Nov 24 14:53:25.517811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2b06ee-5272-42b4-9589-450c2f3467ad req-d8c52ede-29cb-4090-98ce-b72491aa6156 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:25.519239 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6b2b06ee-5272-42b4-9589-450c2f3467ad req-d8c52ede-29cb-4090-98ce-b72491aa6156 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0827265 Nov 24 14:53:25.565962 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6b2b06ee-5272-42b4-9589-450c2f3467ad req-4ea6a752-fefb-4d4c-a517-53dbf83b801b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410440 Nov 24 14:53:26.767347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6156d50-1da9-4a88-9075-6a167d3f6fbb req-4c27df59-50f4-4578-a042-00ccf1632add tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:26.768858 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6156d50-1da9-4a88-9075-6a167d3f6fbb req-4c27df59-50f4-4578-a042-00ccf1632add tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0792990 Nov 24 14:53:26.815250 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c6156d50-1da9-4a88-9075-6a167d3f6fbb req-54a99e8a-0996-4bf4-af9c-f46183900776 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408952 Nov 24 14:53:28.009074 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ac1cf1-c19a-4b5a-a18f-79bb21f5e308 req-02b1bf3c-304b-4f9b-85ad-a8395c4a216a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:28.010533 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-47ac1cf1-c19a-4b5a-a18f-79bb21f5e308 req-02b1bf3c-304b-4f9b-85ad-a8395c4a216a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0769756 Nov 24 14:53:28.167621 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-47ac1cf1-c19a-4b5a-a18f-79bb21f5e308 req-24ac4ed3-6136-42d5-ac37-999849734028 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1516809 Nov 24 14:53:29.385664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a72466-5f9c-4410-9f12-0cc758fe29eb req-93a4564f-903b-4fea-b0df-52812d6aed38 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:53:29.387095 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8a72466-5f9c-4410-9f12-0cc758fe29eb req-93a4564f-903b-4fea-b0df-52812d6aed38 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0806930 Nov 24 14:53:29.431780 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d8a72466-5f9c-4410-9f12-0cc758fe29eb req-9e7c7bd8-170f-4360-89fd-c137e22687c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386822 Nov 24 14:53:29.459983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53866) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:53:29.564852 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-37760c22-a706-4690-aed0-d78f1c900d99 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/f884cf06-78dd-428f-8df5-98da88ff0ab7 HTTP/1.1" status: 200 len: 993 time: 0.1037331 Nov 24 14:53:33.378653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f2c777ee-d529-4155-a14c-9ac3f7eae18f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:33.772347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:35.938989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-08013c77-40c3-4fae-a899-841a05563f50 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:36.979957 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:38.669462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:48.359080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:53:57.854771 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:54:03.382149 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-21308d65-bb4f-41e0-81b1-3411ce8ed143 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:03.774329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:05.940958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1850d19a-4e0e-4ea3-9596-48619e5e6464 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:06.983858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:08.674931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:18.372760 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:20.021507 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-ec72bee6-cb47-4491-9ab6-51e725593f0f service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1303098 Nov 24 14:54:20.160841 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-e90582e1-eda4-407d-8e43-21666f06f289 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.0676565 Nov 24 14:54:20.305629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-e352e2e1-3eea-430f-b792-fba6549ac04d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:20.307033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-e352e2e1-3eea-430f-b792-fba6549ac04d service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.1282830 Nov 24 14:54:20.410996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-b2a1014e-488f-407d-bdbe-57b1dbcfabbf service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 1001 time: 0.0955870 Nov 24 14:54:20.477065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-ef3d8d79-549c-4a74-a6e3-871ad45b5f52 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:20.478777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-ef3d8d79-549c-4a74-a6e3-871ad45b5f52 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0613787 Nov 24 14:54:20.552131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-d7a6a45d-d440-4046-8f46-55ada5af4433 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0663836 Nov 24 14:54:20.684403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-32be77cd-36b3-4c07-9cd5-4d9d42e9ec77 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238861 Nov 24 14:54:20.825613 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7b10c5df-a970-4eec-ab14-6685bc54b07c req-002e8971-db4c-41ff-9730-b1c07b4794d4 service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1343596 Nov 24 14:54:26.540543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53896) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:26.846423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 9bea2bf2-2a78-4517-a00f-156b4d2b2c28 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:26.846649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:27.011819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:27.012149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:27.130990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 9bea2bf2-2a78-4517-a00f-156b4d2b2c28 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:27.278876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:27.282652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e838b44-57ee-45ef-99c2-34d7796eae35 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:27.326204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=9bea2bf2-2a78-4517-a00f-156b4d2b2c28,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:27.367491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.367903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.368288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.368658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.369030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.369393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.369758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.370118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.370480 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.370847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.371205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:27.378369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:27.429759 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:27.818114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 6a40b499-6f4a-41ae-9e73-62176f12181e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:54:28.014242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:54:28.025509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] Sync routers for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:54:28.034498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:28.040257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:28.041091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:28.087519 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/floatingips/f884cf06-78dd-428f-8df5-98da88ff0ab7 HTTP/1.1" status: 204 len: 168 time: 1.5457861 Nov 24 14:54:28.088021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:54:28.236058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:28.270668 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'status': 'completed', 'code': 200} Nov 24 14:54:28.386371 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-39e89712-fc83-430e-a1e8-c8e0e7ddc130 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 1098 time: 0.0909231 Nov 24 14:54:28.537470 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c60d74-1dc3-4fbf-a83f-98e63e833fed req-6618bf31-5a26-41ad-ad6b-ee7906222c4f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:28.538994 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-23c60d74-1dc3-4fbf-a83f-98e63e833fed req-6618bf31-5a26-41ad-ad6b-ee7906222c4f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0816808 Nov 24 14:54:28.592190 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-23c60d74-1dc3-4fbf-a83f-98e63e833fed req-6b3d3433-e2d7-4569-856b-154b11697de5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464211 Nov 24 14:54:28.640231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-dbdecf51-d428-49ed-8ab7-8ca758f738f4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:28.641666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-dbdecf51-d428-49ed-8ab7-8ca758f738f4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 200 len: 898 time: 0.2481644 Nov 24 14:54:28.643664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:28.647718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] Checking router: 6a40b499-6f4a-41ae-9e73-62176f12181e for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:54:28.658559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:28.659255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:28.710501 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-00b363be-427e-4c88-b468-bdefc8638256 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 200 len: 217 time: 0.0618577 Nov 24 14:54:28.776240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-feab2c8d-7ad7-4eea-a154-cc171535e8ef service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:28.777664 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-feab2c8d-7ad7-4eea-a154-cc171535e8ef service neutron] 10.222.0.47 "GET /v2.0/subnets?id=4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 200 len: 834 time: 0.0598340 Nov 24 14:54:28.851327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:28.860725 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-d954297f-fe06-43a6-ba1b-160d25a5eddc service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=5a3e3145-f139-4830-a9ff-23e6fe787a7a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0746551 Nov 24 14:54:28.995912 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-84defd2c-ef99-4ed3-8c54-c8d47933016c service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275394 Nov 24 14:54:29.137200 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbac838f-6702-4cad-83cd-3cc05c6f541d req-38194d62-d32f-4000-9966-cc734816a6ad service neutron] 10.222.0.47 "GET /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1343334 Nov 24 14:54:29.169580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:29.174124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cb54124-940e-4a46-b775-2b68760f5736 None None] The sync data for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv is: [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:45Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1', 'name': '', 'network_id': '5a3e3145-f139-4830-a9ff-23e6fe787a7a', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:5b:8d:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:44Z', 'updated_at': '2021-11-24T14:51:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '4398f716-5afc-4513-ac4a-1e3b100e3da4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:54:29.386361 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4754ca1-993f-44d5-a572-9c33fcb12385 None None] New status for floating IP f884cf06-78dd-428f-8df5-98da88ff0ab7: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:54:29.813535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3671c1-4e16-470f-9d21-9103fd717f0a req-d0a84434-1754-4551-886b-ba8f9171cc6c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:29.814333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5f3671c1-4e16-470f-9d21-9103fd717f0a req-d0a84434-1754-4551-886b-ba8f9171cc6c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:54:29.831336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-5f3671c1-4e16-470f-9d21-9103fd717f0a req-d0a84434-1754-4551-886b-ba8f9171cc6c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:54:29.832686 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f3671c1-4e16-470f-9d21-9103fd717f0a req-d0a84434-1754-4551-886b-ba8f9171cc6c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0983801 Nov 24 14:54:29.881024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5f3671c1-4e16-470f-9d21-9103fd717f0a req-5b9ccd6d-d42a-4e2e-b602-1e02e3c3739c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=5d0c6087-e7df-4663-9e92-ad5ce35c270f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423992 Nov 24 14:54:30.279323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-529935f2-a9df-4656-9798-1017dd1c7678 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:30.280756 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-529935f2-a9df-4656-9798-1017dd1c7678 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 945 time: 0.0750215 Nov 24 14:54:30.352894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port fd04ff56-7710-40c4-a85e-a496c316f051 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:30.353340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:30.597864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port fd04ff56-7710-40c4-a85e-a496c316f051, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=fd04ff56-7710-40c4-a85e-a496c316f051,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:30.598129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:30.721247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for fd04ff56-7710-40c4-a85e-a496c316f051 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:30.861436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:30.867336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d78a7e04-b083-4e85-a47f-c389d2b1eda6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:30.915263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=fd04ff56-7710-40c4-a85e-a496c316f051,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:30.918518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:30.988776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] No DVR routers for this DVR port fd04ff56-7710-40c4-a85e-a496c316f051 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:54:30.991183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:30.993800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'name': 'network-vif-deleted', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:54:31.010497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0c71d285-c525-48e4-8439-4f801aa346b3 req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "DELETE /v2.0/ports/fd04ff56-7710-40c4-a85e-a496c316f051 HTTP/1.1" status: 204 len: 173 time: 0.7231791 Nov 24 14:54:31.051555 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5de94fe4-98cb-49cb-b7ca-72728a8fd158', 'name': 'network-vif-deleted', 'tag': 'fd04ff56-7710-40c4-a85e-a496c316f051', 'status': 'completed', 'code': 200} Nov 24 14:54:31.061528 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c9b13e08-6d0b-4dc2-9fb3-cc005f2269e6 req-4da90d1c-5734-44ed-9185-5559d72623bf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=5de94fe4-98cb-49cb-b7ca-72728a8fd158 HTTP/1.1" status: 200 len: 210 time: 0.0554688 Nov 24 14:54:32.172606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53928) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:32.676931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:33.023458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd04ff56-7710-40c4-a85e-a496c316f051 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:54:33.056993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: fd04ff56-7710-40c4-a85e-a496c316f051 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:54:33.057340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device fd04ff56-7710-40c4-a85e-a496c316f051 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:54:33.306649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:33.307220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:33.386089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-55e6aa15-c9ba-4554-bc06-2f77f4dfbdab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:33.495414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:33.495848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:33.616747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:33.776804 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:33.800061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:33.803672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f2625c3b-c9ee-4e0c-93a6-e5341ca79138 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:33.849917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:33.853895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:34.275737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:34.854880 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:54:34.857684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 6a40b499-6f4a-41ae-9e73-62176f12181e has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:54:35.058038 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:54:35.067817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] Sync routers for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:54:35.071355 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/6a40b499-6f4a-41ae-9e73-62176f12181e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8965576 Nov 24 14:54:35.074021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53932) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:35.081094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:35.081719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:35.263874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting subnet 4398f716-5afc-4513-ac4a-1e3b100e3da4 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:54:35.266758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:35.274915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:35.320595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:35.404592 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:35.477642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:35.481497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-49d7ddfa-64f2-44da-afa9-d8e1eacaa206 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:35.514361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Subnet': ['ID=4398f716-5afc-4513-ac4a-1e3b100e3da4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:35.520118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:35.525030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:35.531137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07000448-dc57-4d79-aa43-b22be35561d8 None None] Network 5a3e3145-f139-4830-a9ff-23e6fe787a7a requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:54:35.532281 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/subnets/4398f716-5afc-4513-ac4a-1e3b100e3da4 HTTP/1.1" status: 204 len: 168 time: 0.4572289 Nov 24 14:54:35.534260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53936) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:35.782854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:54:33Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:35.789225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] Checking router: 6a40b499-6f4a-41ae-9e73-62176f12181e for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:54:35.805147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] Routers {'6a40b499-6f4a-41ae-9e73-62176f12181e'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:35.805765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['6a40b499-6f4a-41ae-9e73-62176f12181e'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:35.857608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:35.959832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] DHCP port deletion for 5a3e3145-f139-4830-a9ff-23e6fe787a7a request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:54:35.972749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Deleting port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:35.973214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.027834 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-354387cc-8f12-4983-8024-49f3b5fa6604 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.083130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.096892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] Set router 6a40b499-6f4a-41ae-9e73-62176f12181e gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:36.105034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:36.105644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.150767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:54:36.311912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:36.312191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.440767 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:36.542193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:36.542601 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.616459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.619987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13dff74d-bf64-48cc-9bd7-60f9175d4a37 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:36.663848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:36.667852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:36.707496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Calling delete_port for 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:36.737097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.817665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:36.824070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.827556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:36.889614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:36.892687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:54:36.893103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:54:36.905416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:54:33Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:36.916962 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f615d0d7-b838-48f1-952b-cdfa770ddcc0 None None] The sync data for ids ['6a40b499-6f4a-41ae-9e73-62176f12181e'] in dv-neutron-818151-2-hyperv is: [{'id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'name': 'tempest-TestNetworkAdvancedServerOps-router-540713492', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177'}], 'enable_snat': True}, 'gw_port_id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:54:33Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:80:a2:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a40b499-6f4a-41ae-9e73-62176f12181e', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.177', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:51:41Z', 'updated_at': '2021-11-24T14:51:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:54:36.921514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:36.930722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.931178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.931392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.931718 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.932070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.932393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.932719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.933037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.933357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.933664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.933977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:36.937757 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:36.988081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.275591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.280002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.306144 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.306832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Fanout notify agent at l3_agent the message router_deleted on router 6a40b499-6f4a-41ae-9e73-62176f12181e {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:54:37.324019 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.327598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/routers/6a40b499-6f4a-41ae-9e73-62176f12181e HTTP/1.1" status: 204 len: 168 time: 1.7900090 Nov 24 14:54:37.327905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53940) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:37.394016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Deleting port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:37.394567 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.442077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.452511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:37.452853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.680401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:37.680762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.681200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] For port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,segment=NetworkSegment(bce80912-55b0-46c7-9948-16f7b5144ab9),segment_id=bce80912-55b0-46c7-9948-16f7b5144ab9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:37.681597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.799450 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Calling delete_port for 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:37.807739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:54:37.875607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:37.880528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-688cd540-c1d6-446d-8336-2068a51739ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:37.882244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.db.api [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83526) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 14:54:37.882572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_db.api [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 14:54:37.924270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Pushing event deleted for resources: {'Port': ['ID=8174ebd9-6fb1-4bcf-a019-e4c46cdb3181,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:37.926978 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:37.932729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] No DVR routers for this DVR port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:54:38.093215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:54:38.126022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:54:38.126961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bbe2ebeb-b47f-458b-8e6a-f15dc35e4b96 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:54:38.127380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:54:38.161967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:54:38.162317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bee3d1ce-5fb7-4568-9caa-8eaf1027f2a1 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:54:38.383624 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 8174ebd9-6fb1-4bcf-a019-e4c46cdb3181 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:54:38.384192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.450105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] The port '8174ebd9-6fb1-4bcf-a019-e4c46cdb3181' was deleted {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 14:54:38.572456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.598873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5a3e3145-f139-4830-a9ff-23e6fe787a7a']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:38.610679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bce80912-55b0-46c7-9948-16f7b5144ab9') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:38.611538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bce80912-55b0-46c7-9948-16f7b5144ab9') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:38.622530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.639128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.645883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Releasing vlan 850 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:54:38.646492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: util.warn( Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:54:38.660832 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:54:38.677525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.742222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.746972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.750061 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:38.772875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Network': ['ID=5a3e3145-f139-4830-a9ff-23e6fe787a7a,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:38.775258 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:38.788334 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d02cf8d6-5207-4d76-97d4-bc5d3c4c1847 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/networks/5a3e3145-f139-4830-a9ff-23e6fe787a7a HTTP/1.1" status: 204 len: 168 time: 1.4594738 Nov 24 14:54:38.790970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53944) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:38.859481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.888632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.950538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.955595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c13c0418-aa68-4efb-8087-1660748e557b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:38.974454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d0c6087-e7df-4663-9e92-ad5ce35c270f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:38.977642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:38.987585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:38.989272 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-32dc0123-6006-4791-85c2-2bdf5363d371 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/security-groups/5d0c6087-e7df-4663-9e92-ad5ce35c270f HTTP/1.1" status: 204 len: 168 time: 0.1969824 Nov 24 14:54:40.258843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53958) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:40.329976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1592865438', 'description': 'tempest-secgroup-smoke-1592865438 description', 'project_id': '9482331cd77d4af992b911b12f253611'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:40.336162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:40.340317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:40.343217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:40.349735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:40.359357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.394123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:40.397809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:40.400556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:40.406090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:40.460552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.464239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.467991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e9730fb2-ced4-4a2b-995c-0bfba4df629d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:40.510705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:40.514594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:40.515768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.519579 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2571535 Nov 24 14:54:40.519991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53964) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:40.525389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:40.531888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:40.535987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:40.538843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:40.544613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:40.561798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.621959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.626026 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.634877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2a6e84b5-a9a0-4697-a584-cc2ec309d243 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:40.652322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b598af99-7f9e-49d0-8c68-3cde9905f8c7,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:40.655007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:40.662683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.663855 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1431553 Nov 24 14:54:40.666568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53968) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:40.671920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:40.678584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:40.682326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:40.685147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:40.690917 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:40.710572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.772006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.775747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.783983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-49fafb93-8089-42b3-99cc-7de2c3d81c37 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:40.805260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=59755a45-9e26-4454-a52c-c659a1932617,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:40.808117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:40.812556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.813820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-43f2f4de-19ec-49af-8696-619123a825d8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1463106 Nov 24 14:54:40.816645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53972) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:40.822191 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:40.828250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:40.832248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:40.836109 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:40.844529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:40.862431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.928819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.932431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.940105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ad36ba8d-eae8-4ca8-8542-c265636d6538 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:40.960842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e5ca9f78-1891-45d5-9cdd-d4612cd9fcf8,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:40.963659 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:40.968204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:40.969360 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ee180bc0-fbbe-4f90-bbe0-7942996067ff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1517839 Nov 24 14:54:40.973105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53976) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:40.978539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:40.984453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:40.989469 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:40.992275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:40.997849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:41.013786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.186885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.190981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.197147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-98f3e1ce-824c-46ee-af85-16a56ef07df4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:41.222267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=16130adf-979c-41c0-a9e0-6eab46b893ad,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:41.227007 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:41.232045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.233200 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.2591844 Nov 24 14:54:41.236787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53980) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:41.242271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:41.248364 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:41.252483 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:41.255341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:41.262020 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:41.272460 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:54:41.279349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.348368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.351967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.353754 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3cbf5ccd-4934-4cf5-bd5f-1eb03a4d279c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:41.375382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed5cf912-eddf-4e12-8941-b5a80e8ae4e4,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:41.387480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.388669 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1514430 Nov 24 14:54:41.390163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.390549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.390920 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.391295 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.392225 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.392819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53984) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:41.393319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.393319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.393515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.393756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.394116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.394481 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:41.397608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6feedb98-9e7b-4fbd-ba0d-d212545133e5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:41.398263 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:41.404275 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:41.408599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:41.411413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:41.417045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:41.427942 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:54:41.434147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.497849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.501825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.503598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5b7484b3-3a0d-4299-83a2-f8f5d06256a7 tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:41.525392 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1bce1b5f-dacf-4b01-8714-734020d7bd64,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:41.527728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:41.534149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.535288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ac177ee5-8517-4c00-86d2-5dd791273db5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1418619 Nov 24 14:54:41.538224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53988) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:41.543573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'network': {'name': 'tempest-network-smoke--1690576080', 'project_id': '9482331cd77d4af992b911b12f253611', 'port_security_enabled': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:41.548701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:41.552835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:network and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:41.555629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:41.561374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:41.572150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:54:41.575055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.605729 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 883} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:54:41.614945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.615338 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Added segment 2f112ade-8feb-4286-8175-f6b23bae07ce of type vlan for network 6cba8656-86e8-41ed-9bcf-5e546cdca933 Nov 24 14:54:41.641319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.672969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.677428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:41.678008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.683154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c4f66ee3-6c97-4535-9474-92cd0d765539 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:41.766027 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2266943 Nov 24 14:54:41.770657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 53992) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:41.776044 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'admin_state_up': True, 'project_id': '9482331cd77d4af992b911b12f253611', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:41.783997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:41.787928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:router and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:41.790774 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:41.794692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Network': ['ID=6cba8656-86e8-41ed-9bcf-5e546cdca933,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:41.797303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:41.798657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f3f9bad6-94a8-47eb-9ede-10320e05d422 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:41.807245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:54:41.809335 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.810323 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.830246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:41.987554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.166428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.196111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.333989 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.239 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/8b63507f-e542-4563-812d-db0de94496d8) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:54:42.487542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.514660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.519011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:42.585368 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:54:42.586539 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:54:42.593153 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:54:42.618361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=8b63507f-e542-4563-812d-db0de94496d8,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:42.623203 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:42.748674 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.749404 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:42.980012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:54:43.309179 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:54:43.318920 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Sync routers for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:54:43.331290 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:43.332034 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:43.337005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:43.338539 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-41afa0a4-3ae6-46ce-b5f7-a2fc0b552742 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.5668483 Nov 24 14:54:43.341889 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 53996) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:43.447644 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1d9e2175-b5aa-4263-ab2c-f968c9522b0d tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=9482331cd77d4af992b911b12f253611&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1044505 Nov 24 14:54:43.450155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54002) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:43.509391 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:43.582540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8db4e38-9b77-4fb1-81c9-d071f8723c9b tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:43.584174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c8db4e38-9b77-4fb1-81c9-d071f8723c9b tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1331143 Nov 24 14:54:43.587033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54006) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:43.625880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4b342e61-52d7-4133-934c-2ef5e5dc211a tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0376565 Nov 24 14:54:43.628635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54010) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:43.633984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-429866548', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'project_id': '9482331cd77d4af992b911b12f253611', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:43.742097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:43.745830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:subnet and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:54:43.748602 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:54:43.754754 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:43.765211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:54:43.793592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:43.797565 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Checking router: 92b51eb4-3fec-4f48-906c-cbc9a47c1192 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:54:43.798200 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Updating router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 port 8b63507f-e542-4563-812d-db0de94496d8 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:54:43.854914 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:43.872004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.115388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.119911 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-70371cb5-7581-4ab4-9002-6d71f4db4815 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:44.201708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Subnet': ['ID=271709fb-3ce8-4b24-9e91-7ca050c90c3c,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:44.206157 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:44.217506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Checking segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:54:44.217831 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network hostable DHCP agents. Network: 6cba8656-86e8-41ed-9bcf-5e546cdca933, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:54:44.250202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:54:44.263478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6cba8656-86e8-41ed-9bcf-5e546cdca933) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:54:44.269685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:44.270424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.277468 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.281335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37984e12-d703-409f-a1b5-1244dd85d200 None None] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:54:44.291254 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Transition to ACTIVE for port object 8b63507f-e542-4563-812d-db0de94496d8 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:44.298192 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.300353 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6707044 Nov 24 14:54:44.302356 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5ae04e17-3ac5-4b2e-972a-ddb1ab6ea5a8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:44.304280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54014) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:54:44.384377 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Pushing event updated for resources: {'Port': ['ID=8b63507f-e542-4563-812d-db0de94496d8,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:44.396099 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Attempting to bind port 8b63507f-e542-4563-812d-db0de94496d8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:54:44.396525 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Attempting to bind port 8b63507f-e542-4563-812d-db0de94496d8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:54:44.396825 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Attempting to bind port 8b63507f-e542-4563-812d-db0de94496d8 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:54:44.406334 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.406592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.406869 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.407777 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.408089 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.408412 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.408732 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.409048 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.409364 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.409679 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.410160 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:54:44.414326 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:44.415118 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 54, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:54:44.415489 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:54:44.415920 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.416311 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:54:44.416782 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Bound port: 8b63507f-e542-4563-812d-db0de94496d8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:54:44.417155 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.494902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] For port 8b63507f-e542-4563-812d-db0de94496d8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:54:44.500158 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] For port 8b63507f-e542-4563-812d-db0de94496d8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b63507f-e542-4563-812d-db0de94496d8,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:54:44.507174 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.515830 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-535e60c8-7bc1-4ca6-a1c7-75355817c101 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:44.528593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-6cba8656-86e8-41ed-9bcf-5e546cdca933', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:54:44.529925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.638741 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:44.639295 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:44.702947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Pushing event updated for resources: {'Port': ['ID=8b63507f-e542-4563-812d-db0de94496d8,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:44.708575 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:44.740745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Allocated IP 172.20.0.2 (6cba8656-86e8-41ed-9bcf-5e546cdca933/271709fb-3ce8-4b24-9e91-7ca050c90c3c/9e0dd01f-2f21-42c8-aa14-3117aab60f1b) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:54:44.827681 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:44.970885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:44.984649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Transition to ACTIVE for port object 9e0dd01f-2f21-42c8-aa14-3117aab60f1b will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:45.009158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Transition to ACTIVE for port object 9e0dd01f-2f21-42c8-aa14-3117aab60f1b will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:45.015389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.021354 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-4f2aa143-5fb2-4142-921c-4252c6e74137 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:45.095190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:54:45.098943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:54:45.103679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:54:45.105968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Pushing event updated for resources: {'Port': ['ID=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:45.110287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:45.143426 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:45.147994 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8738f660-4736-4a22-9b5e-6353989eecca None None] The sync data for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv is: [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:42Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:54:45.183644 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.205433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Attempting to bind port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:54:45.205808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Attempting to bind port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:54:45.206177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Attempting to bind port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b on network 6cba8656-86e8-41ed-9bcf-5e546cdca933 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:54:45.216249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 54, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:54:45.216627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Checking segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:54:45.217034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.217433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Bound using segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:54:45.217910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Bound port: 9e0dd01f-2f21-42c8-aa14-3117aab60f1b, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:54:45.218290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.318336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] For port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:54:45.324008 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] For port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:54:45.331007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.337122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-10676166-7e3b-4cd4-9470-acaedaab7e77 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:45.444403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Pushing event updated for resources: {'Port': ['ID=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:45.450505 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:45.709924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.1 (6cba8656-86e8-41ed-9bcf-5e546cdca933/271709fb-3ce8-4b24-9e91-7ca050c90c3c/0a429058-acd3-4ae9-bdb2-5a31f36379f4) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:54:45.896661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.915166 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object 0a429058-acd3-4ae9-bdb2-5a31f36379f4 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:45.940453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:45.945115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bc68464a-ba1f-42bb-88e0-2beb975a8471 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:46.008929 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:54:46.016966 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:54:46.021964 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:54:46.057958 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=0a429058-acd3-4ae9-bdb2-5a31f36379f4,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:46.064865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:46.091979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.183288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b63507f-e542-4563-812d-db0de94496d8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:54:46.197445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.268713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8b63507f-e542-4563-812d-db0de94496d8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:54:46.277021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8b63507f-e542-4563-812d-db0de94496d8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:46.278068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.486539 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.505113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 8b63507f-e542-4563-812d-db0de94496d8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b63507f-e542-4563-812d-db0de94496d8,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:46.510045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.510972 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e0dd01f-2f21-42c8-aa14-3117aab60f1b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:54:46.540169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-cc3c4d62-f3e5-4011-a718-3f14ad9fea10 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:46.568116 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fb3293b-399a-455b-aa9a-772fa05dab5e None None] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:54:46.738268 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=8b63507f-e542-4563-812d-db0de94496d8,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:46.742279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-29e1d51e-e227-4919-ab7e-d45c9f703c80 None None] Provisioning for port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:54:46.747284 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:46.790518 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.794940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.803886 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:54:46.817263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:46.817651 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.824116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-09d10c74-fc65-42dc-ab94-f2399c8f2a82 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:46.906908 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=0a429058-acd3-4ae9-bdb2-5a31f36379f4,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:46.909605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:46.913424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:46.995062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:47.032865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:47.038271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:47.040245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:47.060082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:54:47.061610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:54:47.110945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:47.114133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:47.188946 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad793b0b-f60d-46ad-821a-52970ac114cd None None] Provisioning complete for port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:47.189536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad793b0b-f60d-46ad-821a-52970ac114cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:47.362704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad793b0b-f60d-46ad-821a-52970ac114cd None None] Provisioning for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:54:47.372647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ad793b0b-f60d-46ad-821a-52970ac114cd None None] Provisioning complete for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:47.373323 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ad793b0b-f60d-46ad-821a-52970ac114cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:47.443052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ad793b0b-f60d-46ad-821a-52970ac114cd None None] Port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:54:47.504500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:54:47.565530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f901ef4c-82f1-4a6d-be8f-ba107ce49eb7 None None] Provisioning complete for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:47.566102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f901ef4c-82f1-4a6d-be8f-ba107ce49eb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:47.620980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-f901ef4c-82f1-4a6d-be8f-ba107ce49eb7 None None] Port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:54:47.725438 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:54:47.739578 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/92b51eb4-3fec-4f48-906c-cbc9a47c1192/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4341414 Nov 24 14:54:47.741927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-756522c7-97c6-4d8e-bad1-ff311ba8dd2a None None] Provisioning complete for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:47.742312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-756522c7-97c6-4d8e-bad1-ff311ba8dd2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:47.798763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-756522c7-97c6-4d8e-bad1-ff311ba8dd2a None None] Port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:54:47.914562 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-90b2bd2b-e6e7-41ec-94de-996f1cec0104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1592865438&fields=id&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 267 time: 0.0413992 Nov 24 14:54:48.062289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0452a747-0425-49fe-a2e7-3a38121747fc req-77897494-a3f2-4edb-b335-405bea5a7223 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:48.064335 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-77897494-a3f2-4edb-b335-405bea5a7223 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 797 time: 0.1433020 Nov 24 14:54:48.081878 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-2426dc29-3f40-40f2-976f-3ed6466f876b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/quotas/9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 375 time: 0.0119865 Nov 24 14:54:48.108148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b63507f-e542-4563-812d-db0de94496d8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:54:48.181063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8b63507f-e542-4563-812d-db0de94496d8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:48.181580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:48.290881 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8fb44e8a-927a-4eec-8b35-68dbe3bf15f5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:54:48.305282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e0dd01f-2f21-42c8-aa14-3117aab60f1b up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:54:48.306480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8fb44e8a-927a-4eec-8b35-68dbe3bf15f5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:54:48.308099 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8fb44e8a-927a-4eec-8b35-68dbe3bf15f5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2206340 Nov 24 14:54:48.385510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:48.391855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:48.392246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:48.437616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-321925d0-c5f8-4976-8b02-b1e439cff33b service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:54:48.438829 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-321925d0-c5f8-4976-8b02-b1e439cff33b service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0775180 Nov 24 14:54:48.576269 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-6fb1356a-0964-42f1-a295-c5ef79565e32 service neutron] 10.222.0.70 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1303709 Nov 24 14:54:48.713130 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-18b2e9ec-ba8e-4461-8f72-5999ddaab62e service neutron] 10.222.0.70 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1289752 Nov 24 14:54:48.819115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Sync routers for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:54:48.831558 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:48.832244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:49.009864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:49.366731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 2, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:49.370653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Checking router: 92b51eb4-3fec-4f48-906c-cbc9a47c1192 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:54:49.371013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Updating router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:54:49.421150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:49.758695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:49.771043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Transition to ACTIVE for port object 0a429058-acd3-4ae9-bdb2-5a31f36379f4 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:49.777207 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:49.780640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d6b81bc1-1007-4306-9238-e22171153e07 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:49.919908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f437c9-5faf-4bb7-a882-a437d67cf7cf None None] Pushing event updated for resources: {'Port': ['ID=0a429058-acd3-4ae9-bdb2-5a31f36379f4,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:49.950025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-a4eb85dc-92c3-4998-9621-f8a53ba40982 req-00afac17-b3e1-4cde-a88b-a4b4180cb049 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:54:49.954979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7f437c9-5faf-4bb7-a882-a437d67cf7cf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:49.965080 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-a4eb85dc-92c3-4998-9621-f8a53ba40982 req-00afac17-b3e1-4cde-a88b-a4b4180cb049 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:54:49.966441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a4eb85dc-92c3-4998-9621-f8a53ba40982 req-00afac17-b3e1-4cde-a88b-a4b4180cb049 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0603321 Nov 24 14:54:50.009297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Attempting to bind port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:54:50.009680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Attempting to bind port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:54:50.010177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Attempting to bind port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 on network 6cba8656-86e8-41ed-9bcf-5e546cdca933 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:54:50.016917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 54, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:54:50.017294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Checking segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:54:50.017702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:50.018102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Bound using segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:54:50.018573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Bound port: 0a429058-acd3-4ae9-bdb2-5a31f36379f4, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:54:50.018955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:50.108703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] For port 0a429058-acd3-4ae9-bdb2-5a31f36379f4, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:54:50.112523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] For port 0a429058-acd3-4ae9-bdb2-5a31f36379f4, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0a429058-acd3-4ae9-bdb2-5a31f36379f4,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:54:50.116617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:50.121335 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:50.207087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f437c9-5faf-4bb7-a882-a437d67cf7cf None None] Pushing event updated for resources: {'Port': ['ID=0a429058-acd3-4ae9-bdb2-5a31f36379f4,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:50.212278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7f437c9-5faf-4bb7-a882-a437d67cf7cf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:50.218285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:54:50.218913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:54:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:50.403979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:54:50.770115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:50Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:54:50.774279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23533a7-9b10-4ead-a598-66d3b891c4c4 None None] The sync data for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv is: [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:50Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:54:51.092319 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b9dd2a06-e41c-42eb-955d-92da98f209ac req-6366480b-53e5-4a33-8450-59512657a450 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0514977 Nov 24 14:54:52.138722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a429058-acd3-4ae9-bdb2-5a31f36379f4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:54:52.223916 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b908e01b-fadd-4a79-8e09-680cd8b86ff3 req-7ad3ca63-0f11-4911-affa-d62f95987494 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0565732 Nov 24 14:54:52.227675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:54:52.234887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:52.238684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:52.382837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:52.418837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 0a429058-acd3-4ae9-bdb2-5a31f36379f4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0a429058-acd3-4ae9-bdb2-5a31f36379f4,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:54:52.423330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:52.425192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-d55f8226-9496-4831-8973-8e6ee102b5eb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:52.492094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=0a429058-acd3-4ae9-bdb2-5a31f36379f4,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:52.495043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:53.356609 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7fce1bef-4a6d-4a9c-b2d0-1505d8868c1b req-c391ddc2-1f3c-4004-86df-72bb968b3d24 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0443351 Nov 24 14:54:54.112238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a429058-acd3-4ae9-bdb2-5a31f36379f4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:54:54.183556 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:54.183966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:54.528890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3a87fe6c-42c9-4e91-aaeb-91b8300fee8b req-c8ffb276-5a0e-473b-aab5-41f5b7d8ca79 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0452795 Nov 24 14:54:55.446907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3a6a97be-f6a0-4151-a3c6-91fdcbf87a5f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:55.447621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3a6a97be-f6a0-4151-a3c6-91fdcbf87a5f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:54:55.468858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3a6a97be-f6a0-4151-a3c6-91fdcbf87a5f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:54:55.470113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3a6a97be-f6a0-4151-a3c6-91fdcbf87a5f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 797 time: 0.2067137 Nov 24 14:54:55.528839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3112c8f7-b5e3-43b2-a1d0-c1969c5fe750 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:54:55.546036 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3112c8f7-b5e3-43b2-a1d0-c1969c5fe750 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:54:55.547851 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-3112c8f7-b5e3-43b2-a1d0-c1969c5fe750 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 380 time: 0.0644550 Nov 24 14:54:55.556612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'port': {'device_id': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'admin_state_up': True, 'tenant_id': '9482331cd77d4af992b911b12f253611', 'security_groups': ['3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:55.721387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:54:55.732522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:54:55.745261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:54:55.748977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:55.810748 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb27845f-9b49-479c-a3ec-8da00a509227 req-0d54d78c-cf92-4f8b-880e-17f136d603ca tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0821254 Nov 24 14:54:56.034201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.11 (6cba8656-86e8-41ed-9bcf-5e546cdca933/271709fb-3ce8-4b24-9e91-7ca050c90c3c/9fc540d7-7756-45fe-90ec-ab89371e3d17) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:54:56.248077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:56.266264 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object 9fc540d7-7756-45fe-90ec-ab89371e3d17 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:56.289022 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:56.295051 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-83ea69c2-b4ec-47a2-9115-018d9cc6b094 tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:56.355983 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:54:56.364186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:54:56.368578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:54:56.399098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:56.405818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:56.442705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:56.443826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:56.483194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9305058 Nov 24 14:54:56.496376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Request body: {'port': {'device_id': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:54:56.607912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-188d45b5-1ca2-4b80-b64a-4605f7b2dafe None None] Provisioning for port 9fc540d7-7756-45fe-90ec-ab89371e3d17 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:54:56.615715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-188d45b5-1ca2-4b80-b64a-4605f7b2dafe None None] Provisioning complete for port 9fc540d7-7756-45fe-90ec-ab89371e3d17 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:54:56.616300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-188d45b5-1ca2-4b80-b64a-4605f7b2dafe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:56.629977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:56.679355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-188d45b5-1ca2-4b80-b64a-4605f7b2dafe None None] Port 9fc540d7-7756-45fe-90ec-ab89371e3d17 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:54:57.038812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9fc540d7-7756-45fe-90ec-ab89371e3d17 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:54:57.048008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:57.069427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Transition to ACTIVE for port object 9fc540d7-7756-45fe-90ec-ab89371e3d17 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:54:57.073757 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:57.077989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15554311-21d1-4321-aad8-90638138412a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:57.199959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bee06696-1e4d-4d4f-99d1-3118ad8b7ec4 req-bd9ec2f4-8f1b-4bdd-87db-be74b0955241 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:57.200654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bee06696-1e4d-4d4f-99d1-3118ad8b7ec4 req-bd9ec2f4-8f1b-4bdd-87db-be74b0955241 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:54:57.233477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:57.239671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:57.277858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bee06696-1e4d-4d4f-99d1-3118ad8b7ec4 req-bd9ec2f4-8f1b-4bdd-87db-be74b0955241 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:54:57.279045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bee06696-1e4d-4d4f-99d1-3118ad8b7ec4 req-bd9ec2f4-8f1b-4bdd-87db-be74b0955241 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 932 time: 0.3157012 Nov 24 14:54:57.393017 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bee06696-1e4d-4d4f-99d1-3118ad8b7ec4 req-01bc7bc7-6b3c-4cab-a4ad-30091e2ad3c3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0785217 Nov 24 14:54:57.395444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Attempting to bind port 9fc540d7-7756-45fe-90ec-ab89371e3d17 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:54:57.395714 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Attempting to bind port 9fc540d7-7756-45fe-90ec-ab89371e3d17 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:54:57.396154 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Attempting to bind port 9fc540d7-7756-45fe-90ec-ab89371e3d17 on network 6cba8656-86e8-41ed-9bcf-5e546cdca933 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:54:57.402239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Port 9fc540d7-7756-45fe-90ec-ab89371e3d17 on network 6cba8656-86e8-41ed-9bcf-5e546cdca933 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:54:57.402563 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Attempting to bind port 9fc540d7-7756-45fe-90ec-ab89371e3d17 on network 6cba8656-86e8-41ed-9bcf-5e546cdca933 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:54:57.409661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 54, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:54:57.410001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Checking segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:54:57.410372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Bound using segment: {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:54:57.410794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Bound port: 9fc540d7-7756-45fe-90ec-ab89371e3d17, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2f112ade-8feb-4286-8175-f6b23bae07ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 883, 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:54:57.411143 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:57.504717 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:54:57.508484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:54:57.514916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:57.521583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5de4639f-6068-4220-a724-813317de3d1f tempest-TestEncryptedCinderVolumes-368992037 tempest-TestEncryptedCinderVolumes-368992037-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:54:57.580810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:54:57.582182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] 10.222.0.47 "PUT /v2.0/ports/9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 1094 time: 1.0906866 Nov 24 14:54:57.582711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:54:57.614338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:54:57.619920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:54:57.702778 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'status': 'completed', 'code': 200} Nov 24 14:54:57.743923 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-2f1cdef7-d048-43df-b029-f1beac250ad1 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1097 time: 0.0885677 Nov 24 14:54:57.822227 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-e183b9db-84d4-4520-b4d3-c1c58bdb9a57 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 217 time: 0.0706937 Nov 24 14:54:57.890594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0452a747-0425-49fe-a2e7-3a38121747fc req-85157253-8cd9-4cf0-be9d-b36db3b426b8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:57.893335 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-85157253-8cd9-4cf0-be9d-b36db3b426b8 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0647836 Nov 24 14:54:58.091198 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-2401f5df-3994-4757-9f92-a8e2392d08eb service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1916347 Nov 24 14:54:58.229012 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-f639d8d4-7f7b-4d46-88b6-e574a411047e service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304815 Nov 24 14:54:58.393354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0452a747-0425-49fe-a2e7-3a38121747fc req-14ff7ca7-8187-46e6-a3bd-495a1d58be81 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1559875 Nov 24 14:54:58.528120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-ded56faa-0b50-4d9f-a6d7-d8587134b2ed service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1097 time: 0.0800457 Nov 24 14:54:58.726110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219a9843-e3d2-4896-953c-a82db160a74e req-02764baf-4a00-4386-b3f9-7a51f3d094a2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:58.727458 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-02764baf-4a00-4386-b3f9-7a51f3d094a2 service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1661475 Nov 24 14:54:58.734140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54dfda85-61eb-4fe0-9cd3-d0c105a9caf6 req-4eeba482-665e-4a31-b711-da4c0db9f701 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:58.735741 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-54dfda85-61eb-4fe0-9cd3-d0c105a9caf6 req-4eeba482-665e-4a31-b711-da4c0db9f701 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 944 time: 0.2050238 Nov 24 14:54:58.820151 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-d60d839a-b6dd-45b4-b6ed-cfcc93d90578 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 217 time: 0.0832155 Nov 24 14:54:58.883881 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-54dfda85-61eb-4fe0-9cd3-d0c105a9caf6 req-14f06510-ce2d-48c6-b154-f7d1eb847512 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0996344 Nov 24 14:54:58.903715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-219a9843-e3d2-4896-953c-a82db160a74e req-114c2fdc-0e34-43e3-b2c6-f4bde4eb18f6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:54:58.906050 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-114c2fdc-0e34-43e3-b2c6-f4bde4eb18f6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0742760 Nov 24 14:54:58.983977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-535caa8a-6cae-4222-ac9d-1a6763b0a20a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0705786 Nov 24 14:54:59.129053 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-eb583bec-799b-42d5-926d-ffe0ee468955 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1368239 Nov 24 14:54:59.269570 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-219a9843-e3d2-4896-953c-a82db160a74e req-abd4bfed-1fec-48ee-a431-f41f9a4e4d70 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334355 Nov 24 14:55:00.146462 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e4d236-1cb6-4595-a0b6-e06143ca0ec2 req-0a786a77-c0f4-488e-87b5-d3272454967e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:00.147980 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65e4d236-1cb6-4595-a0b6-e06143ca0ec2 req-0a786a77-c0f4-488e-87b5-d3272454967e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 944 time: 0.0895119 Nov 24 14:55:00.196504 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-65e4d236-1cb6-4595-a0b6-e06143ca0ec2 req-99a84fd2-738f-4970-a841-baa7acc552a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427556 Nov 24 14:55:01.105863 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:55:01.252888 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:55:01.275041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'port_id': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'mac_address': 'fa:16:3e:52:92:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 883, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:55:01.343141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:01.358380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9fc540d7-7756-45fe-90ec-ab89371e3d17 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:55:01.374912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:55:01.379572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:01.381347 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:55:01.434343 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5051687e-e6b6-4413-b404-ddc34570db81 req-e46c7f73-803b-4451-88c0-ec019e3b7813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:01.435928 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5051687e-e6b6-4413-b404-ddc34570db81 req-e46c7f73-803b-4451-88c0-ec019e3b7813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 945 time: 0.0960617 Nov 24 14:55:01.462761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:55:01.465943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:55:01.493065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5051687e-e6b6-4413-b404-ddc34570db81 req-e48ee1c5-f082-4168-acbc-1c919c57d176 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447049 Nov 24 14:55:01.747824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['9fc540d7-7756-45fe-90ec-ab89371e3d17'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:55:02.707485 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d3ecc7b-07ef-492d-8b64-88a80d012a8a req-073a03f5-d472-40e8-8a3f-9a7429c20c29 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:02.709232 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5d3ecc7b-07ef-492d-8b64-88a80d012a8a req-073a03f5-d472-40e8-8a3f-9a7429c20c29 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 945 time: 0.0846272 Nov 24 14:55:02.754108 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5d3ecc7b-07ef-492d-8b64-88a80d012a8a req-8bf768a7-d017-4124-8065-c3b989d6cfb2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393848 Nov 24 14:55:03.115493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:55:03.187892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 9fc540d7-7756-45fe-90ec-ab89371e3d17 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:55:03.193183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 9fc540d7-7756-45fe-90ec-ab89371e3d17 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:55:03.193563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:03.375597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:03.430602 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8448626c-c456-4452-9546-102cef8e99eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:03.439142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:55:03.449622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:55:03.455190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:03.459316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:55:03.536741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:55:03.540070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:55:03.626625 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'code': 200} Nov 24 14:55:03.780392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:03.883178 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bd161d08-2607-4c8c-8493-488397a25809 req-ff77c37e-79d2-436d-abe7-65c7cbcb03d1 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1099 time: 0.0947626 Nov 24 14:55:03.932926 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bd161d08-2607-4c8c-8493-488397a25809 req-f585d2f2-8470-4af2-9a81-01ae45d75ecd service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434585 Nov 24 14:55:03.965361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27772a1f-b5f4-444e-97fc-793573cf41c9 req-45eb9042-0275-46ee-a880-22eb364a501a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:03.966838 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-27772a1f-b5f4-444e-97fc-793573cf41c9 req-45eb9042-0275-46ee-a880-22eb364a501a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0852060 Nov 24 14:55:04.020019 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-27772a1f-b5f4-444e-97fc-793573cf41c9 req-91b57713-4163-4810-a128-b974307c4b86 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458286 Nov 24 14:55:05.233676 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa487147-c912-4373-9bbd-d4f17d68e991 req-f6f7572c-c50d-45e9-ae49-f89662682ce1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:05.238005 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aa487147-c912-4373-9bbd-d4f17d68e991 req-f6f7572c-c50d-45e9-ae49-f89662682ce1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0850375 Nov 24 14:55:05.307597 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aa487147-c912-4373-9bbd-d4f17d68e991 req-3a628b34-8c53-4415-aa87-e8e7707f3d4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0574155 Nov 24 14:55:05.941827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-00d33b1c-5097-4195-8e1a-b484e5cfb216 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:06.514690 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b207124f-82d3-490d-9301-4d157cea75c2 req-93dcd3aa-2709-45a1-bd94-bc8dd51abe9b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:06.516719 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b207124f-82d3-490d-9301-4d157cea75c2 req-93dcd3aa-2709-45a1-bd94-bc8dd51abe9b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0798910 Nov 24 14:55:06.565047 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b207124f-82d3-490d-9301-4d157cea75c2 req-294f4ccd-fb61-4dfc-a069-2f2630a7443b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422444 Nov 24 14:55:06.779463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7f11a58-b9e8-467c-9b44-060c9b51815d req-756c9343-a150-4911-87ff-8b90260c40f4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:06.780980 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e7f11a58-b9e8-467c-9b44-060c9b51815d req-756c9343-a150-4911-87ff-8b90260c40f4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0916622 Nov 24 14:55:06.831631 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e7f11a58-b9e8-467c-9b44-060c9b51815d req-02c2a51a-9ea0-434c-8e76-509877b4968c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438092 Nov 24 14:55:06.861568 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54118) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:55:06.939025 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f8fc2ccf-984a-4eaa-aaea-f52c76979e50 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1094 time: 0.0760365 Nov 24 14:55:06.941783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54122) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:55:06.947803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address': '172.20.0.11'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:55:06.954823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:55:06.959440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:floatingip and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:55:06.962727 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:55:06.969494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:55:06.983108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:06.992958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:07.129826 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:07.269314 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.88 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/25a68161-26df-48f6-89ad-1a6e2795cce0) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:55:07.420925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:07.449955 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:07.454361 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-9ca9107e-951b-430c-969b-e785a252a67e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:55:07.514926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:55:07.522339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:55:07.526370 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:55:07.559560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=25a68161-26df-48f6-89ad-1a6e2795cce0,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:55:07.564397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:55:08.197172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:08.257547 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:08.485588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:08.490172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:08.494012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a737406a-d9e6-4324-85af-c857caf06c25 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:55:08.593766 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=25a68161-26df-48f6-89ad-1a6e2795cce0,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:55:08.601621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:55:08.610618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:08.685695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:08.816830 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Floating IP 8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5 associated. External IP: 172.26.4.88, port: 9fc540d7-7756-45fe-90ec-ab89371e3d17. Nov 24 14:55:09.273026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:55:09.513011 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:55:09.523531 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] Sync routers for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:55:09.538947 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:55:09.539631 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:55:09.552265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:09.752527 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:55:09.752981 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.8101165 Nov 24 14:55:09.753713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:55:09.948155 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'status': 'completed', 'code': 200} Nov 24 14:55:10.000696 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d0c9b4-2c45-4973-9836-83e6f85cba90 req-b1af107a-079b-46f8-a76d-0eeafe15e1e4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:10.002633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b8d0c9b4-2c45-4973-9836-83e6f85cba90 req-b1af107a-079b-46f8-a76d-0eeafe15e1e4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.1377976 Nov 24 14:55:10.049822 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-be0a893c-8519-41fc-84af-ff3f995a068d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1099 time: 0.0766435 Nov 24 14:55:10.074341 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b8d0c9b4-2c45-4973-9836-83e6f85cba90 req-999eba2b-9b98-4add-80c5-18d336d81f5c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0613594 Nov 24 14:55:10.106150 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54136) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:55:10.183656 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.88', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'port_id': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'mac_address': 'fa:16:3e:52:92:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:55:08Z', 'updated_at': '2021-11-24T14:55:08Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:55:10.189081 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] Checking router: 92b51eb4-3fec-4f48-906c-cbc9a47c1192 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:55:10.201503 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:55:10.202143 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:55:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:55:10.281871 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7343ca2f-5fab-497e-8b3e-35f67167d8a6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5 HTTP/1.1" status: 200 len: 991 time: 0.1736946 Nov 24 14:55:10.356661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-45be1f99-103b-44f3-8c55-886423f2c82a service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:10.358971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-45be1f99-103b-44f3-8c55-886423f2c82a service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.3015676 Nov 24 14:55:10.443369 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:55:10.480882 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-0f86376f-072b-4a1d-9227-4f4a42104288 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 999 time: 0.1155097 Nov 24 14:55:10.560986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-693bf7c0-19ae-4dff-8676-8b06d2e24664 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:10.563429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-693bf7c0-19ae-4dff-8676-8b06d2e24664 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0763903 Nov 24 14:55:10.671375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-fa887b3c-9cf4-4595-beca-68493bb2721a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1011345 Nov 24 14:55:10.833852 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.88', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'port_id': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'mac_address': 'fa:16:3e:52:92:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:55:08Z', 'updated_at': '2021-11-24T14:55:08Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:55:10.838174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-257c80f0-bdb8-4005-a25f-ab8093b60c5b service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1599967 Nov 24 14:55:10.839171 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07c5132a-c0da-41bb-84a7-c81a6369532e None None] The sync data for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv is: [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.88', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'port_id': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'mac_address': 'fa:16:3e:52:92:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:55:08Z', 'updated_at': '2021-11-24T14:55:08Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:55:11.022275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-823f559d-a2c0-46b2-976d-107352ccfd48 req-a991d146-9850-4517-8829-333f5ef52f8e service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1765387 Nov 24 14:55:11.068433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6032480c-b8c6-426d-82f6-d4fc2881fbe6 None None] New status for floating IP 8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:55:11.286111 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54140) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:55:11.422333 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0c31c4df-8034-44c4-b7b3-422e12166a01 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5 HTTP/1.1" status: 200 len: 991 time: 0.1331592 Nov 24 14:55:11.855474 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:55:12.427180 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54144) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:55:12.543443 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0506c19f-cb97-40e4-bc95-7dc94df76e33 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5 HTTP/1.1" status: 200 len: 993 time: 0.1151276 Nov 24 14:55:18.390789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:20.896194 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-ed264c38-c9a0-46bc-b093-483dbad1d51f service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0890148 Nov 24 14:55:21.069687 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-096680d0-fd72-45a9-9856-63e336baa172 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1099 time: 0.0852134 Nov 24 14:55:21.241391 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-c4ea8e1d-4a3b-40e6-83fe-68facc424743 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:21.241854 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-c4ea8e1d-4a3b-40e6-83fe-68facc424743 service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1490424 Nov 24 14:55:21.353824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-cfb15bf2-2b4e-4264-9061-1aa28dad3e36 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 1001 time: 0.1049793 Nov 24 14:55:21.428322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-6aa28a3a-f119-4bf9-adc2-f79431e409af service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:55:21.429788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-6aa28a3a-f119-4bf9-adc2-f79431e409af service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0692322 Nov 24 14:55:21.516197 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-750d9bdc-20b2-4d04-bb71-1af19af9d05d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0798435 Nov 24 14:55:21.651522 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-f0261b1a-1e06-4aba-9772-384b9dd2dfb6 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1283839 Nov 24 14:55:21.786996 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5c66ebbf-7110-4f25-9900-9c25dd5e66ff req-d787fa38-2902-4489-a615-871fabb9ddf4 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288731 Nov 24 14:55:33.396468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b09f0b7a-a9de-4f91-89cc-21c65dc1f8f7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:33.774279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:35.945399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e1114db3-1ee0-42bb-ba6f-8989065b3d0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:37.000761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:38.688189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:48.404810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:55:48.856391 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:56:03.401910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-dd758959-bcaa-4e7f-8cda-dc4f43df1448 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:03.779512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:05.954649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d6e3dca4-3361-416c-9c8e-eaa4a456d7d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:06.998218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:08.690594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:18.398823 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:21.860588 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eade1799-ddd6-4e73-baf1-6aa8456f02bc req-3ea22fff-ce06-4841-8653-a7cab9ec9a8e service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.0859401 Nov 24 14:56:22.410297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50504872-786a-4923-81f9-26abb5b77e7e req-de7eb421-bd5e-4de2-b12e-2ea76c5d57da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:22.412036 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50504872-786a-4923-81f9-26abb5b77e7e req-de7eb421-bd5e-4de2-b12e-2ea76c5d57da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.2694063 Nov 24 14:56:22.415431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-d8bd3a12-910c-41e4-8a49-fdaa72fb7f93 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.3256660 Nov 24 14:56:22.478457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50504872-786a-4923-81f9-26abb5b77e7e req-c1b8435f-a3b9-43dd-9502-c4af0de633b0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571420 Nov 24 14:56:22.977869 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-ef6d469d-417f-4f57-84c0-3bd2563ea5cf service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1099 time: 0.0835760 Nov 24 14:56:23.167428 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f5d1d11-3887-4903-809a-932786463be7 req-3d343be8-5dec-4945-a1eb-2ca89b3fd77f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:23.170650 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-3d343be8-5dec-4945-a1eb-2ca89b3fd77f service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1708636 Nov 24 14:56:23.287569 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-238fa2d3-64fe-4d1e-b7a6-31c1e5898b6a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 1001 time: 0.1106129 Nov 24 14:56:23.356634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f5d1d11-3887-4903-809a-932786463be7 req-c2a083bd-47ed-4ddf-bd01-a1107ac221c9 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:23.358232 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-c2a083bd-47ed-4ddf-bd01-a1107ac221c9 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0625064 Nov 24 14:56:23.442867 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-6dd2aaa9-01e5-451a-821c-0bf44c310a02 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0784087 Nov 24 14:56:23.618779 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-65a07ea2-7eb6-40f9-9807-30b8cea84c4d service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1691251 Nov 24 14:56:23.782710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f308ffde-4777-4d7b-8550-c9c51c43b589 req-3d0692f6-3dca-4625-9959-55b3ff420438 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:23.784328 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f308ffde-4777-4d7b-8550-c9c51c43b589 req-3d0692f6-3dca-4625-9959-55b3ff420438 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.1303358 Nov 24 14:56:23.814983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f5d1d11-3887-4903-809a-932786463be7 req-029191e7-c36d-445f-8038-c529770f2d1e service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1885269 Nov 24 14:56:23.878888 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f308ffde-4777-4d7b-8550-c9c51c43b589 req-279a8ca5-98ba-466d-a01d-c8e259ed99a0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0801313 Nov 24 14:56:25.100260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e4cc650-22bd-4e93-9a4e-78bd516387f4 req-8a863b9b-ece2-4af1-983b-79f3c470b8e8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:25.101950 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8e4cc650-22bd-4e93-9a4e-78bd516387f4 req-8a863b9b-ece2-4af1-983b-79f3c470b8e8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0843043 Nov 24 14:56:25.150070 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8e4cc650-22bd-4e93-9a4e-78bd516387f4 req-bfc5ebe5-4a1a-4413-bec3-18532b31a669 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424798 Nov 24 14:56:25.858540 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:56:26.031146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-59c7833a-07b9-49f5-a9eb-d027aa27da40 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1099 time: 0.0804565 Nov 24 14:56:26.185288 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-a23c91b9-7be7-4225-a676-8debd4b76214 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:26.186783 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-a23c91b9-7be7-4225-a676-8debd4b76214 service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1495848 Nov 24 14:56:26.369844 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-ae4b617c-a98a-48e9-9a82-570637b21912 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 1001 time: 0.1763523 Nov 24 14:56:26.379558 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b13fa1-9d3d-4140-ac30-e00e6b7bd271 req-0720dedf-26e2-4a54-a813-8d841b5af845 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:26.381213 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a8b13fa1-9d3d-4140-ac30-e00e6b7bd271 req-0720dedf-26e2-4a54-a813-8d841b5af845 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0881121 Nov 24 14:56:26.433614 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a8b13fa1-9d3d-4140-ac30-e00e6b7bd271 req-1c584ecd-a186-4eae-a2fd-b794145bf261 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462275 Nov 24 14:56:26.488187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-e59f6893-40c8-48ea-b906-724e786631c1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:26.490957 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-e59f6893-40c8-48ea-b906-724e786631c1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.1149566 Nov 24 14:56:26.629793 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-c3719fec-9066-4d88-a62b-1a2e103916da service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1317420 Nov 24 14:56:26.855339 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-0123847f-adb4-46da-99f8-4a698461f057 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2187071 Nov 24 14:56:27.118574 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-6e14ba00-222d-4a0a-a2e7-a0e6b4742741 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2569296 Nov 24 14:56:27.658958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-362e427c-28ab-4422-a181-3c16546cc1dc req-0061ebb1-ec60-428a-b5e5-16769a62fb4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:27.660577 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-362e427c-28ab-4422-a181-3c16546cc1dc req-0061ebb1-ec60-428a-b5e5-16769a62fb4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0947454 Nov 24 14:56:27.712629 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-362e427c-28ab-4422-a181-3c16546cc1dc req-24f2a56e-a58d-47c0-a327-79aad633b08f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458539 Nov 24 14:56:28.950536 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de980b3c-f15b-4711-8a65-c3c8bc61860b req-b85199ed-f335-4025-ac66-f5a21bf6f76d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:28.952058 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de980b3c-f15b-4711-8a65-c3c8bc61860b req-b85199ed-f335-4025-ac66-f5a21bf6f76d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0845606 Nov 24 14:56:29.007731 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de980b3c-f15b-4711-8a65-c3c8bc61860b req-aea3e218-86af-427d-ac70-c962bd32061c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456481 Nov 24 14:56:30.278049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd18f339-50bb-4a71-a7f3-52fe1bd772a6 req-2e642435-586c-47f5-8eb2-be3b9242cc16 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:30.280526 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd18f339-50bb-4a71-a7f3-52fe1bd772a6 req-2e642435-586c-47f5-8eb2-be3b9242cc16 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0935550 Nov 24 14:56:30.344975 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd18f339-50bb-4a71-a7f3-52fe1bd772a6 req-611c5c35-b713-43aa-95f8-62c02ced302c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541115 Nov 24 14:56:31.578397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8f1d28-dc63-484b-8116-76816d8d63ed req-d0721739-cb6a-4056-8cbc-2708db4844c2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:31.579793 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0e8f1d28-dc63-484b-8116-76816d8d63ed req-d0721739-cb6a-4056-8cbc-2708db4844c2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0866446 Nov 24 14:56:31.652572 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0e8f1d28-dc63-484b-8116-76816d8d63ed req-13d7722b-ed26-4ef9-ad22-7a7cd983f284 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0659292 Nov 24 14:56:32.877444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54d4c0e-f7db-43d9-900f-6b104da74b40 req-c7872b56-89c4-4208-b6a7-9643c0b39815 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:32.878971 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a54d4c0e-f7db-43d9-900f-6b104da74b40 req-c7872b56-89c4-4208-b6a7-9643c0b39815 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0944583 Nov 24 14:56:32.928007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a54d4c0e-f7db-43d9-900f-6b104da74b40 req-674b5901-5753-42d4-bb8b-75c50b545feb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430632 Nov 24 14:56:33.397622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-999592a6-cbc4-483d-b14f-d0b74816b26b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:33.782995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:34.165965 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5278d800-7622-436b-bb36-9cf4cdd4eeb4 req-9a262dc1-fa53-4e55-8037-dc4a52c16b71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:34.167428 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5278d800-7622-436b-bb36-9cf4cdd4eeb4 req-9a262dc1-fa53-4e55-8037-dc4a52c16b71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.1145318 Nov 24 14:56:34.219231 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5278d800-7622-436b-bb36-9cf4cdd4eeb4 req-2a8a8b10-46c7-4002-96cb-0ed876552dd8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446951 Nov 24 14:56:35.448781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1108bfe1-b901-4676-9720-3865b976c845 req-3bc5ec76-7dd0-4d44-9968-0340f2648128 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:35.451108 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1108bfe1-b901-4676-9720-3865b976c845 req-3bc5ec76-7dd0-4d44-9968-0340f2648128 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0976088 Nov 24 14:56:35.500899 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1108bfe1-b901-4676-9720-3865b976c845 req-6e3e9de6-918d-4f5d-9ea3-7d0cdbc56fe3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437341 Nov 24 14:56:35.951105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-15fd90a3-66f5-417a-815b-b6b04c333820 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:36.746752 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ac3e83-4d28-461b-8276-42548becd7dc req-9ff254e4-0ffe-4ee2-b2ca-8ba4784c385c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:36.749113 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f4ac3e83-4d28-461b-8276-42548becd7dc req-9ff254e4-0ffe-4ee2-b2ca-8ba4784c385c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.1195784 Nov 24 14:56:36.815003 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f4ac3e83-4d28-461b-8276-42548becd7dc req-29afb21a-3fb6-429c-8b22-f288d73cca08 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0587637 Nov 24 14:56:37.001024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:38.039645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e55b78-acd9-4e87-a567-62d3ed78e3fb req-ce89dc2b-d49e-4958-af6f-58639eb8a7a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:38.041364 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9e55b78-acd9-4e87-a567-62d3ed78e3fb req-ce89dc2b-d49e-4958-af6f-58639eb8a7a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0839145 Nov 24 14:56:38.094014 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e9e55b78-acd9-4e87-a567-62d3ed78e3fb req-4eb4fd8c-3fc5-48e2-bc43-40fcffae19ad tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465028 Nov 24 14:56:38.694563 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:39.370587 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f78f08f-3497-4275-a7ae-8fa080dae912 req-4c272b5a-5c9d-4774-abab-afe52b528822 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:39.372809 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f78f08f-3497-4275-a7ae-8fa080dae912 req-4c272b5a-5c9d-4774-abab-afe52b528822 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.1429706 Nov 24 14:56:39.436024 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2f78f08f-3497-4275-a7ae-8fa080dae912 req-4a19cc6b-862a-4b31-b14a-bd52a7a60f01 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529253 Nov 24 14:56:40.743904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30534a0-ee61-415a-bc76-362e8313215d req-96602144-e8d0-413d-af7c-b8ec6f0b96a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:40.745910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b30534a0-ee61-415a-bc76-362e8313215d req-96602144-e8d0-413d-af7c-b8ec6f0b96a9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0912955 Nov 24 14:56:40.798020 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b30534a0-ee61-415a-bc76-362e8313215d req-d7741999-3587-4eeb-899a-93dfd1be5361 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458758 Nov 24 14:56:42.013973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48595e3a-c865-4609-9a3a-e48e8d90340d req-30419fbb-f39b-4600-b877-4b771579e79a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:42.016407 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-48595e3a-c865-4609-9a3a-e48e8d90340d req-30419fbb-f39b-4600-b877-4b771579e79a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0902028 Nov 24 14:56:42.066628 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-48595e3a-c865-4609-9a3a-e48e8d90340d req-d3a6edfe-22f0-4d69-b797-de13267ecba6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432830 Nov 24 14:56:43.306740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd465580-03bc-437e-8319-fe088c1aeae8 req-3030e642-5551-4d2a-a410-a8f350180492 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:43.309235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd465580-03bc-437e-8319-fe088c1aeae8 req-3030e642-5551-4d2a-a410-a8f350180492 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0986364 Nov 24 14:56:43.359457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd465580-03bc-437e-8319-fe088c1aeae8 req-b251ed9c-5bb4-4713-9ede-0615fddf12a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441828 Nov 24 14:56:44.012449 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-f2783f03-4573-43eb-a9f1-dbc8623f2a74 service neutron] 10.222.0.47 "GET /v2.0/ports/9fc540d7-7756-45fe-90ec-ab89371e3d17/bindings/hv-neutron-8181 HTTP/1.1" status: 200 len: 384 time: 0.0823655 Nov 24 14:56:44.390733 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-726805c1-9666-4d92-9418-9d875bf8f9aa service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 1099 time: 0.1293831 Nov 24 14:56:44.507514 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-22412a51-d565-4919-abf2-d7f4effd15ed service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1099 time: 0.0878627 Nov 24 14:56:44.622289 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fbd1206-f7d8-4c2e-be80-9396bfad2f25 req-7149e2f3-29ee-49f1-a067-25fd00d1d1a3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:44.624874 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5fbd1206-f7d8-4c2e-be80-9396bfad2f25 req-7149e2f3-29ee-49f1-a067-25fd00d1d1a3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.1357207 Nov 24 14:56:44.674029 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-b6a89b77-cbdc-431f-8a05-dedffce82411 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:44.675713 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-b6a89b77-cbdc-431f-8a05-dedffce82411 service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1614952 Nov 24 14:56:44.692251 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5fbd1206-f7d8-4c2e-be80-9396bfad2f25 req-fef724b9-f5bd-4c45-80a5-cc8bcf1dff8a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597610 Nov 24 14:56:44.793711 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-1fc26ab1-22b6-4a44-921d-4397a17864ea service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 1001 time: 0.1119027 Nov 24 14:56:44.861819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-091962a8-92f0-4250-be6a-b478e46b3732 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:44.863293 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-091962a8-92f0-4250-be6a-b478e46b3732 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0638037 Nov 24 14:56:44.949616 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-0117fcd4-a402-4a75-bc9a-8f3d151f9eaf service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0796156 Nov 24 14:56:45.106742 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-d26ff32d-48ba-4dcf-9c5b-35ab7b9afdd8 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1503582 Nov 24 14:56:45.276181 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-f420c77e-23f5-4ded-b170-27affc600334 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1630845 Nov 24 14:56:46.048220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291c14c9-5c17-465b-a23f-f11aaf23afcd req-0345ae73-662d-42b3-bf03-294cf4d7d82b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:46.049726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-291c14c9-5c17-465b-a23f-f11aaf23afcd req-0345ae73-662d-42b3-bf03-294cf4d7d82b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.2006664 Nov 24 14:56:46.104198 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-291c14c9-5c17-465b-a23f-f11aaf23afcd req-c610a432-cfd2-483e-99b7-58260105094a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483358 Nov 24 14:56:47.332220 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facb0529-f690-4f8b-829c-c7018b8da742 req-c43cc1c8-d341-4f36-8a7e-f2e3af47e66c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:47.333985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-facb0529-f690-4f8b-829c-c7018b8da742 req-c43cc1c8-d341-4f36-8a7e-f2e3af47e66c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 946 time: 0.0919466 Nov 24 14:56:47.388839 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-facb0529-f690-4f8b-829c-c7018b8da742 req-561646c2-7ab8-432a-8cb2-c975e36b89cd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485291 Nov 24 14:56:47.634177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:56:47.637285 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:56:47.854840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:47.888033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:56:47.910646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:56:47.916765 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'port_id': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'mac_address': 'fa:16:3e:52:92:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 883, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:56:47.923673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:56:47.951506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:47.959292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e7a6361d-324a-400a-b0b8-d3079f8b6078 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:56:47.994024 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'code': 200} Nov 24 14:56:48.037036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:48.063276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9fc540d7-7756-45fe-90ec-ab89371e3d17 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:56:48.067082 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:56:48.082665 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.083266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.083607 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.083983 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.084309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.084636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.084964 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.085291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.085613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.085934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.086255 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:56:48.092490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:56:48.097227 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:56:48.102055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:48.103884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-ce1ad621-fea5-46a0-8fad-a7b7fa3718e3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:56:48.175793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:56:48.178953 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:56:48.212950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['9fc540d7-7756-45fe-90ec-ab89371e3d17'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:56:48.454197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:48.598673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726f2e22-d053-46a4-87ce-910f1f486f9b req-14a40f05-9122-4324-982f-dd13a199f8ec tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:48.600661 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-726f2e22-d053-46a4-87ce-910f1f486f9b req-14a40f05-9122-4324-982f-dd13a199f8ec tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 945 time: 0.0821550 Nov 24 14:56:48.649917 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-726f2e22-d053-46a4-87ce-910f1f486f9b req-2d7f0f26-2df2-4f03-9d8f-4c549e853f4a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432107 Nov 24 14:56:49.006622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-5bb4c228-e00e-43c3-b625-dde69e634ecd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:49.007907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-5bb4c228-e00e-43c3-b625-dde69e634ecd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1&tenant_id=9482331cd77d4af992b911b12f253611&binding%3Ahost_id=hv-neutron-8181 HTTP/1.1" status: 200 len: 945 time: 0.0947621 Nov 24 14:56:49.018075 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c4c927-f21b-4ed4-9430-6a17fcaea273 req-48108c27-1d62-4065-8ab3-f85966420f32 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:49.019584 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-04c4c927-f21b-4ed4-9430-6a17fcaea273 req-48108c27-1d62-4065-8ab3-f85966420f32 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 945 time: 0.0976167 Nov 24 14:56:49.079788 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-04c4c927-f21b-4ed4-9430-6a17fcaea273 req-78f8806a-ba89-4cd5-a0ed-122dfc095f48 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539629 Nov 24 14:56:49.184311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-9d435634-02ff-4585-979b-00ad752b87fa service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1098 time: 0.0992033 Nov 24 14:56:49.408239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-0d10f4e5-3b19-4bbc-8216-dc3aaf33674e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:49.409698 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-0d10f4e5-3b19-4bbc-8216-dc3aaf33674e service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.2197130 Nov 24 14:56:49.501748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f629b7-d331-4f33-8ac9-db6a748a4e50 req-6020156a-9754-48ad-b913-5f2540d73ea2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:49.503216 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93f629b7-d331-4f33-8ac9-db6a748a4e50 req-6020156a-9754-48ad-b913-5f2540d73ea2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 945 time: 0.2059305 Nov 24 14:56:49.546010 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-7c171235-fbd2-41e4-b070-cd483126a35e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 1000 time: 0.1266775 Nov 24 14:56:49.620212 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93f629b7-d331-4f33-8ac9-db6a748a4e50 req-0655ea15-f196-4b6e-a558-a7e557e20b73 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1014154 Nov 24 14:56:49.629033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-33a59eaa-fb09-405a-a319-d3b31faefd65 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:49.630608 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-33a59eaa-fb09-405a-a319-d3b31faefd65 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0776229 Nov 24 14:56:49.654743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:56:49.724366 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-8a3e336a-16f3-4c21-acc2-433c096b9128 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0862539 Nov 24 14:56:49.838272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:49.862721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 9fc540d7-7756-45fe-90ec-ab89371e3d17 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:56:49.868351 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-a22830f6-8bde-4dfc-bd57-e8cb8ca9443a service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361530 Nov 24 14:56:49.883183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:56:49.889286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:56:49.892119 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:56:50.009682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:56:50.014331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-5cec6860-306d-4f54-b0e7-773a0082b7f2 req-f611172b-c273-4174-901a-1adf424d7fce service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1402085 Nov 24 14:56:50.015645 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:56:50.855664 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e29c83e-a9bb-4a9b-b1a6-a191bd0d1bae req-f495cf69-f84a-4f95-b312-29e333443bc9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:56:50.858071 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6e29c83e-a9bb-4a9b-b1a6-a191bd0d1bae req-f495cf69-f84a-4f95-b312-29e333443bc9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 944 time: 0.0879679 Nov 24 14:56:50.933213 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6e29c83e-a9bb-4a9b-b1a6-a191bd0d1bae req-8875773c-3a33-46f4-bfa9-21868c4e6a7f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692670 Nov 24 14:56:50.963489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54274) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:56:51.087346 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-67e4efdf-a6a2-465a-bb1a-2271040465ae tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5 HTTP/1.1" status: 200 len: 991 time: 0.1224463 Nov 24 14:57:02.860239 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:57:03.406300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e01f77d8-c3f9-482f-bcfd-1076d897d73b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:03.791141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:05.947705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b52d765-36c9-428d-a2d9-2a808a82c692 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:07.004002 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:08.694393 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:18.410583 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:24.897907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-990b3fdd-0c84-41f9-a61a-91f816a5c066 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1013558 Nov 24 14:57:25.152824 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-2d07e1c5-dc7c-4f60-aa1e-bf2500bf099e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1097 time: 0.0936537 Nov 24 14:57:25.325746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-b9ae3ddc-4ff2-42d0-b4b0-f3e3fb35be23 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:25.327851 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-b9ae3ddc-4ff2-42d0-b4b0-f3e3fb35be23 service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1552951 Nov 24 14:57:25.461326 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-95385b57-c782-4e96-b519-348673af4f12 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 999 time: 0.1264374 Nov 24 14:57:25.531499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-3f10b782-3aa6-44d3-8635-07357e9c0242 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:25.533033 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-3f10b782-3aa6-44d3-8635-07357e9c0242 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0657840 Nov 24 14:57:25.622751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-7b2b496f-ad86-4904-9008-50cf75b11b9f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0823426 Nov 24 14:57:25.633648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-6cb72d72-c689-4224-ad9d-d6a45912611e service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:57:25.634587 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-6cb72d72-c689-4224-ad9d-d6a45912611e service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0053692 Nov 24 14:57:25.904496 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-015087d4-2a9b-4ebb-87e2-0d55586332ab service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2618799 Nov 24 14:57:26.060062 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-40daab78-7b0b-4e75-a4b7-014cd76ded5e req-fb7f7f33-7454-4d87-80e2-dd9e41abd04e service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1490331 Nov 24 14:57:33.403080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-fcfa6ce9-0242-4020-963c-14240c051123 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:33.785511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:35.941726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f1bbbcd9-0a0c-4ad5-81bd-d80c916f66f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:37.012289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:38.698576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:39.862423 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:57:46.125743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54298) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:46.455782 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 25a68161-26df-48f6-89ad-1a6e2795cce0 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:57:46.456047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:46.640671 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:46.640990 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:46.762713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 25a68161-26df-48f6-89ad-1a6e2795cce0 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:57:46.914670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:46.918440 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:46.964542 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=25a68161-26df-48f6-89ad-1a6e2795cce0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:47.007608 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.008021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.008396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.008767 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.009288 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.009937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.010159 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.010522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.010883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.011244 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.011607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:47.015004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:47.069677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:47.463363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:57:47.666237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:57:47.675779 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] Sync routers for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:57:47.687309 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:47.688637 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:57:47.689242 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:47.741966 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/floatingips/8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5 HTTP/1.1" status: 204 len: 168 time: 1.6150477 Nov 24 14:57:47.742762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:57:47.805327 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'status': 'completed', 'code': 200} Nov 24 14:57:47.873407 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:57:47.904639 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-0ce320c2-67ab-4294-bfe5-82a73e64205d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 1097 time: 0.0769579 Nov 24 14:57:48.052517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-541bfa57-9f6f-44dc-8599-b38e51ffd9a1 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:48.053993 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-541bfa57-9f6f-44dc-8599-b38e51ffd9a1 service neutron] 10.222.0.47 "GET /v2.0/networks?id=6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 200 len: 898 time: 0.1434484 Nov 24 14:57:48.167429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-2499b1d0-000e-425d-bfb8-322d03d29103 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 200 len: 217 time: 0.1053658 Nov 24 14:57:48.201169 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:48.204997 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] Checking router: 92b51eb4-3fec-4f48-906c-cbc9a47c1192 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:57:48.216274 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:57:48.216895 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:48.245211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-db605ccd-1514-4a6e-aad0-fcf0d7171c77 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:48.246590 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-db605ccd-1514-4a6e-aad0-fcf0d7171c77 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 200 len: 834 time: 0.0714374 Nov 24 14:57:48.305633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d926007d-0c6b-4fde-ab2a-afb91288c744 req-50ffb15d-4c2f-4a81-864f-795291c8a0ba tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:48.307221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d926007d-0c6b-4fde-ab2a-afb91288c744 req-50ffb15d-4c2f-4a81-864f-795291c8a0ba tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 944 time: 0.1907330 Nov 24 14:57:48.369345 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-254096be-f0e1-4e08-a425-a49a2ed636ad service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=6cba8656-86e8-41ed-9bcf-5e546cdca933&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1141202 Nov 24 14:57:48.373107 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d926007d-0c6b-4fde-ab2a-afb91288c744 req-36a383b8-8792-4cbd-a584-c05c4557e832 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583622 Nov 24 14:57:48.425840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:48.441645 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:57:48.508476 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-00bac5e4-c7dc-4a44-a2d7-d40cf1bd63eb service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313822 Nov 24 14:57:48.652526 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03dada86-68a6-4dc1-8ecf-3d5a13f98839 req-cbe7d4d6-0be6-4726-8078-66e3db198a71 service neutron] 10.222.0.47 "GET /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1360602 Nov 24 14:57:48.790332 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:48.794888 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02ed3e84-4c30-42fd-85b6-b60c43ed7834 None None] The sync data for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv is: [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '0a429058-acd3-4ae9-bdb2-5a31f36379f4', 'name': '', 'network_id': '6cba8656-86e8-41ed-9bcf-5e546cdca933', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:c2:4b:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:45Z', 'updated_at': '2021-11-24T14:54:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': '271709fb-3ce8-4b24-9e91-7ca050c90c3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:57:49.014974 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1024b41d-1581-40d3-bb11-8abdb9005e34 None None] New status for floating IP 8b8b9031-4f1c-43e0-a2a7-303cd9bcc8d5: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:57:49.703817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05730415-ac8e-427f-af73-83e60bdb8c96 req-03262350-245f-4a23-aa2e-58f5e9e82a71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:49.704413 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-05730415-ac8e-427f-af73-83e60bdb8c96 req-03262350-245f-4a23-aa2e-58f5e9e82a71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:57:49.721259 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-05730415-ac8e-427f-af73-83e60bdb8c96 req-03262350-245f-4a23-aa2e-58f5e9e82a71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:57:49.722471 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-05730415-ac8e-427f-af73-83e60bdb8c96 req-03262350-245f-4a23-aa2e-58f5e9e82a71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 944 time: 0.2180793 Nov 24 14:57:49.769023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-05730415-ac8e-427f-af73-83e60bdb8c96 req-7cf036fb-006c-44fa-9ff5-5b35e1455275 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408723 Nov 24 14:57:49.966375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-937411a0-0a60-471b-ae05-1158d6151776 req-3b634cc0-adeb-4139-bec0-8b08ad23c785 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:49.967683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-937411a0-0a60-471b-ae05-1158d6151776 req-3b634cc0-adeb-4139-bec0-8b08ad23c785 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 944 time: 0.0822299 Nov 24 14:57:50.037721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 9fc540d7-7756-45fe-90ec-ab89371e3d17 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:57:50.038044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:50.283236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 9fc540d7-7756-45fe-90ec-ab89371e3d17, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=9fc540d7-7756-45fe-90ec-ab89371e3d17,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:57:50.283591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:50.404028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 9fc540d7-7756-45fe-90ec-ab89371e3d17 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:57:50.651293 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:50.657347 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64c6e524-f7e7-4dda-b8ca-05a1e3eb3bd9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:50.703062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=9fc540d7-7756-45fe-90ec-ab89371e3d17,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:50.745060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.746876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.747257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.747632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.748030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.748402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.748769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.749133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.749621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.750111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.750481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:50.757366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:50.790595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] No DVR routers for this DVR port 9fc540d7-7756-45fe-90ec-ab89371e3d17 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:57:50.793177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:50.795707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'name': 'network-vif-deleted', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:57:50.812745 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-937411a0-0a60-471b-ae05-1158d6151776 req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "DELETE /v2.0/ports/9fc540d7-7756-45fe-90ec-ab89371e3d17 HTTP/1.1" status: 204 len: 173 time: 0.8392694 Nov 24 14:57:50.855820 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94621821-77d4-4ee7-9504-5bb2d98ba4c1', 'name': 'network-vif-deleted', 'tag': '9fc540d7-7756-45fe-90ec-ab89371e3d17', 'status': 'completed', 'code': 200} Nov 24 14:57:50.961797 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f608489c-8630-4be4-bc14-dc9170ad97c8 req-8fe4cb9b-5ac8-4ff7-86b3-4fc551c4615d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:57:50.979327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f608489c-8630-4be4-bc14-dc9170ad97c8 req-8fe4cb9b-5ac8-4ff7-86b3-4fc551c4615d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:57:50.980425 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f608489c-8630-4be4-bc14-dc9170ad97c8 req-8fe4cb9b-5ac8-4ff7-86b3-4fc551c4615d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=94621821-77d4-4ee7-9504-5bb2d98ba4c1 HTTP/1.1" status: 200 len: 210 time: 0.0665634 Nov 24 14:57:51.939321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:57:51.971925 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 9fc540d7-7756-45fe-90ec-ab89371e3d17 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:57:51.972275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 9fc540d7-7756-45fe-90ec-ab89371e3d17 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:57:52.090049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54318) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:52.489237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:53.111226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 0a429058-acd3-4ae9-bdb2-5a31f36379f4 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:57:53.111937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:53.295892 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 0a429058-acd3-4ae9-bdb2-5a31f36379f4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=0a429058-acd3-4ae9-bdb2-5a31f36379f4,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:57:53.296249 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:53.523373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 0a429058-acd3-4ae9-bdb2-5a31f36379f4 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:57:53.709294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:53.713668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-61914c8f-6510-4d5a-a811-3f4e4d630e96 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:53.755436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=0a429058-acd3-4ae9-bdb2-5a31f36379f4,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:53.759139 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:54.066663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:54.653385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:57:54.972628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:57:54.982324 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] Sync routers for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:57:54.991333 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/92b51eb4-3fec-4f48-906c-cbc9a47c1192/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9001923 Nov 24 14:57:54.994500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:57:54.994658 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54322) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:54.995164 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:55.169800 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:57:55.184533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting subnet 271709fb-3ce8-4b24-9e91-7ca050c90c3c {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 14:57:55.187553 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.246609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.333313 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.408890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.412700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-04791d0e-e7e7-428c-ac3a-d21ce2e58595 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:55.449773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Subnet': ['ID=271709fb-3ce8-4b24-9e91-7ca050c90c3c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:55.454202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:55.459452 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:57:53Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:55.459651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.464456 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] Checking router: 92b51eb4-3fec-4f48-906c-cbc9a47c1192 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:57:55.466949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dba3f100-d7f5-4dba-913e-494d69139513 None None] Network 6cba8656-86e8-41ed-9bcf-5e546cdca933 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:57:55.468563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54326) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:55.469064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cc26bdf5-5c73-4bae-9292-bc5879be22a5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/subnets/271709fb-3ce8-4b24-9e91-7ca050c90c3c HTTP/1.1" status: 204 len: 168 time: 0.4731038 Nov 24 14:57:55.481556 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] Routers {'92b51eb4-3fec-4f48-906c-cbc9a47c1192'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:57:55.482195 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:55.661792 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] Set router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:57:55.680925 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.728282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] DHCP port deletion for 6cba8656-86e8-41ed-9bcf-5e546cdca933 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 14:57:55.735091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Deleting port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:57:55.735712 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.927382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.938071 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 8b63507f-e542-4563-812d-db0de94496d8 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 14:57:55.938796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:55.973797 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] For port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,segment=NetworkSegment(2f112ade-8feb-4286-8175-f6b23bae07ce),segment_id=2f112ade-8feb-4286-8175-f6b23bae07ce)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:57:55.974171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:56.016859 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:57:53Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:56.020814 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c129dec9-548f-44bc-8164-2b953f390a98 None None] The sync data for ids ['92b51eb4-3fec-4f48-906c-cbc9a47c1192'] in dv-neutron-818151-2-hyperv is: [{'id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'name': 'tempest-TestNetworkAdvancedServerOps-router-932792566', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': '8b63507f-e542-4563-812d-db0de94496d8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:54:41Z', 'updated_at': '2021-11-24T14:57:53Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '8b63507f-e542-4563-812d-db0de94496d8', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:16:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92b51eb4-3fec-4f48-906c-cbc9a47c1192', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:54:42Z', 'updated_at': '2021-11-24T14:54:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:57:56.114365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Calling delete_port for 9e0dd01f-2f21-42c8-aa14-3117aab60f1b owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:57:56.144813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 8b63507f-e542-4563-812d-db0de94496d8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8b63507f-e542-4563-812d-db0de94496d8,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:57:56.145170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:56.193769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:56.198597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:56.241058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Pushing event deleted for resources: {'Port': ['ID=9e0dd01f-2f21-42c8-aa14-3117aab60f1b,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:56.253599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.253924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.254164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.254547 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.254872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.255201 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.255518 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.255853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.256170 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.256489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.256800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:57:56.260879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] No DVR routers for this DVR port 9e0dd01f-2f21-42c8-aa14-3117aab60f1b on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 14:57:56.262339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:56.270426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 8b63507f-e542-4563-812d-db0de94496d8 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 14:57:56.417452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a429058-acd3-4ae9-bdb2-5a31f36379f4 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:57:56.454144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 0a429058-acd3-4ae9-bdb2-5a31f36379f4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:57:56.454704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 0a429058-acd3-4ae9-bdb2-5a31f36379f4 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:57:56.455122 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e0dd01f-2f21-42c8-aa14-3117aab60f1b no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:57:56.468504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:56.473998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a529c9d7-e3b3-4192-aa5a-a21000094863 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:56.492440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 9e0dd01f-2f21-42c8-aa14-3117aab60f1b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:57:56.493062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9e0dd01f-2f21-42c8-aa14-3117aab60f1b not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:57:56.521597 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=8b63507f-e542-4563-812d-db0de94496d8,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:56.524297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:56.746187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.122494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.127099 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.153928 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.154445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Fanout notify agent at l3_agent the message router_deleted on router 92b51eb4-3fec-4f48-906c-cbc9a47c1192 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 14:57:57.169652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.170853 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b4268dd1-fd24-45cf-b007-28d5934feb87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/routers/92b51eb4-3fec-4f48-906c-cbc9a47c1192 HTTP/1.1" status: 204 len: 168 time: 1.7012014 Nov 24 14:57:57.173549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54330) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:57.296617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.434454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.466249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6cba8656-86e8-41ed-9bcf-5e546cdca933']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:57.479196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2f112ade-8feb-4286-8175-f6b23bae07ce') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:57.479872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2f112ade-8feb-4286-8175-f6b23bae07ce') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:57:57.490613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.506216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.512434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Releasing vlan 883 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 14:57:57.512812 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 14:57:57.527471 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 14:57:57.607443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.611781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.614858 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-83c164e1-8f2e-4dec-ae04-919d234de038 tempest-RoutersNegativeTest-357973788 tempest-RoutersNegativeTest-357973788-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:57.641895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Network': ['ID=6cba8656-86e8-41ed-9bcf-5e546cdca933,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:57.644557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:57.651422 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7aebebe3-5720-42b8-a63e-533f2a8b6acf tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/networks/6cba8656-86e8-41ed-9bcf-5e546cdca933 HTTP/1.1" status: 204 len: 168 time: 0.4768724 Nov 24 14:57:57.654004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54334) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:57.733484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.764160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.829363 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.833569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-47f81cff-362a-4d0a-b53b-4db3752abb24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:57.849199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:57.851693 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:57.860463 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:57.861591 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-0a82ad25-0e19-45dd-bd77-c9e6daa0d03a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/security-groups/3ceb16b5-2619-42a7-bf1e-ed67d74a5eb7 HTTP/1.1" status: 204 len: 168 time: 0.2066636 Nov 24 14:57:58.195644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b63507f-e542-4563-812d-db0de94496d8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 14:57:58.231546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8b63507f-e542-4563-812d-db0de94496d8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 14:57:58.231955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8b63507f-e542-4563-812d-db0de94496d8 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 14:57:58.408012 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54342) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:58.413643 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1792375052', 'description': 'tempest-secgroup-smoke-1792375052 description', 'project_id': '9482331cd77d4af992b911b12f253611'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:58.420446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:58.424503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:58.427359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:58.433029 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:58.443621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.481596 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:58.485795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:58.489108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:58.495534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:58.555112 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.558353 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.561878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6404e3c6-cbb3-4ff3-8c4f-715ce3f3df53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:58.603940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:58.606508 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.607724 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.1987369 Nov 24 14:57:58.608634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-119f7be2-f19e-4cfb-aca9-42c43e1ef23d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:58.610847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54346) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:58.616187 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '16bbcbed-c693-4b1e-acfb-4f7e3b80a29d', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:58.622217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:58.626003 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:58.628867 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:58.635388 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:58.652887 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.715841 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.719341 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.721174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-055522b5-a910-4777-9bcc-80ce8d7fa43a tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:58.743271 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=23ad5fad-e288-43b4-8b9a-a08b3cf51386,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:58.745660 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:58.752854 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.756706 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b2761284-5cbd-480d-8e6c-6cb59f321ec8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1424339 Nov 24 14:57:58.756864 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54350) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:58.762847 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '16bbcbed-c693-4b1e-acfb-4f7e3b80a29d', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:58.768923 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:58.772777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:58.776381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:58.782379 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:58.800620 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.867406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.872639 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.874435 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-925535cb-e68f-4dbe-a440-1e18fd700df7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:58.896718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b92efd9-c319-4199-8f59-8bd510c871e4,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:58.899268 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:58.906937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:58.908209 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1504509 Nov 24 14:57:58.912661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54354) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:58.918391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '16bbcbed-c693-4b1e-acfb-4f7e3b80a29d', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:58.924543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:58.928589 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:58.932210 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:58.938240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:58.958094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.030319 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.034459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.041169 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8eae9c83-3aa6-4fc2-82af-b835eb8075ea tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:59.062460 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75231760-3aa8-46a2-ab60-7851ff1c239e,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:59.065453 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:59.074677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.076379 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7cc67933-2068-4d73-ba73-6811af732901 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1627402 Nov 24 14:57:59.079092 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54358) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:59.085217 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '16bbcbed-c693-4b1e-acfb-4f7e3b80a29d', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:59.092792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:59.097065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:59.100207 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:59.106892 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:59.124703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.191436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.195429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.197818 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cd9d81b0-ee03-4f4d-9e0b-5fa71f18f1a5 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:59.220645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1fadae8a-875d-4037-ba3d-5fb40ab7a8f5,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:59.223174 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:59.233136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.234771 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4d177258-6082-4d4d-814b-04fe796be1b4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1545620 Nov 24 14:57:59.237343 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54362) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:59.242843 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '16bbcbed-c693-4b1e-acfb-4f7e3b80a29d', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:59.248927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:59.253019 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:59.255942 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:59.262128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:59.276707 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:57:59.283430 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.348700 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.353017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.354937 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:59.376534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8074f34b-327e-4517-9bea-d69e63f807c3,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:59.379124 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:59.386992 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.388294 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ea63f0cb-2ab5-4b52-b5a8-7e0c40bab152 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1500087 Nov 24 14:57:59.390996 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54366) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:59.396301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '16bbcbed-c693-4b1e-acfb-4f7e3b80a29d', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:59.402898 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:59.406650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:59.409515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:59.415270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:59.426068 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 14:57:59.433156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.500588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.504300 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.506673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a1e37d89-2812-4379-952e-a9f180ada6df tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:59.529321 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c51638cd-ce07-4816-8cc4-533662f7b3e0,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:59.531747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:59.538318 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.539580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1477060 Nov 24 14:57:59.542628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54370) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:59.548084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'network': {'name': 'tempest-network-smoke--2092220142', 'project_id': '9482331cd77d4af992b911b12f253611', 'port_security_enabled': True}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:59.552967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:59.557993 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:network and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:59.560831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:59.566424 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:59.576486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:57:59.579465 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.607056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 882} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 14:57:59.615828 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.616163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Added segment d7a3fa9e-11c6-4698-a174-9c2f9596c1dd of type vlan for network 4163e171-8af6-446b-b467-ad2dbcca11e9 Nov 24 14:57:59.646051 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.674134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.677951 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:57:59.678523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.682994 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41ac3a19-e7f5-4aa0-b7f7-dabb245ea041 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:57:59.786590 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2428691 Nov 24 14:57:59.789189 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54374) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:57:59.796564 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'admin_state_up': True, 'project_id': '9482331cd77d4af992b911b12f253611', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:57:59.801678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Network': ['ID=4163e171-8af6-446b-b467-ad2dbcca11e9,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:57:59.804872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d50d5707-c68d-4803-9461-d0221e169813 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:57:59.806439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:57:59.810594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:router and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:57:59.812316 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 14:57:59.813540 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:57:59.819227 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:57:59.829406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.830365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:57:59.850594 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.106130 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.292656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.327196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.457468 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.239 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/c182f290-e8d3-4699-9bdf-86cb07d770be) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:58:00.605252 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.634128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.637729 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:00.705661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:58:00.709184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:00.714373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:58:00.738543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=c182f290-e8d3-4699-9bdf-86cb07d770be,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:00.743477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:00.880241 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:00.880974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:01.114517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 63d26344-337f-432c-99bf-fb1f3789f059 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 14:58:01.325637 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:58:01.335056 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Sync routers for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:58:01.348261 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:58:01.349039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:01.351972 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:01.353469 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-837733eb-c79b-489c-a762-57a85e0c2cd0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.5632997 Nov 24 14:58:01.357043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54378) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:01.398523 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5f5a7413-d265-4002-9692-032d52e2869f tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=9482331cd77d4af992b911b12f253611&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0392864 Nov 24 14:58:01.400426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54382) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:01.535143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:58:01.540447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46dc7c98-57aa-4f5c-b295-e2decb8f4c56 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:01.541960 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-46dc7c98-57aa-4f5c-b295-e2decb8f4c56 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1405950 Nov 24 14:58:01.544855 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54386) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:01.587402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ea007a8f-c4b7-46cb-8cb1-0752c0a18fe0 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0411515 Nov 24 14:58:01.589869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54390) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:01.595663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-240472616', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'project_id': '9482331cd77d4af992b911b12f253611', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:58:01.711611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:58:01.716643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:subnet and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:58:01.719948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:58:01.725762 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:58:01.742071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:58:01.855745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:01.886429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:00Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:01.890473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Checking router: 63d26344-337f-432c-99bf-fb1f3789f059 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:58:01.891320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Updating router 63d26344-337f-432c-99bf-fb1f3789f059 port c182f290-e8d3-4699-9bdf-86cb07d770be binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:58:01.943425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.081195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.085145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6c6d3872-58d2-4896-b1e6-5b5e3982f897 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:02.157609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Subnet': ['ID=f180fd7c-f692-4581-ab7e-4760fe2559bb,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:02.163907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:02.174278 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Checking segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:58:02.174642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network hostable DHCP agents. Network: 4163e171-8af6-446b-b467-ad2dbcca11e9, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 14:58:02.197016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 14:58:02.208784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 4163e171-8af6-446b-b467-ad2dbcca11e9) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:02.213103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:02.213783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.237799 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.6468377 Nov 24 14:58:02.240814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54394) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:02.253984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdf5c895-ea26-4541-b544-0997423c49ff None None] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:58:02.355507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.380294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Transition to ACTIVE for port object c182f290-e8d3-4699-9bdf-86cb07d770be will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:02.402011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.413994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-10676166-7e3b-4cd4-9470-acaedaab7e77 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:02.527553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Attempting to bind port c182f290-e8d3-4699-9bdf-86cb07d770be on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:58:02.527954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Attempting to bind port c182f290-e8d3-4699-9bdf-86cb07d770be by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:58:02.528320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Attempting to bind port c182f290-e8d3-4699-9bdf-86cb07d770be on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:58:02.539492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-824209f8-3059-4222-80ec-e27f9c5523e2 None None] Pushing event updated for resources: {'Port': ['ID=c182f290-e8d3-4699-9bdf-86cb07d770be,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:02.545066 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-824209f8-3059-4222-80ec-e27f9c5523e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:02.553320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 57, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:58:02.553691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:58:02.554093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.554481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:58:02.554945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Bound port: c182f290-e8d3-4699-9bdf-86cb07d770be, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:58:02.555934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.641045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-4163e171-8af6-446b-b467-ad2dbcca11e9', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 14:58:02.641878 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.720961 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] For port c182f290-e8d3-4699-9bdf-86cb07d770be, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:58:02.738958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] For port c182f290-e8d3-4699-9bdf-86cb07d770be, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c182f290-e8d3-4699-9bdf-86cb07d770be,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:58:02.744238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:02.750022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:02.898956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-824209f8-3059-4222-80ec-e27f9c5523e2 None None] Pushing event updated for resources: {'Port': ['ID=c182f290-e8d3-4699-9bdf-86cb07d770be,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:02.904840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:58:02.905490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:57:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:02.958955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-824209f8-3059-4222-80ec-e27f9c5523e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:02.969181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Allocated IP 172.20.0.2 (4163e171-8af6-446b-b467-ad2dbcca11e9/f180fd7c-f692-4581-ab7e-4760fe2559bb/536e922d-541b-4e72-8698-e35aaa8c05e4) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:58:03.143197 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.249145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:58:03.442653 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0945da51-51a0-41ef-a995-03cbbef50d14 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.512179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.533470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Transition to ACTIVE for port object 536e922d-541b-4e72-8698-e35aaa8c05e4 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:03.576189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Transition to ACTIVE for port object 536e922d-541b-4e72-8698-e35aaa8c05e4 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:03.606644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.613471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-49a02ef4-b387-489a-adfe-450b00c75faa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:03.647213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.1 (4163e171-8af6-446b-b467-ad2dbcca11e9/f180fd7c-f692-4581-ab7e-4760fe2559bb/15bbb874-6f67-4b68-b31e-276bef86a856) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:58:03.691744 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:58:03.693219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Pushing event updated for resources: {'Port': ['ID=536e922d-541b-4e72-8698-e35aaa8c05e4,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:03.696691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:03.699685 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:58:03.702474 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:03.815195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:00Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:03.818786 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.819698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Attempting to bind port 536e922d-541b-4e72-8698-e35aaa8c05e4 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:58:03.820102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Attempting to bind port 536e922d-541b-4e72-8698-e35aaa8c05e4 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:58:03.820468 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Attempting to bind port 536e922d-541b-4e72-8698-e35aaa8c05e4 on network 4163e171-8af6-446b-b467-ad2dbcca11e9 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:58:03.826126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4783dd4-8ae4-4215-9599-afa17727a512 None None] The sync data for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv is: [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:00Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:58:03.828147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.833309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 58, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:58:03.833686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Checking segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:58:03.834098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.834499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Bound using segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:58:03.835059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Bound port: 536e922d-541b-4e72-8698-e35aaa8c05e4, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:58:03.835324 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.839185 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object 15bbb874-6f67-4b68-b31e-276bef86a856 will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:03.865895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.871401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-cbb40d49-89c0-48f4-a6d7-0ab3dda2e104 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:03.936922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] For port 536e922d-541b-4e72-8698-e35aaa8c05e4, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:58:03.941055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] For port 536e922d-541b-4e72-8698-e35aaa8c05e4, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=536e922d-541b-4e72-8698-e35aaa8c05e4,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:58:03.946756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:03.948377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:58:03.951339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:03.952297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:03.954823 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:58:03.986451 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=15bbb874-6f67-4b68-b31e-276bef86a856,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:03.989342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:04.036778 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.037334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Pushing event updated for resources: {'Port': ['ID=536e922d-541b-4e72-8698-e35aaa8c05e4,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:04.043472 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:04.171057 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.267639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c182f290-e8d3-4699-9bdf-86cb07d770be up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:04.365432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c182f290-e8d3-4699-9bdf-86cb07d770be completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:04.372566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c182f290-e8d3-4699-9bdf-86cb07d770be triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:04.373038 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.525649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.544786 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port c182f290-e8d3-4699-9bdf-86cb07d770be, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c182f290-e8d3-4699-9bdf-86cb07d770be,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:58:04.549145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.551185 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:04.623672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=c182f290-e8d3-4699-9bdf-86cb07d770be,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:04.626703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:04.815631 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.820569 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:04.846127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0e4068a4-1b14-47b3-9cda-fa00dbe095e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:04.936808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=15bbb874-6f67-4b68-b31e-276bef86a856,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:04.939741 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:04.943055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:05.091645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:58:05.092796 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:05.097344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5513f68a-5db4-4406-bd64-85235d00b356 None None] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 14:58:05.214389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-fca7beba-ba96-451c-8062-3bff5d6c435b None None] Provisioning for port 536e922d-541b-4e72-8698-e35aaa8c05e4 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:05.491787 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 63d26344-337f-432c-99bf-fb1f3789f059 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:58:05.583986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c8cd1cca-1643-4e61-8482-101ac4074f58 None None] Provisioning for port 15bbb874-6f67-4b68-b31e-276bef86a856 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:05.590977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c8cd1cca-1643-4e61-8482-101ac4074f58 None None] Provisioning complete for port 15bbb874-6f67-4b68-b31e-276bef86a856 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:05.591677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c8cd1cca-1643-4e61-8482-101ac4074f58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:05.650249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-c8cd1cca-1643-4e61-8482-101ac4074f58 None None] Port 15bbb874-6f67-4b68-b31e-276bef86a856 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:58:05.720544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:58:05.734245 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-1eb0e9e4-690b-41a5-9dfb-0f93d3de6194 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/63d26344-337f-432c-99bf-fb1f3789f059/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4917603 Nov 24 14:58:05.782410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8a400462-8b2c-4d8a-9936-6abe09c703eb None None] Provisioning complete for port 15bbb874-6f67-4b68-b31e-276bef86a856 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:05.782410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8a400462-8b2c-4d8a-9936-6abe09c703eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:05.841738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8a400462-8b2c-4d8a-9936-6abe09c703eb None None] Port 15bbb874-6f67-4b68-b31e-276bef86a856 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:58:05.921600 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b70f4701-ea89-4c25-8913-d8c1097c6c14 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1792375052&fields=id&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 267 time: 0.0445814 Nov 24 14:58:05.951225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5b67d831-e8e9-4c0a-864f-232f6d54efec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:05.968398 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5f5e4ea7-9901-4af7-8ff7-465e2ac24f92 None None] Provisioning complete for port 15bbb874-6f67-4b68-b31e-276bef86a856 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:05.968779 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5f5e4ea7-9901-4af7-8ff7-465e2ac24f92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:06.021301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-5f5e4ea7-9901-4af7-8ff7-465e2ac24f92 None None] Port 15bbb874-6f67-4b68-b31e-276bef86a856 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:58:06.074006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f340ac-434f-480c-b1b8-cab5e915453b req-e85faae0-fe98-4480-a07c-e0a1197e6c3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:06.075449 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-e85faae0-fe98-4480-a07c-e0a1197e6c3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 797 time: 0.1475501 Nov 24 14:58:06.095541 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-40c6c506-ef46-4a81-9cf6-484289a53ccd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/quotas/9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 375 time: 0.0136251 Nov 24 14:58:06.181062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-62f340ac-434f-480c-b1b8-cab5e915453b req-ec95ea45-8183-4525-84fe-0ff14f70235d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:58:06.196963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-62f340ac-434f-480c-b1b8-cab5e915453b req-ec95ea45-8183-4525-84fe-0ff14f70235d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:58:06.198294 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-ec95ea45-8183-4525-84fe-0ff14f70235d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0977347 Nov 24 14:58:06.290491 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-6c83af64-5c9f-45a5-bf65-b6752c3410b4 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 14:58:06.291478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-6c83af64-5c9f-45a5-bf65-b6752c3410b4 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0818684 Nov 24 14:58:06.298776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 536e922d-541b-4e72-8698-e35aaa8c05e4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:06.420573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 536e922d-541b-4e72-8698-e35aaa8c05e4 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:06.425412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 536e922d-541b-4e72-8698-e35aaa8c05e4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:06.425794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:06.433549 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-a4636d1d-a402-4d5b-a2fc-e8a657490c14 service neutron] 10.222.0.70 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1354034 Nov 24 14:58:06.548251 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:06.592318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 536e922d-541b-4e72-8698-e35aaa8c05e4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=536e922d-541b-4e72-8698-e35aaa8c05e4,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:58:06.596622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:06.597530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c182f290-e8d3-4699-9bdf-86cb07d770be up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:06.621868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:06.686374 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-7b1ef4c8-67d4-43a1-90c3-e1fe1c96c172 service neutron] 10.222.0.70 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2467580 Nov 24 14:58:06.715098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=536e922d-541b-4e72-8698-e35aaa8c05e4,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:06.718617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:06.730151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c182f290-e8d3-4699-9bdf-86cb07d770be triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:06.730532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:06.896324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b0479310-3d2f-4293-b496-30b9bcfbaf5d req-628421b0-752a-477c-9fa1-ddfd47eb8da9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:58:06.910229 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-b0479310-3d2f-4293-b496-30b9bcfbaf5d req-628421b0-752a-477c-9fa1-ddfd47eb8da9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:58:06.911580 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b0479310-3d2f-4293-b496-30b9bcfbaf5d req-628421b0-752a-477c-9fa1-ddfd47eb8da9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 210 time: 0.0608208 Nov 24 14:58:07.009587 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:07.454211 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Sync routers for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:58:07.466848 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:58:07.467459 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:07.645924 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:58:07.985955 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 2, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:07.990809 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Checking router: 63d26344-337f-432c-99bf-fb1f3789f059 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:58:07.991252 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Updating router 63d26344-337f-432c-99bf-fb1f3789f059 port 15bbb874-6f67-4b68-b31e-276bef86a856 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 14:58:08.053709 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.094893 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-225954d5-dbe3-4e49-98a4-0128c23d2769 req-ef2673a0-3a4e-46be-9498-12acb19b5a6e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 210 time: 0.0539200 Nov 24 14:58:08.151725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f340ac-434f-480c-b1b8-cab5e915453b req-a8b9d796-ef44-4544-ac2f-ab28f23bc634 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:08.153354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-a8b9d796-ef44-4544-ac2f-ab28f23bc634 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 797 time: 0.2172227 Nov 24 14:58:08.219931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-41dc8b44-9c58-4f73-bf26-01d29bb6cca3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 380 time: 0.0509994 Nov 24 14:58:08.227389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 536e922d-541b-4e72-8698-e35aaa8c05e4 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:08.231117 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'port': {'device_id': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'admin_state_up': True, 'tenant_id': '9482331cd77d4af992b911b12f253611', 'security_groups': ['16bbcbed-c693-4b1e-acfb-4f7e3b80a29d']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:58:08.324559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 536e922d-541b-4e72-8698-e35aaa8c05e4 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:08.324937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.390486 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:58:08.400485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:58:08.411693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 14:58:08.415059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.437660 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.453266 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Transition to ACTIVE for port object 15bbb874-6f67-4b68-b31e-276bef86a856 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:08.460555 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.472399 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-a5b1eb64-8b4c-4007-a339-12a295868db0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:08.589131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.9 (4163e171-8af6-446b-b467-ad2dbcca11e9/f180fd7c-f692-4581-ab7e-4760fe2559bb/c66b06e7-aaa5-420a-8ca5-95047e131d97) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:58:08.681172 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Pushing event updated for resources: {'Port': ['ID=15bbb874-6f67-4b68-b31e-276bef86a856,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:08.690844 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.691379 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.691718 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.692066 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.692390 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.692705 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.693513 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.693827 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.694299 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.694661 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.694916 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 14:58:08.705792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.708138 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:08.718779 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Attempting to bind port 15bbb874-6f67-4b68-b31e-276bef86a856 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:58:08.719146 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Attempting to bind port 15bbb874-6f67-4b68-b31e-276bef86a856 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:58:08.719507 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Attempting to bind port 15bbb874-6f67-4b68-b31e-276bef86a856 on network 4163e171-8af6-446b-b467-ad2dbcca11e9 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:58:08.725939 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 58, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:58:08.726308 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Checking segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:58:08.726707 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.727609 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Bound using segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:58:08.728248 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Bound port: 15bbb874-6f67-4b68-b31e-276bef86a856, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:58:08.728625 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.818770 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.819335 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] For port 15bbb874-6f67-4b68-b31e-276bef86a856, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:58:08.823092 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] For port 15bbb874-6f67-4b68-b31e-276bef86a856, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=15bbb874-6f67-4b68-b31e-276bef86a856,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:58:08.827796 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.832095 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:08.838507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object c66b06e7-aaa5-420a-8ca5-95047e131d97 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:08.860803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:08.866514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8c91e513-091f-400a-977a-3929b9f9e9c9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:08.913934 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Pushing event updated for resources: {'Port': ['ID=15bbb874-6f67-4b68-b31e-276bef86a856,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:08.917246 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:58:08.917863 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:08.926520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:58:08.931862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:08.936842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:58:08.991530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=c66b06e7-aaa5-420a-8ca5-95047e131d97,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:09.001608 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:09.001949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:09.025899 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:09.026746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:09.054347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8285787 Nov 24 14:58:09.066990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Request body: {'port': {'device_id': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:58:09.146086 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:58:09.224064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:09.338039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-935b079f-3325-454f-90cd-771d6bb01823 None None] Provisioning for port c66b06e7-aaa5-420a-8ca5-95047e131d97 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:09.346356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-935b079f-3325-454f-90cd-771d6bb01823 None None] Provisioning complete for port c66b06e7-aaa5-420a-8ca5-95047e131d97 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:09.346609 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8af9cb7d-c917-4194-86bc-a2f1d7bc6cc5 req-6ae8001c-267e-46f3-a99a-75a331403b49 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:09.347566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-935b079f-3325-454f-90cd-771d6bb01823 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:09.354077 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8af9cb7d-c917-4194-86bc-a2f1d7bc6cc5 req-6ae8001c-267e-46f3-a99a-75a331403b49 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 931 time: 0.1036570 Nov 24 14:58:09.403437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-8af9cb7d-c917-4194-86bc-a2f1d7bc6cc5 req-45436586-f986-4d38-a5dc-4431e3b03790 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:58:09.420543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-935b079f-3325-454f-90cd-771d6bb01823 None None] Port c66b06e7-aaa5-420a-8ca5-95047e131d97 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 14:58:09.424885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-8af9cb7d-c917-4194-86bc-a2f1d7bc6cc5 req-45436586-f986-4d38-a5dc-4431e3b03790 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:58:09.426996 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8af9cb7d-c917-4194-86bc-a2f1d7bc6cc5 req-45436586-f986-4d38-a5dc-4431e3b03790 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0711834 Nov 24 14:58:09.545885 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:08Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:09.550005 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb600ea-6da8-4d6e-a106-7666c11c7028 None None] The sync data for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv is: [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:08Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:58:09.676912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c66b06e7-aaa5-420a-8ca5-95047e131d97 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:58:09.685283 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:09.701939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Transition to ACTIVE for port object c66b06e7-aaa5-420a-8ca5-95047e131d97 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 14:58:09.706333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:09.710620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-18f77556-357e-4b79-8a5f-bee23f16fdc7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:09.840976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Pushing event updated for resources: {'Port': ['ID=c66b06e7-aaa5-420a-8ca5-95047e131d97,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:09.844614 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:09.962670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Attempting to bind port c66b06e7-aaa5-420a-8ca5-95047e131d97 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 14:58:09.963006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Attempting to bind port c66b06e7-aaa5-420a-8ca5-95047e131d97 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 14:58:09.963329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Attempting to bind port c66b06e7-aaa5-420a-8ca5-95047e131d97 on network 4163e171-8af6-446b-b467-ad2dbcca11e9 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:58:09.969691 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Port c66b06e7-aaa5-420a-8ca5-95047e131d97 on network 4163e171-8af6-446b-b467-ad2dbcca11e9 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 14:58:09.970010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Attempting to bind port c66b06e7-aaa5-420a-8ca5-95047e131d97 on network 4163e171-8af6-446b-b467-ad2dbcca11e9 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 14:58:09.976543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 14, 57, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 14:58:09.976908 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Checking segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 14:58:09.977289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Bound using segment: {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 14:58:09.977708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Bound port: c66b06e7-aaa5-420a-8ca5-95047e131d97, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 14:58:09.978055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:10.074555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] For port c66b06e7-aaa5-420a-8ca5-95047e131d97, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 14:58:10.077909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] For port c66b06e7-aaa5-420a-8ca5-95047e131d97, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 14:58:10.083547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:10.087701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c0b2f40f-908a-460c-bd5c-c2e1597bd768 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:10.144896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:10.146445 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] 10.222.0.47 "PUT /v2.0/ports/c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 1093 time: 1.0838366 Nov 24 14:58:10.147015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:58:10.175410 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Pushing event updated for resources: {'Port': ['ID=c66b06e7-aaa5-420a-8ca5-95047e131d97,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:10.177530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:10.259462 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'status': 'completed', 'code': 200} Nov 24 14:58:10.281955 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 15bbb874-6f67-4b68-b31e-276bef86a856 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:10.377219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 15bbb874-6f67-4b68-b31e-276bef86a856 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:10.384290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 15bbb874-6f67-4b68-b31e-276bef86a856 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:10.384897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:10.445441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-47f2febb-be33-4133-8969-d40f600175ae service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1096 time: 0.2504296 Nov 24 14:58:10.519795 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-f4951230-0c48-4c7e-b032-4187401f864f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 217 time: 0.0673652 Nov 24 14:58:10.530143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:10.565617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 15bbb874-6f67-4b68-b31e-276bef86a856, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=15bbb874-6f67-4b68-b31e-276bef86a856,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:58:10.570531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:10.573428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-5140f1bd-e8db-4100-83af-1e5bc3c1f4c7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:10.599556 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f340ac-434f-480c-b1b8-cab5e915453b req-32e03a29-3bab-44dd-8f26-35a1b2062650 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:10.601516 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-32e03a29-3bab-44dd-8f26-35a1b2062650 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0751452 Nov 24 14:58:10.642865 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=15bbb874-6f67-4b68-b31e-276bef86a856,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:10.646356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:10.671055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f41abb-f722-465e-a991-520e63649177 req-192a7e43-6666-422e-b791-eb23e96cbfb9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:10.672597 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e6f41abb-f722-465e-a991-520e63649177 req-192a7e43-6666-422e-b791-eb23e96cbfb9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 943 time: 0.0888426 Nov 24 14:58:10.682149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-14643bfd-dec6-4ad2-a066-2cd54d9a94b6 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0736980 Nov 24 14:58:10.719671 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e6f41abb-f722-465e-a991-520e63649177 req-6e5d8d98-7dc5-4793-8973-724ea52d1ca9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410333 Nov 24 14:58:10.814668 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-fdf943f1-560e-41ab-bf9d-563f6908753d service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262300 Nov 24 14:58:10.946091 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-62f340ac-434f-480c-b1b8-cab5e915453b req-e56b6313-ffc8-4bfe-bff4-416ec81f21b2 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247580 Nov 24 14:58:11.071485 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-c2298774-b76e-4dbf-a342-074c8f6696c1 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1096 time: 0.0729146 Nov 24 14:58:11.203134 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-a132b427-9c31-457a-b177-ec57063c623b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:11.204481 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-a132b427-9c31-457a-b177-ec57063c623b service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1273315 Nov 24 14:58:11.282263 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-7e91a60d-f6c8-4c0a-bc93-0bfee7d81a4a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 217 time: 0.0714350 Nov 24 14:58:11.347608 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-e95ad6ca-0e26-41c4-a11b-940e7b93fad6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:11.349106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-e95ad6ca-0e26-41c4-a11b-940e7b93fad6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0608094 Nov 24 14:58:11.422289 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-86f2029e-7d11-4c9e-aa64-cd3f361a99d8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0672033 Nov 24 14:58:11.556558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-d29b44e1-b83a-4125-8181-71cbf49c4acb service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280916 Nov 24 14:58:11.690498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-665960ce-02ab-4e94-b5d2-9decdda44d14 req-ca0a8d85-4233-48c7-a838-508f68a00eff service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271236 Nov 24 14:58:11.918625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b98d24-4d24-4394-b48a-27666d7001ee req-ba3a2d8f-318c-4b14-ae7e-2ac7cbc70962 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:11.919314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f4b98d24-4d24-4394-b48a-27666d7001ee req-ba3a2d8f-318c-4b14-ae7e-2ac7cbc70962 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 14:58:11.936047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-f4b98d24-4d24-4394-b48a-27666d7001ee req-ba3a2d8f-318c-4b14-ae7e-2ac7cbc70962 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 14:58:11.937230 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f4b98d24-4d24-4394-b48a-27666d7001ee req-ba3a2d8f-318c-4b14-ae7e-2ac7cbc70962 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 943 time: 0.0945692 Nov 24 14:58:11.989280 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f4b98d24-4d24-4394-b48a-27666d7001ee req-8f26208a-06c7-4c91-af04-73d3b7e95b12 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459020 Nov 24 14:58:12.220598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 15bbb874-6f67-4b68-b31e-276bef86a856 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:12.299611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 15bbb874-6f67-4b68-b31e-276bef86a856 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:12.300044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:13.192278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad5e7be-af35-42d0-9bf8-aea7f5382387 req-16531d63-2a6d-4da0-b26f-0047b2261262 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:13.193653 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cad5e7be-af35-42d0-9bf8-aea7f5382387 req-16531d63-2a6d-4da0-b26f-0047b2261262 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 943 time: 0.0834429 Nov 24 14:58:13.258122 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cad5e7be-af35-42d0-9bf8-aea7f5382387 req-56524c37-8162-4870-9fbf-f825a8ed7a1d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575655 Nov 24 14:58:14.029428 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device c66b06e7-aaa5-420a-8ca5-95047e131d97 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 14:58:14.167180 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port c66b06e7-aaa5-420a-8ca5-95047e131d97, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:58:14.183240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'port_id': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'mac_address': 'fa:16:3e:6e:0b:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 882, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 14:58:14.244642 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:14.263131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c66b06e7-aaa5-420a-8ca5-95047e131d97 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 14:58:14.279613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port c66b06e7-aaa5-420a-8ca5-95047e131d97, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:58:14.287390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:14.287390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:14.355516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=c66b06e7-aaa5-420a-8ca5-95047e131d97,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:14.358604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:14.475407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a8a2f1d-2ea1-4634-9389-a5c95ee1f2d8 req-094124ac-be6b-47e5-b55e-94b4852733ce tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:14.477099 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6a8a2f1d-2ea1-4634-9389-a5c95ee1f2d8 req-094124ac-be6b-47e5-b55e-94b4852733ce tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 944 time: 0.0839477 Nov 24 14:58:14.527019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6a8a2f1d-2ea1-4634-9389-a5c95ee1f2d8 req-5f1e8caf-78c5-4401-9c4c-d07c4d0f19db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442560 Nov 24 14:58:14.651044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['c66b06e7-aaa5-420a-8ca5-95047e131d97'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 14:58:15.725870 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e781b2-5f18-42a3-84b4-1f24db34ebc9 req-34c38500-d90c-4e67-8496-cdefcd7adefe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:15.727309 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-15e781b2-5f18-42a3-84b4-1f24db34ebc9 req-34c38500-d90c-4e67-8496-cdefcd7adefe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 944 time: 0.0765049 Nov 24 14:58:15.775106 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-15e781b2-5f18-42a3-84b4-1f24db34ebc9 req-05f4c031-8917-490c-9f6d-90af5bfbf40e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419481 Nov 24 14:58:16.033795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device c66b06e7-aaa5-420a-8ca5-95047e131d97 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 14:58:16.139559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port c66b06e7-aaa5-420a-8ca5-95047e131d97 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 14:58:16.144105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port c66b06e7-aaa5-420a-8ca5-95047e131d97 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 14:58:16.144483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:16.255700 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:16.283309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:58:16.293656 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port c66b06e7-aaa5-420a-8ca5-95047e131d97, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 14:58:16.297555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:16.299537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:16.342732 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'code': 200} Nov 24 14:58:16.368140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=c66b06e7-aaa5-420a-8ca5-95047e131d97,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:16.371058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:16.568624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3c437992-baf0-4491-9a4e-5ed6fef4e70f req-e4054bfb-d126-4ec9-b98b-e04b9bc03cfc service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.0725901 Nov 24 14:58:16.611604 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3c437992-baf0-4491-9a4e-5ed6fef4e70f req-e466947f-2a10-459e-8792-0e7533b5454f service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364254 Nov 24 14:58:16.863107 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:58:16.979563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30da34f-dde4-4dfd-b658-8f5fb00e9d14 req-ec56a1dc-d5ff-417b-a914-36ef56a22a7c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:16.981031 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e30da34f-dde4-4dfd-b658-8f5fb00e9d14 req-ec56a1dc-d5ff-417b-a914-36ef56a22a7c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0838029 Nov 24 14:58:17.031489 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e30da34f-dde4-4dfd-b658-8f5fb00e9d14 req-b3921a2c-5c5d-46ac-b918-9eb1d5591069 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449026 Nov 24 14:58:18.234682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060945a7-acc5-4bc4-9f65-812b5b078843 req-a032bb29-25f7-41a0-9686-3beb599d9d7b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:18.236146 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-060945a7-acc5-4bc4-9f65-812b5b078843 req-a032bb29-25f7-41a0-9686-3beb599d9d7b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0787544 Nov 24 14:58:18.283472 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-060945a7-acc5-4bc4-9f65-812b5b078843 req-273df5e1-59e6-4175-9fa9-90ff4fa4d770 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418127 Nov 24 14:58:18.444328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:18.484513 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3adc2298-d40c-43bd-a251-14663a48f048 req-1de8c5c1-74e0-419a-a3f2-539abb516a82 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:18.486039 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3adc2298-d40c-43bd-a251-14663a48f048 req-1de8c5c1-74e0-419a-a3f2-539abb516a82 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0788722 Nov 24 14:58:18.532095 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3adc2298-d40c-43bd-a251-14663a48f048 req-a4b54c9f-6a54-42ba-8e90-0acea4fd9ce6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405591 Nov 24 14:58:18.560156 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54452) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:18.752622 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a5614a5c-1802-4289-927d-3e6e474a30d8 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1093 time: 0.1911495 Nov 24 14:58:18.755113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54456) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:18.761042 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address': '172.20.0.9'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 14:58:18.766865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 14:58:18.770694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:floatingip and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 14:58:18.773604 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 14:58:18.779281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 14:58:18.789546 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:18.924882 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:19.069805 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.58 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/ff08b030-4371-4e8a-8573-33b52480eed6) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 14:58:19.222263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:19.252316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:19.256194 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d2f5c185-8baa-4b67-b8c6-1082e276c553 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:19.314389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 14:58:19.321952 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 14:58:19.326034 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 14:58:19.359005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=ff08b030-4371-4e8a-8573-33b52480eed6,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:19.365031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:19.863723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:19.919918 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:20.122743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:20.127108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:20.130561 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-961ca95c-b453-4711-ad9f-ccdd2223aa0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 14:58:20.232533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=ff08b030-4371-4e8a-8573-33b52480eed6,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 14:58:20.236584 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 14:58:20.252316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:20.562315 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.l3_db [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Floating IP b0f24fb6-be74-4c5e-b0a4-cdda97fab095 associated. External IP: 172.26.4.58, port: c66b06e7-aaa5-420a-8ca5-95047e131d97. Nov 24 14:58:20.960139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 63d26344-337f-432c-99bf-fb1f3789f059 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 14:58:21.171750 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 14:58:21.182411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] Sync routers for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 14:58:21.196339 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:58:21.197025 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:21.197209 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:21.261606 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-005afc1f-c4e3-4144-a224-a9710d74907d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.5053110 Nov 24 14:58:21.262162 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 14:58:21.323152 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'status': 'completed', 'code': 200} Nov 24 14:58:21.383609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:58:21.534609 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-75963b24-7efc-4b87-adbc-efc1c9877847 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.1895568 Nov 24 14:58:21.732423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-0382e459-d2a0-4c82-a19a-e5b8030962a7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:21.733886 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-0382e459-d2a0-4c82-a19a-e5b8030962a7 service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1918919 Nov 24 14:58:21.743378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f63f0aeb-b0ab-40cf-ac4a-d3ecac750782 req-1eb92fc7-af2f-49fa-bf17-22a80a0f732c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:21.744814 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f63f0aeb-b0ab-40cf-ac4a-d3ecac750782 req-1eb92fc7-af2f-49fa-bf17-22a80a0f732c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.2538905 Nov 24 14:58:21.747401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'b0f24fb6-be74-4c5e-b0a4-cdda97fab095', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.58', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'port_id': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'mac_address': 'fa:16:3e:6e:0b:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:58:19Z', 'updated_at': '2021-11-24T14:58:19Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:21.752081 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] Checking router: 63d26344-337f-432c-99bf-fb1f3789f059 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 14:58:21.763377 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 14:58:21.763986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T14:58:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:21.873218 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f63f0aeb-b0ab-40cf-ac4a-d3ecac750782 req-087353d5-bb1f-4789-a09e-0445a520b820 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782325 Nov 24 14:58:21.875202 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-8a10609a-a973-46d1-a79b-04ae6916275c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 998 time: 0.1295257 Nov 24 14:58:21.902284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54466) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:21.943436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-5f2ff18f-bff9-40f6-b83b-76e193cc124a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:21.943829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 14:58:21.945227 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-5f2ff18f-bff9-40f6-b83b-76e193cc124a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0636959 Nov 24 14:58:22.010633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-eaed255d-a011-4800-865d-d970b17db653 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 990 time: 0.1070948 Nov 24 14:58:22.023408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-36f7a3a6-f56e-481e-93a6-0518570796e2 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0719080 Nov 24 14:58:22.167468 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-efe6d1cb-f292-4f55-ac42-e4272571511b service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1374378 Nov 24 14:58:22.315921 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b7b61d37-7d69-4f71-8023-326e31e4e69e req-c5ab43d8-765b-4ff2-9f24-cb4713408d2f service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1417239 Nov 24 14:58:22.324808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'b0f24fb6-be74-4c5e-b0a4-cdda97fab095', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.58', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'port_id': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'mac_address': 'fa:16:3e:6e:0b:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:58:19Z', 'updated_at': '2021-11-24T14:58:19Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 14:58:22.329032 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dc22b1c-0287-4513-8ffb-36e6910ff798 None None] The sync data for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv is: [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': 'b0f24fb6-be74-4c5e-b0a4-cdda97fab095', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.58', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'port_id': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'mac_address': 'fa:16:3e:6e:0b:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T14:58:19Z', 'updated_at': '2021-11-24T14:58:19Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 14:58:23.014614 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54470) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:23.121132 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-722f8bd9-1158-4d34-9d35-5afd966b2d4d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 990 time: 0.1052220 Nov 24 14:58:24.125040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54474) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:24.230775 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fa50db9c-24e9-4dbd-a073-0434353bbb3b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 990 time: 0.1042144 Nov 24 14:58:24.893874 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-f4223000-2a33-438f-ac61-58522fd36956 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0760913 Nov 24 14:58:25.030336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-bf32e5d7-9a87-4421-bc65-f1e018de2503 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.0681522 Nov 24 14:58:25.172874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-ca38114c-730c-4534-b014-93e7650545b2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:25.174240 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-ca38114c-730c-4534-b014-93e7650545b2 service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1250732 Nov 24 14:58:25.233490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54478) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:25.370985 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-d38859b3-4736-4975-9648-390e25ec0f8c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 998 time: 0.1901898 Nov 24 14:58:25.378839 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1613dd72-1277-4e80-94d2-2bb83dd89908 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 990 time: 0.1442094 Nov 24 14:58:25.437874 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60f253b2-2189-473a-9bc1-a676cc2e9852 None None] New status for floating IP b0f24fb6-be74-4c5e-b0a4-cdda97fab095: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 14:58:25.439877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-22080b62-4fd2-4064-91b3-523d232a918c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:58:25.441336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-22080b62-4fd2-4064-91b3-523d232a918c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0615411 Nov 24 14:58:25.629226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-99d13a3b-d88f-46ae-a32a-c4eebd00fa32 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1811080 Nov 24 14:58:25.764470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-9603e6a3-cec3-47b2-82a5-331bddf477e8 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1290815 Nov 24 14:58:25.897009 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f1a82f7-74f6-42fa-a9b2-3201582118bd req-291f1eab-af18-426b-9eef-e982a05231c8 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269662 Nov 24 14:58:26.383461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54482) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:58:26.495690 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-402d01ae-a5b4-4313-83d2-93da8ecf8746 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 992 time: 0.1108813 Nov 24 14:58:33.401994 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-901df71b-1bc6-4df7-87df-ef4853200817 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:33.791325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:35.944877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-bb3e798e-d1a3-463e-b6be-bd667407e91b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:37.011158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:38.709380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:48.438090 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:58:53.865904 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:59:03.395640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5bc68ef8-e234-4189-bb75-7c6ce3394287 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:03.783843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:05.947140 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5753ec31-1040-460f-9a96-91ab329e1c2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:07.014866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:08.711276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:18.459875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:24.977387 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-f83cfbaa-8ea4-490c-9f57-c6bff175da60 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1713021 Nov 24 14:59:25.175988 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-05c65dc7-0fab-40b9-85c5-b5ca52ffade6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.1188450 Nov 24 14:59:25.345123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0b392a-a903-4a5c-b715-215934866155 req-22eb1239-b840-4532-8898-d8952b427ab9 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:25.346595 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-22eb1239-b840-4532-8898-d8952b427ab9 service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1487164 Nov 24 14:59:25.471502 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-920ac07e-62b7-4bd7-95b4-0680551f7b1b service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 1000 time: 0.1177316 Nov 24 14:59:25.548230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0b392a-a903-4a5c-b715-215934866155 req-b0f335c6-8826-4504-80e8-67ca65afd9ee service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:25.549909 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-b0f335c6-8826-4504-80e8-67ca65afd9ee service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0719407 Nov 24 14:59:25.635283 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-20381838-d7ae-4663-b6e1-d81cd965e6be service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0767210 Nov 24 14:59:25.788891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-3d796b96-1edd-4b87-b51b-6484d3e06070 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1464963 Nov 24 14:59:25.953244 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dc0b392a-a903-4a5c-b715-215934866155 req-3907165c-3b5c-408a-800b-e2f4564357c4 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1577635 Nov 24 14:59:30.867667 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 14:59:33.452220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7bc4b82b-b22f-4a61-acf7-82fdd05f21c7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:33.795630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:34.014762 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b11b1fb-2b19-4e63-b459-d1534e12d124 req-88966fa6-ab78-4437-a1a3-9c99cf1562ce tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:34.016348 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2b11b1fb-2b19-4e63-b459-d1534e12d124 req-88966fa6-ab78-4437-a1a3-9c99cf1562ce tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.2328990 Nov 24 14:59:34.069163 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2b11b1fb-2b19-4e63-b459-d1534e12d124 req-008eee94-4927-42c0-9b30-9cc3da634d03 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465932 Nov 24 14:59:35.310747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c30ae16-edd0-474f-8e1a-adcadbd66557 req-4141d45c-acfb-4766-998b-03a3f308cc33 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:35.312476 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30ae16-edd0-474f-8e1a-adcadbd66557 req-4141d45c-acfb-4766-998b-03a3f308cc33 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0949681 Nov 24 14:59:35.370167 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c30ae16-edd0-474f-8e1a-adcadbd66557 req-55d08a46-1f1f-4224-b6a9-d09e39e58765 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505109 Nov 24 14:59:35.952178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2286aea8-b423-4c8b-bc25-74683d137eb0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:36.602128 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7253229-85d3-4639-befc-3727496bd7f9 req-bbc6e959-3a52-42ab-870e-d4c6572f4c87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:36.603633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e7253229-85d3-4639-befc-3727496bd7f9 req-bbc6e959-3a52-42ab-870e-d4c6572f4c87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0881374 Nov 24 14:59:36.653853 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e7253229-85d3-4639-befc-3727496bd7f9 req-ecfbdd2e-8ed1-4334-a472-4c07d9043ff6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444922 Nov 24 14:59:37.019854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:37.871885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4402db1-8205-4b4e-b415-ba7cc8695362 req-f17c3822-36e2-4809-a1ee-19eadf0954b5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:37.873352 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4402db1-8205-4b4e-b415-ba7cc8695362 req-f17c3822-36e2-4809-a1ee-19eadf0954b5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0842571 Nov 24 14:59:37.922117 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4402db1-8205-4b4e-b415-ba7cc8695362 req-9a578148-0360-4296-9d7d-562159748d61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431614 Nov 24 14:59:38.713491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:39.152484 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a735124e-f08f-44d8-b348-6ad0bb5eb287 req-cb550e69-2972-403a-82b2-2d87025b28a4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:39.154238 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a735124e-f08f-44d8-b348-6ad0bb5eb287 req-cb550e69-2972-403a-82b2-2d87025b28a4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0944064 Nov 24 14:59:39.210046 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a735124e-f08f-44d8-b348-6ad0bb5eb287 req-8df62871-1c9a-419a-9d8c-0015e11af245 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494254 Nov 24 14:59:40.736546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d24e6c-5562-4563-86b4-24ed00ec28b6 req-76e53bd9-e048-4cf0-868e-34a50a905b3c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:40.737915 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4d24e6c-5562-4563-86b4-24ed00ec28b6 req-76e53bd9-e048-4cf0-868e-34a50a905b3c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0846555 Nov 24 14:59:40.790231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b4d24e6c-5562-4563-86b4-24ed00ec28b6 req-db1bac27-d39a-4fa5-9d50-b3226a76dd6c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448830 Nov 24 14:59:42.179562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e7ffe5-4733-495e-a533-075805862a78 req-cfa902bc-9952-48b8-b9c5-399d356b0b87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:42.181091 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-12e7ffe5-4733-495e-a533-075805862a78 req-cfa902bc-9952-48b8-b9c5-399d356b0b87 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0831447 Nov 24 14:59:42.235657 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-12e7ffe5-4733-495e-a533-075805862a78 req-4e86ab59-847b-4789-8b04-f4ad458a6de3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489516 Nov 24 14:59:43.457528 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aac728a5-5867-432c-b277-c240ab9ef19c req-8acd7bab-8e9b-45a8-98b1-5520d44691fa tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:43.459110 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aac728a5-5867-432c-b277-c240ab9ef19c req-8acd7bab-8e9b-45a8-98b1-5520d44691fa tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0889030 Nov 24 14:59:43.508466 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aac728a5-5867-432c-b277-c240ab9ef19c req-34659f62-94cb-476c-93bd-9211a9d841bc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438664 Nov 24 14:59:44.723297 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e22b138-1c4b-4724-8bb7-37be8b39cf57 req-3c320b1e-c3b3-4887-9f8c-5bbfab7f45f8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:44.725356 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4e22b138-1c4b-4724-8bb7-37be8b39cf57 req-3c320b1e-c3b3-4887-9f8c-5bbfab7f45f8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0843520 Nov 24 14:59:44.775606 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4e22b138-1c4b-4724-8bb7-37be8b39cf57 req-5854b806-da2b-4bda-a22b-8e03e9f994d0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445883 Nov 24 14:59:44.804815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54532) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:59:45.026201 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-4cca3c86-5e74-4940-9459-e05c67f577a4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 992 time: 0.2201099 Nov 24 14:59:46.619724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1aace9-6b13-4305-8157-805043b2500d req-7e969477-8a10-444a-9d85-265f93aa02f2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:46.621254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ee1aace9-6b13-4305-8157-805043b2500d req-7e969477-8a10-444a-9d85-265f93aa02f2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.1663671 Nov 24 14:59:46.627288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-6eaa8a37-19d5-4fd9-bf25-2195e0e6b250 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.1225600 Nov 24 14:59:46.759238 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ee1aace9-6b13-4305-8157-805043b2500d req-53d0512f-afd9-43b0-8106-397857efce64 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1307805 Nov 24 14:59:46.798267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc6705ef-5620-451b-87ba-a749a9369dab req-dda87dc6-5917-4f34-b7ab-ebe5fcb3ce0b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:46.799983 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-dda87dc6-5917-4f34-b7ab-ebe5fcb3ce0b service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1576316 Nov 24 14:59:46.917364 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-e36f1f8f-ed7c-4633-8a86-7a40e9975765 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 1000 time: 0.1108887 Nov 24 14:59:46.982344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc6705ef-5620-451b-87ba-a749a9369dab req-1336fa4b-47ce-406a-9d7a-0679bddd592e service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:46.983779 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-1336fa4b-47ce-406a-9d7a-0679bddd592e service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0607495 Nov 24 14:59:47.059751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-3c7b524f-d015-4c37-9735-efa2a5b54c1b service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0697439 Nov 24 14:59:47.198050 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-3a1c7da5-ec81-4aa9-b3ba-dd5f710c67de service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319196 Nov 24 14:59:47.329731 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc6705ef-5620-451b-87ba-a749a9369dab req-aedadfc5-61cb-4a81-9aad-5123099ff586 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259861 Nov 24 14:59:48.079979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c7144d-7f87-4382-938f-2b0f6a7ef4a8 req-4c17c7f3-43d0-40eb-8d33-0f670c9920f8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:48.081357 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-64c7144d-7f87-4382-938f-2b0f6a7ef4a8 req-4c17c7f3-43d0-40eb-8d33-0f670c9920f8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.1973443 Nov 24 14:59:48.126675 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-64c7144d-7f87-4382-938f-2b0f6a7ef4a8 req-7d808725-349f-4615-b420-85f199ea5ebb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388780 Nov 24 14:59:48.452173 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 14:59:49.331506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee24bbff-21c2-45cd-bc50-1dcd21df2568 req-991eb29e-4a96-4c62-b34a-b23d9c3375ec tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 14:59:49.333945 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ee24bbff-21c2-45cd-bc50-1dcd21df2568 req-991eb29e-4a96-4c62-b34a-b23d9c3375ec tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0816500 Nov 24 14:59:49.385942 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ee24bbff-21c2-45cd-bc50-1dcd21df2568 req-9f1135f6-130e-4da1-a27a-43468f322216 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464098 Nov 24 14:59:49.415901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54546) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 14:59:49.530295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-d65b76c7-b131-4afb-838f-34397831aed6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 200 len: 992 time: 0.1129675 Nov 24 15:00:03.397297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b1cabe67-6cb7-49b2-8872-86cc357dadb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:03.792308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:05.961701 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4897a047-2566-470a-b5ff-5375c2281b1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:07.022533 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:07.869581 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:00:08.726148 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:18.479225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:27.620143 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-8afe36ea-736c-4019-aadf-516ce8024b89 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0780127 Nov 24 15:00:27.766027 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-5ec02f90-0641-4634-9cfc-dff72a754c0e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.0733006 Nov 24 15:00:27.914467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d81f45-75ea-4a1d-99da-233480dedddd req-aa2b81aa-7ca7-454d-9ccc-72ed504f6a12 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:27.915831 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-aa2b81aa-7ca7-454d-9ccc-72ed504f6a12 service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1299887 Nov 24 15:00:28.020789 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-5fdf1c7b-50c0-48ab-a782-8f1ab56525af service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 1000 time: 0.0981956 Nov 24 15:00:28.085256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d81f45-75ea-4a1d-99da-233480dedddd req-04b0f785-607d-40b1-853a-fa1f50a7b60f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:28.086688 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-04b0f785-607d-40b1-853a-fa1f50a7b60f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0599794 Nov 24 15:00:28.168342 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-8b382be6-55fb-441a-ad6e-ed246b1d1d6a service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0747759 Nov 24 15:00:28.408854 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-8441078c-dcba-4ee3-80d6-f4d6a58e8471 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2343743 Nov 24 15:00:28.541340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-50d81f45-75ea-4a1d-99da-233480dedddd req-545b2dc4-3315-4b2b-9f17-98db81f27754 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1261935 Nov 24 15:00:33.401162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-423dee44-5d5c-443f-8477-858c5dc7f009 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:33.787783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:35.954795 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b91b8e8d-e6d4-49b2-84c3-4ee99f33b57c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:37.025312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:38.719748 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:44.510903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54590) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:44.728224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port ff08b030-4371-4e8a-8573-33b52480eed6 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:00:44.728566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:44.869773 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:00:44.895212 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:44.895518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:45.016131 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for ff08b030-4371-4e8a-8573-33b52480eed6 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:00:45.179849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:45.183694 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9b9efe4a-7d31-4ec6-85da-d687292b07d2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:45.225379 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=ff08b030-4371-4e8a-8573-33b52480eed6,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:45.264607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.264995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.265374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.265747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.266115 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.266485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.266848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.267214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.267574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.267972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.268584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:45.275362 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:45.333161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:45.772808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 63d26344-337f-432c-99bf-fb1f3789f059 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:00:46.149233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:00:46.161609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] Sync routers for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:00:46.171562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:46.173747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:00:46.174379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:46.226018 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/floatingips/b0f24fb6-be74-4c5e-b0a4-cdda97fab095 HTTP/1.1" status: 204 len: 168 time: 1.7140892 Nov 24 15:00:46.226784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:00:46.376320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:00:46.468702 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'status': 'completed', 'code': 200} Nov 24 15:00:46.582619 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-b540906a-a1c7-48b4-841f-11d8a3512411 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 1098 time: 0.0872285 Nov 24 15:00:46.724026 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e5c942a-5f45-4376-89d8-d36f27e322fc req-0355511c-dcba-4601-9867-4d5686b15bff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:46.725915 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0e5c942a-5f45-4376-89d8-d36f27e322fc req-0355511c-dcba-4601-9867-4d5686b15bff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0997126 Nov 24 15:00:46.746534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:46.748578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-13d08be8-12ef-490f-bfee-a6f5ed5c50d6 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:46.750144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] Checking router: 63d26344-337f-432c-99bf-fb1f3789f059 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:00:46.750596 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-13d08be8-12ef-490f-bfee-a6f5ed5c50d6 service neutron] 10.222.0.47 "GET /v2.0/networks?id=4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 200 len: 898 time: 0.1595120 Nov 24 15:00:46.762158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:00:46.762882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:46.776810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0e5c942a-5f45-4376-89d8-d36f27e322fc req-7509a180-9d23-4bba-9983-350bcf8afcaa tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444221 Nov 24 15:00:46.828857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-cab0a2a8-203f-4809-813c-7ae4d1edb87d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 200 len: 217 time: 0.0713897 Nov 24 15:00:46.897311 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-3c68a7c0-8251-4c1f-8844-610a8b788bb1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:46.898746 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-3c68a7c0-8251-4c1f-8844-610a8b788bb1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 200 len: 834 time: 0.0628028 Nov 24 15:00:46.945586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:00:46.984244 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-8422841f-c32f-4b8b-81bb-a4891b4c37b4 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=4163e171-8af6-446b-b467-ad2dbcca11e9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0786431 Nov 24 15:00:47.124104 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-04cdea64-57a3-4dcf-8ea5-baeadf31d374 service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329703 Nov 24 15:00:47.261867 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-63013cef-d0f6-4ed8-bed4-1e7ba8441b48 req-f798f04c-1526-4e09-9882-607a3aa3cd2f service neutron] 10.222.0.47 "GET /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301208 Nov 24 15:00:47.332893 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:47.337306 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-099458ae-05ae-43c8-9dc7-bc19ddb56d91 None None] The sync data for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv is: [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '15bbb874-6f67-4b68-b31e-276bef86a856', 'name': '', 'network_id': '4163e171-8af6-446b-b467-ad2dbcca11e9', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:43:6b:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:03Z', 'updated_at': '2021-11-24T14:58:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'f180fd7c-f692-4581-ab7e-4760fe2559bb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:00:47.553456 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b9876a3-8231-49bf-9aee-8eb0b284647a None None] New status for floating IP b0f24fb6-be74-4c5e-b0a4-cdda97fab095: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:00:48.018599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df35678-ca8a-45ab-a901-8e39f092d9d7 req-85e7bf36-a4b0-4c8f-9eb4-15d17bd69c47 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:48.019280 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7df35678-ca8a-45ab-a901-8e39f092d9d7 req-85e7bf36-a4b0-4c8f-9eb4-15d17bd69c47 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:00:48.037450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-7df35678-ca8a-45ab-a901-8e39f092d9d7 req-85e7bf36-a4b0-4c8f-9eb4-15d17bd69c47 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:00:48.039034 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df35678-ca8a-45ab-a901-8e39f092d9d7 req-85e7bf36-a4b0-4c8f-9eb4-15d17bd69c47 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.1261330 Nov 24 15:00:48.089007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df35678-ca8a-45ab-a901-8e39f092d9d7 req-0cde9c44-8d66-4a86-8a6e-05969c32c9a4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429227 Nov 24 15:00:48.448846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-ddcb039f-764b-4ad5-911d-44c74e0af2ab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:48.450298 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-ddcb039f-764b-4ad5-911d-44c74e0af2ab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 945 time: 0.0792272 Nov 24 15:00:48.478001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:48.518790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port c66b06e7-aaa5-420a-8ca5-95047e131d97 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:00:48.519646 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:48.771512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port c66b06e7-aaa5-420a-8ca5-95047e131d97, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=c66b06e7-aaa5-420a-8ca5-95047e131d97,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:00:48.771781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:48.897561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for c66b06e7-aaa5-420a-8ca5-95047e131d97 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:00:49.154793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:49.161221 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9eff5883-7663-4baa-b8ae-ecb69a148a4e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:49.206814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=c66b06e7-aaa5-420a-8ca5-95047e131d97,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:49.211189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:49.275023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e49909b3-bd54-42b9-9121-a16ea08bddeb req-4682acb1-780f-4f5e-880c-753ba44d7017 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=1ec19cd2-53ef-4f9d-9252-d007b5b8297e HTTP/1.1" status: 200 len: 210 time: 0.0580559 Nov 24 15:00:49.281430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] No DVR routers for this DVR port c66b06e7-aaa5-420a-8ca5-95047e131d97 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:00:49.284189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:49.286927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'name': 'network-vif-deleted', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:00:49.304279 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-22b1286e-5ee9-4c3d-81e0-3cc749657e49 req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "DELETE /v2.0/ports/c66b06e7-aaa5-420a-8ca5-95047e131d97 HTTP/1.1" status: 204 len: 173 time: 0.8488233 Nov 24 15:00:49.347840 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ec19cd2-53ef-4f9d-9252-d007b5b8297e', 'name': 'network-vif-deleted', 'tag': 'c66b06e7-aaa5-420a-8ca5-95047e131d97', 'status': 'completed', 'code': 200} Nov 24 15:00:50.386095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:50.807093 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:51.443652 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 15bbb874-6f67-4b68-b31e-276bef86a856 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:00:51.444410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:51.637204 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 15bbb874-6f67-4b68-b31e-276bef86a856, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=15bbb874-6f67-4b68-b31e-276bef86a856,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:00:51.637560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:51.881208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 15bbb874-6f67-4b68-b31e-276bef86a856 owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:00:52.070113 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:52.076157 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-4c3d43ee-1941-4418-b05c-52e045f9bb1c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:52.121419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=15bbb874-6f67-4b68-b31e-276bef86a856,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:52.161417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.161804 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.162182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.162555 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.162924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.163294 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.163657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.164081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.164441 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.164803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.165163 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:52.172263 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:52.444331 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:52.542461 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device c66b06e7-aaa5-420a-8ca5-95047e131d97 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:00:52.577311 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: c66b06e7-aaa5-420a-8ca5-95047e131d97 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:00:52.577668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device c66b06e7-aaa5-420a-8ca5-95047e131d97 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:00:53.062522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 63d26344-337f-432c-99bf-fb1f3789f059 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:00:53.269649 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:00:53.280196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] Sync routers for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:00:53.285036 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/63d26344-337f-432c-99bf-fb1f3789f059/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8972912 Nov 24 15:00:53.287403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54624) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:53.303314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:00:53.305469 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:53.497047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:00:53.617096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting subnet f180fd7c-f692-4581-ab7e-4760fe2559bb {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 15:00:53.620050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:53.677640 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:53.775550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:53.805590 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T15:00:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:53.812183 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] Checking router: 63d26344-337f-432c-99bf-fb1f3789f059 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:00:53.830564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] Routers {'63d26344-337f-432c-99bf-fb1f3789f059'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:00:53.831560 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['63d26344-337f-432c-99bf-fb1f3789f059'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:53.902968 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:53.910743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-1564cb9e-3ddb-40eb-89d9-1706899e4c21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:53.974393 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Subnet': ['ID=f180fd7c-f692-4581-ab7e-4760fe2559bb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:53.980322 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:53.986371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:53.996317 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-313b8039-56b7-4f9c-80c6-a541502cdd61 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/subnets/f180fd7c-f692-4581-ab7e-4760fe2559bb HTTP/1.1" status: 204 len: 168 time: 0.7078681 Nov 24 15:00:53.999106 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-271ef5c7-9f35-4c86-9102-2359a63a43cf None None] Network 4163e171-8af6-446b-b467-ad2dbcca11e9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:00:54.000489 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:54.196223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] Set router 63d26344-337f-432c-99bf-fb1f3789f059 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:00:54.262278 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:54.540276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] DHCP port deletion for 4163e171-8af6-446b-b467-ad2dbcca11e9 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 15:00:54.543240 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:54.547908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Deleting port 536e922d-541b-4e72-8698-e35aaa8c05e4 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:00:54.548276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:54.554543 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port c182f290-e8d3-4699-9bdf-86cb07d770be {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:00:54.554895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:54.741528 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T15:00:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:54.753849 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port c182f290-e8d3-4699-9bdf-86cb07d770be, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c182f290-e8d3-4699-9bdf-86cb07d770be,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:00:54.754583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:54.762581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f529b23-9d47-4264-961b-809aed60a0ab None None] The sync data for ids ['63d26344-337f-432c-99bf-fb1f3789f059'] in dv-neutron-818151-2-hyperv is: [{'id': '63d26344-337f-432c-99bf-fb1f3789f059', 'name': 'tempest-TestNetworkAdvancedServerOps-router-753441555', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239'}], 'enable_snat': True}, 'gw_port_id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T14:57:59Z', 'updated_at': '2021-11-24T15:00:52Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': 'c182f290-e8d3-4699-9bdf-86cb07d770be', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:43:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '63d26344-337f-432c-99bf-fb1f3789f059', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.239', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T14:58:00Z', 'updated_at': '2021-11-24T14:58:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:00:54.910771 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] For port 536e922d-541b-4e72-8698-e35aaa8c05e4, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=536e922d-541b-4e72-8698-e35aaa8c05e4,segment=NetworkSegment(d7a3fa9e-11c6-4698-a174-9c2f9596c1dd),segment_id=d7a3fa9e-11c6-4698-a174-9c2f9596c1dd)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:00:54.911499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:54.912670 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for c182f290-e8d3-4699-9bdf-86cb07d770be owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:00:55.092564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Calling delete_port for 536e922d-541b-4e72-8698-e35aaa8c05e4 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:00:55.092875 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.096511 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-26a1aed1-93e1-4219-a908-acae0a389be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:55.140168 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=c182f290-e8d3-4699-9bdf-86cb07d770be,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:55.142815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:55.185724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.196209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7f437c9-5faf-4bb7-a882-a437d67cf7cf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:55.275309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Pushing event deleted for resources: {'Port': ['ID=536e922d-541b-4e72-8698-e35aaa8c05e4,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:55.298334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] No DVR routers for this DVR port 536e922d-541b-4e72-8698-e35aaa8c05e4 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:00:55.302901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.303654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.304374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.305130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.305631 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.306035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.306441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.306849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.307240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.307845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.308249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:00:55.312181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:55.501345 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.773865 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.778330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.806648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.807215 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Fanout notify agent at l3_agent the message router_deleted on router 63d26344-337f-432c-99bf-fb1f3789f059 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 15:00:55.832328 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:55.833697 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/routers/63d26344-337f-432c-99bf-fb1f3789f059 HTTP/1.1" status: 204 len: 168 time: 1.8320751 Nov 24 15:00:55.836737 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54632) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:55.985999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.223072 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.275981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4163e171-8af6-446b-b467-ad2dbcca11e9']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:56.300898 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:56.301369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7a3fa9e-11c6-4698-a174-9c2f9596c1dd') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:00:56.325818 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.354546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.356659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 536e922d-541b-4e72-8698-e35aaa8c05e4 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:00:56.366961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Releasing vlan 882 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 15:00:56.367573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.393390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 536e922d-541b-4e72-8698-e35aaa8c05e4 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:00:56.393755 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 536e922d-541b-4e72-8698-e35aaa8c05e4 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:00:56.394158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c182f290-e8d3-4699-9bdf-86cb07d770be no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 15:00:56.397468 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 15:00:56.426491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c182f290-e8d3-4699-9bdf-86cb07d770be {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:00:56.426851 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c182f290-e8d3-4699-9bdf-86cb07d770be not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:00:56.427288 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 15bbb874-6f67-4b68-b31e-276bef86a856 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:00:56.464457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 15bbb874-6f67-4b68-b31e-276bef86a856 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:00:56.464882 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 15bbb874-6f67-4b68-b31e-276bef86a856 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:00:56.539812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.544450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cfeab41d-9677-4ce1-9ca7-a622e28c5c58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:56.562405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.574108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Network': ['ID=4163e171-8af6-446b-b467-ad2dbcca11e9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:56.578041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:56.581621 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5c8ed6cf-de91-4cf1-bb24-a63ba843cffd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/networks/4163e171-8af6-446b-b467-ad2dbcca11e9 HTTP/1.1" status: 204 len: 168 time: 0.7419217 Nov 24 15:00:56.585509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54636) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:56.684508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.719605 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.793323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.797160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e101b5fe-be63-49f4-95f5-75b7e218e0eb tempest-SecGroupIPv6Test-875635337 tempest-SecGroupIPv6Test-875635337-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:56.814457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=16bbcbed-c693-4b1e-acfb-4f7e3b80a29d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:56.818385 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:56.831634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:56.833254 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5c6d09fd-c367-4453-a578-18f717ce8870 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/security-groups/16bbcbed-c693-4b1e-acfb-4f7e3b80a29d HTTP/1.1" status: 204 len: 168 time: 0.2467780 Nov 24 15:00:57.326626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54644) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:57.336587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1562403715', 'description': 'tempest-secgroup-smoke-1562403715 description', 'project_id': '9482331cd77d4af992b911b12f253611'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:57.342853 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:57.347329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:57.350829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:57.356244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:57.368230 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.408289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:57.413016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:57.416020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:57.422189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:57.493364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.498375 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.502786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8427fc59-00ce-4c93-81a2-4447f5f0064a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:57.552633 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroup': ['ID=20d1c05b-4eeb-4193-a56e-7e534191ab46,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:57.556432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.558297 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2301092 Nov 24 15:00:57.559861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0e91a869-b09e-4055-b2d8-cf67d1461292 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:57.562224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54648) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:57.570400 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '20d1c05b-4eeb-4193-a56e-7e534191ab46', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:57.577155 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:57.582437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:57.586224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:57.593188 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:57.614104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.692429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.696981 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.699084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8ce560b9-5d1c-4690-af44-e13ce407de2e tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:57.723696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8e11b6c-bbf4-4df0-9e38-6c8ac9d6fe0d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:57.726698 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:57.734570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.735816 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1728652 Nov 24 15:00:57.739333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54652) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:57.745163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '20d1c05b-4eeb-4193-a56e-7e534191ab46', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:57.751649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:57.756531 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:57.759861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:57.766005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:57.785401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.854086 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.858409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.860411 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fb330e43-07de-48f5-845c-f7960a4e9837 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:57.884387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2cc07dac-d449-4d81-9823-b2c8c28b3d1b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:57.887251 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:57.896079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:57.897274 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1569366 Nov 24 15:00:57.901095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54656) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:57.906776 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '20d1c05b-4eeb-4193-a56e-7e534191ab46', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:57.913807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:57.917903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:57.920961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:57.927995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:57.949014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.024832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.029189 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.031282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-92959741-765d-4f54-b889-48c80efa49f1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:58.056849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c0edf1ef-a245-4c91-bc26-2f33f3e4f17d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:58.059520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:58.068865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.070061 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-50b77614-7e7f-4ef9-9325-f1dd0928056a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1680672 Nov 24 15:00:58.072955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54660) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:58.078716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '20d1c05b-4eeb-4193-a56e-7e534191ab46', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:58.086243 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:58.090267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:58.093487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:58.100003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:58.119073 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.195389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.199942 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.202018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ee3d72a-bb91-4ef9-a2b6-d8bb1282e6da tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:58.242560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a36a6ed7-241b-43a1-9141-784a1551dc4a,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:58.250205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:58.255492 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.260177 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1830740 Nov 24 15:00:58.260609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54664) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:58.267064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '20d1c05b-4eeb-4193-a56e-7e534191ab46', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:58.275483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:58.279890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:58.284219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:58.293025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:58.311977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:00:58.320961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.404991 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.409876 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.416570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec028ee5-cede-447b-97c2-648d1d86651b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:58.437372 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba133a90-ab90-4c3e-a7bd-7478780afdfe,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:58.442683 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:58.447990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.449288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1874638 Nov 24 15:00:58.452074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54668) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:58.459971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'security_group_rule': {'security_group_id': '20d1c05b-4eeb-4193-a56e-7e534191ab46', 'project_id': '9482331cd77d4af992b911b12f253611', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:58.466076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:58.469896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:security_group_rule and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:58.473583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:58.479151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:58.489497 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Project 9482331cd77d4af992b911b12f253611 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:00:58.496145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.576935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.582562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.584566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-433742d5-2d20-4c7f-b4fe-5375af78ebb7 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:58.613090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d284b63-4146-4734-8bda-1b3513cd3d0c,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:58.621575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:58.628052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.629595 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d2ba11a-f47c-4720-b44f-0ad1a8b90cab tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1764925 Nov 24 15:00:58.632839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54672) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:58.641374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'network': {'name': 'tempest-network-smoke--2705352', 'project_id': '9482331cd77d4af992b911b12f253611', 'port_security_enabled': True}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:58.647642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:58.653146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:network and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:58.656172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:58.662341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:58.673576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:00:58.677351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.710723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 852} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 15:00:58.720004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.720340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Added segment 41501d45-bef8-4807-b9fc-cfe4d6d1a28a of type vlan for network 7eec1d5c-64fa-44a9-9534-54389054c34c Nov 24 15:00:58.754856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.789555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.793437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:00:58.794018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.797820 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adf6c74a-4b5c-4db5-8ae8-76c5bd91b714 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:00:58.920796 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.2863195 Nov 24 15:00:58.924010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54676) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:00:58.931963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'admin_state_up': True, 'project_id': '9482331cd77d4af992b911b12f253611', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:00:58.937318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Network': ['ID=7eec1d5c-64fa-44a9-9534-54389054c34c,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:00:58.942274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:00:58.944660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:00:58.947845 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:router and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:00:58.949794 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7eec1d5c-64fa-44a9-9534-54389054c34c details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 15:00:58.952299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:00:58.966830 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:00:58.979348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:58.980595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:59.009118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:59.259944 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:59.687473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:59.719783 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:00:59.865388 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.132 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/4ea054ed-aede-4d57-ac39-3bc7f3d86439) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:01:00.035229 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:00.067746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:00.072140 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-61b82f1d-7bf6-4a1d-b099-94b4b7b3f6b2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:00.139444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:01:00.147426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:00.151832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:01:00.182056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=4ea054ed-aede-4d57-ac39-3bc7f3d86439,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:00.188609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:00.338085 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:00.338926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:00.642049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 948bda43-771c-4718-b885-f4b02b03131d is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 15:01:00.858035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:01:00.869864 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Sync routers for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:01:00.886263 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:01:00.886902 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:00.891806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:00.895098 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.9689956 Nov 24 15:01:00.898195 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54680) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:01.083086 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:01:01.346027 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-04e9b42a-d391-4715-9cd8-b7db431e09e4 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?project_id=9482331cd77d4af992b911b12f253611&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.4461491 Nov 24 15:01:01.348756 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54686) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:01.515395 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:00Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:00:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:01.522646 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Checking router: 948bda43-771c-4718-b885-f4b02b03131d for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:01:01.522646 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Updating router 948bda43-771c-4718-b885-f4b02b03131d port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:01:01.573703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c74035f-e91a-4597-a420-cf0d983056ab tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:01.576188 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8c74035f-e91a-4597-a420-cf0d983056ab tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2259109 Nov 24 15:01:01.579562 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54690) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:01.604230 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:01.630486 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c6571120-5772-46b9-a0eb-b001dfe84520 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/subnets?network_id=402f60a1-052a-4741-af19-c310771ae4cd&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0446134 Nov 24 15:01:01.630750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54694) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:01.637934 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1860449112', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'project_id': '9482331cd77d4af992b911b12f253611', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:01:01.762257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:01:01.766661 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:subnet and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:01:01.770366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:01:01.777824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:01:01.792964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:01:01.919233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:01.984254 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.001325 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Transition to ACTIVE for port object 4ea054ed-aede-4d57-ac39-3bc7f3d86439 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:02.012091 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.017274 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7fa4528e-120d-4562-aff5-e3521a0f870d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:02.101981 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Pushing event updated for resources: {'Port': ['ID=4ea054ed-aede-4d57-ac39-3bc7f3d86439,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:02.113511 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Attempting to bind port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:01:02.114120 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Attempting to bind port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:01:02.114592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Attempting to bind port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:01:02.119250 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.119774 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.120269 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.120683 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.121096 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.121513 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.121923 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.122437 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.123128 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.123453 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.123996 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:01:02.130829 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:02.136508 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:01:02.137061 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:01:02.137695 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.138308 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:01:02.139335 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Bound port: 4ea054ed-aede-4d57-ac39-3bc7f3d86439, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:01:02.139659 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.230978 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] For port 4ea054ed-aede-4d57-ac39-3bc7f3d86439, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:01:02.234911 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] For port 4ea054ed-aede-4d57-ac39-3bc7f3d86439, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4ea054ed-aede-4d57-ac39-3bc7f3d86439,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:01:02.241421 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.255582 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-74d8b670-374d-479f-9ae4-6e2ae4458de6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:02.338357 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:01:02.339278 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:00:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:02.356187 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.360363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-837cd1aa-28a3-468d-a3b0-204031266a2d tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:02.414983 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Pushing event updated for resources: {'Port': ['ID=4ea054ed-aede-4d57-ac39-3bc7f3d86439,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:02.420767 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-41dd5fe8-634b-4926-89b4-17f4128b5fb4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:02.465869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Subnet': ['ID=a4db6e34-fd42-4891-8ed1-1c5b91c809c8,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:02.473004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:02.480686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Checking segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:01:02.481434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network hostable DHCP agents. Network: 7eec1d5c-64fa-44a9-9534-54389054c34c, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:01:02.516147 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 7eec1d5c-64fa-44a9-9534-54389054c34c is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:01:02.528497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7eec1d5c-64fa-44a9-9534-54389054c34c) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:02.532968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:02.534565 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:02.545360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-396bada1-657b-456b-8c65-f00128c76a67 None None] Network 7eec1d5c-64fa-44a9-9534-54389054c34c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:01:02.559931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ddd442c8-dcbd-4881-8431-338c1e165014 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.9277885 Nov 24 15:01:02.564573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54700) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:02.583578 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:01:02.812575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7eec1d5c-64fa-44a9-9534-54389054c34c', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 15:01:02.814217 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.048524 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:00Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:03.053537 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d920605-406e-4c27-bcbe-68290d90f4b5 None None] The sync data for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv is: [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:00Z', 'revision_number': 3, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:01:03.082336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Allocated IP 172.20.0.2 (7eec1d5c-64fa-44a9-9534-54389054c34c/a4db6e34-fd42-4891-8ed1-1c5b91c809c8/9c32d5e5-9a27-493e-953e-f9d39a523e27) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:01:03.333224 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.345600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Transition to ACTIVE for port object 9c32d5e5-9a27-493e-953e-f9d39a523e27 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:03.367606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Transition to ACTIVE for port object 9c32d5e5-9a27-493e-953e-f9d39a523e27 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:03.381264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.395597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-243e6816-f37b-41b2-a16c-648706263ce0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:03.479546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Network 7eec1d5c-64fa-44a9-9534-54389054c34c is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:01:03.488267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:03.493301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5644d571-ed28-4a86-9475-b2e5f2be4489 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.497677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:01:03.500599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Pushing event updated for resources: {'Port': ['ID=9c32d5e5-9a27-493e-953e-f9d39a523e27,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:03.505341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:03.597946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.618333 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Attempting to bind port 9c32d5e5-9a27-493e-953e-f9d39a523e27 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:01:03.619260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Attempting to bind port 9c32d5e5-9a27-493e-953e-f9d39a523e27 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:01:03.619475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Attempting to bind port 9c32d5e5-9a27-493e-953e-f9d39a523e27 on network 7eec1d5c-64fa-44a9-9534-54389054c34c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:01:03.630421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:01:03.631015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Checking segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:01:03.631627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.632315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Bound using segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:01:03.633037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Bound port: 9c32d5e5-9a27-493e-953e-f9d39a523e27, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:01:03.633599 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.773513 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] For port 9c32d5e5-9a27-493e-953e-f9d39a523e27, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:01:03.781214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] For port 9c32d5e5-9a27-493e-953e-f9d39a523e27, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9c32d5e5-9a27-493e-953e-f9d39a523e27,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:01:03.795046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.801531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:03.836234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:03.900887 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Pushing event updated for resources: {'Port': ['ID=9c32d5e5-9a27-493e-953e-f9d39a523e27,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:03.915980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:04.120333 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.1 (7eec1d5c-64fa-44a9-9534-54389054c34c/a4db6e34-fd42-4891-8ed1-1c5b91c809c8/a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:01:04.387996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9c32d5e5-9a27-493e-953e-f9d39a523e27 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:04.521551 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 9c32d5e5-9a27-493e-953e-f9d39a523e27 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:04.527320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ea054ed-aede-4d57-ac39-3bc7f3d86439 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:04.532208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.551095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:04.576610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.581635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-d1737ba1-1e12-4c87-b23d-67a8c9b94030 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:04.608359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:04.614063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:04.614441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.644731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 7eec1d5c-64fa-44a9-9534-54389054c34c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:01:04.648323 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:04.657681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:01:04.703373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:04.709004 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:04.737844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.758830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.778917 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 4ea054ed-aede-4d57-ac39-3bc7f3d86439, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4ea054ed-aede-4d57-ac39-3bc7f3d86439,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:01:04.785292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.787929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:04.859489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:04.862942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=4ea054ed-aede-4d57-ac39-3bc7f3d86439,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:04.866416 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:05.077447 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8415e5f1-77ec-47c4-af00-57143e570646 None None] Network 7eec1d5c-64fa-44a9-9534-54389054c34c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:01:05.263589 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Provisioning for port 9c32d5e5-9a27-493e-953e-f9d39a523e27 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:05.324192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Provisioning complete for port 9c32d5e5-9a27-493e-953e-f9d39a523e27 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:05.324192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.374971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.382196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.438893 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:05.511378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.558439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] For port 9c32d5e5-9a27-493e-953e-f9d39a523e27, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9c32d5e5-9a27-493e-953e-f9d39a523e27,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:01:05.565145 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.568954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:05.585541 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.595952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:05.602081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:05.668317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Pushing event updated for resources: {'Port': ['ID=9c32d5e5-9a27-493e-953e-f9d39a523e27,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:05.677144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:05.766775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 7eec1d5c-64fa-44a9-9534-54389054c34c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:01:05.768534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:05.802574 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-db32a62f-2790-4dc9-a16a-e3e5925cc0b9 None None] Provisioning complete for port 9c32d5e5-9a27-493e-953e-f9d39a523e27 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:05.803264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-db32a62f-2790-4dc9-a16a-e3e5925cc0b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.962540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a4d4e606-ce3f-4adb-9546-a12e69a9379d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:05.967308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-db32a62f-2790-4dc9-a16a-e3e5925cc0b9 None None] Provisioning for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:05.974161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-db32a62f-2790-4dc9-a16a-e3e5925cc0b9 None None] Provisioning complete for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:05.974535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-db32a62f-2790-4dc9-a16a-e3e5925cc0b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:06.032767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-db32a62f-2790-4dc9-a16a-e3e5925cc0b9 None None] Port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:01:06.157052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3781cf88-888a-4c48-becc-be0fbaa9ad74 None None] Provisioning complete for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:06.157616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3781cf88-888a-4c48-becc-be0fbaa9ad74 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:06.221543 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3781cf88-888a-4c48-becc-be0fbaa9ad74 None None] Port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:01:06.233540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 948bda43-771c-4718-b885-f4b02b03131d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:01:06.307184 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9c32d5e5-9a27-493e-953e-f9d39a523e27 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:06.380963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-d2b3b50a-d0c2-45dc-a815-56a027d073db None None] Provisioning complete for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:06.381334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d2b3b50a-d0c2-45dc-a815-56a027d073db None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:06.448167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d2b3b50a-d0c2-45dc-a815-56a027d073db None None] Port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:01:06.450611 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 9c32d5e5-9a27-493e-953e-f9d39a523e27 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:06.450958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:06.574340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ea054ed-aede-4d57-ac39-3bc7f3d86439 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:06.578259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:01:06.591139 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/948bda43-771c-4718-b885-f4b02b03131d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0255706 Nov 24 15:01:06.647684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:06.648098 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:06.798324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-fcce6c83-4f5d-433a-b4b8-ff1cfae3e8b5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:01:06.813968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-fcce6c83-4f5d-433a-b4b8-ff1cfae3e8b5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:01:06.816106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-fcce6c83-4f5d-433a-b4b8-ff1cfae3e8b5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1562403715&fields=id&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 267 time: 0.0663629 Nov 24 15:01:06.966769 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-f2239311-4c9f-4398-ac5a-0016a9e16c4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:06.967440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-f2239311-4c9f-4398-ac5a-0016a9e16c4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:01:06.981683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Sync routers for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:01:06.985092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-f2239311-4c9f-4398-ac5a-0016a9e16c4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:01:06.986872 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-f2239311-4c9f-4398-ac5a-0016a9e16c4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 794 time: 0.1637394 Nov 24 15:01:06.994657 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:01:06.995271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:07.004976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-045fb077-4864-48ad-92de-902b5252c8e8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/quotas/9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 375 time: 0.0119493 Nov 24 15:01:07.077494 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:07.092318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-ddab7813-6a9b-4e9c-94f2-ac7fecfdcc2c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:01:07.107826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-ddab7813-6a9b-4e9c-94f2-ac7fecfdcc2c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:01:07.109465 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-ddab7813-6a9b-4e9c-94f2-ac7fecfdcc2c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0990078 Nov 24 15:01:07.235862 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:01:07.431430 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-7349070a-78bf-4a8f-9615-7a9b69e6d515 service neutron] 10.222.0.70 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2356076 Nov 24 15:01:07.565416 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-62d19ddc-af58-4889-9fce-468f4b8dce1a service neutron] 10.222.0.70 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1282260 Nov 24 15:01:07.604216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:05Z', 'revision_number': 2, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:07.608181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Checking router: 948bda43-771c-4718-b885-f4b02b03131d for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:01:07.608546 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Updating router 948bda43-771c-4718-b885-f4b02b03131d port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:01:07.663743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:07.774562 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4beb788b-bb22-4bbd-ab94-7b567f29fa66 req-d6b2ec1d-bdc3-4c34-8070-81fa90cb84ee tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:01:07.788357 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-4beb788b-bb22-4bbd-ab94-7b567f29fa66 req-d6b2ec1d-bdc3-4c34-8070-81fa90cb84ee tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:01:07.789531 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4beb788b-bb22-4bbd-ab94-7b567f29fa66 req-d6b2ec1d-bdc3-4c34-8070-81fa90cb84ee tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 210 time: 0.0605259 Nov 24 15:01:08.032889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:08.051485 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Transition to ACTIVE for port object a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:08.058756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:08.063248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-824209f8-3059-4222-80ec-e27f9c5523e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:08.221904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09fcd457-6fbc-4e23-9b0f-c2fcd84f631d None None] Pushing event updated for resources: {'Port': ['ID=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:08.232366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-09fcd457-6fbc-4e23-9b0f-c2fcd84f631d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:08.289810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Attempting to bind port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:01:08.290190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Attempting to bind port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:01:08.290564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Attempting to bind port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 on network 7eec1d5c-64fa-44a9-9534-54389054c34c {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:01:08.299405 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:01:08.300052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Checking segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:01:08.300477 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:08.300995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Bound using segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:01:08.301488 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Bound port: a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:01:08.301881 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:08.402091 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] For port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:01:08.408776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] For port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:01:08.414480 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:08.418805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-294ef3ca-6b4e-4d52-a896-e9ec34dcfe4a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:08.504228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09fcd457-6fbc-4e23-9b0f-c2fcd84f631d None None] Pushing event updated for resources: {'Port': ['ID=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:08.508325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-09fcd457-6fbc-4e23-9b0f-c2fcd84f631d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:08.509294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:01:08.509920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:08.710242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:01:08.781529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:08.856716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-25bca72a-0aad-416d-9c69-797021b3466d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:08.858231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-25bca72a-0aad-416d-9c69-797021b3466d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 794 time: 0.1688137 Nov 24 15:01:08.929015 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-8ff1b483-f352-468f-9c28-7e50ee4bdda8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9482331cd77d4af992b911b12f253611 HTTP/1.1" status: 200 len: 380 time: 0.0573442 Nov 24 15:01:08.940519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'port': {'device_id': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'admin_state_up': True, 'tenant_id': '9482331cd77d4af992b911b12f253611', 'security_groups': ['20d1c05b-4eeb-4193-a56e-7e534191ab46']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:01:09.140246 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-17dee2ca-a6f0-473c-ae5a-c4c0dbf5d374 req-0a7c08f3-cf5a-4c75-a656-29428506452d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 210 time: 0.0463495 Nov 24 15:01:09.146037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:01:09.156518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:01:09.169926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Made reservation on behalf of 9482331cd77d4af992b911b12f253611 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:01:09.175123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:09.210257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:08Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:09.214433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3159093e-a10c-4cf9-9cfe-9a92cd3fdb4b None None] The sync data for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv is: [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:08Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:01:09.398252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.20.0.4 (7eec1d5c-64fa-44a9-9534-54389054c34c/a4db6e34-fd42-4891-8ed1-1c5b91c809c8/ba5ce296-b48b-4dac-9788-41fb6a625085) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:01:09.611972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:09.629571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Transition to ACTIVE for port object ba5ce296-b48b-4dac-9788-41fb6a625085 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:09.651936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:09.657638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b0244041-46e6-41c3-9f91-550d9d1b1c9d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:09.737664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 7eec1d5c-64fa-44a9-9534-54389054c34c is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:01:09.741482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:09.743519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=ba5ce296-b48b-4dac-9788-41fb6a625085,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:09.745716 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:01:09.775645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:09.819172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:09.820668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:09.856793 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9216149 Nov 24 15:01:09.869148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Request body: {'port': {'device_id': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:01:10.003462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.035947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3b263e05-714b-4de7-bae2-385d00c3bcf2 None None] Provisioning for port ba5ce296-b48b-4dac-9788-41fb6a625085 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:10.043694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3b263e05-714b-4de7-bae2-385d00c3bcf2 None None] Provisioning complete for port ba5ce296-b48b-4dac-9788-41fb6a625085 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:10.044205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3b263e05-714b-4de7-bae2-385d00c3bcf2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.110177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3b263e05-714b-4de7-bae2-385d00c3bcf2 None None] Port ba5ce296-b48b-4dac-9788-41fb6a625085 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:01:10.351330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:10.353193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d7b242-4602-4959-abe0-a65f41803001 req-6cf7977c-5366-434e-9013-ffe31f3c7862 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:10.354660 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-38d7b242-4602-4959-abe0-a65f41803001 req-6cf7977c-5366-434e-9013-ffe31f3c7862 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 931 time: 0.0818794 Nov 24 15:01:10.408411 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-38d7b242-4602-4959-abe0-a65f41803001 req-5d89ac36-8c18-41d6-8200-9d8bfa145b4d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474689 Nov 24 15:01:10.425451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:10.436576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:10.437048 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.501196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ba5ce296-b48b-4dac-9788-41fb6a625085 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:01:10.508163 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.522870 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Transition to ACTIVE for port object ba5ce296-b48b-4dac-9788-41fb6a625085 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:01:10.526577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.530150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:10.561429 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.597369 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:01:10.601871 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.603885 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:10.652696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Pushing event updated for resources: {'Port': ['ID=ba5ce296-b48b-4dac-9788-41fb6a625085,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:10.655455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:10.678016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:10.681401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:10.770089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Attempting to bind port ba5ce296-b48b-4dac-9788-41fb6a625085 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:01:10.770423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Attempting to bind port ba5ce296-b48b-4dac-9788-41fb6a625085 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:01:10.770746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Attempting to bind port ba5ce296-b48b-4dac-9788-41fb6a625085 on network 7eec1d5c-64fa-44a9-9534-54389054c34c {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:01:10.777466 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Port ba5ce296-b48b-4dac-9788-41fb6a625085 on network 7eec1d5c-64fa-44a9-9534-54389054c34c not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 15:01:10.777779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Attempting to bind port ba5ce296-b48b-4dac-9788-41fb6a625085 on network 7eec1d5c-64fa-44a9-9534-54389054c34c {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:01:10.785244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 0, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:01:10.785577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Checking segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:01:10.786540 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Bound using segment: {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:01:10.786962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Bound port: ba5ce296-b48b-4dac-9788-41fb6a625085, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41501d45-bef8-4807-b9fc-cfe4d6d1a28a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 852, 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:01:10.787303 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.907746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] For port ba5ce296-b48b-4dac-9788-41fb6a625085, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:01:10.911601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] For port ba5ce296-b48b-4dac-9788-41fb6a625085, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ba5ce296-b48b-4dac-9788-41fb6a625085,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:01:10.915512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.919176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15554311-21d1-4321-aad8-90638138412a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:10.978262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:10.979628 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] 10.222.0.47 "PUT /v2.0/ports/ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 1093 time: 1.1153162 Nov 24 15:01:10.980179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:01:11.004513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Pushing event updated for resources: {'Port': ['ID=ba5ce296-b48b-4dac-9788-41fb6a625085,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:11.007726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:11.062083 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'status': 'completed', 'code': 200} Nov 24 15:01:11.108610 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-353a162e-8aa6-482b-ac34-62930dea9a7d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1096 time: 0.0809565 Nov 24 15:01:11.181106 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-33af8865-0f2b-4df4-b00a-8c3cf8144149 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 217 time: 0.0651479 Nov 24 15:01:11.244805 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-2d036e1c-2bf1-414b-9f9b-0d41a9325e09 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:11.246158 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-2d036e1c-2bf1-414b-9f9b-0d41a9325e09 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.0595267 Nov 24 15:01:11.327132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-68ad238b-f533-48a4-8d7e-51302e86827c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0740571 Nov 24 15:01:11.463331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-1df77692-7b9e-4d67-abaf-fbb65351ca70 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1292648 Nov 24 15:01:11.596354 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2084c358-da1b-47e6-80cf-38f8a24540d2 req-a6383908-12ac-41aa-a0f3-376f3e400bbd service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269171 Nov 24 15:01:11.610284 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c620486b-d885-4ff9-b508-1ea2724dc0c7 req-55851c11-63a6-4e53-abb9-85878d9b4cfb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:11.613130 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c620486b-d885-4ff9-b508-1ea2724dc0c7 req-55851c11-63a6-4e53-abb9-85878d9b4cfb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 943 time: 0.0797212 Nov 24 15:01:11.661237 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c620486b-d885-4ff9-b508-1ea2724dc0c7 req-00dc37e8-a722-4a5d-908c-bc18ed363e8e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422904 Nov 24 15:01:11.715874 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-d0680c3e-5e01-4432-8d25-82621eef5ca7 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1096 time: 0.0692255 Nov 24 15:01:11.848975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-dcb5f2fc-3444-4ef5-802b-7c697d6b6de5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:11.850320 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-dcb5f2fc-3444-4ef5-802b-7c697d6b6de5 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 895 time: 0.1279583 Nov 24 15:01:11.920223 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-3bae705b-479d-4958-a99e-f21ea90deffa service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 217 time: 0.0637200 Nov 24 15:01:11.988433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-1daa349c-9e03-4dce-b2b2-bed127bdd5ec service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:11.989910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-1daa349c-9e03-4dce-b2b2-bed127bdd5ec service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.0632739 Nov 24 15:01:12.067444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-492d2e76-910d-4d08-bbcf-691ae8eb9724 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0715296 Nov 24 15:01:12.305667 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:12.306221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-561387f0-e148-4dea-940d-96ca87fcf7f9 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2318561 Nov 24 15:01:12.376005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:12.376384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:12.441147 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b44911bc-a456-4edd-b721-fbb6e82e0279 req-4eb3ba41-2927-4404-9767-1db01d67e9b7 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1282861 Nov 24 15:01:12.862542 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba1b13d-97a9-4ba4-82d8-0437b47110e4 req-1b153243-ea45-4d6c-9746-c009b9b06e35 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:12.863132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2ba1b13d-97a9-4ba4-82d8-0437b47110e4 req-1b153243-ea45-4d6c-9746-c009b9b06e35 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:01:12.879979 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-2ba1b13d-97a9-4ba4-82d8-0437b47110e4 req-1b153243-ea45-4d6c-9746-c009b9b06e35 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:01:12.881164 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2ba1b13d-97a9-4ba4-82d8-0437b47110e4 req-1b153243-ea45-4d6c-9746-c009b9b06e35 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 943 time: 0.0974255 Nov 24 15:01:12.951316 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2ba1b13d-97a9-4ba4-82d8-0437b47110e4 req-04bb344f-00fc-4b05-827d-01c2466ecd13 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0640779 Nov 24 15:01:14.168721 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2717e9cc-7202-41f8-8cb8-b329d3b28a49 req-4498a0fd-6b14-497a-8074-4b10270e4216 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:14.170087 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2717e9cc-7202-41f8-8cb8-b329d3b28a49 req-4498a0fd-6b14-497a-8074-4b10270e4216 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 943 time: 0.0850098 Nov 24 15:01:14.219125 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2717e9cc-7202-41f8-8cb8-b329d3b28a49 req-d44d2987-5417-49b2-9f09-b49182a04769 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424716 Nov 24 15:01:14.600846 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ba5ce296-b48b-4dac-9788-41fb6a625085 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:01:14.738248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port ba5ce296-b48b-4dac-9788-41fb6a625085, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ba5ce296-b48b-4dac-9788-41fb6a625085,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:01:14.754235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'port_id': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'mac_address': 'fa:16:3e:32:c9:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 852, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:01:14.809650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:14.826743 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ba5ce296-b48b-4dac-9788-41fb6a625085 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:01:14.843298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port ba5ce296-b48b-4dac-9788-41fb6a625085, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ba5ce296-b48b-4dac-9788-41fb6a625085,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:01:14.847968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:14.849672 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-0d315a01-f988-4a30-abde-e6466ff77c13 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:14.917341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=ba5ce296-b48b-4dac-9788-41fb6a625085,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:14.920280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:15.222840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['ba5ce296-b48b-4dac-9788-41fb6a625085'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:01:15.426058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-845eb5f5-16c0-4ecc-91ea-67ef4077f409 req-2bfdc603-e478-4825-8ea5-638ed7a381dd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:15.427516 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-845eb5f5-16c0-4ecc-91ea-67ef4077f409 req-2bfdc603-e478-4825-8ea5-638ed7a381dd tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 944 time: 0.0809038 Nov 24 15:01:15.474119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-845eb5f5-16c0-4ecc-91ea-67ef4077f409 req-78f34309-d491-4944-b7cc-2c172ab66001 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408928 Nov 24 15:01:16.603245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ba5ce296-b48b-4dac-9788-41fb6a625085 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:01:16.688868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port ba5ce296-b48b-4dac-9788-41fb6a625085 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:01:16.694809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port ba5ce296-b48b-4dac-9788-41fb6a625085 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:01:16.695263 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:16.699975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ceb1d6-4586-4aa2-b515-4d73e9502e32 req-93e1bff5-ff6a-48f0-b20f-0ef0815799d4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:16.701474 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-34ceb1d6-4586-4aa2-b515-4d73e9502e32 req-93e1bff5-ff6a-48f0-b20f-0ef0815799d4 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 944 time: 0.0968530 Nov 24 15:01:16.751568 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-34ceb1d6-4586-4aa2-b515-4d73e9502e32 req-7137ddfd-3469-4884-af1f-3b234b9d0906 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431676 Nov 24 15:01:16.812417 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:16.839879 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:01:16.850717 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port ba5ce296-b48b-4dac-9788-41fb6a625085, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ba5ce296-b48b-4dac-9788-41fb6a625085,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:01:16.855123 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:16.858153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:16.928942 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=ba5ce296-b48b-4dac-9788-41fb6a625085,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:16.932156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:16.972102 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'code': 200} Nov 24 15:01:17.201671 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-576981fa-4e75-44b4-b4a6-4dfe23699803 req-829e0e44-57f6-42fd-9d6e-f5ec62a74813 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1098 time: 0.0712328 Nov 24 15:01:17.249925 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-576981fa-4e75-44b4-b4a6-4dfe23699803 req-8c770ecc-54c6-40b6-87a4-66bfbbf8e2da service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412791 Nov 24 15:01:17.965432 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3ef706-3f60-421a-b893-c12f03fe70b4 req-d1e1640e-6982-4db3-94e5-152567c000c3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:17.966870 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de3ef706-3f60-421a-b893-c12f03fe70b4 req-d1e1640e-6982-4db3-94e5-152567c000c3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0888457 Nov 24 15:01:18.016980 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de3ef706-3f60-421a-b893-c12f03fe70b4 req-176c4bf2-f4a0-4d35-a7c8-2219c8dc98c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433936 Nov 24 15:01:18.489763 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:19.241560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb98c14a-6404-426c-8b4b-8da1c14da42d req-b737a765-282d-42bc-9900-cda3abf3f62f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:19.243001 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eb98c14a-6404-426c-8b4b-8da1c14da42d req-b737a765-282d-42bc-9900-cda3abf3f62f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0946820 Nov 24 15:01:19.289852 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-eb98c14a-6404-426c-8b4b-8da1c14da42d req-c35d42e2-4a81-4b8d-b990-edb3a29c1ad7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410717 Nov 24 15:01:19.502708 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d91d096-a0ee-4a88-ac8b-43252df19a42 req-6f6d8bf7-53c0-4d46-9c34-33f60dbfe505 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:19.504245 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d91d096-a0ee-4a88-ac8b-43252df19a42 req-6f6d8bf7-53c0-4d46-9c34-33f60dbfe505 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0861108 Nov 24 15:01:19.568087 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4d91d096-a0ee-4a88-ac8b-43252df19a42 req-023d1a32-8254-47f8-8ec6-b38f099818cb tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566692 Nov 24 15:01:19.596346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54752) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:19.673004 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-38e331b0-9f75-4916-975c-e08ff5428c20 tempest-TestNetworkAdvancedServerOps-1626887227 tempest-TestNetworkAdvancedServerOps-1626887227-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1093 time: 0.0753314 Nov 24 15:01:19.676214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54756) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:19.682124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address': '172.20.0.4'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:01:19.687862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:01:19.692105 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Usage tracker for resource:floatingip and tenant:9482331cd77d4af992b911b12f253611 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:01:19.695027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:01:19.700809 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:01:19.712065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:19.852505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:19.989891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Allocated IP 172.26.4.78 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/f9a041d0-c1ef-426f-a0e6-746a64bce82f) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:01:20.152365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:20.182665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:20.186632 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6707486-039c-40be-8032-7c09655a985f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:20.252547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:01:20.260265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:01:20.262826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:01:20.300397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=f9a041d0-c1ef-426f-a0e6-746a64bce82f,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:20.303814 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:20.934951 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:20.995918 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:21.210641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:21.216175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:21.220152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-38856744-e4c1-49a2-8c27-8c5d5aca0696 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:01:21.317739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event updated for resources: {'Port': ['ID=f9a041d0-c1ef-426f-a0e6-746a64bce82f,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:01:21.321720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:01:21.337254 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:21.529676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Floating IP 7396c250-aa79-4856-b339-15be1ead3705 associated. External IP: 172.26.4.78, port: ba5ce296-b48b-4dac-9788-41fb6a625085. Nov 24 15:01:21.870486 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:01:21.931620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 948bda43-771c-4718-b885-f4b02b03131d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:01:22.134666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:01:22.146063 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] Sync routers for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:01:22.159731 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:01:22.160205 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:22.160357 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:22.221733 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.5408297 Nov 24 15:01:22.221733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:01:22.284914 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'status': 'completed', 'code': 200} Nov 24 15:01:22.352087 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:01:22.578347 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-c3499564-7b93-4785-b9cb-5b4de1293df7 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1098 time: 0.2711289 Nov 24 15:01:22.612701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c7ac00-10ae-4121-9637-c2bb0acc5eac req-c558121f-1745-41ff-860c-04bdd25cb3e2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:22.614489 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-33c7ac00-10ae-4121-9637-c2bb0acc5eac req-c558121f-1745-41ff-860c-04bdd25cb3e2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.2672765 Nov 24 15:01:22.716780 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7396c250-aa79-4856-b339-15be1ead3705', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.78', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '948bda43-771c-4718-b885-f4b02b03131d', 'port_id': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'mac_address': 'fa:16:3e:32:c9:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:01:20Z', 'updated_at': '2021-11-24T15:01:20Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:22.721686 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] Checking router: 948bda43-771c-4718-b885-f4b02b03131d for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:01:22.735560 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:01:22.736219 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:01:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:22.751812 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-33c7ac00-10ae-4121-9637-c2bb0acc5eac req-f45756a5-ee64-4096-9d53-c875219721b0 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1258600 Nov 24 15:01:22.772402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-dd896554-a373-42bf-b6d9-68fbf80130f2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:22.784046 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-dd896554-a373-42bf-b6d9-68fbf80130f2 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 895 time: 0.1893995 Nov 24 15:01:22.784816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54764) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:22.901574 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3926b9c1-c8bb-4eb7-8dbb-61a51d4b5e7f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 990 time: 0.1151977 Nov 24 15:01:22.907268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-87a90d65-0a0b-4ebf-8023-63e7dc9cfc7f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 998 time: 0.1255567 Nov 24 15:01:22.928697 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:01:22.978483 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-f34b1444-81e4-4e1b-9e17-e5b3d2904e86 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:22.980022 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-f34b1444-81e4-4e1b-9e17-e5b3d2904e86 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.0665402 Nov 24 15:01:23.062738 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-4adf4ede-99ff-45cd-b8cf-72715272698d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0755162 Nov 24 15:01:23.280069 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-5fc26202-fd14-433d-ae66-9b95c67eb155 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2098920 Nov 24 15:01:23.306876 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7396c250-aa79-4856-b339-15be1ead3705', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.78', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '948bda43-771c-4718-b885-f4b02b03131d', 'port_id': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'mac_address': 'fa:16:3e:32:c9:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:01:20Z', 'updated_at': '2021-11-24T15:01:20Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:01:23.311024 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3bd9e69-d142-48b6-b385-e1ea79bed6f1 None None] The sync data for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv is: [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '7396c250-aa79-4856-b339-15be1ead3705', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'floating_ip_address': '172.26.4.78', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '948bda43-771c-4718-b885-f4b02b03131d', 'port_id': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'mac_address': 'fa:16:3e:32:c9:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:01:20Z', 'updated_at': '2021-11-24T15:01:20Z', 'revision_number': 0, 'project_id': '9482331cd77d4af992b911b12f253611', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:01:23.422711 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f1acebee-4166-464c-8ae4-4bf4daa4b9f1 req-821bace8-1a26-451e-936d-4ab3e35ea0d6 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1361639 Nov 24 15:01:23.905522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54768) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:24.018978 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-c2eae64e-7ee0-4891-9e76-932cfc660eff tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 990 time: 0.1120458 Nov 24 15:01:25.022645 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54772) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:25.131770 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-161944a7-65c8-411b-bec9-b6a4c7c21430 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 990 time: 0.1078260 Nov 24 15:01:25.943937 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d0a8c2c-06d4-4574-9b9f-c34b03218da9 None None] New status for floating IP 7396c250-aa79-4856-b339-15be1ead3705: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:01:26.135722 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54776) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:26.369725 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-4597a459-6453-4234-959f-58aaa4f42c8b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 990 time: 0.2327247 Nov 24 15:01:27.372903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54780) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:01:27.483774 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-de98cd24-4c28-4e99-afff-1c7d114142f5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 992 time: 0.1096275 Nov 24 15:01:27.869386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-0282bd69-d7a3-4232-872a-e5793f67a127 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0766881 Nov 24 15:01:28.028704 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-3628a356-79d6-441d-b75f-6e2c2b271043 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1098 time: 0.0723798 Nov 24 15:01:28.179642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989c6b66-9e40-49b0-8969-7199a763e136 req-aac19b27-b7aa-4965-acf8-19c61e5adecf service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:28.181070 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-aac19b27-b7aa-4965-acf8-19c61e5adecf service neutron] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 895 time: 0.1327822 Nov 24 15:01:28.300089 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-0d03b8c4-8e51-4ca8-a5d0-f0350163a1c4 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 1000 time: 0.1128159 Nov 24 15:01:28.375179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-989c6b66-9e40-49b0-8969-7199a763e136 req-676c3670-b0a0-4d18-904e-3910e73b9e77 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:01:28.377521 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-676c3670-b0a0-4d18-904e-3910e73b9e77 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.0714512 Nov 24 15:01:28.459447 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-af9dd70b-99fd-41fe-9b45-2ef264f4c060 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0759079 Nov 24 15:01:28.597883 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-2fa29700-e4cb-4a45-a4c6-f818eb178313 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1321523 Nov 24 15:01:28.858838 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-989c6b66-9e40-49b0-8969-7199a763e136 req-2071c2f4-8ed5-470b-8c75-f3a1a23de1ef service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2546756 Nov 24 15:01:33.404495 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-453c099f-b24c-46db-9858-dd2779dd9ac1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:33.789580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:35.957592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-085c1f6d-4ddd-4dfc-82d8-5ad4810b72a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:37.034889 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:38.724935 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:48.494266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:01:58.871016 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:02:03.411931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4102ab2e-0948-4ec8-8513-4af9a413fe1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:03.793554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:05.965381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9f334174-5d84-4486-ba92-2111ae77d60b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:07.035840 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:08.733151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:18.515576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:29.850670 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-70f21cc4-a5bd-40ec-b84c-38df02b81314 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0697033 Nov 24 15:02:29.993729 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-ebb2570d-7955-4e28-86a8-a84c11d6359a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1098 time: 0.0747085 Nov 24 15:02:30.149049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-5ddef57c-5462-435e-beae-ab29ad21595f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:30.150470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-5ddef57c-5462-435e-beae-ab29ad21595f service neutron] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 895 time: 0.1377721 Nov 24 15:02:30.264930 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-2e310c03-c362-4258-994f-3a56348f75fa service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 1000 time: 0.1077154 Nov 24 15:02:30.334350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-e843dbc3-bbec-4cfe-b0fe-2550e1f32241 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:30.335802 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-e843dbc3-bbec-4cfe-b0fe-2550e1f32241 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.0642343 Nov 24 15:02:30.413332 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-da68d4c3-f2dc-4e5a-b01a-d22292826a88 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0712290 Nov 24 15:02:30.550170 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-d0272960-53e0-46ff-8c1d-9edd90f38d94 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1305251 Nov 24 15:02:30.688832 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d31c104-9fc6-4e22-a751-f57164027ff4 req-24533dd6-872b-41ba-a6f1-e4a2b8e14739 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324110 Nov 24 15:02:33.446097 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-70c1461c-02a1-4a71-828e-88368e3a59d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:33.870400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:35.234801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b08159-e56d-44b9-8bc9-99d37e670f6c req-44cab613-eb3b-42d4-9cd9-6608c629c1f3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:35.236279 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-48b08159-e56d-44b9-8bc9-99d37e670f6c req-44cab613-eb3b-42d4-9cd9-6608c629c1f3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0804439 Nov 24 15:02:35.284705 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-48b08159-e56d-44b9-8bc9-99d37e670f6c req-722a0abe-c27d-47c8-9b4d-6a44153df232 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425112 Nov 24 15:02:35.870964 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:02:35.962003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9a3512f0-97e5-49f8-b06e-f27575c6db60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:36.513488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b850f829-8025-48ca-9a99-f07167cf926e req-a6041928-6ba9-482a-be04-7202432c8ffa tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:36.515664 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b850f829-8025-48ca-9a99-f07167cf926e req-a6041928-6ba9-482a-be04-7202432c8ffa tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0889091 Nov 24 15:02:36.576759 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b850f829-8025-48ca-9a99-f07167cf926e req-a50a395c-6a4e-4d68-b870-c204db24727a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507250 Nov 24 15:02:37.038014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:37.785188 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-387e21b6-57fc-4ad9-a89d-cd2d30c770f7 req-b05b9f89-c20a-42bb-bdd4-a2184035a79b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:37.786798 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-387e21b6-57fc-4ad9-a89d-cd2d30c770f7 req-b05b9f89-c20a-42bb-bdd4-a2184035a79b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0808082 Nov 24 15:02:37.853688 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-387e21b6-57fc-4ad9-a89d-cd2d30c770f7 req-ebd2b381-a2f4-41bf-8ceb-4c727e1150e7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537243 Nov 24 15:02:37.882496 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54814) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:37.990338 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7e45f0d7-010d-4138-9fbe-8b8f8a936628 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 992 time: 0.1066086 Nov 24 15:02:38.732911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:39.567408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e37235d9-0116-4665-8db1-56861d438b77 req-67d08201-b0c1-4ae5-8fce-bb0b52b002a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:39.568822 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e37235d9-0116-4665-8db1-56861d438b77 req-67d08201-b0c1-4ae5-8fce-bb0b52b002a7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.1454651 Nov 24 15:02:39.572420 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-23aa9fed-f13b-4cbb-9a25-c038eab06cfe service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1098 time: 0.1134779 Nov 24 15:02:39.694206 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e37235d9-0116-4665-8db1-56861d438b77 req-4f0d81cf-81df-469b-b760-4848fad2d4e6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1195621 Nov 24 15:02:39.742342 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-abac2921-471a-4c02-8f25-c10a3ebbce44 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:39.743839 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-abac2921-471a-4c02-8f25-c10a3ebbce44 service neutron] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 895 time: 0.1550062 Nov 24 15:02:39.852512 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-9e57c00e-366e-46c8-ae08-48af57e4c8e5 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 1000 time: 0.1024604 Nov 24 15:02:39.958723 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-25d07a5a-8a07-4990-834f-ec3243802679 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:39.961135 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-25d07a5a-8a07-4990-834f-ec3243802679 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.1021454 Nov 24 15:02:40.041548 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-d7f36b69-6dc2-4a37-b94f-465f43c9f9ab service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0746856 Nov 24 15:02:40.289275 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-c6689871-077d-41c8-9c52-474d3c38e956 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2416193 Nov 24 15:02:40.422451 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6dad0cfe-8200-475a-a3f3-ec1a9bded1f7 req-8b0d0c60-29c6-4c92-8827-26eba1c8775f service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1273329 Nov 24 15:02:40.911281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ccd15d-afd3-4bc2-8c1a-59453a62f4ca req-32e69146-d264-400e-becf-f73bc306037c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:40.912782 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1ccd15d-afd3-4bc2-8c1a-59453a62f4ca req-32e69146-d264-400e-becf-f73bc306037c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0898466 Nov 24 15:02:40.962351 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e1ccd15d-afd3-4bc2-8c1a-59453a62f4ca req-9d57ea03-f352-4053-a99c-161afcc6cd20 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439458 Nov 24 15:02:42.166802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2379f7-883b-4eea-a4e9-102a8235e707 req-63f86c2d-6208-475b-83b3-46e4c3d3596a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:42.168268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea2379f7-883b-4eea-a4e9-102a8235e707 req-63f86c2d-6208-475b-83b3-46e4c3d3596a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0823839 Nov 24 15:02:42.216049 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ea2379f7-883b-4eea-a4e9-102a8235e707 req-58beec21-fe55-48af-bdeb-bc269d18afbc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408437 Nov 24 15:02:42.245181 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54828) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:42.356670 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3625b7d2-5ebe-40af-8b3c-64edcec0a6d5 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 200 len: 992 time: 0.1101544 Nov 24 15:02:42.639628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54836) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:42.850508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port f9a041d0-c1ef-426f-a0e6-746a64bce82f {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:02:42.850842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:43.026789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:43.027040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:43.157977 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for f9a041d0-c1ef-426f-a0e6-746a64bce82f owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:02:43.317151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:43.322028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b08f581e-8645-46dd-beb5-b279fc5f5e4b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:43.379474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=f9a041d0-c1ef-426f-a0e6-746a64bce82f,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:43.416990 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.417377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.417760 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.418132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.418499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.418869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.419233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.419598 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.420631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.421122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.421600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:43.428546 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:43.486738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:44.026895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 948bda43-771c-4718-b885-f4b02b03131d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:02:44.278276 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:02:44.300473 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] Sync routers for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:02:44.317196 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:44.329689 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:02:44.330598 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:44.413042 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-938f95ba-f9d9-4f21-91c3-e8908943c1cc tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/floatingips/7396c250-aa79-4856-b339-15be1ead3705 HTTP/1.1" status: 204 len: 168 time: 1.7695773 Nov 24 15:02:44.413042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:02:44.473919 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'status': 'completed', 'code': 200} Nov 24 15:02:44.575910 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-53f9775e-d9c9-4c61-bba0-8a1ff1171948 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=9482331cd77d4af992b911b12f253611&device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 1098 time: 0.0767353 Nov 24 15:02:44.579832 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:02:44.749062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-181984e8-7dcd-4774-82ac-8d396210f2af service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:44.750529 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-181984e8-7dcd-4774-82ac-8d396210f2af service neutron] 10.222.0.47 "GET /v2.0/networks?id=7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 200 len: 895 time: 0.1674662 Nov 24 15:02:44.825441 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-efc99978-e372-44a9-8e08-ce5445cddcff service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 200 len: 217 time: 0.0667293 Nov 24 15:02:44.876829 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e85a97-8c55-4563-9fa9-e1a77316b208 req-0eb9cf0c-95d9-4b84-83b0-474c8467558f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:44.878359 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-77e85a97-8c55-4563-9fa9-e1a77316b208 req-0eb9cf0c-95d9-4b84-83b0-474c8467558f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0930912 Nov 24 15:02:44.927475 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-77e85a97-8c55-4563-9fa9-e1a77316b208 req-cef57370-aed8-4ecd-8c5f-74698c9380e8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432043 Nov 24 15:02:44.936592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:44.940927 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-bba57edc-d263-4fec-b206-7ed2e89ceb0b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:44.942018 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] Checking router: 948bda43-771c-4718-b885-f4b02b03131d for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:02:44.943540 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-bba57edc-d263-4fec-b206-7ed2e89ceb0b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 200 len: 835 time: 0.1063797 Nov 24 15:02:44.954226 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:02:44.954835 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:45.028781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-06466c3d-6b2c-4f38-81fe-da1439fd5430 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=7eec1d5c-64fa-44a9-9534-54389054c34c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0782008 Nov 24 15:02:45.139582 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:02:45.170371 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-3326f81e-59a9-46c9-be65-13910fdafe33 service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1334364 Nov 24 15:02:45.322576 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7436aa5d-88e7-4f5a-9903-d9330f6b15fb req-f206d0f3-fc4d-4662-bb5a-c5276337440b service neutron] 10.222.0.47 "GET /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1452377 Nov 24 15:02:45.473196 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:45.477005 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a15efff8-4fab-4a10-8c02-fadb91bba508 None None] The sync data for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv is: [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': 'a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54', 'name': '', 'network_id': '7eec1d5c-64fa-44a9-9534-54389054c34c', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'mac_address': 'fa:16:3e:6c:46:9f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:01:03Z', 'updated_at': '2021-11-24T15:01:10Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'subnets': [{'id': 'a4db6e34-fd42-4891-8ed1-1c5b91c809c8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:02:45.728336 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b96c413-9716-4c11-acd4-11cbc8c38051 None None] New status for floating IP 7396c250-aa79-4856-b339-15be1ead3705: DOWN {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:02:46.148881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d01c7deb-361d-49f2-8e83-3317d7bbde67 req-4cb83aed-3dc2-49d0-b702-4a86f19f0c3b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:46.149558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d01c7deb-361d-49f2-8e83-3317d7bbde67 req-4cb83aed-3dc2-49d0-b702-4a86f19f0c3b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Synchronizing usage tracker for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:02:46.166032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d01c7deb-361d-49f2-8e83-3317d7bbde67 req-4cb83aed-3dc2-49d0-b702-4a86f19f0c3b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Unset dirty status for tenant:9482331cd77d4af992b911b12f253611 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:02:46.167192 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d01c7deb-361d-49f2-8e83-3317d7bbde67 req-4cb83aed-3dc2-49d0-b702-4a86f19f0c3b tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.1030257 Nov 24 15:02:46.218057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d01c7deb-361d-49f2-8e83-3317d7bbde67 req-b8bfff8a-5b2b-4a42-8b19-d683b0d28ed3 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/security-groups?id=20d1c05b-4eeb-4193-a56e-7e534191ab46&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447156 Nov 24 15:02:46.438879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-eaa1f426-93dd-4e10-9bc7-e74eda7947d1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:46.440358 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-eaa1f426-93dd-4e10-9bc7-e74eda7947d1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 945 time: 0.0775361 Nov 24 15:02:46.515690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port ba5ce296-b48b-4dac-9788-41fb6a625085 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:02:46.515970 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:46.780868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port ba5ce296-b48b-4dac-9788-41fb6a625085, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=ba5ce296-b48b-4dac-9788-41fb6a625085,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:02:46.781128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:47.028407 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for ba5ce296-b48b-4dac-9788-41fb6a625085 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:02:47.179161 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:47.186515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:47.231511 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=ba5ce296-b48b-4dac-9788-41fb6a625085,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:47.234847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:47.317950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] No DVR routers for this DVR port ba5ce296-b48b-4dac-9788-41fb6a625085 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:02:47.320576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:47.323438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'name': 'network-vif-deleted', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:02:47.344028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9cb3d882-54db-4b27-b9bd-0f05866c9579 req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.47 "DELETE /v2.0/ports/ba5ce296-b48b-4dac-9788-41fb6a625085 HTTP/1.1" status: 204 len: 173 time: 0.8939214 Nov 24 15:02:47.393857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e41b763d-b0a8-4adf-a9ed-96a1b99860cc', 'name': 'network-vif-deleted', 'tag': 'ba5ce296-b48b-4dac-9788-41fb6a625085', 'status': 'completed', 'code': 200} Nov 24 15:02:47.418001 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-75a6a42e-c9cb-4036-8f24-56136535db33 req-2210f07f-9e55-45ae-b8b3-d3d5c3bb38e2 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "GET /v2.0/ports?device_id=e41b763d-b0a8-4adf-a9ed-96a1b99860cc HTTP/1.1" status: 200 len: 210 time: 0.0491700 Nov 24 15:02:48.521020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:48.532696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54854) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:48.963125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:49.575573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:02:49.576933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:49.769232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:02:49.769582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:50.005290 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:02:50.208868 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:50.212641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-169f46fe-22a7-4f41-986f-df6ffbeede69 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:50.256512 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:50.258999 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:50.563743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:51.023952 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ba5ce296-b48b-4dac-9788-41fb6a625085 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:02:51.058478 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: ba5ce296-b48b-4dac-9788-41fb6a625085 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:02:51.058868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device ba5ce296-b48b-4dac-9788-41fb6a625085 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:02:51.160167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Router 948bda43-771c-4718-b885-f4b02b03131d has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:02:51.499430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:02:51.510405 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] Sync routers for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:02:51.512944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "PUT /v2.0/routers/948bda43-771c-4718-b885-f4b02b03131d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9783511 Nov 24 15:02:51.514890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54858) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:51.524730 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:02:51.525747 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:51.720381 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:02:51.731720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting subnet a4db6e34-fd42-4891-8ed1-1c5b91c809c8 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 15:02:51.735788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:51.795405 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:51.881700 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:51.971182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:51.975430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fac21822-4499-4dc7-b8d3-f80d77e7c80d tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:52.023437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Subnet': ['ID=a4db6e34-fd42-4891-8ed1-1c5b91c809c8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:52.027836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:52.034962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.048067 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-956640b7-d246-42cb-a3bd-348b7e4d29a1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/subnets/a4db6e34-fd42-4891-8ed1-1c5b91c809c8 HTTP/1.1" status: 204 len: 168 time: 0.5317581 Nov 24 15:02:52.049593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98df73ce-2d49-42da-8b22-7578a21b5c2b None None] Network 7eec1d5c-64fa-44a9-9534-54389054c34c requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:02:52.051616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54862) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:52.070124 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:02:50Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:52.080928 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] Checking router: 948bda43-771c-4718-b885-f4b02b03131d for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:02:52.098799 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] Routers {'948bda43-771c-4718-b885-f4b02b03131d'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:02:52.099430 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['948bda43-771c-4718-b885-f4b02b03131d'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:52.277637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.318249 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] Set router 948bda43-771c-4718-b885-f4b02b03131d gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:02:52.361663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] DHCP port deletion for 7eec1d5c-64fa-44a9-9534-54389054c34c request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 15:02:52.365600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Deleting port 9c32d5e5-9a27-493e-953e-f9d39a523e27 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:02:52.366059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.493581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.506256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Deleting port 4ea054ed-aede-4d57-ac39-3bc7f3d86439 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:02:52.506656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.585290 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] For port 9c32d5e5-9a27-493e-953e-f9d39a523e27, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=9c32d5e5-9a27-493e-953e-f9d39a523e27,segment=NetworkSegment(41501d45-bef8-4807-b9fc-cfe4d6d1a28a),segment_id=41501d45-bef8-4807-b9fc-cfe4d6d1a28a)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:02:52.586133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.622176 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:02:50Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:52.627092 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6eae7fb5-ff14-46e5-b682-fb2214650d20 None None] The sync data for ids ['948bda43-771c-4718-b885-f4b02b03131d'] in dv-neutron-818151-2-hyperv is: [{'id': '948bda43-771c-4718-b885-f4b02b03131d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1324569178', 'tenant_id': '9482331cd77d4af992b911b12f253611', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132'}], 'enable_snat': True}, 'gw_port_id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:00:58Z', 'updated_at': '2021-11-24T15:02:50Z', 'revision_number': 5, 'project_id': '9482331cd77d4af992b911b12f253611', 'gw_port': {'id': '4ea054ed-aede-4d57-ac39-3bc7f3d86439', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:7a:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '948bda43-771c-4718-b885-f4b02b03131d', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.132', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:00:59Z', 'updated_at': '2021-11-24T15:01:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:02:52.696518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] For port 4ea054ed-aede-4d57-ac39-3bc7f3d86439, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4ea054ed-aede-4d57-ac39-3bc7f3d86439,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:02:52.696901 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.721532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Calling delete_port for 9c32d5e5-9a27-493e-953e-f9d39a523e27 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:02:52.794452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042'] for port, after_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:52.798895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:52.816813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Calling delete_port for 4ea054ed-aede-4d57-ac39-3bc7f3d86439 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:02:52.841011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Pushing event deleted for resources: {'Port': ['ID=9c32d5e5-9a27-493e-953e-f9d39a523e27,revision_number=None']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:52.846592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] No DVR routers for this DVR port 9c32d5e5-9a27-493e-953e-f9d39a523e27 on host dv-neutron-818151-2-hyperv {{(pid=83527) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.855705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.857557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.857557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.857557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.857557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:52.860681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:53.003377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.005498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1279b178-265f-404e-a2ab-2b58a6a8024d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:53.055170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Port': ['ID=4ea054ed-aede-4d57-ac39-3bc7f3d86439,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:53.057785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:53.411740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.676168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.680803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.708218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.708866 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Fanout notify agent at l3_agent the message router_deleted on router 948bda43-771c-4718-b885-f4b02b03131d {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 15:02:53.724044 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.725132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/routers/948bda43-771c-4718-b885-f4b02b03131d HTTP/1.1" status: 204 len: 168 time: 1.6723676 Nov 24 15:02:53.727948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54866) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:53.848462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:53.980812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.006124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7eec1d5c-64fa-44a9-9534-54389054c34c']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:54.017920 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41501d45-bef8-4807-b9fc-cfe4d6d1a28a') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:54.018215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41501d45-bef8-4807-b9fc-cfe4d6d1a28a') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:54.029692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.045774 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.052718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Releasing vlan 852 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 15:02:54.053165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 15:02:54.069113 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 15:02:54.154574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.158012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-815ef804-872a-4e6b-b8b2-9bf5bc38ca7d tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:54.172325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.183555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'Network': ['ID=7eec1d5c-64fa-44a9-9534-54389054c34c,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:54.187654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:54.193295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/networks/7eec1d5c-64fa-44a9-9534-54389054c34c HTTP/1.1" status: 204 len: 168 time: 0.4643698 Nov 24 15:02:54.196091 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54870) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:54.273795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.306449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.352265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:02:54.376005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.379935 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4c8850d2-2816-47a4-8d7f-508df109f3ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:54.396522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=20d1c05b-4eeb-4193-a56e-7e534191ab46,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:54.399481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:54.409098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:54.410375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-084f861a-6d56-4b2d-9b13-def572b0ae71 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] 10.222.0.70 "DELETE /v2.0/security-groups/20d1c05b-4eeb-4193-a56e-7e534191ab46 HTTP/1.1" status: 204 len: 168 time: 0.2132528 Nov 24 15:02:54.444368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:02:54.444690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device a66d7f1d-1f94-4bfd-bfef-f8162bf5bf54 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:02:54.445177 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9c32d5e5-9a27-493e-953e-f9d39a523e27 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:02:54.478496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 9c32d5e5-9a27-493e-953e-f9d39a523e27 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:02:54.478849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 9c32d5e5-9a27-493e-953e-f9d39a523e27 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:02:54.479266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ea054ed-aede-4d57-ac39-3bc7f3d86439 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:02:54.514378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 4ea054ed-aede-4d57-ac39-3bc7f3d86439 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:02:54.514745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ea054ed-aede-4d57-ac39-3bc7f3d86439 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:02:54.827271 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54880) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:55.011889 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6f7e3fca-237a-47af-b237-f4b1f63b8581 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=9482331cd77d4af992b911b12f253611&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1826510 Nov 24 15:02:55.014454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54886) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:55.079689 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.106220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.163319 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.167119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:55.181156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf2b9406-8b1e-4dc9-a393-a13448872681,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:55.184724 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:55.188215 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.189370 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/bf2b9406-8b1e-4dc9-a393-a13448872681 HTTP/1.1" status: 204 len: 168 time: 0.1739800 Nov 24 15:02:55.532891 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54894) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:55.551432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.585705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:02:55.589987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Usage tracker for resource:security_group_rule and tenant:420c44db10b34eb6a1567f96457d39f2 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:02:55.593384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:02:55.599555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:02:55.670039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.674455 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.681725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-48c4d212-014d-469f-a1b3-e76eeabb2f39 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:55.723670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b1f918d-c1f3-47dc-8c0b-20abc5c1e78e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:55.726720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:55.730151 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9d94997b-2f90-4e53-b6cd-d70b385ad8ae admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=420c44db10b34eb6a1567f96457d39f2&name=default HTTP/1.1" status: 200 len: 2647 time: 0.1962879 Nov 24 15:02:55.733010 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 54898) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:55.792325 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.824535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.882839 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.886845 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-6ed5a1e8-ebdd-4145-a7c4-a844dd4829fe tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:55.898739 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b1f918d-c1f3-47dc-8c0b-20abc5c1e78e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:55.909799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:55.910905 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/1b1f918d-c1f3-47dc-8c0b-20abc5c1e78e HTTP/1.1" status: 204 len: 168 time: 0.1769371 Nov 24 15:02:55.912744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.913137 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.913610 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.914021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.914352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.915082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.915082 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.915419 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.916337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.916337 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.916679 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:02:55.920040 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-fe511a61-df3b-4f93-8407-0d5c3cc35833 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:56.820667 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54920) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:56.955384 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-502047448-network', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:02:56.960707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:02:56.964450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Usage tracker for resource:network and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:02:56.969584 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:02:56.975338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:02:56.985808 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Made reservation on behalf of 8ea7acbe2851472a95e5b9a5d726a011 for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:02:56.988433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.002442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.035013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:02:57.038792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:02:57.041597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:02:57.048255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:02:57.120735 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.124848 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.127962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc3bc182-8b84-4de9-9225-5b3201189d3f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:57.158148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 897} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 15:02:57.166477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df466cd8-6fc5-4269-8ef3-806df17c31e6,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:57.170495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:57.175103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.175461 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Added segment 813f4bb2-91ce-4380-87dd-7be1beb26558 of type vlan for network 3bace08e-55bc-42bb-be54-36d02a25dcad Nov 24 15:02:57.203307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.235248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.235904 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:57.236476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.239973 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-80283c2d-11ed-4724-b27f-ee7528fedb7f tempest-RoutersNegativeTest-796697603 tempest-RoutersNegativeTest-796697603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:57.453404 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Pushing event updated for resources: {'Network': ['ID=3bace08e-55bc-42bb-be54-36d02a25dcad,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:57.456798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:57.458833 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.6369379 Nov 24 15:02:57.461872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54926) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:57.464800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 3bace08e-55bc-42bb-be54-36d02a25dcad details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 15:02:57.468048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Request body: {'subnet': {'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-502047448-subnet', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:02:57.473159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:02:57.477027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Usage tracker for resource:subnet and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:02:57.479910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:02:57.486722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:02:57.496995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Made reservation on behalf of 8ea7acbe2851472a95e5b9a5d726a011 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:02:57.499442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.708398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.712027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1260d1c3-4777-46ac-aec0-7f463aa38bb6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:57.782858 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Pushing event updated for resources: {'Subnet': ['ID=9119f9d2-54c0-4483-ad28-6f72771e7d2d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:57.785941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:57.798663 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Checking segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:02:57.799016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Network hostable DHCP agents. Network: 3bace08e-55bc-42bb-be54-36d02a25dcad, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:02:57.822408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Network 3bace08e-55bc-42bb-be54-36d02a25dcad is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:02:57.832975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 3bace08e-55bc-42bb-be54-36d02a25dcad) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:02:57.838746 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:02:57.839322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.843654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00947216-63d1-4e4f-9352-5e5daf4a3e9a None None] Network 3bace08e-55bc-42bb-be54-36d02a25dcad requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:02:57.863231 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-30d65f8f-2154-4fff-8812-467bb60f2a6d admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4001994 Nov 24 15:02:57.865829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54930) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:57.870998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:02:57.877173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:02:57.881296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Usage tracker for resource:router and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:02:57.884409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:02:57.891250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:02:57.906630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.908053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:57.927707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.067633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-3bace08e-55bc-42bb-be54-36d02a25dcad', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 15:02:58.068687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.082687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.228582 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Allocated IP 172.20.0.2 (3bace08e-55bc-42bb-be54-36d02a25dcad/9119f9d2-54c0-4483-ad28-6f72771e7d2d/bf400227-6a30-4469-91e6-7398c9df88a0) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:02:58.279615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.312829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.445041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.455822 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Allocated IP 172.26.4.165 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:02:58.457663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Transition to ACTIVE for port object bf400227-6a30-4469-91e6-7398c9df88a0 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:02:58.478459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Transition to ACTIVE for port object bf400227-6a30-4469-91e6-7398c9df88a0 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:02:58.487172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.498011 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:58.585299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Network 3bace08e-55bc-42bb-be54-36d02a25dcad is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:02:58.586381 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:02:58.589859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:02:58.601007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Pushing event updated for resources: {'Port': ['ID=bf400227-6a30-4469-91e6-7398c9df88a0,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:58.632527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:58.658613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.687049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Attempting to bind port bf400227-6a30-4469-91e6-7398c9df88a0 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:02:58.687423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Attempting to bind port bf400227-6a30-4469-91e6-7398c9df88a0 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:02:58.687822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Attempting to bind port bf400227-6a30-4469-91e6-7398c9df88a0 on network 3bace08e-55bc-42bb-be54-36d02a25dcad {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:02:58.689621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.694766 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-901fa956-f66c-40db-ac6f-fffb79442835 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:58.695057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:02:58.695394 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Checking segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:02:58.695842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.696248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Bound using segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:02:58.696742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Bound port: bf400227-6a30-4469-91e6-7398c9df88a0, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:02:58.697131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.757564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:02:58.766107 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:02:58.769165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:02:58.795490 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] For port bf400227-6a30-4469-91e6-7398c9df88a0, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:02:58.799031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] For port bf400227-6a30-4469-91e6-7398c9df88a0, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf400227-6a30-4469-91e6-7398c9df88a0,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:02:58.804850 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.810319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:02:58.813160 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Pushing event updated for resources: {'Port': ['ID=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:58.816708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:58.891581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Pushing event updated for resources: {'Port': ['ID=bf400227-6a30-4469-91e6-7398c9df88a0,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:02:58.894724 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:02:58.956751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:58.957559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:59.224626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 15:02:59.547795 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:02:59.558014 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:02:59.572187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:02:59.572916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:02:59.576250 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:02:59.577607 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.7108247 Nov 24 15:02:59.580227 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54934) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:02:59.775144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:02:59.879225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fa1f6ab-e6a4-42b5-8206-f54e602bd6f8 None None] Network 3bace08e-55bc-42bb-be54-36d02a25dcad requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:03:00.156162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-431aaa1a-7d1a-4c18-a2e5-d089c2c4018c None None] Provisioning for port bf400227-6a30-4469-91e6-7398c9df88a0 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:00.335321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:02:58Z', 'revision_number': 3, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:02:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:00.346884 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:03:00.347248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Updating router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:03:00.382092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.407720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.433425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf400227-6a30-4469-91e6-7398c9df88a0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:00.598395 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port bf400227-6a30-4469-91e6-7398c9df88a0 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:00.605609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bf400227-6a30-4469-91e6-7398c9df88a0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:00.606432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.646647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Allocated IP 172.20.0.1 (3bace08e-55bc-42bb-be54-36d02a25dcad/9119f9d2-54c0-4483-ad28-6f72771e7d2d/4ed226b7-2923-4b9f-a4d7-66349a2dd9e8) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:03:00.761932 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ba0584d5-a575-40a8-b6c7-856c16253645 None None] Provisioning complete for port bf400227-6a30-4469-91e6-7398c9df88a0 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:00.762188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ba0584d5-a575-40a8-b6c7-856c16253645 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.817237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.833638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Transition to ACTIVE for port object 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:00.858912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.869677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-7f8e5724-f07a-4479-901d-5454e80d1be1 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:00.911988 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:00.947932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Network 3bace08e-55bc-42bb-be54-36d02a25dcad is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:00.951703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:00.953599 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Pushing event updated for resources: {'Port': ['ID=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:00.955719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:03:00.985708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:01.019259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.039152 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ba0584d5-a575-40a8-b6c7-856c16253645 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.078299 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port bf400227-6a30-4469-91e6-7398c9df88a0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf400227-6a30-4469-91e6-7398c9df88a0,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:01.095153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.099368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:01.127233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.133532 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.206274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Transition to ACTIVE for port object 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:01.231350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.236900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=bf400227-6a30-4469-91e6-7398c9df88a0,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:01.240479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-ba0584d5-a575-40a8-b6c7-856c16253645 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 15:03:01.241041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-ba0584d5-a575-40a8-b6c7-856c16253645 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 15:03:01.242818 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:01.243441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:01.324360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Attempting to bind port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:03:01.324756 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Attempting to bind port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:03:01.325092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Attempting to bind port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:01.328849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67ca766-aee2-4cee-ab0d-b10e7f01acb8 None None] Pushing event updated for resources: {'Port': ['ID=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:01.333455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a67ca766-aee2-4cee-ab0d-b10e7f01acb8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:01.337092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 2, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:03:01.337348 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:01.337762 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.338158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:03:01.338636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Bound port: 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:03:01.339010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.421252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] For port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:03:01.424954 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] For port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:03:01.430837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.435302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-824209f8-3059-4222-80ec-e27f9c5523e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:01.501126 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.505962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.510808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67ca766-aee2-4cee-ab0d-b10e7f01acb8 None None] Pushing event updated for resources: {'Port': ['ID=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:01.514927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a67ca766-aee2-4cee-ab0d-b10e7f01acb8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:01.518504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:01.519127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:02:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:01.534739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-593d7d9e-981e-4a63-b547-0b86e507dfa9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:01.618986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:01.623262 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Pushing event updated for resources: {'Port': ['ID=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:01.626888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:01.768971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Network 3bace08e-55bc-42bb-be54-36d02a25dcad is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:01.770284 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:01.812867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:02.037726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf3058f3-fe0e-4b77-87c5-cc3d86c52032 None None] Provisioning for port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:02.049784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf3058f3-fe0e-4b77-87c5-cc3d86c52032 None None] Provisioning complete for port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:02.050080 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf3058f3-fe0e-4b77-87c5-cc3d86c52032 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:02.136502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf3058f3-fe0e-4b77-87c5-cc3d86c52032 None None] Port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:03:02.181113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:03:02.200142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 2, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:02.205498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b60e131-797e-4948-8066-0a1bddf49aa2 None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 2, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:03:02.269069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4588138e-96ba-4a62-bf59-5fb5f106e146 None None] Provisioning complete for port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:02.269759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4588138e-96ba-4a62-bf59-5fb5f106e146 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:02.347138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4588138e-96ba-4a62-bf59-5fb5f106e146 None None] Port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:03:02.375679 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf400227-6a30-4469-91e6-7398c9df88a0 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:02.430327 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:03:02.448350 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] 10.222.0.70 "PUT /v2.0/routers/57b208f4-3b28-49da-ab2e-e4eb44a2e088/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8669465 Nov 24 15:03:02.477138 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port bf400227-6a30-4469-91e6-7398c9df88a0 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:02.477357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.415308 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e2152dbb-fa8c-4f91-a32c-95edfce8b827 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.481295 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54956) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:03.488124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-5738910-network', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:03.493424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:03.497496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Usage tracker for resource:network and tenant:f88f6c692de147a68233f78a4b9d682f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:03.500489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:03.506127 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:03.518257 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Made reservation on behalf of f88f6c692de147a68233f78a4b9d682f for: {'network': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:03:03.520611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.533969 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.568111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:03.572006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Usage tracker for resource:security_group_rule and tenant:f88f6c692de147a68233f78a4b9d682f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:03.574780 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:03.582534 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:03.652829 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.658018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.661047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-92ea9b49-7129-4213-9903-3b30e220ec84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:03.689177 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854} {{(pid=83526) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 15:03:03.697679 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=812aad9c-9417-41c2-8626-7d8363837550,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:03.701921 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:03.704533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.704875 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.segments_db [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Added segment 3634727d-b0b0-4f21-93f9-ce9566a38361 of type vlan for network 7edb0d44-f6a4-45ec-996d-1c10575992d9 Nov 24 15:03:03.733013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.767524 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.768445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:03.769012 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.772544 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-866eec04-5b7b-4f57-a9ce-22b98c8d3e28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:03.794639 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:03.879481 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 879 time: 0.3934155 Nov 24 15:03:03.879481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Pushing event updated for resources: {'Network': ['ID=7edb0d44-f6a4-45ec-996d-1c10575992d9,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:03.879481 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54960) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:03.881621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a29d160b-16bb-433f-8cf1-5cfad19bc0ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:03.885064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Request body: {'subnet': {'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-5738910-subnet', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:03.889385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 15:03:03.891423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:03.895660 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Usage tracker for resource:subnet and tenant:f88f6c692de147a68233f78a4b9d682f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:03.899015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:03.906267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:03.921943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Made reservation on behalf of f88f6c692de147a68233f78a4b9d682f for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:03:03.924427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.138622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.142690 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dee8e4ff-c37f-467f-9c43-0a3724139ff9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:04.213950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Pushing event updated for resources: {'Subnet': ['ID=2011a02a-5a19-4787-8def-3bfb750cbe1b,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:04.218896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:04.229377 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Checking segment: {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:04.229734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Network hostable DHCP agents. Network: 7edb0d44-f6a4-45ec-996d-1c10575992d9, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:03:04.255515 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:03:04.268787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 7edb0d44-f6a4-45ec-996d-1c10575992d9) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:04.274203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:04.275233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.281005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c260a37-f134-4b5a-9542-2cb725cd2f42 None None] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:03:04.305895 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-e6ab4d02-9a97-4de7-9fb7-e2fba69f67fe admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.4259696 Nov 24 15:03:04.308572 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54964) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:04.314940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:04.321778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:04.328146 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Usage tracker for resource:router and tenant:f88f6c692de147a68233f78a4b9d682f is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:04.332359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:04.338447 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:04.355800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.355800 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.376034 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.406329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:04.574492 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:04.579729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:04.580111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.604633 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-7edb0d44-f6a4-45ec-996d-1c10575992d9', 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'fixed_ips': [{'subnet_id': '2011a02a-5a19-4787-8def-3bfb750cbe1b'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 15:03:04.605462 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.648843 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.820920 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.839864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.848222 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Allocated IP 172.20.0.2 (7edb0d44-f6a4-45ec-996d-1c10575992d9/2011a02a-5a19-4787-8def-3bfb750cbe1b/c56c4bdc-2e9b-4717-982e-88a055ba5a2e) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:03:04.850960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:04.854593 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:04.857693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-f7f437c9-5faf-4bb7-a882-a437d67cf7cf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:04.876953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.021564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Allocated IP 172.26.4.11 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/25d4b937-8c2d-4510-8881-8f1dfa752e35) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:03:05.067020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:05.071382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:05.180237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.189993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.200775 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Transition to ACTIVE for port object c56c4bdc-2e9b-4717-982e-88a055ba5a2e will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:05.211575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.217021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:05.221425 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Transition to ACTIVE for port object c56c4bdc-2e9b-4717-982e-88a055ba5a2e will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:05.227415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.231938 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:05.288281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:05.291606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:05.297098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:03:05.306807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:05.311705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:05.313594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Pushing event updated for resources: {'Port': ['ID=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:05.316049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:03:05.318483 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:05.326200 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Pushing event updated for resources: {'Port': ['ID=25d4b937-8c2d-4510-8881-8f1dfa752e35,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:05.333802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:05.411095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Attempting to bind port c56c4bdc-2e9b-4717-982e-88a055ba5a2e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:03:05.411663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Attempting to bind port c56c4bdc-2e9b-4717-982e-88a055ba5a2e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:03:05.412241 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Attempting to bind port c56c4bdc-2e9b-4717-982e-88a055ba5a2e on network 7edb0d44-f6a4-45ec-996d-1c10575992d9 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:05.421420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:03:05.421793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Checking segment: {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:05.422244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.422609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Bound using segment: {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:03:05.423073 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Bound port: c56c4bdc-2e9b-4717-982e-88a055ba5a2e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:03:05.423475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.479664 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.480438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.517167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] For port c56c4bdc-2e9b-4717-982e-88a055ba5a2e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:03:05.520345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] For port c56c4bdc-2e9b-4717-982e-88a055ba5a2e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:03:05.524687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.528864 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a67ca766-aee2-4cee-ab0d-b10e7f01acb8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:05.605531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Pushing event updated for resources: {'Port': ['ID=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:05.609206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:05.728312 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 15:03:05.957275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-729555be-1f18-4b0d-8598-1a18e912109a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:05.991318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:03:06.003688 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Sync routers for ids ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:03:06.018594 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Routers {'e1f813e5-005b-4741-b1db-c5fc7c9ecec0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:06.019259 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:06.019618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:06.021144 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 917 time: 1.7114689 Nov 24 15:03:06.024133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54968) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:06.205468 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Set router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:06.478206 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:06.517399 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:05Z', 'revision_number': 3, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:06.522791 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Checking router: e1f813e5-005b-4741-b1db-c5fc7c9ecec0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:03:06.523547 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Updating router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 port 25d4b937-8c2d-4510-8881-8f1dfa752e35 binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:03:06.567191 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:06.568033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:06.584488 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:06.704451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff8cde81-8d40-43bc-a3b4-efb9694b1741 None None] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:03:06.793047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c56c4bdc-2e9b-4717-982e-88a055ba5a2e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:06.883833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5accc2d4-bcb3-4fa7-86d9-698d0cf9cbd0 None None] Provisioning for port c56c4bdc-2e9b-4717-982e-88a055ba5a2e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:06.970248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port c56c4bdc-2e9b-4717-982e-88a055ba5a2e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:06.990106 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.004281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c56c4bdc-2e9b-4717-982e-88a055ba5a2e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:07.004281 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.006398 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.019956 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Transition to ACTIVE for port object 25d4b937-8c2d-4510-8881-8f1dfa752e35 will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:07.029488 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.046492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:07.078796 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.111506 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Attempting to bind port 25d4b937-8c2d-4510-8881-8f1dfa752e35 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:03:07.112045 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Attempting to bind port 25d4b937-8c2d-4510-8881-8f1dfa752e35 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:03:07.112506 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Attempting to bind port 25d4b937-8c2d-4510-8881-8f1dfa752e35 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:07.132867 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Pushing event updated for resources: {'Port': ['ID=25d4b937-8c2d-4510-8881-8f1dfa752e35,revision_number=2']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:07.136252 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:03:07.136852 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:07.137424 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.138071 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:03:07.138853 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Bound port: 25d4b937-8c2d-4510-8881-8f1dfa752e35, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:03:07.139452 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.165854 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.185022 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.185600 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.186127 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.186609 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.187088 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.187572 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.188080 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.188544 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.189051 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.189373 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.189694 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:03:07.195134 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:07.206976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port c56c4bdc-2e9b-4717-982e-88a055ba5a2e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:07.214537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.216793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:07.251195 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] For port 25d4b937-8c2d-4510-8881-8f1dfa752e35, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:03:07.255395 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] For port 25d4b937-8c2d-4510-8881-8f1dfa752e35, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=25d4b937-8c2d-4510-8881-8f1dfa752e35,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:03:07.265474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Allocated IP 172.20.0.1 (7edb0d44-f6a4-45ec-996d-1c10575992d9/2011a02a-5a19-4787-8def-3bfb750cbe1b/8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:03:07.274232 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.290910 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-45b0a9ff-4946-4e2b-9458-9bea36fee024 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:07.316205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:07.319464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:07.379907 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Pushing event updated for resources: {'Port': ['ID=25d4b937-8c2d-4510-8881-8f1dfa752e35,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:07.383167 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-6e3bd407-d3d4-448d-b2a1-6b276749478c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:07.384316 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Routers {'e1f813e5-005b-4741-b1db-c5fc7c9ecec0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:07.385272 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:07.432971 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.435340 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-5a087ef7-a5a3-4d73-b6e0-24740cfc5201 None None] Provisioning complete for port c56c4bdc-2e9b-4717-982e-88a055ba5a2e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:07.436026 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5a087ef7-a5a3-4d73-b6e0-24740cfc5201 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.450153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Transition to ACTIVE for port object 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:07.475883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.482210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:07.545005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:07.553039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:07.556223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:03:07.597163 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] Set router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:07.601703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Pushing event updated for resources: {'Port': ['ID=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:07.605433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:07.633460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.739642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.811214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8de6fc16-b450-4fbc-86a3-349869bd865b None None] Provisioning for port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:07.817276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8de6fc16-b450-4fbc-86a3-349869bd865b None None] Provisioning complete for port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:07.817895 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8de6fc16-b450-4fbc-86a3-349869bd865b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.873171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8de6fc16-b450-4fbc-86a3-349869bd865b None None] Port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:03:07.917411 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:05Z', 'revision_number': 3, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:07.921721 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61d04f30-96de-4cda-adfd-282479320f06 None None] The sync data for ids ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'] in dv-neutron-818151-2-hyperv is: [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:05Z', 'revision_number': 3, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:03:07.979782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:07.985079 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:08.009873 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c5d48b1b-d9b0-4da4-aefb-feb6537b3273 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:08.094811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Pushing event updated for resources: {'Port': ['ID=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:08.097104 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:08.100720 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:08.236042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:08.237363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:08.369987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c56c4bdc-2e9b-4717-982e-88a055ba5a2e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:08.451200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port c56c4bdc-2e9b-4717-982e-88a055ba5a2e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:08.451829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:08.524629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ff30f2a7-9e93-4296-a59f-33cb60a43240 None None] Provisioning complete for port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:08.524891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ff30f2a7-9e93-4296-a59f-33cb60a43240 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:08.617209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-ff30f2a7-9e93-4296-a59f-33cb60a43240 None None] Port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:03:08.741313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:08.775817 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:03:08.980557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:03:08.990359 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] 10.222.0.70 "PUT /v2.0/routers/e1f813e5-005b-4741-b1db-c5fc7c9ecec0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9649425 Nov 24 15:03:09.752859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54978) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:09.758782 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1036764980', 'description': 'tempest-secgroup-smoke-1036764980 description', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:09.765471 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:09.769361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:09.772475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:09.778574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:09.790703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:09.827462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:09.831806 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:09.834596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:09.840286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:09.898370 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:09.902208 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:09.907409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-043df723-2776-4fbb-a40b-c41ec23bfbbd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:09.945211 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroup': ['ID=14be9642-2338-4421-814a-cc6df323901b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:09.948715 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:09.949970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.1960435 Nov 24 15:03:09.951413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-59b0e20a-f227-43de-98cf-cfb794d8be2c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:09.954330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54982) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:09.959987 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '14be9642-2338-4421-814a-cc6df323901b', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:09.966268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:09.970041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:09.972978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:09.978573 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:09.995050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.057393 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.062456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.064435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-54948970-0a39-4404-b014-0205597053f4 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:10.090594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3e62308-2d75-40f6-9ada-39dbe8feef5d,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:10.093141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:10.103216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.104440 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-6b249112-7ffe-4d16-830a-b9adbcd9c618 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1494629 Nov 24 15:03:10.108066 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54986) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:10.113596 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '14be9642-2338-4421-814a-cc6df323901b', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:10.120010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:10.124699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:10.127597 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:10.133357 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:10.150341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.214185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.219084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.220905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-531fce88-e096-4e60-a2f2-2ca74a1cfe2c tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:10.243413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4c6849a-c612-4911-b9a1-f2d1359a3712,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:10.245749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:10.256190 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.257381 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-acf65343-e0bd-4905-8f0d-7d5f5706b2bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1484036 Nov 24 15:03:10.260103 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54990) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:10.265803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '14be9642-2338-4421-814a-cc6df323901b', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:10.272052 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:10.275962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:10.279835 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:10.286049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:10.307259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.376978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.381623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.389446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42a97e9f-b10e-40af-9770-a19abdab5136 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:10.430595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d071c33-f6ec-4243-ac74-86e7b28efe92,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:10.433027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:10.439463 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.440752 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-037f3c8b-aeb4-4595-bc6f-9f2d3bf78aba tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1797802 Nov 24 15:03:10.443441 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 54996) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:10.449068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '14be9642-2338-4421-814a-cc6df323901b', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:10.455199 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:10.459226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:10.462067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:10.468238 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:10.484919 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.555460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.559231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.561213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-61d541dd-4f4d-4cf6-9e52-448e52f7b5cd tempest-TestVolumeBootPattern-1823332555 tempest-TestVolumeBootPattern-1823332555-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:10.584170 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a234eeab-81da-411c-9bde-a8c6f507baa4,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:10.588925 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:10.594710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.596083 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2428c5ad-ed77-4edd-a3bd-d9ab1fc8c432 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1514513 Nov 24 15:03:10.599090 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55000) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:10.604941 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '14be9642-2338-4421-814a-cc6df323901b', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:10.611718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:10.615574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:10.618628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:10.625039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:10.635992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Project 8ea7acbe2851472a95e5b9a5d726a011 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:03:10.643112 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.707560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.711217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.717684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4907317d-6241-4c2b-a731-879d21493c0a tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:10.740397 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a9e5c416-2723-431d-b3fa-9d00d2eafd47,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:10.744124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:10.752669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.754030 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.1539311 Nov 24 15:03:10.756852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55004) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:10.762398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '14be9642-2338-4421-814a-cc6df323901b', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:10.768458 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:10.772213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:10.774998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:10.781185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:10.792431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Project 8ea7acbe2851472a95e5b9a5d726a011 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:03:10.799635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.872885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.876771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.878972 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-003a229c-db9b-4c6b-9984-e099242ba903 tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:10.902259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d568ae4d-6905-4a4b-b68e-a66dfb33e9e7,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:10.907242 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:10.916231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:10.917540 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fc4099c0-2e25-4c57-a8e6-c836b6b062c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1597457 Nov 24 15:03:11.093002 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-d848daf0-31ee-47ae-afa7-2ab1c9430c4a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1036764980&fields=id&tenant_id=8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 267 time: 0.0439162 Nov 24 15:03:11.238950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87555156-d27d-42e3-83c4-241b2e36e154 req-249efcf4-b764-4bf3-b090-b41d3df8715b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:11.240399 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-249efcf4-b764-4bf3-b090-b41d3df8715b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 808 time: 0.1410122 Nov 24 15:03:11.256948 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-13731790-39bf-4203-9df5-e77e9af943fc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/quotas/8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 375 time: 0.0113146 Nov 24 15:03:11.340948 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-47775a26-1d50-4622-acc6-81363f49d290 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0782208 Nov 24 15:03:11.605442 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bfefe8c7-8b1e-4bfe-97cb-1cbef9cf5781 service neutron] 10.222.0.70 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2522891 Nov 24 15:03:11.740910 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-425a6243-c796-4ef6-a586-fdef3ecea76d service neutron] 10.222.0.70 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1290414 Nov 24 15:03:11.937015 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-301cf676-0f7c-431d-aac3-ecd3410c513b req-82e531f9-7551-43a4-b39f-89f24d30535c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:03:11.957270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-301cf676-0f7c-431d-aac3-ecd3410c513b req-82e531f9-7551-43a4-b39f-89f24d30535c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:03:11.958624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-301cf676-0f7c-431d-aac3-ecd3410c513b req-82e531f9-7551-43a4-b39f-89f24d30535c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 210 time: 0.0652344 Nov 24 15:03:12.870630 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:03:13.158296 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c7c573a1-f4d0-4b51-a639-c2c317cd8de4 req-12245cf9-6f4c-4c6c-ab3d-d54a52010f69 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 210 time: 0.0710084 Nov 24 15:03:13.268785 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87555156-d27d-42e3-83c4-241b2e36e154 req-a2711819-cd2c-4d36-b82d-646d9caec77d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:13.270345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-87555156-d27d-42e3-83c4-241b2e36e154 req-a2711819-cd2c-4d36-b82d-646d9caec77d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:network {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:03:13.294417 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-87555156-d27d-42e3-83c4-241b2e36e154 req-a2711819-cd2c-4d36-b82d-646d9caec77d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:network {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:03:13.295725 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-a2711819-cd2c-4d36-b82d-646d9caec77d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 808 time: 0.2034242 Nov 24 15:03:13.350648 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-87555156-d27d-42e3-83c4-241b2e36e154 req-7393d519-d78a-4eee-bb20-efb6362f2bf5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:03:13.369666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-87555156-d27d-42e3-83c4-241b2e36e154 req-7393d519-d78a-4eee-bb20-efb6362f2bf5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:03:13.370767 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-7393d519-d78a-4eee-bb20-efb6362f2bf5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 380 time: 0.0621367 Nov 24 15:03:13.379346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'port': {'device_id': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'admin_state_up': True, 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'security_groups': ['14be9642-2338-4421-814a-cc6df323901b']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:13.515132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:13.524338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:13.534582 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Made reservation on behalf of 8ea7acbe2851472a95e5b9a5d726a011 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:03:13.537705 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:13.815824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Allocated IP 172.20.0.5 (3bace08e-55bc-42bb-be54-36d02a25dcad/9119f9d2-54c0-4483-ad28-6f72771e7d2d/0e7a4814-adc7-4507-ad1f-3fea9abbc6a2) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:03:14.020289 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.041693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Transition to ACTIVE for port object 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:14.066175 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.071902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:14.144574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Network 3bace08e-55bc-42bb-be54-36d02a25dcad is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:14.148078 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:14.152508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:03:14.178560 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:14.185270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:14.221017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:14.221864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.254772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-bacd4bda-277e-4a76-a72a-84bf54b61988 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8787720 Nov 24 15:03:14.267247 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Request body: {'port': {'device_id': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:14.410218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 25d4b937-8c2d-4510-8881-8f1dfa752e35 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:14.453791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842d4fd6-bff4-4f5f-acbd-8ef5f675f6bc req-b990b962-2672-4771-9d26-6a20c35c3874 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:14.454438 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-842d4fd6-bff4-4f5f-acbd-8ef5f675f6bc req-b990b962-2672-4771-9d26-6a20c35c3874 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:03:14.484474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.494418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 25d4b937-8c2d-4510-8881-8f1dfa752e35 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:14.498009 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-842d4fd6-bff4-4f5f-acbd-8ef5f675f6bc req-b990b962-2672-4771-9d26-6a20c35c3874 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:03:14.499362 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-842d4fd6-bff4-4f5f-acbd-8ef5f675f6bc req-b990b962-2672-4771-9d26-6a20c35c3874 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 931 time: 0.2051849 Nov 24 15:03:14.501572 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 25d4b937-8c2d-4510-8881-8f1dfa752e35 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:14.502179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.529113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-34e40fa5-ebbf-4ab7-a747-5d50e5bd898e None None] Provisioning for port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:14.595434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-34e40fa5-ebbf-4ab7-a747-5d50e5bd898e None None] Provisioning complete for port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:14.595434 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-34e40fa5-ebbf-4ab7-a747-5d50e5bd898e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.653456 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-842d4fd6-bff4-4f5f-acbd-8ef5f675f6bc req-d17453ec-40dc-4015-a773-87f3b5a44c0b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1236989 Nov 24 15:03:14.659747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-34e40fa5-ebbf-4ab7-a747-5d50e5bd898e None None] Port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:03:14.734618 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.752215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 25d4b937-8c2d-4510-8881-8f1dfa752e35, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=25d4b937-8c2d-4510-8881-8f1dfa752e35,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:14.760156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.762083 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:14.838968 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=25d4b937-8c2d-4510-8881-8f1dfa752e35,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:14.842570 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:14.905087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:03:14.913684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.932151 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Transition to ACTIVE for port object 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:14.936574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:14.940474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f877c2cb-22b3-4ba7-a1e6-fb2beb095df7 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:15.070304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:15.073786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:15.195071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Attempting to bind port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:03:15.195382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Attempting to bind port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:03:15.195708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Attempting to bind port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 on network 3bace08e-55bc-42bb-be54-36d02a25dcad {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:15.202174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 on network 3bace08e-55bc-42bb-be54-36d02a25dcad not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 15:03:15.202494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Attempting to bind port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 on network 3bace08e-55bc-42bb-be54-36d02a25dcad {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:15.209937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 2, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:03:15.210270 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Checking segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:15.210669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Bound using segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:03:15.211097 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Bound port: 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:03:15.211449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:15.309363 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:03:15.312378 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:03:15.318905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:15.322635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-72f795d3-2b20-4e58-92f1-e79a47377258 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:15.380909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:15.382301 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] 10.222.0.47 "PUT /v2.0/ports/0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 1093 time: 1.1204324 Nov 24 15:03:15.382810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:03:15.408514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:15.411514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:15.460245 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'status': 'completed', 'code': 200} Nov 24 15:03:15.503446 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-5415991d-859c-4837-b129-826718553963 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1096 time: 0.0791111 Nov 24 15:03:15.577826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-2bce3f34-d4a0-46ca-9e8d-13d8d007b498 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 217 time: 0.0669048 Nov 24 15:03:15.640619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87555156-d27d-42e3-83c4-241b2e36e154 req-5a85408a-88a6-48c5-8d70-836cbce21dc2 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:15.641959 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-5a85408a-88a6-48c5-8d70-836cbce21dc2 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0571940 Nov 24 15:03:15.870031 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-a83990eb-8cad-4b11-8fa3-fcac7f6caf4c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2202439 Nov 24 15:03:15.992369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1161aaa3-f7dd-4b70-af20-711e033b1d43 req-489e70d9-4181-4feb-9dde-5a38040d2e9b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:15.993805 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1161aaa3-f7dd-4b70-af20-711e033b1d43 req-489e70d9-4181-4feb-9dde-5a38040d2e9b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.1738448 Nov 24 15:03:16.048943 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-9923a3a9-c531-4308-a33f-7cbb6e18e757 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1713643 Nov 24 15:03:16.142944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1161aaa3-f7dd-4b70-af20-711e033b1d43 req-1bd30cca-3f04-4f01-b276-88950a0e8bbd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1419981 Nov 24 15:03:16.193436 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87555156-d27d-42e3-83c4-241b2e36e154 req-b982fa5e-06f5-416b-ad8d-3266991fb4e9 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1375883 Nov 24 15:03:16.317831 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-46bec99e-4991-432e-9cdf-28159187c021 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1096 time: 0.0741842 Nov 24 15:03:16.368203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 25d4b937-8c2d-4510-8881-8f1dfa752e35 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:16.441064 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 25d4b937-8c2d-4510-8881-8f1dfa752e35 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:16.441358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:16.453772 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-fcd047f4-dc54-470d-92d9-322b5953b0c9 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:16.455214 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-fcd047f4-dc54-470d-92d9-322b5953b0c9 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1314230 Nov 24 15:03:16.533134 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-59571dd2-03b9-4a92-86c2-6629239812c5 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 217 time: 0.0714891 Nov 24 15:03:16.594224 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-cb44d0a6-1c42-46aa-8273-5845aadb65f4 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:16.595649 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-cb44d0a6-1c42-46aa-8273-5845aadb65f4 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0569789 Nov 24 15:03:16.670680 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-0b39f782-6980-4eec-a1f0-7d82ef550392 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0685625 Nov 24 15:03:16.811182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-996b2472-f4ad-41af-9399-63338b6e1e9b service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328270 Nov 24 15:03:16.950242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cf2314f6-fa72-4bc9-82ae-994284eaef0f req-bbf28fe6-5423-4808-a16b-efc9360bd758 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1322720 Nov 24 15:03:17.012497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:03:17.024923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:17.025553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:17.211075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:17.357053 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8604022b-4142-4238-aea6-702ca41c5d22 req-ba0427d6-43a2-431d-8f23-b6d553d1afb2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:17.358818 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8604022b-4142-4238-aea6-702ca41c5d22 req-ba0427d6-43a2-431d-8f23-b6d553d1afb2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0830722 Nov 24 15:03:17.409188 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8604022b-4142-4238-aea6-702ca41c5d22 req-51e9ba36-2588-4499-88f1-a41ba1b6203d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412199 Nov 24 15:03:17.536872 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 2, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:17.541112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:03:17.541473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Updating router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:03:17.595094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:17.959496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:17.974647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Transition to ACTIVE for port object 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:17.982402 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:17.986581 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-09fcd457-6fbc-4e23-9b0f-c2fcd84f631d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:18.117891 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56ac13a-2adc-4f4e-a883-73920711cba5 None None] Pushing event updated for resources: {'Port': ['ID=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:18.121031 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a56ac13a-2adc-4f4e-a883-73920711cba5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:18.266592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Attempting to bind port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:03:18.267010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Attempting to bind port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:03:18.267337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Attempting to bind port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 on network 3bace08e-55bc-42bb-be54-36d02a25dcad {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:18.274442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:03:18.274816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Checking segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:18.275223 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:18.275619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Bound using segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:03:18.276108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Bound port: 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:03:18.276489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:18.377998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] For port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:03:18.381969 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] For port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:03:18.387719 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:18.391732 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a56ac13a-2adc-4f4e-a883-73920711cba5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:18.474114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56ac13a-2adc-4f4e-a883-73920711cba5 None None] Pushing event updated for resources: {'Port': ['ID=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:18.477776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:18.478387 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:18.531001 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a56ac13a-2adc-4f4e-a883-73920711cba5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:18.564778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:18.680261 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f23979-d71a-4d07-83fc-66ce04d88c65 req-1ac5c8a4-bb65-499d-b7cb-6471598e3fa4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:18.688101 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1f23979-d71a-4d07-83fc-66ce04d88c65 req-1ac5c8a4-bb65-499d-b7cb-6471598e3fa4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.1141531 Nov 24 15:03:18.692133 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:18.732386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d1f23979-d71a-4d07-83fc-66ce04d88c65 req-9fac7a7e-067a-4635-9012-3ce30422ca0c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433857 Nov 24 15:03:18.763430 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Sync routers for ids ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:03:18.775884 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Routers {'e1f813e5-005b-4741-b1db-c5fc7c9ecec0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:18.776503 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:18.953415 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Set router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:19.028366 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:18Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:19.032708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6ca322-4048-40fe-b6f9-241666f70e63 None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:18Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:03:19.051294 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:03:19.202950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:19.218164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'mac_address': 'fa:16:3e:6b:94:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:03:19.281690 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:19.300516 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:03:19.319580 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:19.322639 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:07Z', 'revision_number': 4, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd', 'name': '', 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'mac_address': 'fa:16:3e:45:0c:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '2011a02a-5a19-4787-8def-3bfb750cbe1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:07Z', 'updated_at': '2021-11-24T15:03:07Z', 'revision_number': 2, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'subnets': [{'id': '2011a02a-5a19-4787-8def-3bfb750cbe1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:19.324636 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:19.327778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:19.327977 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Checking router: e1f813e5-005b-4741-b1db-c5fc7c9ecec0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:03:19.328148 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Updating router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:03:19.384138 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:19.406101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:19.410108 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:19.647919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:03:19.740933 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:19.753115 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Transition to ACTIVE for port object 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:03:19.760305 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:19.764099 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-12578ae1-ba3e-49b2-96e3-ffd7358e9efe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:19.924228 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fc3688-1319-4a4f-9e16-4c2311db9b07 None None] Pushing event updated for resources: {'Port': ['ID=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:19.928680 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-51fc3688-1319-4a4f-9e16-4c2311db9b07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:19.969039 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba84da9b-0ace-4c63-a1fd-66da52ba90c8 req-de50039e-a1db-4488-ba9b-2475ade75fd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:19.972259 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba84da9b-0ace-4c63-a1fd-66da52ba90c8 req-de50039e-a1db-4488-ba9b-2475ade75fd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 944 time: 0.0965469 Nov 24 15:03:20.025290 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ba84da9b-0ace-4c63-a1fd-66da52ba90c8 req-1990ad19-08df-43f3-b90d-5a886754629b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487075 Nov 24 15:03:20.028565 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Attempting to bind port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:03:20.028945 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Attempting to bind port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:03:20.029345 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Attempting to bind port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd on network 7edb0d44-f6a4-45ec-996d-1c10575992d9 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:03:20.037277 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 3, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:03:20.037652 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Checking segment: {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:03:20.038058 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:20.038440 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Bound using segment: {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:03:20.038967 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Bound port: 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3634727d-b0b0-4f21-93f9-ce9566a38361', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:03:20.039288 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:20.146603 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] For port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:03:20.149604 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] For port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:03:20.154995 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:20.158574 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-5e7ca468-c9b9-4b79-8e60-658d0085aeb9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:20.234473 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51fc3688-1319-4a4f-9e16-4c2311db9b07 None None] Pushing event updated for resources: {'Port': ['ID=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:20.238570 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-51fc3688-1319-4a4f-9e16-4c2311db9b07 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:20.239588 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Routers {'e1f813e5-005b-4741-b1db-c5fc7c9ecec0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:20.240228 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:20.398726 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:20.447125 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] Set router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:20.478984 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:20.486904 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:20.487216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:20.613708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:20.651375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:20.657319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:20.659400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:20.727029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:20.730134 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:20.780616 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-94243748-e5c2-4605-843b-d043d005b35a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:07Z', 'revision_number': 4, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd', 'name': '', 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'mac_address': 'fa:16:3e:45:0c:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '2011a02a-5a19-4787-8def-3bfb750cbe1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:07Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 4, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'subnets': [{'id': '2011a02a-5a19-4787-8def-3bfb750cbe1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:20.785054 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94243748-e5c2-4605-843b-d043d005b35a None None] The sync data for ids ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'] in dv-neutron-818151-2-hyperv is: [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:07Z', 'revision_number': 4, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd', 'name': '', 'network_id': '7edb0d44-f6a4-45ec-996d-1c10575992d9', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'mac_address': 'fa:16:3e:45:0c:37', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '2011a02a-5a19-4787-8def-3bfb750cbe1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:07Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 4, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'subnets': [{'id': '2011a02a-5a19-4787-8def-3bfb750cbe1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:03:21.055835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:21.142681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:21.148827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:21.149264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:21.328412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:21.362595 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46671d77-d7fe-4963-8b5a-882903f68aa9 req-cab09cd4-8fbc-4a3f-99ff-722ff4faa345 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:21.363089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:03:21.368464 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46671d77-d7fe-4963-8b5a-882903f68aa9 req-cab09cd4-8fbc-4a3f-99ff-722ff4faa345 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 944 time: 0.1937656 Nov 24 15:03:21.383216 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:21.389853 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:21.393464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:21.433081 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46671d77-d7fe-4963-8b5a-882903f68aa9 req-497b81bd-b903-4879-999b-53d948461acc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0602090 Nov 24 15:03:21.438547 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'code': 200} Nov 24 15:03:21.470512 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:21.475390 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:21.683544 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aee11a90-0234-48cd-a99b-09bdf38d66e9 req-55892b89-177a-4b42-981d-1ecd2904bf6a service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1098 time: 0.0736868 Nov 24 15:03:21.729834 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aee11a90-0234-48cd-a99b-09bdf38d66e9 req-fee977a5-fd8d-42e0-9974-3d2bda6b681e service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400686 Nov 24 15:03:22.432588 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:22.503640 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:03:22.508623 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:22.509005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:22.628579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:22.629355 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2372acc-8d60-4bab-aa8b-13bfd930b68e req-042fc334-8964-4b68-aa5f-f709207ad8b5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:22.630781 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a2372acc-8d60-4bab-aa8b-13bfd930b68e req-042fc334-8964-4b68-aa5f-f709207ad8b5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0827339 Nov 24 15:03:22.665020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:03:22.673912 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:22.675015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:22.685804 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a2372acc-8d60-4bab-aa8b-13bfd930b68e req-b6e55f8e-5b27-457c-984a-fc2389f77c7e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493801 Nov 24 15:03:22.701916 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:22.791926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:22.795317 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:22.805454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:22.805830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:23.891998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fff932a-2bdc-41f7-91a1-2b42b0913fa0 req-b8b40b09-fc65-4f8c-ad32-707d29431367 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:23.893470 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7fff932a-2bdc-41f7-91a1-2b42b0913fa0 req-b8b40b09-fc65-4f8c-ad32-707d29431367 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0828543 Nov 24 15:03:23.941558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7fff932a-2bdc-41f7-91a1-2b42b0913fa0 req-0cf8d400-5b9e-416f-bc2c-dfc5a8a5d3a6 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422175 Nov 24 15:03:24.146979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda6203a-63b0-4ffa-af34-db5c78af97f8 req-7f8a11f7-6e50-44d0-b46c-4641348cbae2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:24.148586 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cda6203a-63b0-4ffa-af34-db5c78af97f8 req-7f8a11f7-6e50-44d0-b46c-4641348cbae2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0824769 Nov 24 15:03:24.194138 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cda6203a-63b0-4ffa-af34-db5c78af97f8 req-87da6ee7-f16f-4b05-8b9a-212e7bed695c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399799 Nov 24 15:03:24.222402 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55068) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:24.367926 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fdd87ad0-f3b0-4023-a75f-b617c759f1df tempest-TestShelveInstance-1019541265 tempest-TestShelveInstance-1019541265-project-admin] Synchronizing usage tracker for tenant:f88f6c692de147a68233f78a4b9d682f on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:03:24.375689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:03:24.386253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-fdd87ad0-f3b0-4023-a75f-b617c759f1df tempest-TestShelveInstance-1019541265 tempest-TestShelveInstance-1019541265-project-admin] Unset dirty status for tenant:f88f6c692de147a68233f78a4b9d682f on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:03:24.387510 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-fdd87ad0-f3b0-4023-a75f-b617c759f1df tempest-TestShelveInstance-1019541265 tempest-TestShelveInstance-1019541265-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1093 time: 0.1641049 Nov 24 15:03:24.391456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55074) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:03:24.396929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address': '172.20.0.5'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:03:24.402616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:03:24.406431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:floatingip and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:03:24.409314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:03:24.415050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:03:24.426108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:24.445617 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:03:24.445996 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:24.670945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:24.825475 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Allocated IP 172.26.4.177 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/a0303d01-85e8-42ae-a52e-bf014497d439) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:03:24.974755 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:25.002048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:25.005731 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c73a3ebd-ed31-4bff-b689-dd33d0dca33e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:25.069345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:03:25.077939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:03:25.082296 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:03:25.112674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'Port': ['ID=a0303d01-85e8-42ae-a52e-bf014497d439,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:25.118672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:25.612467 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:25.668496 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:25.898071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:25.903217 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:25.907365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:03:26.011482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'Port': ['ID=a0303d01-85e8-42ae-a52e-bf014497d439,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:03:26.016334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:03:26.033169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:26.338586 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Floating IP 9f581d0a-97fe-4cf5-973e-a790cbbd129b associated. External IP: 172.26.4.177, port: 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2. Nov 24 15:03:26.731074 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:03:26.934433 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:03:26.947923 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:03:26.962385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:26.962669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:26.963453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:27.021977 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6293235 Nov 24 15:03:27.022569 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:03:27.085246 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'status': 'completed', 'code': 200} Nov 24 15:03:27.149830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:27.178934 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-3955efed-7ffe-4d3d-962c-f00843220862 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1098 time: 0.0709269 Nov 24 15:03:27.322651 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-3077285f-ea8c-4447-ad24-9b80976ea168 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:27.324129 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-3077285f-ea8c-4447-ad24-9b80976ea168 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1391842 Nov 24 15:03:27.427810 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-d405b479-a5ff-4256-8966-891829db910c service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 999 time: 0.0974338 Nov 24 15:03:27.496607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-8158eb2e-79cc-4d5e-800c-6e813099e7ec service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:27.498340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-8158eb2e-79cc-4d5e-800c-6e813099e7ec service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0647292 Nov 24 15:03:27.517030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '9f581d0a-97fe-4cf5-973e-a790cbbd129b', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'floating_ip_address': '172.26.4.177', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'mac_address': 'fa:16:3e:6b:94:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:03:25Z', 'updated_at': '2021-11-24T15:03:25Z', 'revision_number': 0, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:27.521586 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:03:27.533267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:03:27.534024 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:03:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:27.580210 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-cd778bf3-88a3-486b-b930-ec46577bfbd5 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0753472 Nov 24 15:03:27.722262 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-9e67e10c-49fb-46e9-8161-8f17d2158231 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353397 Nov 24 15:03:27.763664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:03:27.855786 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-3f4e4c8d-8536-4006-bf72-6e6e873b16a2 req-170e94fc-ec09-4743-8f47-84fa3567c7e7 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271760 Nov 24 15:03:28.121944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '9f581d0a-97fe-4cf5-973e-a790cbbd129b', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'floating_ip_address': '172.26.4.177', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'mac_address': 'fa:16:3e:6b:94:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:03:25Z', 'updated_at': '2021-11-24T15:03:25Z', 'revision_number': 0, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:03:28.126249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38a5b69b-6996-4d6f-85ce-60da69b4d705 None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '9f581d0a-97fe-4cf5-973e-a790cbbd129b', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'floating_ip_address': '172.26.4.177', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'mac_address': 'fa:16:3e:6b:94:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:03:25Z', 'updated_at': '2021-11-24T15:03:25Z', 'revision_number': 0, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:03:30.850346 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-c2486f17-10c0-4b97-a055-f2be0c23f3cf service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0733891 Nov 24 15:03:30.993945 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-69bbb8a9-b63b-497d-95f9-b935867c8f82 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1098 time: 0.0732927 Nov 24 15:03:31.257612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-8f771c4f-a412-4d5e-99f6-79dde2fde018 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:31.259057 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-8f771c4f-a412-4d5e-99f6-79dde2fde018 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.2463841 Nov 24 15:03:31.365019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-b0efafce-9eb5-4e0e-91d7-80245301c7c6 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 999 time: 0.0986497 Nov 24 15:03:31.429975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-75cae873-0493-45c8-8b52-c2d324d312be service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:03:31.431407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-75cae873-0493-45c8-8b52-c2d324d312be service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0606298 Nov 24 15:03:31.507019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-21cb98f6-76a3-40fc-980c-8f81779e1229 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0695751 Nov 24 15:03:31.643284 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-d85effff-234a-44cc-9f86-f19953a4bba3 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1297798 Nov 24 15:03:31.778803 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-185ba0c3-0041-4e6b-a713-d6b5b7ebb428 req-a223e2b8-104c-409b-a2fd-1ed22f46514a service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1291950 Nov 24 15:03:33.410841 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c33e8c2a-3b9e-4236-91d3-cc09430d8803 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:33.798609 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:35.952749 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-313e60f3-a4c7-495c-a345-04c83c3098e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:36.297205 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-463d5ce5-e938-463c-982f-76c86c024dc5 None None] New status for floating IP 9f581d0a-97fe-4cf5-973e-a790cbbd129b: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:03:37.046219 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:38.737669 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:48.533465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:03:49.871413 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:04:03.415524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9c59440f-dda8-4052-b364-83a950ec9ed0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:03.800929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:05.960449 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1d9152f-fab9-49b4-ba8f-0e5aa94ecca6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:07.047847 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:08.743118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:18.560254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:26.872000 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:04:31.966547 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-20d54b78-915e-4707-aa11-e17d3ce249b7 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1633070 Nov 24 15:04:32.111394 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-d3482fa8-e4b4-4ddd-9c84-51215331fb51 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1098 time: 0.0751677 Nov 24 15:04:32.263321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-bf0762f9-0e5c-4f72-bb98-993a7bd25195 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:04:32.264809 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-bf0762f9-0e5c-4f72-bb98-993a7bd25195 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1345811 Nov 24 15:04:32.372255 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-a68acf7e-3bff-4137-beba-3896b24253b3 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 1001 time: 0.0999873 Nov 24 15:04:32.439317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-bba83754-5148-4a63-8fb1-24621a1ac056 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:04:32.440920 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-bba83754-5148-4a63-8fb1-24621a1ac056 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0592487 Nov 24 15:04:32.520561 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-2a528f4c-7813-47ae-bb65-fbc938f68ccf service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0724330 Nov 24 15:04:32.669284 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-509e3359-e2e9-4d25-9fba-fcbf2bb64489 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1397884 Nov 24 15:04:32.803649 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-86ce2f60-b8ff-4827-88f8-b2719e8e9562 req-4b307c2c-daff-4835-8d66-4ae652425ab4 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269412 Nov 24 15:04:33.419596 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d947721c-e7ec-459e-8544-89fc702469c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:33.805187 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:35.952897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a2c97c86-9ed8-4e9a-b6f9-8e903ca6f8c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:37.050832 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:38.753559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:04:48.564458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:03.423169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7589fef1-3c28-45c7-bef7-eac0009d0b0f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:03.807857 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:03.872592 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:05:05.955600 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d640ad52-bd91-4401-89df-bb5e422f6bc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:07.053358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:08.748125 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:18.574809 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:32.843496 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-92a9766e-6162-41d8-a38f-a62a79fe1afe service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0716212 Nov 24 15:05:32.979683 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-36f613d4-56ee-449b-98c0-555f3143d4f8 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1098 time: 0.0704222 Nov 24 15:05:33.237781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-4b8db962-3969-4b1b-917e-12b66edcc5e6 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:05:33.239390 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-4b8db962-3969-4b1b-917e-12b66edcc5e6 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.2409167 Nov 24 15:05:33.345708 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-e23bfd6c-7821-467e-876f-51ccb3559b50 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 1001 time: 0.0997014 Nov 24 15:05:33.412570 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-14becc8e-f4fa-4dde-b127-1501672977ad service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:05:33.414596 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-14becc8e-f4fa-4dde-b127-1501672977ad service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0625451 Nov 24 15:05:33.428243 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-632c9184-45dc-4c23-975f-53a89917a70b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:33.494976 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-ddd7f8c8-1ba7-47b9-be9c-5fb78ddf6467 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0732708 Nov 24 15:05:33.657907 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-5c2df240-2303-4968-ac74-2458ac73e19f service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1561618 Nov 24 15:05:33.812604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:33.821201 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f85ff8b9-77b8-4590-9da1-7a2d4ee12687 req-67d4c2c9-d532-4dbe-9e90-a7ece7547cad service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1562457 Nov 24 15:05:35.958534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3248d238-ae32-4b2c-9dfb-84fb69c6ecb8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:37.063254 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:38.752159 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:05:40.873769 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:05:48.576688 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:02.496894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e64187-b37b-496d-bf69-8d0d57b6629c req-277cdee9-ebf9-4cf1-9989-9a95f70abcbc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:02.498250 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76e64187-b37b-496d-bf69-8d0d57b6629c req-277cdee9-ebf9-4cf1-9989-9a95f70abcbc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0929682 Nov 24 15:06:02.554145 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76e64187-b37b-496d-bf69-8d0d57b6629c req-94fa1e44-6974-401f-ba13-8ce1d1aa7187 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473797 Nov 24 15:06:03.425211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-37a49024-f692-407a-8870-e7dd7de16666 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:03.793378 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2acad7-6ef5-4b1a-87da-cb3d030c00cc req-f102743f-e2a4-445f-a279-cfb302ba3d6c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:03.794801 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cf2acad7-6ef5-4b1a-87da-cb3d030c00cc req-f102743f-e2a4-445f-a279-cfb302ba3d6c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0992401 Nov 24 15:06:03.815911 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:03.971456 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cf2acad7-6ef5-4b1a-87da-cb3d030c00cc req-8d0df0e6-d588-4182-b87e-9b80d7ee2b01 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1694508 Nov 24 15:06:05.183803 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1a81c4-2490-45a8-b074-acc89d7540eb req-a56c39e9-312d-4dba-82e1-cdf7d4045835 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:05.185241 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c1a81c4-2490-45a8-b074-acc89d7540eb req-a56c39e9-312d-4dba-82e1-cdf7d4045835 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0787616 Nov 24 15:06:05.231263 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4c1a81c4-2490-45a8-b074-acc89d7540eb req-18561b53-d6e4-4f41-90fe-c046d9690585 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405407 Nov 24 15:06:05.962868 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-20c16cdb-8653-4e65-8e0c-23365cf5c8ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:06.433180 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74cb8e2c-2ed2-43ff-8cad-00234bd06ff4 req-842cd996-4561-4315-a00b-e148012caae4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:06.434654 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-74cb8e2c-2ed2-43ff-8cad-00234bd06ff4 req-842cd996-4561-4315-a00b-e148012caae4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0777524 Nov 24 15:06:06.480735 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-74cb8e2c-2ed2-43ff-8cad-00234bd06ff4 req-bdf8e43f-2e80-4364-8dc2-31c2900faa84 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406568 Nov 24 15:06:07.063632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:07.684739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d86025e-55b4-4bdd-a592-0e729072dd42 req-dbe26332-6721-4f1f-b73b-d9a6ed02ba58 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:07.686186 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d86025e-55b4-4bdd-a592-0e729072dd42 req-dbe26332-6721-4f1f-b73b-d9a6ed02ba58 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0823884 Nov 24 15:06:07.732870 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0d86025e-55b4-4bdd-a592-0e729072dd42 req-9a9a0c10-69e0-4c80-a7eb-f2ec740e41e4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412824 Nov 24 15:06:08.753473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:08.933362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6c3609-d953-4662-bb3e-9fc82cb37575 req-0f89bf46-1cee-4284-b96c-b82de4d10538 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:08.934797 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5a6c3609-d953-4662-bb3e-9fc82cb37575 req-0f89bf46-1cee-4284-b96c-b82de4d10538 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0788693 Nov 24 15:06:08.981402 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5a6c3609-d953-4662-bb3e-9fc82cb37575 req-6c8101d3-e550-4efe-a4ea-cd1d083a10f1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411272 Nov 24 15:06:10.178545 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16151f5f-22aa-4fa6-98ea-4162404d9155 req-5ba8ada8-82b2-4f59-929e-f1dba3ccb7da tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:10.180642 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16151f5f-22aa-4fa6-98ea-4162404d9155 req-5ba8ada8-82b2-4f59-929e-f1dba3ccb7da tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0797398 Nov 24 15:06:10.229614 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-16151f5f-22aa-4fa6-98ea-4162404d9155 req-ef364250-21df-4d45-b1b9-7d4f7153f1c2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434031 Nov 24 15:06:11.429005 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01527b51-d49c-43fd-84c5-e4919f39c040 req-3145914e-ca0d-4a3e-81a1-400f43c7546e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:11.430989 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-01527b51-d49c-43fd-84c5-e4919f39c040 req-3145914e-ca0d-4a3e-81a1-400f43c7546e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0763726 Nov 24 15:06:11.479898 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-01527b51-d49c-43fd-84c5-e4919f39c040 req-54346226-a351-469d-8224-a746fc3b5974 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434299 Nov 24 15:06:12.681881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02181888-7ab6-474c-9065-f67a356a919b req-5adb142e-6c4f-4cf3-87f0-b6b6ad782995 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:12.683329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-02181888-7ab6-474c-9065-f67a356a919b req-5adb142e-6c4f-4cf3-87f0-b6b6ad782995 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0782759 Nov 24 15:06:12.729236 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-02181888-7ab6-474c-9065-f67a356a919b req-bade6e31-4cb4-43a3-9291-40d845e5c89e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404928 Nov 24 15:06:13.927052 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c691746-9097-4ef1-b938-c93d35b7b58b req-a6594ff4-7226-4a02-aec3-bd9227bf0046 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:13.928527 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9c691746-9097-4ef1-b938-c93d35b7b58b req-a6594ff4-7226-4a02-aec3-bd9227bf0046 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0792911 Nov 24 15:06:13.974332 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9c691746-9097-4ef1-b938-c93d35b7b58b req-255d5048-d4a6-40fd-b1e2-b9b6ed70e6f2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400867 Nov 24 15:06:15.179366 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4021a62-c57d-4591-b20a-597776f689fb req-ef731541-e53f-49d1-85d9-cba8d3e35541 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:15.180775 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f4021a62-c57d-4591-b20a-597776f689fb req-ef731541-e53f-49d1-85d9-cba8d3e35541 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0806894 Nov 24 15:06:15.228357 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f4021a62-c57d-4591-b20a-597776f689fb req-2ab4d4d4-9865-42f8-bb0a-70b6dbb4082d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420592 Nov 24 15:06:15.908413 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:06:16.044022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:16.056992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'mac_address': 'fa:16:3e:6b:94:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:06:16.114172 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:16.131275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:06:16.147049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:16.151641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:16.153414 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:06:16.219705 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:06:16.229715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.230060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.230406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.230734 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.231063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.231392 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.231742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.232095 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.232418 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.233151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.233151 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:06:16.237799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:06:16.261087 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:06:16.444001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b77004a5-ac8d-44c8-9278-c72799feae19 req-592a9233-ef5d-42ef-a4c2-69b3d0605d3a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:16.446045 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b77004a5-ac8d-44c8-9278-c72799feae19 req-592a9233-ef5d-42ef-a4c2-69b3d0605d3a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 944 time: 0.0856559 Nov 24 15:06:16.495364 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b77004a5-ac8d-44c8-9278-c72799feae19 req-85a1803d-8e60-4abd-bf84-d29ae794f6ad tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431869 Nov 24 15:06:17.698798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c86e3b5d-c26b-436a-9daf-e4cee90f4a20 req-aa7b3fc6-caa4-4465-956b-ba13a0d43ef6 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:17.700292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c86e3b5d-c26b-436a-9daf-e4cee90f4a20 req-aa7b3fc6-caa4-4465-956b-ba13a0d43ef6 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 944 time: 0.0789850 Nov 24 15:06:17.748072 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-c86e3b5d-c26b-436a-9daf-e4cee90f4a20 req-f5731d52-f31c-495e-8c88-80daaf382d1a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422814 Nov 24 15:06:17.873870 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:06:17.927608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:06:18.005236 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:06:18.005612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:18.118433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:18.145997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:06:18.156475 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:18.161379 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:18.163179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-09fcd457-6fbc-4e23-9b0f-c2fcd84f631d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:06:18.229829 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:06:18.232874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:06:18.285727 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'code': 200} Nov 24 15:06:18.589139 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:18.952975 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddc6810-5169-4c5f-9f97-16723af43226 req-47bbd671-6c8a-4a2f-be0d-c914f63680d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:18.954411 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cddc6810-5169-4c5f-9f97-16723af43226 req-47bbd671-6c8a-4a2f-be0d-c914f63680d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0830901 Nov 24 15:06:19.002906 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cddc6810-5169-4c5f-9f97-16723af43226 req-a197465a-6313-4004-b159-c33453a4020c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424430 Nov 24 15:06:20.235142 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d960fac4-67fd-4989-9537-9fdad2830294 req-cc9f5c18-ab9f-463b-b712-10cbe453c51e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:20.237387 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d960fac4-67fd-4989-9537-9fdad2830294 req-cc9f5c18-ab9f-463b-b712-10cbe453c51e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0920353 Nov 24 15:06:20.286631 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d960fac4-67fd-4989-9537-9fdad2830294 req-81495d93-beae-4532-8fcf-a986e214b02a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431561 Nov 24 15:06:21.514389 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eaf69b9-fa7d-4ce4-b43e-c21b292fe066 req-454358e8-47ac-4c2e-b330-25899845a96f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:21.515964 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9eaf69b9-fa7d-4ce4-b43e-c21b292fe066 req-454358e8-47ac-4c2e-b330-25899845a96f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0967309 Nov 24 15:06:21.568618 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9eaf69b9-fa7d-4ce4-b43e-c21b292fe066 req-8856429f-baa9-4f7b-a158-6c02e633c1d5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470707 Nov 24 15:06:22.793001 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a1c18a-54ec-4148-bd98-2bd5a6016693 req-5f40c377-49f6-404d-a263-5526e160b61e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:22.799553 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-80a1c18a-54ec-4148-bd98-2bd5a6016693 req-5f40c377-49f6-404d-a263-5526e160b61e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.1016796 Nov 24 15:06:22.846121 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-80a1c18a-54ec-4148-bd98-2bd5a6016693 req-cb4b3814-0f32-4744-ad13-b5f039f262f9 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456133 Nov 24 15:06:24.077718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4baffd1a-1186-423a-abaf-eedcd8d530b4 req-8b45f3d8-61d7-4b4d-a054-bb89582b4447 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:24.084299 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4baffd1a-1186-423a-abaf-eedcd8d530b4 req-8b45f3d8-61d7-4b4d-a054-bb89582b4447 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.1116264 Nov 24 15:06:24.128928 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4baffd1a-1186-423a-abaf-eedcd8d530b4 req-2cb62930-d620-4bc1-863c-947af0c387c8 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437720 Nov 24 15:06:25.346238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb7a71e-8303-477a-b06a-5ce94f652daa req-43ae4a3e-412c-4d89-a0c4-aba460784f21 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:25.347677 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9bb7a71e-8303-477a-b06a-5ce94f652daa req-43ae4a3e-412c-4d89-a0c4-aba460784f21 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0858989 Nov 24 15:06:25.405144 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9bb7a71e-8303-477a-b06a-5ce94f652daa req-c5691a1f-9e69-4b48-be06-8dbc6f6bd837 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514665 Nov 24 15:06:26.635622 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcd0f47-df21-4631-8889-262947d2ef3a req-57aa8272-2ff2-4657-8cac-d12ca9885c89 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:26.637586 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bcd0f47-df21-4631-8889-262947d2ef3a req-57aa8272-2ff2-4657-8cac-d12ca9885c89 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0925710 Nov 24 15:06:26.704350 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0bcd0f47-df21-4631-8889-262947d2ef3a req-3bbf0640-1c64-492a-b3ba-372c873a9e64 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601709 Nov 24 15:06:27.927634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056f82ac-4022-42ab-9fca-f14fae88d855 req-0181cd23-48de-4286-91f3-908c8f7ef3b8 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:27.930414 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-056f82ac-4022-42ab-9fca-f14fae88d855 req-0181cd23-48de-4286-91f3-908c8f7ef3b8 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0866044 Nov 24 15:06:27.984599 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-056f82ac-4022-42ab-9fca-f14fae88d855 req-b8fb408b-284e-40f7-a8ec-9bae49dd6c95 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482697 Nov 24 15:06:29.212260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c1b8df-09b7-4d9e-81d6-e12323dacdf3 req-48a44563-fa69-487e-878a-1e33b0abad34 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:29.213707 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67c1b8df-09b7-4d9e-81d6-e12323dacdf3 req-48a44563-fa69-487e-878a-1e33b0abad34 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0818253 Nov 24 15:06:29.260003 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-67c1b8df-09b7-4d9e-81d6-e12323dacdf3 req-55471e4b-ff71-4f69-b888-9d12ecb78880 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406363 Nov 24 15:06:30.365407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-be2e5576-4acb-429f-b4d3-db7d9b6dbaa2 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1098 time: 0.1755371 Nov 24 15:06:30.462986 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ace54c1-a275-47d4-83db-1470660c2896 req-57380300-f091-4d19-bbac-c3813ee429f1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:30.464490 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3ace54c1-a275-47d4-83db-1470660c2896 req-57380300-f091-4d19-bbac-c3813ee429f1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0814972 Nov 24 15:06:30.505652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-2d60ffbe-1c66-4575-8f8c-0549250e3df7 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:30.508366 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-2d60ffbe-1c66-4575-8f8c-0549250e3df7 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1360960 Nov 24 15:06:30.513810 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3ace54c1-a275-47d4-83db-1470660c2896 req-9a40ddbd-3f1d-45d3-976c-cb7fe0b65d7d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437744 Nov 24 15:06:30.610165 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-4c3ff394-5feb-421e-87aa-e02a9ee15c37 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 1001 time: 0.0957339 Nov 24 15:06:30.676530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-185d7c77-3e7e-4838-835e-c0cfad2ddf8f service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:30.678565 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-185d7c77-3e7e-4838-835e-c0cfad2ddf8f service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0606329 Nov 24 15:06:30.750512 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-ceeff641-6bc5-4325-b4bf-915f3acb6479 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0664830 Nov 24 15:06:30.884346 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-77605fcd-d806-4129-9bde-8c4f534dd2e8 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262019 Nov 24 15:06:31.014716 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69571969-ac51-4fa6-bde9-fc593a0ab6c0 req-2b903a38-8549-4f80-a649-0cfe6c46d8a1 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238682 Nov 24 15:06:31.714013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d2b3c6-56ab-4733-b305-cb9137a298da req-028035a4-cf22-419d-9a6e-a98297933834 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:31.715444 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80d2b3c6-56ab-4733-b305-cb9137a298da req-028035a4-cf22-419d-9a6e-a98297933834 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0815284 Nov 24 15:06:31.760484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80d2b3c6-56ab-4733-b305-cb9137a298da req-24bf75e3-0ef6-428c-87b2-fc9ca0cd27ed tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394089 Nov 24 15:06:32.962538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9df2197-41d6-4388-88b4-bd12807f0444 req-6f81e30a-1c61-4369-a1bc-45c3e6f51b2b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:32.964016 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b9df2197-41d6-4388-88b4-bd12807f0444 req-6f81e30a-1c61-4369-a1bc-45c3e6f51b2b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0797114 Nov 24 15:06:33.011455 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b9df2197-41d6-4388-88b4-bd12807f0444 req-af2ff42d-23f1-417f-bd4f-20f6ced2b256 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418315 Nov 24 15:06:33.268386 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-29cd0f39-152d-4e43-8e05-4b85daa73a20 req-e271c3b9-078e-419e-b647-9e231b9636c7 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.1380079 Nov 24 15:06:33.420357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-556a6b39-6f5c-4ce8-8fb8-52c0ec285de0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:33.459484 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55256) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:06:33.537556 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67778434-4230-46f7-a3d5-a7e980322634 req-261de7c8-3782-416b-9ddf-374be49ac93c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:33.541732 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-67778434-4230-46f7-a3d5-a7e980322634 req-261de7c8-3782-416b-9ddf-374be49ac93c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 945 time: 0.0816414 Nov 24 15:06:33.588895 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-67778434-4230-46f7-a3d5-a7e980322634 req-9b447ede-8679-4f47-b6d1-ef4bfb73f7ac tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423517 Nov 24 15:06:33.601374 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-447314dc-3ffc-493a-9e43-fd76d6949a28 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1402318 Nov 24 15:06:33.818575 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:33.998550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:06:34.106777 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-668b9f19-7b09-46f7-990f-914c90a63dff service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&tenant_id=8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 1098 time: 0.0757196 Nov 24 15:06:34.119111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:34.157143 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:06:34.162673 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:34.169939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:34.172753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-a1623894-1dc3-48e9-bb76-57b1169c62ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:06:34.221076 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-70d307d9-5cc6-4436-9051-cd521fc23813 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1096 time: 0.0868504 Nov 24 15:06:34.222651 dv-neutron-818151-2-hyperv neutron-server[83527]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'code': 422} returned with failed status Nov 24 15:06:34.242240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:06:34.246006 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:06:34.361021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-f637f05e-36c0-48f8-9897-c6ee050ca1c4 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:34.362673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-f637f05e-36c0-48f8-9897-c6ee050ca1c4 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1349747 Nov 24 15:06:34.466624 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-39dfd029-7bd8-441f-8f99-2954ce000616 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 999 time: 0.0979285 Nov 24 15:06:34.536067 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-4ea1ab07-2a8c-43e5-97fa-9fed8af2dc29 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:34.537532 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-4ea1ab07-2a8c-43e5-97fa-9fed8af2dc29 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0651271 Nov 24 15:06:34.614964 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-4f4b760b-c826-4e95-a568-cc31a707db68 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0703230 Nov 24 15:06:34.788399 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-d95883d9-c3b6-47cd-8e37-35fa502ba5f4 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1665671 Nov 24 15:06:34.800779 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9cef87-763b-46d4-97e9-ab36b5a76aec req-d987833d-e795-47fb-8577-027be81b4700 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:34.802392 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0d9cef87-763b-46d4-97e9-ab36b5a76aec req-d987833d-e795-47fb-8577-027be81b4700 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0903296 Nov 24 15:06:34.856624 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-0d9cef87-763b-46d4-97e9-ab36b5a76aec req-9044d8fd-bdd1-481e-bba8-0f36d0c7ff3a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474296 Nov 24 15:06:34.926156 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-303dcf8c-ff5e-4a86-9f65-cd94c01a54fe req-f30486ab-32a2-4752-abdc-a0ee95aee112 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1316938 Nov 24 15:06:35.971343 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-860106d8-ce26-44c1-939a-e09d71ce17eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:36.182629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caba6610-3e33-497d-a8ca-93c7460f8e08 req-8e79bc69-4cf8-4ee3-96be-5eb1aba052b7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:36.184113 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-caba6610-3e33-497d-a8ca-93c7460f8e08 req-8e79bc69-4cf8-4ee3-96be-5eb1aba052b7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.1956801 Nov 24 15:06:36.237558 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-caba6610-3e33-497d-a8ca-93c7460f8e08 req-de53fcf0-d8be-4ff8-8125-e7a160bf7329 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469711 Nov 24 15:06:37.078356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:37.455216 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c64be665-12ab-4993-a667-c32da99280c6 req-35e2e047-33fb-4871-ab6f-0eca8b178411 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:37.456944 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c64be665-12ab-4993-a667-c32da99280c6 req-35e2e047-33fb-4871-ab6f-0eca8b178411 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0834622 Nov 24 15:06:37.507494 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c64be665-12ab-4993-a667-c32da99280c6 req-238d51c4-578b-45a9-9193-81a22156e919 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446260 Nov 24 15:06:38.726305 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac4eba9-6b23-4284-ac9e-22deff5ca42b req-686db413-7109-4d27-8f5f-5651746d0a9d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:38.727879 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0ac4eba9-6b23-4284-ac9e-22deff5ca42b req-686db413-7109-4d27-8f5f-5651746d0a9d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0930884 Nov 24 15:06:38.758338 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:38.783857 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0ac4eba9-6b23-4284-ac9e-22deff5ca42b req-465e3fb5-9a35-4aba-97aa-2bef4c544418 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478573 Nov 24 15:06:39.995557 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc4445c-8f85-49af-940c-ab2d649d0522 req-3823b1b4-f7b3-4cdf-b552-a48bb4fbc338 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:39.997053 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ecc4445c-8f85-49af-940c-ab2d649d0522 req-3823b1b4-f7b3-4cdf-b552-a48bb4fbc338 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0807869 Nov 24 15:06:40.050944 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ecc4445c-8f85-49af-940c-ab2d649d0522 req-82eca824-05fc-485c-8e50-1858a3460be0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483892 Nov 24 15:06:41.263426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d29604-b95b-448a-9964-c762afe0bfef req-f1f59ed2-6dc5-4b09-99db-2a645b722cb8 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:41.265722 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-55d29604-b95b-448a-9964-c762afe0bfef req-f1f59ed2-6dc5-4b09-99db-2a645b722cb8 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0848777 Nov 24 15:06:41.314689 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-55d29604-b95b-448a-9964-c762afe0bfef req-06733d77-2675-42c5-9e3b-d4c780ae05eb tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431736 Nov 24 15:06:42.533248 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5159b201-079f-4304-9676-af231a26b98b req-1b80bcfd-6efd-4290-bf0d-06dcda8e4ff4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:42.534727 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5159b201-079f-4304-9676-af231a26b98b req-1b80bcfd-6efd-4290-bf0d-06dcda8e4ff4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0891507 Nov 24 15:06:42.588893 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5159b201-079f-4304-9676-af231a26b98b req-770e4fdc-9926-4570-a298-02de81d36d1b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473905 Nov 24 15:06:43.815952 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e407e4d-7f1b-43bf-ba57-9d8db63c7f14 req-eca4f9d6-6897-49e5-9158-489b129b73f1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:43.818180 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4e407e4d-7f1b-43bf-ba57-9d8db63c7f14 req-eca4f9d6-6897-49e5-9158-489b129b73f1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0998619 Nov 24 15:06:43.871881 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4e407e4d-7f1b-43bf-ba57-9d8db63c7f14 req-0961d1b4-f93a-40de-b492-d3f59a6b8d0b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469158 Nov 24 15:06:45.099842 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c48aeb-442f-4455-b0b4-8df353244a57 req-93c5caf4-ba45-47db-b785-2b05febff73b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:45.101790 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d2c48aeb-442f-4455-b0b4-8df353244a57 req-93c5caf4-ba45-47db-b785-2b05febff73b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0887473 Nov 24 15:06:45.152640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d2c48aeb-442f-4455-b0b4-8df353244a57 req-10d59074-f8a4-4379-bfe7-eb8e97f79b77 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450585 Nov 24 15:06:46.353268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b106bb-ebd3-4cdb-b021-84f3a91b445c req-3e6e19f0-c9e4-44c2-a3e6-97904003c332 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:46.354758 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-11b106bb-ebd3-4cdb-b021-84f3a91b445c req-3e6e19f0-c9e4-44c2-a3e6-97904003c332 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0815644 Nov 24 15:06:46.411458 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-11b106bb-ebd3-4cdb-b021-84f3a91b445c req-7fa217fc-37e8-4708-b062-efde4bf77b9e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503607 Nov 24 15:06:47.606694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4870834-5f6b-4705-98cb-c2bbb5191edf req-491f4932-46ec-4192-bb77-e3bf68cd1280 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:47.608064 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b4870834-5f6b-4705-98cb-c2bbb5191edf req-491f4932-46ec-4192-bb77-e3bf68cd1280 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0781765 Nov 24 15:06:47.653980 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b4870834-5f6b-4705-98cb-c2bbb5191edf req-daa8bdba-ba0d-447c-b0b7-fb3b194c260c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405059 Nov 24 15:06:48.590637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:48.866916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eb3ed0f-0cc5-4a83-815c-185515c85b2a req-84c35391-7be9-41d5-98be-2d238677a816 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:48.868375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0eb3ed0f-0cc5-4a83-815c-185515c85b2a req-84c35391-7be9-41d5-98be-2d238677a816 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0905390 Nov 24 15:06:48.916165 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0eb3ed0f-0cc5-4a83-815c-185515c85b2a req-be790aeb-a8ea-424d-bdd1-ea857a047f8f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420461 Nov 24 15:06:50.123303 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f33663fc-23f1-4c4c-8d44-db5a47388511 req-adcb5da8-0e50-43d1-ac34-4592006a9c52 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:50.124767 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f33663fc-23f1-4c4c-8d44-db5a47388511 req-adcb5da8-0e50-43d1-ac34-4592006a9c52 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0825915 Nov 24 15:06:50.170693 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f33663fc-23f1-4c4c-8d44-db5a47388511 req-b55fbb76-9679-47f9-927d-90624b482a7b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405309 Nov 24 15:06:51.366642 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8422841-bc42-492a-be38-d6a253fd2189 req-aa548555-8882-42a7-a871-3d1e22d3373e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:51.368115 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8422841-bc42-492a-be38-d6a253fd2189 req-aa548555-8882-42a7-a871-3d1e22d3373e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 943 time: 0.0770392 Nov 24 15:06:51.413093 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8422841-bc42-492a-be38-d6a253fd2189 req-97145817-880d-4425-8840-dd21cb674e7f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394821 Nov 24 15:06:52.120150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:06:52.252325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:52.265419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'port_id': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'mac_address': 'fa:16:3e:6b:94:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:06:52.318499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:52.335856 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:06:52.351044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:52.354799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:52.356598 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:06:52.423869 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=9']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:06:52.427017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:06:52.614007 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3838fc10-0a46-4d3d-b00d-ec6b98aaab14 req-f784e954-f65e-472e-882d-41e7621de066 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:52.615484 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3838fc10-0a46-4d3d-b00d-ec6b98aaab14 req-f784e954-f65e-472e-882d-41e7621de066 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 944 time: 0.0798726 Nov 24 15:06:52.668150 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3838fc10-0a46-4d3d-b00d-ec6b98aaab14 req-9ff6a37f-69f1-4ba4-831c-fa78d5c90a5e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460720 Nov 24 15:06:52.732747 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:06:53.870842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a69033-75fc-4c36-963e-9856dfc515a3 req-cca976b0-d669-4ceb-a385-6074f292d213 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:53.872322 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b1a69033-75fc-4c36-963e-9856dfc515a3 req-cca976b0-d669-4ceb-a385-6074f292d213 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 944 time: 0.0815299 Nov 24 15:06:53.918092 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b1a69033-75fc-4c36-963e-9856dfc515a3 req-cc6e8b8e-7fae-4247-8c9d-4756c5e6a12a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403764 Nov 24 15:06:54.122830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:06:54.191860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:06:54.192233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:54.309664 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:54.336484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:06:54.345844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:06:54.350931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:06:54.353017 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:06:54.399485 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'code': 200} Nov 24 15:06:54.431301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=10']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:06:54.436039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:06:54.666759 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-90d3ea35-4a70-4060-8b0d-fb0989e8b26e req-ef1b46a9-7609-43d2-84f2-fe9ffc3a9f4d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1099 time: 0.0724747 Nov 24 15:06:54.710418 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-90d3ea35-4a70-4060-8b0d-fb0989e8b26e req-e8cd0b0b-c120-468e-b2b6-1fa6a640e391 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0370193 Nov 24 15:06:54.873735 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:06:55.124037 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcc79c29-53fa-468f-89e0-6a1174381cea req-fd59a4a8-4a37-4a58-93ba-9513726753a4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:55.125485 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcc79c29-53fa-468f-89e0-6a1174381cea req-fd59a4a8-4a37-4a58-93ba-9513726753a4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 946 time: 0.0836127 Nov 24 15:06:55.170882 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dcc79c29-53fa-468f-89e0-6a1174381cea req-cfc39564-13a3-43c4-9648-ba331b04d2b4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399625 Nov 24 15:06:56.481535 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faee1fa-9a1c-402b-98c3-690b0b7e139f req-daf9b37c-db34-4017-8cc9-65da9951ae96 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:56.483214 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3faee1fa-9a1c-402b-98c3-690b0b7e139f req-daf9b37c-db34-4017-8cc9-65da9951ae96 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 946 time: 0.1797726 Nov 24 15:06:56.531594 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-3faee1fa-9a1c-402b-98c3-690b0b7e139f req-2e92e79d-34b0-4167-97a9-90af8016f48b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426273 Nov 24 15:06:57.733081 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebd350a-91ad-4983-9dca-cecc23d1fe8c req-fbe46587-b5bf-4978-9c92-6193c2d427ef tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:06:57.734541 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aebd350a-91ad-4983-9dca-cecc23d1fe8c req-fbe46587-b5bf-4978-9c92-6193c2d427ef tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 946 time: 0.0785902 Nov 24 15:06:57.784144 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-aebd350a-91ad-4983-9dca-cecc23d1fe8c req-24a6a160-0148-4059-83db-5c5f7e1e8e3c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441327 Nov 24 15:07:03.423129 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-3cda0795-a968-42f7-8556-a17c3db7d73f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:03.822218 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:05.964514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4aae3273-317a-44e6-8de2-0427d3345ffb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:07.069385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:08.755524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:18.591592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:31.874497 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:07:33.425542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d56d8e88-90df-47d6-8345-3e45850da54c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:33.824295 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:33.843132 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-ea076555-c62a-4fcd-87ff-95f84e1616b3 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0731273 Nov 24 15:07:33.985519 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-54213e06-b636-433d-a786-1aa0f69fe46d service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1099 time: 0.0714614 Nov 24 15:07:34.137547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-37bb8b20-67e6-4ed4-9779-340d85e5d86e service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:07:34.138961 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-37bb8b20-67e6-4ed4-9779-340d85e5d86e service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1324143 Nov 24 15:07:34.249363 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-7ee94f91-c3bd-4ac7-92b5-76f1f15ace79 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 1001 time: 0.1029997 Nov 24 15:07:34.317331 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-0646f7c7-e202-444b-a933-277cf645fa5d service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:07:34.318728 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-0646f7c7-e202-444b-a933-277cf645fa5d service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0626919 Nov 24 15:07:34.398617 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-cab82cc3-3d0f-4a4f-bd1f-924b67a403da service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0733793 Nov 24 15:07:34.409076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-283723d9-7925-41b1-89bf-aac14c1c14ea service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 15:07:34.410052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-283723d9-7925-41b1-89bf-aac14c1c14ea service neutron] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0050366 Nov 24 15:07:34.550274 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-3fe256a4-9dba-4ed7-861f-613c1037feec service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328280 Nov 24 15:07:34.693163 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1145650e-874a-48d1-8b86-3e77f3e8fe84 req-42f90b79-cce0-426c-b9a3-cec7b8e8170d service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1356251 Nov 24 15:07:35.967927 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-82be0003-5d10-4800-a5e8-bfe9c0552982 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:37.071456 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:38.764220 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:07:48.588023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:03.429058 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-569ff29e-bb0a-4e20-b225-da1f11a483b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:03.827322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:05.970491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0fa1a9ba-24fc-4281-b236-b6f1fd44eeeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:07.073999 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:08.764033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:08.874830 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:08:18.597179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:33.433613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4573f3be-f10c-4184-83be-396f4fc6396e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:33.827697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:34.848398 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-92261e87-ccab-4c9b-beff-bcda992fd00d service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0872724 Nov 24 15:08:35.119719 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-52f5a2fa-1f72-468b-ae4e-afb7f0ee3a00 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1099 time: 0.1966109 Nov 24 15:08:35.336581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-ec649dcd-828f-4549-b7cf-020058702445 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:35.339274 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-ec649dcd-828f-4549-b7cf-020058702445 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1982858 Nov 24 15:08:35.488523 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-4c95ac16-33e9-4422-8681-2898222ba91d service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 1001 time: 0.1417217 Nov 24 15:08:35.565964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-1de3aa64-cca0-48da-95d1-eb8b47d38468 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:35.567525 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-1de3aa64-cca0-48da-95d1-eb8b47d38468 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0726621 Nov 24 15:08:35.695890 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-3320cc7d-a171-40fe-9c19-eac71ca88bf7 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1213546 Nov 24 15:08:35.866363 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-2047fe58-313c-430a-9788-9e31efeda716 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1617246 Nov 24 15:08:35.984870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-30c6553e-0e90-48f3-8473-a4481fa7e9f8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:36.023414 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-cc4df1d1-18e6-437f-861e-f5c475197805 req-1a9a9859-528b-4444-aa58-2fc3dc19ce8c service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1522503 Nov 24 15:08:37.088557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:38.774915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:44.735862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55392) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:45.097502 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Deleting port a0303d01-85e8-42ae-a52e-bf014497d439 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:08:45.097957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:45.398318 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:45.398643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:45.526896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Calling delete_port for a0303d01-85e8-42ae-a52e-bf014497d439 owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:08:45.713476 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:45.721669 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:45.802174 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event deleted for resources: {'Port': ['ID=a0303d01-85e8-42ae-a52e-bf014497d439,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:45.874907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.875513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.877120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.877840 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.878290 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:08:45.879241 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.879520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.880060 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.880678 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.881279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.881880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.882507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:45.901028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:46.155738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:46.609507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:08:46.837279 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:08:46.848458 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:08:46.862430 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:46.866359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:08:46.867144 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:08:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:08:46.922232 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "DELETE /v2.0/floatingips/9f581d0a-97fe-4cf5-973e-a790cbbd129b HTTP/1.1" status: 204 len: 168 time: 2.1846871 Nov 24 15:08:46.923287 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:08:47.097167 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'status': 'completed', 'code': 200} Nov 24 15:08:47.102919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:08:47.300832 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-859a0621-72cd-47f7-beb5-5d04d290a478 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 1099 time: 0.1772001 Nov 24 15:08:47.553945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-5e3313ef-2a45-448d-a459-564f4317d15c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:47.555434 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-5e3313ef-2a45-448d-a459-564f4317d15c service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.2476866 Nov 24 15:08:47.562629 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:08:47.568437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:08:47.582467 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:08:47.583305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:08:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:08:47.639717 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-126acd51-6c61-4555-bbb3-a275fb39d180 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 200 len: 217 time: 0.0741000 Nov 24 15:08:47.706460 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea5a040-115a-441c-b4af-8fbb4caeb375 req-5c8a0207-078d-4e1c-b249-518a413f6517 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:47.707218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bea5a040-115a-441c-b4af-8fbb4caeb375 req-5c8a0207-078d-4e1c-b249-518a413f6517 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:08:47.736743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-54b49131-59fd-4d1b-8abc-7363c93f8338 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:47.738572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-54b49131-59fd-4d1b-8abc-7363c93f8338 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0903258 Nov 24 15:08:47.743692 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bea5a040-115a-441c-b4af-8fbb4caeb375 req-5c8a0207-078d-4e1c-b249-518a413f6517 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:08:47.745182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bea5a040-115a-441c-b4af-8fbb4caeb375 req-5c8a0207-078d-4e1c-b249-518a413f6517 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 946 time: 0.4101167 Nov 24 15:08:47.802511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:08:47.847092 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bea5a040-115a-441c-b4af-8fbb4caeb375 req-b8070bcd-f4fd-4989-aa38-23dd51c61db0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655518 Nov 24 15:08:47.867690 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-45ff1201-7e01-4508-bca3-1f448cdeff33 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1212609 Nov 24 15:08:48.102056 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-12207b7d-9b5b-4a17-ab0a-f45c2ae13527 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2252591 Nov 24 15:08:48.186164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:08:48.192046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27234ce5-58b9-4bbe-b829-c6ac2bc408ba None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:08:48.409013 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-87ac5bf2-23fa-4177-b06f-c8e1545fb52f req-9a2b2305-6b31-42de-bbc7-40d8157e429e service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2994823 Nov 24 15:08:48.468502 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d20fce73-25ec-4ff8-a0fe-eddf67c10b1b None None] New status for floating IP 9f581d0a-97fe-4cf5-973e-a790cbbd129b: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:08:48.619497 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:49.014842 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-3f7b68a6-6b76-4414-bead-f498f9aeb8f7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:49.016483 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-3f7b68a6-6b76-4414-bead-f498f9aeb8f7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 946 time: 0.0919757 Nov 24 15:08:49.097069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Deleting port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:08:49.097425 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:49.183947 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-440f38ba-ea1e-47e4-8051-aee6e9861b00 req-e464e60c-dd9e-4387-a7b0-ef9396bfa745 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:08:49.186191 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-440f38ba-ea1e-47e4-8051-aee6e9861b00 req-e464e60c-dd9e-4387-a7b0-ef9396bfa745 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 946 time: 0.1377473 Nov 24 15:08:49.264982 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-440f38ba-ea1e-47e4-8051-aee6e9861b00 req-74e7e730-1e1e-4a30-8be1-4d056d72ab13 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=14be9642-2338-4421-814a-cc6df323901b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0719323 Nov 24 15:08:49.443903 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] For port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:08:49.444186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:49.572874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Calling delete_port for 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:08:49.743727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:49.750847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:49.807133 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event deleted for resources: {'Port': ['ID=0e7a4814-adc7-4507-ad1f-3fea9abbc6a2,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:49.812094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:49.905885 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] No DVR routers for this DVR port 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:08:49.909268 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:49.912341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-deleted', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:08:49.934131 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b529ddec-6627-405c-97b1-7fcaa7cf136a req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "DELETE /v2.0/ports/0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 HTTP/1.1" status: 204 len: 173 time: 0.9123340 Nov 24 15:08:49.990065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af717b14-bfd0-4acc-9c30-c14babc9a8c6', 'name': 'network-vif-deleted', 'tag': '0e7a4814-adc7-4507-ad1f-3fea9abbc6a2', 'status': 'completed', 'code': 200} Nov 24 15:08:50.515506 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-beaec0c7-eba1-428f-a734-9dd2b132a0ab req-d72bd38e-0a50-4efd-8899-279c531f9be5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=af717b14-bfd0-4acc-9c30-c14babc9a8c6 HTTP/1.1" status: 200 len: 210 time: 0.0521157 Nov 24 15:08:51.647110 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55416) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:51.738781 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:51.773727 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:51.854644 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:51.859256 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c662f8d-f386-4cfd-a108-6a87992d6b24 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:51.889245 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=14be9642-2338-4421-814a-cc6df323901b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:51.897008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:51.912485 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:51.914766 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "DELETE /v2.0/security-groups/14be9642-2338-4421-814a-cc6df323901b HTTP/1.1" status: 204 len: 168 time: 0.2658973 Nov 24 15:08:52.428290 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55424) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:52.434967 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-675217026', 'description': 'tempest-secgroup-smoke-675217026 description', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:52.441718 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:52.447280 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:52.451048 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:52.460293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:52.473520 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.522362 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:52.527094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:52.530246 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:52.538897 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:52.618960 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.623697 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.629133 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-17b0a500-0653-4aa0-aa95-59ee7ce3f5f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:52.683634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4567be63-b59d-4942-8096-5e4a70636860,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:52.689987 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.691240 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1626 time: 0.2615621 Nov 24 15:08:52.694498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55428) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:52.700073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.700715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.701308 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.701936 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.702332 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '4567be63-b59d-4942-8096-5e4a70636860', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:52.702668 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.703311 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.707566 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.708799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.709417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.710437 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.710579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:08:52.711055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:08:52.715788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:52.718622 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-50f4f8e1-ad5e-49b2-bd4b-36f8a04b9a30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:52.723812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:52.730489 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:52.742740 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:52.767992 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:08:52.768441 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 0e7a4814-adc7-4507-ad1f-3fea9abbc6a2 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:08:52.772032 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.855130 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.860681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.868339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9cff1f98-f926-4cc3-b8b0-b0a3a829d926 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:52.893520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7713a668-7fc8-43b6-a7de-11dc88564c6e,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:52.901789 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:52.908807 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:52.909375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-eed0120d-8b18-43d6-8a34-58cd0e8aa827 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.2132277 Nov 24 15:08:52.912784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55432) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:52.919488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '4567be63-b59d-4942-8096-5e4a70636860', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:52.928062 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:52.932825 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:52.936450 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:52.944095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:52.965346 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.040996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.046730 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.055516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6c84ca3c-2b6d-4ea7-aacb-d08bf83d86da tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:53.077984 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=64ed9b0d-c2e6-4e64-acfc-90f80c8cb566,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:53.084374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:53.090640 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.091883 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-58a4301b-4cfe-49d4-81f2-32e6a6e7b2d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1779592 Nov 24 15:08:53.097791 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55436) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:53.103708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '4567be63-b59d-4942-8096-5e4a70636860', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:53.110273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:53.116986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:53.120833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:53.129704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:53.152749 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.227905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.233535 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.236629 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-29f0de25-77df-4f21-9aae-263bec14e220 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:53.264361 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e95b296c-14b1-409a-9a7a-3904ec8ac68a,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:53.268589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:53.277962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.279288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-71245f41-2a0f-4c44-a53e-34d73a3a6cca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1805081 Nov 24 15:08:53.285406 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55440) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:53.298599 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '4567be63-b59d-4942-8096-5e4a70636860', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:53.310504 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:53.319367 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:53.325049 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:53.337627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:53.368797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.456067 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.460848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.463281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8e3a83cd-6277-4520-bded-38871bf7fc68 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:53.490550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=edb6d06a-adcd-4be1-8924-bd1d98d5ec7c,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:53.494523 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:53.505777 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.507518 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7da8174b-63c8-4aea-a30c-d43bf5bf0fc5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.2198379 Nov 24 15:08:53.510522 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55444) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:53.517580 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '4567be63-b59d-4942-8096-5e4a70636860', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:53.524976 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:53.530291 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:53.535445 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:53.542744 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:53.556353 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Project 8ea7acbe2851472a95e5b9a5d726a011 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:08:53.565694 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.658114 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.663382 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.670313 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-af1f50d5-b79e-4fe2-8c6f-83b910eaedf8 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:53.697027 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3adcd780-dc42-43ca-8250-9d613e44c09e,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:53.700988 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:53.711497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.713302 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7a644ebe-6ab2-46be-ad8d-29906aa8069b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.2014377 Nov 24 15:08:53.716551 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55448) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:08:53.724165 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'security_group_rule': {'security_group_id': '4567be63-b59d-4942-8096-5e4a70636860', 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:08:53.731041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:08:53.736721 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:security_group_rule and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:08:53.740442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:08:53.748253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:08:53.764781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.securitygroups_db [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Project 8ea7acbe2851472a95e5b9a5d726a011 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:08:53.773630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.902654 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.909204 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.917005 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-315e2488-b4b8-4e7d-afd8-bb16a22afc0c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:08:53.944108 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f0ae2de2-6774-47db-bb30-98d525839242,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:08:53.951273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:08:53.958637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:08:53.960247 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3c25c075-85e8-41aa-9b66-13c04d00113c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.2423675 Nov 24 15:09:03.444163 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d2dd36bc-2750-4ec0-b3b1-c02066caafc8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:03.833511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:05.982833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf9b07a4-a3d7-4d6b-a312-2b8c7e0b7d5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:07.094439 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:08.785240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:10.933475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-94aa6a46-1794-40b0-a384-f70059474c6b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:09:10.958033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-94aa6a46-1794-40b0-a384-f70059474c6b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:09:10.960050 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-94aa6a46-1794-40b0-a384-f70059474c6b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-675217026&fields=id&tenant_id=8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 267 time: 0.0795596 Nov 24 15:09:11.140590 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-96d27e6d-d042-46bd-be89-ffdead493c7b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:11.143640 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-96d27e6d-d042-46bd-be89-ffdead493c7b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 808 time: 0.1764183 Nov 24 15:09:11.165211 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cddeabc1-84e4-481f-870e-5dd6aa3a8343 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/quotas/8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 375 time: 0.0120914 Nov 24 15:09:11.258059 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-707880cb-598d-428f-8402-2fab2b01d4dd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0872316 Nov 24 15:09:11.364089 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-43ec125f-8bba-4f1b-8aaa-9a57b0f7db19 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83525) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 15:09:11.365478 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-43ec125f-8bba-4f1b-8aaa-9a57b0f7db19 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0864446 Nov 24 15:09:11.513566 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c4359524-12ec-446a-9d23-d6a471e4f0fb service neutron] 10.222.0.70 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1403158 Nov 24 15:09:11.657681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-65b627b5-63c8-446d-95ba-54e6ad1d4887 service neutron] 10.222.0.70 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1362977 Nov 24 15:09:13.190959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-96c876ab-7639-4cfa-8199-9e1de3bebead req-c3baaa53-5070-44a0-9bd8-a827d4996809 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:09:13.213326 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-96c876ab-7639-4cfa-8199-9e1de3bebead req-c3baaa53-5070-44a0-9bd8-a827d4996809 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:09:13.214957 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-96c876ab-7639-4cfa-8199-9e1de3bebead req-c3baaa53-5070-44a0-9bd8-a827d4996809 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 210 time: 0.0981624 Nov 24 15:09:14.494709 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4a93cf9d-677c-4621-97cd-5a8170ecf930 req-2862a488-dcb2-43db-acd0-d84b6534e744 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 210 time: 0.0857682 Nov 24 15:09:14.788478 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-2a742900-6146-4d71-97dc-f7b065463b9e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:14.791118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-2a742900-6146-4d71-97dc-f7b065463b9e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 808 time: 0.2940476 Nov 24 15:09:14.864856 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-5182106c-128e-475c-b46e-ff2882e4c466 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:09:14.882675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-5182106c-128e-475c-b46e-ff2882e4c466 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:09:14.886574 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-5182106c-128e-475c-b46e-ff2882e4c466 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 379 time: 0.0793414 Nov 24 15:09:14.895619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'port': {'device_id': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'admin_state_up': True, 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'security_groups': ['4567be63-b59d-4942-8096-5e4a70636860']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:09:15.079156 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:09:15.094652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:09:15.108030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Made reservation on behalf of 8ea7acbe2851472a95e5b9a5d726a011 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:09:15.112265 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:15.405306 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Allocated IP 172.20.0.6 (3bace08e-55bc-42bb-be54-36d02a25dcad/9119f9d2-54c0-4483-ad28-6f72771e7d2d/afb1bdde-71f1-42d0-93f3-fe88d447fe4b) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:09:15.706495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:15.817206 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Transition to ACTIVE for port object afb1bdde-71f1-42d0-93f3-fe88d447fe4b will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:09:15.821772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8c0c8fa-bfca-4294-82a5-fe2fd43760b8 req-79c12570-327a-429b-944a-123317334f1b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 210 time: 0.0932014 Nov 24 15:09:15.855936 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:15.865652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:15.943616 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Network 3bace08e-55bc-42bb-be54-36d02a25dcad is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:09:15.951739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:09:15.955752 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:09:16.138269 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:16.142192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:16.176390 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:16.176751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:16.227810 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-cbca4779-20f9-43ea-b854-6352e652bd02 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3369520 Nov 24 15:09:16.243345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Request body: {'port': {'device_id': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:09:16.345939 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6b051103-2630-4993-b907-b5435324116b None None] Provisioning for port afb1bdde-71f1-42d0-93f3-fe88d447fe4b completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:09:16.352536 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6b051103-2630-4993-b907-b5435324116b None None] Provisioning complete for port afb1bdde-71f1-42d0-93f3-fe88d447fe4b triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:09:16.352965 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6b051103-2630-4993-b907-b5435324116b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:16.413326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-6b051103-2630-4993-b907-b5435324116b None None] Port afb1bdde-71f1-42d0-93f3-fe88d447fe4b cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:09:16.461482 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:17.002928 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id afb1bdde-71f1-42d0-93f3-fe88d447fe4b {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:09:17.011365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:17.032798 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Transition to ACTIVE for port object afb1bdde-71f1-42d0-93f3-fe88d447fe4b will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:09:17.037581 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:17.042645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b5ba2809-c0e2-47a8-a772-167bda5e0a09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:17.174909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:17.185558 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:17.193365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347b03f9-ce90-400c-940e-dd2324f8f626 req-3c28b6b7-9651-4837-b6aa-6cda8012a4a7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:17.195653 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-347b03f9-ce90-400c-940e-dd2324f8f626 req-3c28b6b7-9651-4837-b6aa-6cda8012a4a7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.1634429 Nov 24 15:09:17.319874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Attempting to bind port afb1bdde-71f1-42d0-93f3-fe88d447fe4b on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:09:17.320234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Attempting to bind port afb1bdde-71f1-42d0-93f3-fe88d447fe4b by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:09:17.320620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Attempting to bind port afb1bdde-71f1-42d0-93f3-fe88d447fe4b on network 3bace08e-55bc-42bb-be54-36d02a25dcad {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:09:17.322854 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-347b03f9-ce90-400c-940e-dd2324f8f626 req-1c81ada9-bf40-4cba-b253-c1b766f1bc7f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1180308 Nov 24 15:09:17.328966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Port afb1bdde-71f1-42d0-93f3-fe88d447fe4b on network 3bace08e-55bc-42bb-be54-36d02a25dcad not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 15:09:17.329413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Attempting to bind port afb1bdde-71f1-42d0-93f3-fe88d447fe4b on network 3bace08e-55bc-42bb-be54-36d02a25dcad {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:09:17.338618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 8, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:09:17.338965 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Checking segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:09:17.339348 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Bound using segment: {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:09:17.339894 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Bound port: afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '813f4bb2-91ce-4380-87dd-7be1beb26558', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 897, 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:09:17.340499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:17.464121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:09:17.468236 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:09:17.475468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:17.480913 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9f9ae3ef-677b-460f-b750-b8377f5233ac tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:17.542223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:17.543901 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] 10.222.0.47 "PUT /v2.0/ports/afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 1093 time: 1.3077977 Nov 24 15:09:17.544446 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:09:17.569445 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:17.575949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:17.677538 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'status': 'completed', 'code': 200} Nov 24 15:09:17.721696 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-0f871662-2a73-4f5c-b7e9-541d4801b2b6 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1096 time: 0.1152046 Nov 24 15:09:17.828918 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-54b8a6cb-a4d9-4e36-be88-40dfc90f5008 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 217 time: 0.0955200 Nov 24 15:09:17.904420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-8a35e4ed-0db8-4647-abc1-a8416dbb364c service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:17.908666 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-8a35e4ed-0db8-4647-abc1-a8416dbb364c service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0741067 Nov 24 15:09:18.022778 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-6ce80af2-d32a-414d-a76a-56ffe03eb833 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1076441 Nov 24 15:09:18.172490 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-77c618b1-bf1e-446a-83fe-7a067c678cc2 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1424513 Nov 24 15:09:18.333390 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e3656e87-1ac6-4423-9533-a1d0e5110b6b req-c19144c7-2d33-43e0-849c-a16e93c0ac2b service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1545606 Nov 24 15:09:18.477667 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-bfc79461-52f1-49ba-8b55-1a67e926e048 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1096 time: 0.0883031 Nov 24 15:09:18.619300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:18.628783 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4d092e-91a1-479f-ba44-b5daf474d592 req-86f36cda-6758-4dc4-83fa-975b03c9b203 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:18.631633 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5d4d092e-91a1-479f-ba44-b5daf474d592 req-86f36cda-6758-4dc4-83fa-975b03c9b203 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.1339173 Nov 24 15:09:18.719147 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5d4d092e-91a1-479f-ba44-b5daf474d592 req-cf72a1a9-f4aa-442d-9e3c-86979eb7407e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0803363 Nov 24 15:09:18.763590 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-8dfe935b-fe30-43ee-9dd6-9364e4a4b025 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:18.765251 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-8dfe935b-fe30-43ee-9dd6-9364e4a4b025 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.2810481 Nov 24 15:09:18.846925 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-593660d7-f1da-49c8-af4c-317c1330ede0 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 217 time: 0.0740268 Nov 24 15:09:18.913201 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-5813f848-5ce6-41a9-88a1-a61054a11f52 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:18.914667 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-5813f848-5ce6-41a9-88a1-a61054a11f52 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0615640 Nov 24 15:09:18.996296 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-ab0aa87c-a28e-4a64-a9a7-8f889c806aa5 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0744150 Nov 24 15:09:19.138973 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-ccf45e2e-eaf8-4125-916e-c56c9c2a8dfd service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1348341 Nov 24 15:09:19.287443 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e911c887-5f43-4fd9-900c-bb024c23a03d req-e48b9011-9d7d-4e5b-bfd5-cc804bc9792f service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1410844 Nov 24 15:09:19.947989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a7e9e4-778e-42ef-ab3b-3dc8a2844375 req-19688af5-fb75-4dcd-901b-cb287d651647 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:19.948708 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d3a7e9e4-778e-42ef-ab3b-3dc8a2844375 req-19688af5-fb75-4dcd-901b-cb287d651647 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:09:19.968946 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d3a7e9e4-778e-42ef-ab3b-3dc8a2844375 req-19688af5-fb75-4dcd-901b-cb287d651647 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:09:19.970428 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d3a7e9e4-778e-42ef-ab3b-3dc8a2844375 req-19688af5-fb75-4dcd-901b-cb287d651647 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.1109996 Nov 24 15:09:20.028469 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d3a7e9e4-778e-42ef-ab3b-3dc8a2844375 req-6550e533-7682-4439-b404-3b8e1a438ce0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477588 Nov 24 15:09:21.302330 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac45976-20df-402d-980b-91d48e52fb5b req-928bfab2-ca16-4918-ba99-a1f36206c4d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:21.304017 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2ac45976-20df-402d-980b-91d48e52fb5b req-928bfab2-ca16-4918-ba99-a1f36206c4d0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.1403141 Nov 24 15:09:21.356978 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2ac45976-20df-402d-980b-91d48e52fb5b req-712aee80-02e2-44ba-8271-5c33d6fa3c3a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467932 Nov 24 15:09:22.572049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94bf5259-055e-40fb-a1c1-aae158f8cce7 req-85e4622b-5b6e-4d9e-b289-71b6b0febf4b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:22.573627 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94bf5259-055e-40fb-a1c1-aae158f8cce7 req-85e4622b-5b6e-4d9e-b289-71b6b0febf4b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0875013 Nov 24 15:09:22.630446 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94bf5259-055e-40fb-a1c1-aae158f8cce7 req-d05c547a-5a78-45bb-8dc8-809c128582bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501282 Nov 24 15:09:22.880355 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:09:23.873815 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de911e5e-b9e7-4088-b93a-f64c8f8ee0fe req-c91fd691-dcf6-44d7-8d1a-03d1b41f9853 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:23.876290 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de911e5e-b9e7-4088-b93a-f64c8f8ee0fe req-c91fd691-dcf6-44d7-8d1a-03d1b41f9853 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.1137342 Nov 24 15:09:23.931625 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-de911e5e-b9e7-4088-b93a-f64c8f8ee0fe req-fa1c328b-ba12-42b2-b073-3e4197f7bae1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493450 Nov 24 15:09:25.164747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aaf9679-de24-4c14-bd83-3a9380969a75 req-f069d225-2bfe-4c61-ae86-925c418eeb1a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:25.166631 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aaf9679-de24-4c14-bd83-3a9380969a75 req-f069d225-2bfe-4c61-ae86-925c418eeb1a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0990093 Nov 24 15:09:25.225451 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aaf9679-de24-4c14-bd83-3a9380969a75 req-9f09490f-d098-482b-aa1f-31ba59c62c64 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484164 Nov 24 15:09:26.465627 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db9ab3e-310b-4ad1-b810-56b582b1ae94 req-37f2f4c0-64e4-4167-a822-b4c61ffaf34d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:26.467310 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5db9ab3e-310b-4ad1-b810-56b582b1ae94 req-37f2f4c0-64e4-4167-a822-b4c61ffaf34d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0887957 Nov 24 15:09:26.557386 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-5db9ab3e-310b-4ad1-b810-56b582b1ae94 req-e040665c-fb7e-4cf8-ae88-0b5e70458b4a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0830750 Nov 24 15:09:26.831592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:09:27.037843 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:09:27.057319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'port_id': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'mac_address': 'fa:16:3e:5e:52:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:09:27.123635 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:27.144737 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id afb1bdde-71f1-42d0-93f3-fe88d447fe4b {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:09:27.162801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:09:27.167585 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:27.169696 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:27.263423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:27.278816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.279276 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.279628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.280047 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.280437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.281356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.281751 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.282110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.282437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.282815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.283198 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:09:27.287874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:27.512021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['afb1bdde-71f1-42d0-93f3-fe88d447fe4b'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:09:27.873214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b041923f-f7c4-491d-acc0-e6ceaac3cae0 req-7775d660-0996-4ae1-b07b-decf3645b0bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:27.875536 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b041923f-f7c4-491d-acc0-e6ceaac3cae0 req-7775d660-0996-4ae1-b07b-decf3645b0bd tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 944 time: 0.1002388 Nov 24 15:09:27.938450 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b041923f-f7c4-491d-acc0-e6ceaac3cae0 req-0e0a96c9-dd9f-41ce-8fc5-86bae003543e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527112 Nov 24 15:09:28.833211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:09:28.914845 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port afb1bdde-71f1-42d0-93f3-fe88d447fe4b completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:09:28.920624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port afb1bdde-71f1-42d0-93f3-fe88d447fe4b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:09:28.921054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:29.050287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:29.086063 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:09:29.102386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:09:29.110327 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:29.114514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-c2cc2044-7df2-4706-ad23-394c48baca0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:29.205612 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'code': 200} Nov 24 15:09:29.248503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:29.252265 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:29.459028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd8c797-a468-4869-84f7-a87e6ae54eb3 req-be280bf2-24ef-4be5-8b89-f8ec78d6b71a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:29.461131 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6cd8c797-a468-4869-84f7-a87e6ae54eb3 req-be280bf2-24ef-4be5-8b89-f8ec78d6b71a tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.1381831 Nov 24 15:09:29.522316 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6cd8c797-a468-4869-84f7-a87e6ae54eb3 req-2b7ad26d-da8f-4bb5-a685-5c84d4d6a851 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512323 Nov 24 15:09:29.537572 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d61aa03-0679-4135-953d-778f325a196f req-5a95c50a-e920-494e-8b6f-a130b3e0a777 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.1005287 Nov 24 15:09:29.588050 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6d61aa03-0679-4135-953d-778f325a196f req-9a670a28-43a6-4564-a265-d555c96d13b3 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438647 Nov 24 15:09:30.769252 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4cff598-c064-4c6b-9414-e626e43283ff req-b30c8641-68a7-4f55-bffd-2706fe917a4c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:30.771418 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d4cff598-c064-4c6b-9414-e626e43283ff req-b30c8641-68a7-4f55-bffd-2706fe917a4c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.1172988 Nov 24 15:09:30.834818 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d4cff598-c064-4c6b-9414-e626e43283ff req-8a7f4e5b-bcc3-4496-b831-c84a9f4dd024 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0516343 Nov 24 15:09:32.108999 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d83a61b7-84c0-4d6e-a553-0998bd42ef50 req-5c7d442b-0f8b-401a-86d9-5255fcd6c620 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:32.110440 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d83a61b7-84c0-4d6e-a553-0998bd42ef50 req-5c7d442b-0f8b-401a-86d9-5255fcd6c620 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0888813 Nov 24 15:09:32.286675 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-d83a61b7-84c0-4d6e-a553-0998bd42ef50 req-068b271b-61b5-4490-a0f9-a62ea577bd6b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1659722 Nov 24 15:09:32.523704 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5cedfab-0015-444e-8622-3a318230c8bf req-689e3a78-beb2-41c4-943d-2853d7b5a3d1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:32.525317 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d5cedfab-0015-444e-8622-3a318230c8bf req-689e3a78-beb2-41c4-943d-2853d7b5a3d1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0946867 Nov 24 15:09:32.578583 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d5cedfab-0015-444e-8622-3a318230c8bf req-f9409f42-a7c1-477e-8d26-db6f535c534b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460665 Nov 24 15:09:32.607307 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55618) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:09:32.762757 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-2b80ce1f-cdc6-4997-8f1e-fb51cbbfce27 tempest-TestShelveInstance-1019541265 tempest-TestShelveInstance-1019541265-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1093 time: 0.1537361 Nov 24 15:09:32.766401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55624) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:09:32.772733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address': '172.20.0.6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:09:32.778833 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:09:32.784123 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Usage tracker for resource:floatingip and tenant:8ea7acbe2851472a95e5b9a5d726a011 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:09:32.788122 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:09:32.795594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:09:32.814609 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:32.964013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:33.125053 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Allocated IP 172.26.4.227 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/14e9bbae-0054-4981-b18e-fb3ef795daaa) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:09:33.357058 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:33.400246 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:33.408628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9c0c9491-5c0d-4e07-9988-ba71f4d906d9 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:33.443043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9e50cf3f-4a75-4229-b70b-f15465693697 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:33.534367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:09:33.550718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:09:33.558513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:09:33.628457 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'Port': ['ID=14e9bbae-0054-4981-b18e-fb3ef795daaa,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:33.636950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:33.842571 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:34.331237 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:34.402426 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:34.660719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:34.665930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:34.670120 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8aee15df-496b-4929-ad3a-dd2da111fb5a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:09:34.777961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event updated for resources: {'Port': ['ID=14e9bbae-0054-4981-b18e-fb3ef795daaa,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:09:34.783013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:09:34.799964 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:35.099589 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Floating IP 33fd0b81-cf1a-4620-bb9b-6ce24b8d581f associated. External IP: 172.26.4.227, port: afb1bdde-71f1-42d0-93f3-fe88d447fe4b. Nov 24 15:09:35.606043 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:09:35.979792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0ff06a29-4e89-4127-9e37-40e300a85504 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:36.101349 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:09:36.121649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:09:36.133612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:36.142380 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:09:36.145346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:09:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:09:36.225784 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.4440570 Nov 24 15:09:36.225784 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:09:36.326120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'status': 'completed', 'code': 200} Nov 24 15:09:36.440209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:09:36.573195 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-cb5a1542-44da-4a0d-a5a9-97297d1e895e service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.2252336 Nov 24 15:09:36.745533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-72f31af5-b768-4b8e-b830-d0a867a204e8 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:36.749267 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-72f31af5-b768-4b8e-b830-d0a867a204e8 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1661673 Nov 24 15:09:36.766581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.47', 52973) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:09:36.876786 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-5ea9c321-4330-4507-8395-353e1180bdcc service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1076012 Nov 24 15:09:36.932807 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '33fd0b81-cf1a-4620-bb9b-6ce24b8d581f', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'floating_ip_address': '172.26.4.227', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'port_id': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'mac_address': 'fa:16:3e:5e:52:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:09:34Z', 'updated_at': '2021-11-24T15:09:34Z', 'revision_number': 0, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:09:36.938644 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:09:36.948498 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-1a6aa8d0-6b5a-48a9-b646-868990fecca7 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 999 time: 0.1938028 Nov 24 15:09:36.959344 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:09:36.960655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:09:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:09:37.022334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-ca6c83dc-4d27-4218-9a08-680564a6fbcc service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:37.023842 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-ca6c83dc-4d27-4218-9a08-680564a6fbcc service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0684440 Nov 24 15:09:37.113720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:37.119205 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-43844a5d-b548-4c3a-b433-59f07b2bc08b service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0833752 Nov 24 15:09:37.272052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-bee929a1-8d86-44d3-8ba9-77a91787e313 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1456795 Nov 24 15:09:37.319319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:09:37.435165 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f3f4d103-fecd-4f3f-8b91-12953e84365c req-54ab88d9-a977-4ac1-8792-b27b102da3aa service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1566663 Nov 24 15:09:37.643484 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-6e8c102d-8581-41ce-856a-ba68a2736d32 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.0887461 Nov 24 15:09:37.835330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-28d7d0a2-dd25-495b-b265-6c470964a01c service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:37.838292 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-28d7d0a2-dd25-495b-b265-6c470964a01c service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1730950 Nov 24 15:09:37.866828 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '33fd0b81-cf1a-4620-bb9b-6ce24b8d581f', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'floating_ip_address': '172.26.4.227', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'port_id': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'mac_address': 'fa:16:3e:5e:52:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:09:34Z', 'updated_at': '2021-11-24T15:09:34Z', 'revision_number': 0, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:09:37.871292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1f0fb9a-aef2-42cc-9a2b-6927c218d4f5 None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '33fd0b81-cf1a-4620-bb9b-6ce24b8d581f', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'floating_ip_address': '172.26.4.227', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'port_id': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'mac_address': 'fa:16:3e:5e:52:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:09:34Z', 'updated_at': '2021-11-24T15:09:34Z', 'revision_number': 0, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:09:38.020653 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-d8ead2dc-4b41-4e8d-846f-a521c3c127e8 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 999 time: 0.1760120 Nov 24 15:09:38.116523 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dff27be3-0159-4a39-9035-8cf81e4bde58 None None] New status for floating IP 33fd0b81-cf1a-4620-bb9b-6ce24b8d581f: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:09:38.118040 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-29734f42-a769-4016-9531-122cb51fe6a1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:09:38.120712 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-29734f42-a769-4016-9531-122cb51fe6a1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0938556 Nov 24 15:09:38.247979 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-57bbde60-b1f5-4391-9efc-336a9294d17b service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1200562 Nov 24 15:09:38.430781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-4ab46811-2fb4-4bc8-9c5f-b4ef11353484 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1764176 Nov 24 15:09:38.709408 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-0560f052-c1fc-4b95-a209-107af5bdc670 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2715509 Nov 24 15:09:38.781440 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:48.637824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:09:59.883743 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:10:03.438619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-26898eb3-aefa-4f3f-a1d9-0e3310e0f2a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:03.829689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:05.980966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c9de3b2a-fdac-4bf8-a4a7-e22b9f9c2d45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:07.090403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:08.788837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:18.630397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:33.445231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d540f4ce-7bc9-45d9-b4ff-c5953a4e94d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:33.827375 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:35.989287 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7c59f78e-9f3c-4724-8cb2-bb11706fcd72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:36.855794 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-43796544-6db7-4c32-91df-9356180c72e7 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0813677 Nov 24 15:10:36.888722 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:10:37.044799 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-a7bbc369-3a5a-495f-ac9a-957f0ac7c4cb service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.1034191 Nov 24 15:10:37.100783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:37.212307 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-601fcf25-7f00-48e4-b709-888432c64fa2 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:10:37.213833 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-601fcf25-7f00-48e4-b709-888432c64fa2 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1491868 Nov 24 15:10:37.330715 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-cc4e51b3-aa65-4382-9920-1a6e548d847f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 1001 time: 0.1088135 Nov 24 15:10:37.401846 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-84d36716-6516-421a-be55-bb4242ef5c70 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:10:37.404427 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-84d36716-6516-421a-be55-bb4242ef5c70 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0677679 Nov 24 15:10:37.488692 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-37e4543b-5b65-400c-b871-147ff9261e79 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0771937 Nov 24 15:10:37.640539 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-175f9e52-1c0c-4610-b34e-bf83af3887d9 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1456075 Nov 24 15:10:37.799182 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-7df69d1e-cd34-493e-b444-9ed5a0bee747 req-a58d6c3f-8531-4f2e-ac4a-3a2d1a8ac930 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1504233 Nov 24 15:10:38.789041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:10:48.649315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:03.448321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-455f667d-1af4-457d-aaed-9b8dd2764570 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:03.831012 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:05.975515 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6f506e2a-cf08-4674-ab39-994e6ed0e7e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:07.096431 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:08.793554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:13.891323 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:11:18.636274 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:22.417344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-830b0ca5-ab03-4254-b9a3-1187a8921a77 req-d8bd3a12-910c-41e4-8a49-fdaa72fb7f93 service neutron] (83526) timed out ('10.222.0.70', 51420) {{(pid=83526) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} Nov 24 15:11:32.305161 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c256f7-1811-4fa3-96b8-8bc9b3da0810 req-b61dff25-8854-42ce-9d92-0c7d4d85af96 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:32.306697 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e9c256f7-1811-4fa3-96b8-8bc9b3da0810 req-b61dff25-8854-42ce-9d92-0c7d4d85af96 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.2694628 Nov 24 15:11:32.358288 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-e9c256f7-1811-4fa3-96b8-8bc9b3da0810 req-81569c4f-9258-4d2a-8866-b6944d53c5be tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451450 Nov 24 15:11:33.445452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-168b6681-36f5-48e2-8457-10d795dd42fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:33.585824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-523f5e3c-bfa4-4bcd-9836-983bf77d77ac req-e2ec51e2-a50b-452d-b484-fcbd7dc4fde2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:33.587378 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-523f5e3c-bfa4-4bcd-9836-983bf77d77ac req-e2ec51e2-a50b-452d-b484-fcbd7dc4fde2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0951545 Nov 24 15:11:33.645150 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-523f5e3c-bfa4-4bcd-9836-983bf77d77ac req-115e1112-ac33-4df0-914a-bcb263780f30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507553 Nov 24 15:11:33.829169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:34.873861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1a099e-34c3-4879-8375-b8503c10d34a req-e38f3816-fefe-403e-9ee4-54cf41bc422c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:34.875476 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aa1a099e-34c3-4879-8375-b8503c10d34a req-e38f3816-fefe-403e-9ee4-54cf41bc422c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0907602 Nov 24 15:11:34.936702 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-aa1a099e-34c3-4879-8375-b8503c10d34a req-e30343a1-bee0-47bb-a53a-8f77a91ed610 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500839 Nov 24 15:11:35.972914 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2633a3ac-54b8-4c54-b833-bb6884d77af6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:36.154864 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03353737-3a80-4902-bc28-647e31064ad6 req-a280dac4-febd-4f9e-9929-cae45697e1e4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:36.156849 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03353737-3a80-4902-bc28-647e31064ad6 req-a280dac4-febd-4f9e-9929-cae45697e1e4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0864336 Nov 24 15:11:36.211429 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-03353737-3a80-4902-bc28-647e31064ad6 req-9e4b8c4c-78a0-40fc-ad48-cd075479bfa2 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475497 Nov 24 15:11:37.110880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:37.459630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137413dc-8b72-4642-afa2-21e55b007e21 req-6d869a78-bb9d-4369-ab6b-86aab5caeb30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:37.461249 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-137413dc-8b72-4642-afa2-21e55b007e21 req-6d869a78-bb9d-4369-ab6b-86aab5caeb30 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0977395 Nov 24 15:11:37.531116 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-137413dc-8b72-4642-afa2-21e55b007e21 req-1949e8bf-05fb-4a7a-aff7-4b093b7b3144 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0626509 Nov 24 15:11:38.778645 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c51b48d-9257-47d5-b270-44026f0f323c req-f3357a7b-29a4-4da2-b66b-2f2a4ba84dc3 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:38.780258 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1c51b48d-9257-47d5-b270-44026f0f323c req-f3357a7b-29a4-4da2-b66b-2f2a4ba84dc3 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0927987 Nov 24 15:11:38.814919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:38.854258 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1c51b48d-9257-47d5-b270-44026f0f323c req-be10a59d-88dc-44d4-b965-14715555a0af tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0633061 Nov 24 15:11:38.968804 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-16a13285-8b9d-461d-bb5a-d36a50c38b80 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.1115663 Nov 24 15:11:39.147647 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-d909798b-2e67-4ea7-9aa2-32edd0ba3f16 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:39.149221 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-d909798b-2e67-4ea7-9aa2-32edd0ba3f16 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1494513 Nov 24 15:11:39.287547 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-c2a05f3d-47d3-4ddd-be30-108c79eb1390 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 1001 time: 0.1315012 Nov 24 15:11:39.370697 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-07e7c3c2-4c4d-4799-afd3-77579df7f286 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:39.372224 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-07e7c3c2-4c4d-4799-afd3-77579df7f286 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0781636 Nov 24 15:11:39.459149 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-bafd5c0b-962c-44c9-bc48-accc84e8306d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0789144 Nov 24 15:11:39.740196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-6b721c8e-f9f3-4480-b1df-2a474273d362 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2744691 Nov 24 15:11:39.895335 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88b0aa28-b4db-4ed2-a111-f9f48c85c6c7 req-ea9bf578-4735-4653-b2ea-a4f08f676ce3 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1485872 Nov 24 15:11:40.120403 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bbbb66e-8dad-4f05-9677-438aa1d4585b req-a1b21fa7-f2b8-4d06-be96-3bd3f0d74511 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:40.121958 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9bbbb66e-8dad-4f05-9677-438aa1d4585b req-a1b21fa7-f2b8-4d06-be96-3bd3f0d74511 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0880392 Nov 24 15:11:40.172040 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9bbbb66e-8dad-4f05-9677-438aa1d4585b req-934e2a54-5d4a-4f35-a35b-dee8ce3511be tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441380 Nov 24 15:11:41.390734 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1344eabc-665f-4952-a7a0-8328d5c3bfe8 req-5555f969-dd65-4421-b1db-94662f309e79 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:41.392379 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1344eabc-665f-4952-a7a0-8328d5c3bfe8 req-5555f969-dd65-4421-b1db-94662f309e79 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0906246 Nov 24 15:11:41.443019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-1344eabc-665f-4952-a7a0-8328d5c3bfe8 req-2b6fc2d2-1871-4358-b7b6-17dce9df5241 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447352 Nov 24 15:11:42.199105 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-10a3eea3-e202-4167-bf71-ac0790982543 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.0761459 Nov 24 15:11:42.347628 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46647d46-f275-43a2-832c-4a5092c6c882 req-b803ef84-b11f-45e5-8e53-afaaf126b5de service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:42.349189 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-b803ef84-b11f-45e5-8e53-afaaf126b5de service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1440086 Nov 24 15:11:42.466268 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-ffc2354e-7cfa-4e23-8560-98a83730db93 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 1001 time: 0.1106160 Nov 24 15:11:42.583986 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46647d46-f275-43a2-832c-4a5092c6c882 req-3b2a37d4-8c21-4ba4-bfae-d8ef4fd481d9 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:42.586285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-3b2a37d4-8c21-4ba4-bfae-d8ef4fd481d9 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.1130919 Nov 24 15:11:42.717235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-0d6c29b9-1c1a-4eb5-9ce7-f0cc0761f23c service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1246388 Nov 24 15:11:42.755401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c70d1794-4fc7-4422-a159-0f961d368d41 req-52e77586-fbcf-486c-81b0-1fb04ad9c880 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:42.757763 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c70d1794-4fc7-4422-a159-0f961d368d41 req-52e77586-fbcf-486c-81b0-1fb04ad9c880 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.1281223 Nov 24 15:11:42.817819 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c70d1794-4fc7-4422-a159-0f961d368d41 req-84c2de75-1391-40bd-965b-307b6e24e121 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0498085 Nov 24 15:11:42.907045 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-f18a09f5-c20d-47ca-ac1f-dc5daa3a9203 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1819119 Nov 24 15:11:43.053734 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-46647d46-f275-43a2-832c-4a5092c6c882 req-503b6ef6-b4da-41d5-af1e-9c5ce4e2c2e1 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1397693 Nov 24 15:11:44.208575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0c2ecb-5039-4ed4-b5e5-831abe37b48c req-99d82e80-0de6-454c-bc48-b4001a0f0c1b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:44.210431 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad0c2ecb-5039-4ed4-b5e5-831abe37b48c req-99d82e80-0de6-454c-bc48-b4001a0f0c1b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0874248 Nov 24 15:11:44.293478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ad0c2ecb-5039-4ed4-b5e5-831abe37b48c req-afecef13-08b2-4ebd-a88e-71076e80d17d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0755658 Nov 24 15:11:45.522405 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c1babf-b2f3-4f68-8adb-ab3c181c1348 req-5ce55924-32c8-41bf-af89-f90f72573174 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:45.525028 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a5c1babf-b2f3-4f68-8adb-ab3c181c1348 req-5ce55924-32c8-41bf-af89-f90f72573174 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0947311 Nov 24 15:11:45.586177 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-a5c1babf-b2f3-4f68-8adb-ab3c181c1348 req-6685c5d2-3fe9-42ad-8c64-be0f34e7b4a1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0524387 Nov 24 15:11:45.896726 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-55b76090-d39c-4a49-9487-2de6083e776e req-688857cf-fa2c-484d-8174-ab24c5875cf4 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d&fields=resource_request HTTP/1.1" status: 200 len: 212 time: 0.1617022 Nov 24 15:11:46.223623 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-f447bb2d-04df-4477-8080-60faf8819544 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1854196 Nov 24 15:11:46.240903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea265af-fcbe-400e-a0fb-58243d4d6206 req-5d33f1a5-f1f8-4504-8c81-7def1a1d36a7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:46.242661 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ea265af-fcbe-400e-a0fb-58243d4d6206 req-5d33f1a5-f1f8-4504-8c81-7def1a1d36a7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.1081491 Nov 24 15:11:46.336642 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6ea265af-fcbe-400e-a0fb-58243d4d6206 req-7e919e57-a908-4935-b2f9-3f3d49181c3c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0793118 Nov 24 15:11:47.445234 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:11:47.625310 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be23743-2246-427a-a989-6f1d2cb81e8a req-97c84487-c1eb-4606-bd26-bd2f53ed3213 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:47.627005 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6be23743-2246-427a-a989-6f1d2cb81e8a req-97c84487-c1eb-4606-bd26-bd2f53ed3213 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0943513 Nov 24 15:11:47.634956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:47.687009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:11:47.706113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:11:47.713411 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:47.716071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:11:47.717454 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6be23743-2246-427a-a989-6f1d2cb81e8a req-12cab3be-e5ca-4362-bac5-aae59f4e311b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0799310 Nov 24 15:11:47.816960 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:11:47.831689 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.832346 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.832866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.833272 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.833740 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.834071 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.834397 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.834722 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.835041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.835364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.835681 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:11:47.840752 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:11:47.893127 dv-neutron-818151-2-hyperv neutron-server[83527]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'code': 422} returned with failed status Nov 24 15:11:48.670010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:48.727421 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-9d8c1a75-50b3-42ac-ac07-909bd1787cb0 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d&tenant_id=8ea7acbe2851472a95e5b9a5d726a011 HTTP/1.1" status: 200 len: 1096 time: 0.0778046 Nov 24 15:11:48.837158 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-8ef037d1-7eb1-4fbb-94cc-445f0a398adb service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1096 time: 0.0869877 Nov 24 15:11:49.305672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-5989493a-5f1b-435d-b94d-76f10d49bf77 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:49.308177 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-5989493a-5f1b-435d-b94d-76f10d49bf77 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.4646749 Nov 24 15:11:49.319398 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa61628-1d0b-4e7d-9c7d-9e4045b2d75c req-9186a1c2-adb9-4962-a60d-cb3a433cd57d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:49.322535 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bfa61628-1d0b-4e7d-9c7d-9e4045b2d75c req-9186a1c2-adb9-4962-a60d-cb3a433cd57d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.4576130 Nov 24 15:11:49.570826 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bfa61628-1d0b-4e7d-9c7d-9e4045b2d75c req-0687607d-fc91-4e8a-afb1-5d2c7bb4f108 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1495044 Nov 24 15:11:49.577970 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-6b238b9c-e0dd-4082-9426-97260a816788 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 999 time: 0.2515802 Nov 24 15:11:49.690422 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-12dd991f-54b8-4cb1-a49e-be5f2eb2fc62 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:49.692953 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-12dd991f-54b8-4cb1-a49e-be5f2eb2fc62 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.1111703 Nov 24 15:11:49.779488 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-ec68e324-72e8-4790-9a49-4377b3fe724d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0802162 Nov 24 15:11:49.924075 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-cf9a9087-9368-4c5e-8ba5-bdf14581119d service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1375229 Nov 24 15:11:50.081118 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0f60cb0e-be35-4f9f-8bef-107ca3736d89 req-78c54c4e-b9a3-40b9-8dba-6acd2d5d9255 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1506867 Nov 24 15:11:50.788998 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a61b4d-6c3e-4192-b9ba-7809a0abedb0 req-cd418ef6-386e-4217-9a4d-4a5c584411e7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:50.790674 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-49a61b4d-6c3e-4192-b9ba-7809a0abedb0 req-cd418ef6-386e-4217-9a4d-4a5c584411e7 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0841534 Nov 24 15:11:50.844409 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-49a61b4d-6c3e-4192-b9ba-7809a0abedb0 req-ffd41c6e-fdfc-447f-b921-b7efe74bb798 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477014 Nov 24 15:11:50.899482 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:11:52.066637 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d59d5c61-319d-487d-941e-49f36f9839be req-ed58c292-7413-4ade-b3dd-441ff320a83d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:52.068255 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d59d5c61-319d-487d-941e-49f36f9839be req-ed58c292-7413-4ade-b3dd-441ff320a83d tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0945289 Nov 24 15:11:52.125545 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d59d5c61-319d-487d-941e-49f36f9839be req-0617e3b1-5df4-4833-93fc-739312fce312 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0506594 Nov 24 15:11:53.401553 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c27dbdb-800d-42ef-8991-ee8c738eb681 req-8d324281-4e08-4564-8fce-2c66bbde1b5c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:53.403236 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4c27dbdb-800d-42ef-8991-ee8c738eb681 req-8d324281-4e08-4564-8fce-2c66bbde1b5c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.1031818 Nov 24 15:11:53.456398 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-4c27dbdb-800d-42ef-8991-ee8c738eb681 req-e510d91f-21b0-4f5e-bc68-27820269a5e0 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460927 Nov 24 15:11:54.727522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db80f4a-1b1e-4fb0-b343-6a04d2dd8208 req-597706c3-abf4-4f9c-b6d4-316a7ef0c549 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:54.729267 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0db80f4a-1b1e-4fb0-b343-6a04d2dd8208 req-597706c3-abf4-4f9c-b6d4-316a7ef0c549 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0900388 Nov 24 15:11:54.794088 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-0db80f4a-1b1e-4fb0-b343-6a04d2dd8208 req-7054f61a-4b7d-41de-88c1-aeaefb51dafc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563529 Nov 24 15:11:56.027926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587496f8-1f80-4e07-97d4-b31928c7cb6a req-ab12edce-c9e7-4aad-ad63-994f3364d2ca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:56.029593 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-587496f8-1f80-4e07-97d4-b31928c7cb6a req-ab12edce-c9e7-4aad-ad63-994f3364d2ca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0895410 Nov 24 15:11:56.093147 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-587496f8-1f80-4e07-97d4-b31928c7cb6a req-1df9bb0a-8607-41ab-91e3-c5c6a89f0a55 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577588 Nov 24 15:11:57.314292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99943d49-c102-4c82-a7e5-8a1e2fdcc172 req-a448b168-190b-48e5-8c57-bcd230c7d5ca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:57.315856 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-99943d49-c102-4c82-a7e5-8a1e2fdcc172 req-a448b168-190b-48e5-8c57-bcd230c7d5ca tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0900190 Nov 24 15:11:57.366046 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-99943d49-c102-4c82-a7e5-8a1e2fdcc172 req-aa24d686-7630-4516-aea3-81413a8ea84c tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445912 Nov 24 15:11:58.592605 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a3c62f-b8e9-4bbe-b550-ce7176ffb23e req-7031374c-cfd8-4309-9aee-d62890c20476 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:58.594329 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c2a3c62f-b8e9-4bbe-b550-ce7176ffb23e req-7031374c-cfd8-4309-9aee-d62890c20476 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 943 time: 0.0922987 Nov 24 15:11:58.652084 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-c2a3c62f-b8e9-4bbe-b550-ce7176ffb23e req-0d6a8856-45aa-4fc0-ba26-84c100d6c174 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515938 Nov 24 15:11:59.492859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:11:59.639112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:11:59.656410 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'port_id': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'mac_address': 'fa:16:3e:5e:52:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 897, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:11:59.729055 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:59.750877 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id afb1bdde-71f1-42d0-93f3-fe88d447fe4b {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:11:59.772278 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:11:59.779260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:11:59.782959 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:11:59.877179 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:11:59.882443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:11:59.929517 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6014a693-cecb-486b-8868-00783b8319fa req-0fb20c68-ef98-47cb-9b2c-f315102501e9 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:11:59.931863 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6014a693-cecb-486b-8868-00783b8319fa req-0fb20c68-ef98-47cb-9b2c-f315102501e9 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 944 time: 0.1187472 Nov 24 15:11:59.981719 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6014a693-cecb-486b-8868-00783b8319fa req-1e4616d0-3c42-40e3-85ba-534d6896aa06 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436661 Nov 24 15:12:00.131486 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['afb1bdde-71f1-42d0-93f3-fe88d447fe4b'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:12:01.204377 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4a2064-9c8e-4485-922c-bb8d34b18472 req-12368fd3-5d2a-4dc2-b9b2-106b5d5d32e5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:12:01.206305 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ef4a2064-9c8e-4485-922c-bb8d34b18472 req-12368fd3-5d2a-4dc2-b9b2-106b5d5d32e5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 944 time: 0.0960364 Nov 24 15:12:01.271485 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ef4a2064-9c8e-4485-922c-bb8d34b18472 req-c47d193e-df55-482b-a0b1-f5badcebed01 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0591960 Nov 24 15:12:01.497432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:12:01.574529 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port afb1bdde-71f1-42d0-93f3-fe88d447fe4b triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:12:01.574820 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:01.700126 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:01.739221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:12:01.751499 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:12:01.757686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:01.761460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-3fd38b29-86f5-44ba-bfd6-066c0f993ae7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:12:01.802855 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'code': 200} Nov 24 15:12:01.847352 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:12:01.850883 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:12:02.095019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4dbdfb27-14a9-4a39-8ce4-6fc32c6fc014 req-dcc02ed7-47c1-4f99-bade-cd1841926cc3 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.0801480 Nov 24 15:12:02.144087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4dbdfb27-14a9-4a39-8ce4-6fc32c6fc014 req-e2a419bf-08dd-43a7-8df7-2015b3c2cddf service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425622 Nov 24 15:12:02.500178 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da97f75-8a49-4b58-91cd-cb3acfd1258f req-8e1b78bb-a3a1-4100-9a99-1596cff93f1b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:12:02.501646 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1da97f75-8a49-4b58-91cd-cb3acfd1258f req-8e1b78bb-a3a1-4100-9a99-1596cff93f1b tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0854011 Nov 24 15:12:02.554489 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1da97f75-8a49-4b58-91cd-cb3acfd1258f req-9c177ca7-61ec-4c75-b5a3-52741b2d8bfa tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468111 Nov 24 15:12:03.462579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-07306924-9097-4513-af03-ad156f6df14e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:03.812851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680a69e5-ca32-403d-99fc-9ca3597b385c req-74f652b9-4e42-4f01-b578-d9ce3a32d248 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:12:03.815331 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680a69e5-ca32-403d-99fc-9ca3597b385c req-74f652b9-4e42-4f01-b578-d9ce3a32d248 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.1234429 Nov 24 15:12:03.827897 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:03.876715 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680a69e5-ca32-403d-99fc-9ca3597b385c req-064a9cce-b45f-4295-90ff-8a8254a5abf5 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549126 Nov 24 15:12:05.967694 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-03aa619a-ef68-4ec7-bd70-be37e190fe63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:07.104860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:08.800120 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:18.679267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:27.890416 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:12:33.466235 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-45cea62f-374f-40f2-8065-7cce60cfead6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:33.824500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:35.978229 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-53ea3730-acfe-48c8-b098-436fe9ce660c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:37.125193 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:38.803564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:12:40.850133 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-1230c95e-d59d-4de0-b0e4-fffc1ca566a5 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0787656 Nov 24 15:12:41.050126 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-888d429f-4409-4414-b1c8-ca460fc7538a service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.1000967 Nov 24 15:12:41.274277 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-483be8b9-e507-4218-9000-65a22b517072 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:12:41.276873 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-483be8b9-e507-4218-9000-65a22b517072 service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.2018054 Nov 24 15:12:41.417078 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-84b53933-bd2b-420a-a464-027c4255a1cb service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 1001 time: 0.1324131 Nov 24 15:12:41.493153 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-b1ffbe7e-a041-4197-b42d-f52787818cf5 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:12:41.494622 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-b1ffbe7e-a041-4197-b42d-f52787818cf5 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0705040 Nov 24 15:12:41.586925 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-2eed92fc-0a48-421d-8d57-b091afbb0a8d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0853074 Nov 24 15:12:41.863778 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-bc02707f-8368-44b0-b211-7ac335c353a6 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2697439 Nov 24 15:12:42.028220 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-680958c8-3ee4-4d9a-8df6-ad39c9c62206 req-ef36fecb-24f5-488c-96a1-be41e724fe5a service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1565723 Nov 24 15:12:48.688802 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:03.453604 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9b814997-1881-4c34-8c7a-dc55e1d5be18 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:03.828687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:04.891090 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:13:05.974509 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-1f5620d6-c392-4267-8348-202c868b804f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:07.110711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:08.806502 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:18.687670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:23.253787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55760) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:23.509330 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Deleting port 14e9bbae-0054-4981-b18e-fb3ef795daaa {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:23.509620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:23.694649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:23.695047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:23.821982 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Calling delete_port for 14e9bbae-0054-4981-b18e-fb3ef795daaa owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:24.029635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:24.033859 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-bf6de7f2-3af9-4d6a-84b2-7d677a06ed6b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:24.081536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event deleted for resources: {'Port': ['ID=14e9bbae-0054-4981-b18e-fb3ef795daaa,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:24.127630 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.128056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.128437 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.128810 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.129183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.129554 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.129922 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.130294 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.131406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.131939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.132314 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:24.140222 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:24.199434 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:24.629341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:13:25.043432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:13:25.056542 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:13:25.071337 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:25.073211 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:25.074153 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:25.145035 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "DELETE /v2.0/floatingips/33fd0b81-cf1a-4620-bb9b-6ce24b8d581f HTTP/1.1" status: 204 len: 168 time: 1.8898103 Nov 24 15:13:25.146329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:13:25.252403 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'status': 'completed', 'code': 200} Nov 24 15:13:25.294707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:25.425850 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-3f42c853-a98c-45dc-b114-ea3e1abb8410 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 1098 time: 0.1429856 Nov 24 15:13:25.609996 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-c056c737-6df8-425c-bb96-425871f66b5f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:25.611916 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-c056c737-6df8-425c-bb96-425871f66b5f service neutron] 10.222.0.47 "GET /v2.0/networks?id=3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 200 len: 909 time: 0.1790831 Nov 24 15:13:25.721799 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-8fedced6-4ac6-4120-8465-869a815bf3a1 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 200 len: 217 time: 0.1020751 Nov 24 15:13:25.803751 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-db39c522-5b87-4ff1-a19b-ae1a47337b65 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:25.805407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-db39c522-5b87-4ff1-a19b-ae1a47337b65 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 200 len: 847 time: 0.0717199 Nov 24 15:13:25.831446 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:25.838437 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:13:25.853034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:25.853880 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:25.882677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a99247-dafa-414c-999e-3597f24dee72 req-0c79e120-4257-4ec3-8814-b50db1496114 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:25.883413 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-93a99247-dafa-414c-999e-3597f24dee72 req-0c79e120-4257-4ec3-8814-b50db1496114 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:13:25.907851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-93a99247-dafa-414c-999e-3597f24dee72 req-0c79e120-4257-4ec3-8814-b50db1496114 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:13:25.909053 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93a99247-dafa-414c-999e-3597f24dee72 req-0c79e120-4257-4ec3-8814-b50db1496114 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.2208626 Nov 24 15:13:25.951318 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-55fbef53-9164-49ff-98dd-29336f36c5e8 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=3bace08e-55bc-42bb-be54-36d02a25dcad&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1343546 Nov 24 15:13:26.051835 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-93a99247-dafa-414c-999e-3597f24dee72 req-b8eea353-d9c7-47c2-9cc0-c5d99f166182 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1287892 Nov 24 15:13:26.124256 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-108ca38b-0043-493c-a887-da5a57697439 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1630423 Nov 24 15:13:26.146702 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:26.316019 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e2a8faee-bde6-4020-806c-46acdd6d6256 req-71ef94ea-6c0f-417d-8b75-4e8eb8ed5332 service neutron] 10.222.0.47 "GET /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1850238 Nov 24 15:13:26.610761 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:26.616465 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fff31bc-d343-42d4-ab7d-511c20b2fa09 None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:03:01Z', 'revision_number': 4, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '4ed226b7-2923-4b9f-a4d7-66349a2dd9e8', 'name': '', 'network_id': '3bace08e-55bc-42bb-be54-36d02a25dcad', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'mac_address': 'fa:16:3e:42:69:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:00Z', 'updated_at': '2021-11-24T15:03:20Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'subnets': [{'id': '9119f9d2-54c0-4483-ad28-6f72771e7d2d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:13:26.876013 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33e4e9aa-2cc2-41ad-a362-145c3f556539 None None] New status for floating IP 33fd0b81-cf1a-4620-bb9b-6ce24b8d581f: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:13:27.333742 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7556dd80-705c-4048-a58b-73f1c1e2fbd1 req-3c3f51ab-6fb1-4e74-ab00-c45a7a0d0517 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:27.335369 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7556dd80-705c-4048-a58b-73f1c1e2fbd1 req-3c3f51ab-6fb1-4e74-ab00-c45a7a0d0517 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0971496 Nov 24 15:13:27.392409 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-7556dd80-705c-4048-a58b-73f1c1e2fbd1 req-1cae2bed-9964-4ef1-923c-3b5d20550a47 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/security-groups?id=4567be63-b59d-4942-8096-5e4a70636860&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475559 Nov 24 15:13:27.440148 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-13f99ceb-22ae-49f2-b43b-900c8039db9f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:27.441945 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-13f99ceb-22ae-49f2-b43b-900c8039db9f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 945 time: 0.0849063 Nov 24 15:13:27.523240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Deleting port afb1bdde-71f1-42d0-93f3-fe88d447fe4b {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:27.523575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:27.853905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] For port afb1bdde-71f1-42d0-93f3-fe88d447fe4b, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:27.854168 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:28.108832 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Calling delete_port for afb1bdde-71f1-42d0-93f3-fe88d447fe4b owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:28.284304 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:28.292219 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f5599aed-7291-45b9-81b1-7c53d0aa0258 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:28.339218 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event deleted for resources: {'Port': ['ID=afb1bdde-71f1-42d0-93f3-fe88d447fe4b,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:28.342957 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:28.422883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] No DVR routers for this DVR port afb1bdde-71f1-42d0-93f3-fe88d447fe4b on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:13:28.425576 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:28.428865 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-deleted', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:13:28.451361 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6e0b99d4-71ff-4fb2-addc-af49363f1c84 req-2085d2e9-f070-49b2-8d03-249f1935ecd1 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.47 "DELETE /v2.0/ports/afb1bdde-71f1-42d0-93f3-fe88d447fe4b HTTP/1.1" status: 204 len: 173 time: 1.0030496 Nov 24 15:13:28.515467 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c70247dd-64ee-4621-a4c5-f6e82d36325d', 'name': 'network-vif-deleted', 'tag': 'afb1bdde-71f1-42d0-93f3-fe88d447fe4b', 'status': 'completed', 'code': 200} Nov 24 15:13:28.679078 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9508fefe-9b63-4bbc-8f79-06c384d10806 req-955d75e4-7152-4f2e-91ac-963891dafaab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 210 time: 0.0463219 Nov 24 15:13:29.828132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:29.901471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: afb1bdde-71f1-42d0-93f3-fe88d447fe4b {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:29.902355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device afb1bdde-71f1-42d0-93f3-fe88d447fe4b not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:29.920758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9cf496f8-8225-4854-9025-53addbbd12fd req-cb7cfb7d-5176-4ce1-ae2e-e189a7d6b277 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Synchronizing usage tracker for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:13:29.942685 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-9cf496f8-8225-4854-9025-53addbbd12fd req-cb7cfb7d-5176-4ce1-ae2e-e189a7d6b277 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Unset dirty status for tenant:8ea7acbe2851472a95e5b9a5d726a011 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:13:29.944288 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-9cf496f8-8225-4854-9025-53addbbd12fd req-cb7cfb7d-5176-4ce1-ae2e-e189a7d6b277 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "GET /v2.0/ports?device_id=c70247dd-64ee-4621-a4c5-f6e82d36325d HTTP/1.1" status: 200 len: 210 time: 0.0702400 Nov 24 15:13:31.132435 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55788) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:31.221932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:31.289631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:31.390499 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:31.397786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8f7cdb0a-2d26-4fd7-a531-5f4a6963601b tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:31.419710 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4567be63-b59d-4942-8096-5e4a70636860,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:31.422674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:31.429937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:31.431119 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ceb6506d-6e5f-43f3-b120-bed392df97ab tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] 10.222.0.70 "DELETE /v2.0/security-groups/4567be63-b59d-4942-8096-5e4a70636860 HTTP/1.1" status: 204 len: 168 time: 0.2975821 Nov 24 15:13:31.502158 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55794) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:32.293045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:33.234453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Deleting port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:33.234902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:33.449613 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-64ef2153-114c-4ee6-b3f0-fd848bf64041 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:33.620421 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] For port 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:33.621003 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:33.758182 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Calling delete_port for 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:33.834742 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:33.962448 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:33.966696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-f894352f-66b7-4954-ac2c-ed421998561a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:34.011743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ed226b7-2923-4b9f-a4d7-66349a2dd9e8,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:34.015092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:34.414520 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:35.384186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:13:35.746790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:13:35.760130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] Sync routers for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:13:35.769061 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a10fa521-9198-4656-8153-f3456e2e96f0 admin admin] 10.222.0.70 "PUT /v2.0/routers/57b208f4-3b28-49da-ab2e-e4eb44a2e088/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2653224 Nov 24 15:13:35.774159 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55800) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:35.778578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:35.779315 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:35.995305 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6d47c7ea-4656-4a87-acde-7b31903ba9b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:36.005802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:36.014310 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:36.266841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:36.280101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Deleting port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:36.280849 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:36.404304 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165'}], 'enable_snat': True}, 'gw_port_id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:13:33Z', 'revision_number': 5, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port': {'id': '5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:0e:1b:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:02:58Z', 'updated_at': '2021-11-24T15:03:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:36.409691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] Checking router: 57b208f4-3b28-49da-ab2e-e4eb44a2e088 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:13:36.424403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] Routers {'57b208f4-3b28-49da-ab2e-e4eb44a2e088'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:36.425248 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:36.499121 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] For port 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:36.500050 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:36.596189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] Set router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:36.644947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Calling delete_port for 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:36.716919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:13:36Z', 'revision_number': 6, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:36.721334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-867354cf-72e3-4377-90fb-5e8f6f94798f None None] The sync data for ids ['57b208f4-3b28-49da-ab2e-e4eb44a2e088'] in dv-neutron-818151-2-hyperv is: [{'id': '57b208f4-3b28-49da-ab2e-e4eb44a2e088', 'name': 'tempest-TestShelveInstance-502047448-router', 'tenant_id': '8ea7acbe2851472a95e5b9a5d726a011', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:02:57Z', 'updated_at': '2021-11-24T15:13:36Z', 'revision_number': 6, 'project_id': '8ea7acbe2851472a95e5b9a5d726a011', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:13:36.888345 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:36.892468 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-27ff5db5-db53-4d6f-92bc-d18ba4d0fb87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:36.936505 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Pushing event deleted for resources: {'Port': ['ID=5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:36.940464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:37.116249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.229745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.627412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.634824 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.676850 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.679102 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 57b208f4-3b28-49da-ab2e-e4eb44a2e088 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 15:13:37.700923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.702810 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] 10.222.0.70 "DELETE /v2.0/routers/57b208f4-3b28-49da-ab2e-e4eb44a2e088 HTTP/1.1" status: 204 len: 168 time: 1.9274383 Nov 24 15:13:37.705961 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55804) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:37.809626 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Deleting subnet 9119f9d2-54c0-4483-ad28-6f72771e7d2d {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 15:13:37.813896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.876059 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:37.965719 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.065353 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.069960 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-e6207e2f-aad8-4ab7-af13-21139b703f0d tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:38.107018 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9119f9d2-54c0-4483-ad28-6f72771e7d2d,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:38.110777 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:38.115559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.122345 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e40cd61d-7a1e-4afb-abf3-068af7aead40 None None] Network 3bace08e-55bc-42bb-be54-36d02a25dcad requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:13:38.123198 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-581f00db-570e-488c-a97f-bdbf2f9aec94 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/9119f9d2-54c0-4483-ad28-6f72771e7d2d HTTP/1.1" status: 204 len: 168 time: 0.4154983 Nov 24 15:13:38.126728 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55808) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:38.257111 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.273603 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Deleting port bf400227-6a30-4469-91e6-7398c9df88a0 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:38.274152 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.442161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] DHCP port deletion for 3bace08e-55bc-42bb-be54-36d02a25dcad request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 15:13:38.451980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Deleting port bf400227-6a30-4469-91e6-7398c9df88a0 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:38.452713 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.584828 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] For port bf400227-6a30-4469-91e6-7398c9df88a0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf400227-6a30-4469-91e6-7398c9df88a0,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:38.585439 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.786132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Calling delete_port for bf400227-6a30-4469-91e6-7398c9df88a0 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:38.852530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:38.896900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:38.902033 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:38.936175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:38.936634 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 4ed226b7-2923-4b9f-a4d7-66349a2dd9e8 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:38.937331 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:38.952872 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Pushing event deleted for resources: {'Port': ['ID=bf400227-6a30-4469-91e6-7398c9df88a0,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:38.956522 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:38.961937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] No DVR routers for this DVR port bf400227-6a30-4469-91e6-7398c9df88a0 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:13:38.996301 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:38.996782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 5ac6ad6b-d641-4b0c-a77b-0f68b8d4b8a9 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:38.997334 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf400227-6a30-4469-91e6-7398c9df88a0 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:39.039296 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.050738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: bf400227-6a30-4469-91e6-7398c9df88a0 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:39.051228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device bf400227-6a30-4469-91e6-7398c9df88a0 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:39.055548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] For port bf400227-6a30-4469-91e6-7398c9df88a0, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=bf400227-6a30-4469-91e6-7398c9df88a0,segment=NetworkSegment(813f4bb2-91ce-4380-87dd-7be1beb26558),segment_id=813f4bb2-91ce-4380-87dd-7be1beb26558)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:39.056142 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.122442 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.158267 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3bace08e-55bc-42bb-be54-36d02a25dcad']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:39.173506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '813f4bb2-91ce-4380-87dd-7be1beb26558') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:39.173881 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '813f4bb2-91ce-4380-87dd-7be1beb26558') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:39.188510 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.212883 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.222340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Releasing vlan 897 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 15:13:39.223047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 15:13:39.241924 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 15:13:39.308659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Calling delete_port for bf400227-6a30-4469-91e6-7398c9df88a0 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:39.344350 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.351233 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ec30329e-472c-4a6c-a4d6-2726d2079e1f tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:39.367575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:39.383453 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Pushing event deleted for resources: {'Network': ['ID=3bace08e-55bc-42bb-be54-36d02a25dcad,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:39.388356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:39.414108 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] 10.222.0.70 "DELETE /v2.0/networks/3bace08e-55bc-42bb-be54-36d02a25dcad HTTP/1.1" status: 204 len: 168 time: 1.2817471 Nov 24 15:13:39.414374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55812) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:39.463457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 15:13:39.465404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 15:13:39.965759 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Deleting port bf400227-6a30-4469-91e6-7398c9df88a0 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:39.966267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:40.048196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-d1aae0a8-2eb3-410d-9f51-a0336c7174ab None None] The port 'bf400227-6a30-4469-91e6-7398c9df88a0' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 15:13:40.138989 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:41.044216 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Deleting port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:41.044498 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:41.359451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] For port 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:41.361030 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:41.520369 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Calling delete_port for 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd owned by network:router_interface {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:41.735465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:41.740555 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-859763c5-c714-46f3-9c0c-00b9e2b9b4cc tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:41.789530 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Pushing event deleted for resources: {'Port': ['ID=8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:41.792266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:41.892685 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:13:42.262536 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:42.996578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:13:43.241321 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:13:43.254834 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] Sync routers for ids ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:13:43.270120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] 10.222.0.70 "PUT /v2.0/routers/e1f813e5-005b-4741-b1db-c5fc7c9ecec0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8543267 Nov 24 15:13:43.275244 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55816) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:43.291541 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] Routers {'e1f813e5-005b-4741-b1db-c5fc7c9ecec0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:43.292779 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:43.539857 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks [] for router, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:43.572828 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] Set router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:43.908755 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:13:41Z', 'revision_number': 5, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:43.914918 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] Checking router: e1f813e5-005b-4741-b1db-c5fc7c9ecec0 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:13:43.929111 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] Routers {'e1f813e5-005b-4741-b1db-c5fc7c9ecec0'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:43.929749 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:44.121045 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:44.132132 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Deleting port 25d4b937-8c2d-4510-8881-8f1dfa752e35 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:44.132655 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:44.191052 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] Set router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:44.405583 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] For port 25d4b937-8c2d-4510-8881-8f1dfa752e35, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=25d4b937-8c2d-4510-8881-8f1dfa752e35,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:44.405940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:44.525887 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:13:41Z', 'revision_number': 5, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:44.531326 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a2d37e2-ee5e-45e5-b132-8417f92e1b2a None None] The sync data for ids ['e1f813e5-005b-4741-b1db-c5fc7c9ecec0'] in dv-neutron-818151-2-hyperv is: [{'id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'name': 'tempest-TestShelveInstance-5738910-router', 'tenant_id': 'f88f6c692de147a68233f78a4b9d682f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11'}], 'enable_snat': True}, 'gw_port_id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:13:41Z', 'revision_number': 5, 'project_id': 'f88f6c692de147a68233f78a4b9d682f', 'gw_port': {'id': '25d4b937-8c2d-4510-8881-8f1dfa752e35', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:53:2f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1f813e5-005b-4741-b1db-c5fc7c9ecec0', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:03:04Z', 'updated_at': '2021-11-24T15:03:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:13:44.540220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Calling delete_port for 25d4b937-8c2d-4510-8881-8f1dfa752e35 owned by network:router_gateway {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:44.748743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:44.753374 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-adc52b24-baa8-4c60-bfa3-ab179037093e tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:44.802695 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Pushing event deleted for resources: {'Port': ['ID=25d4b937-8c2d-4510-8881-8f1dfa752e35,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:44.805202 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:44.985203 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:45.043021 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:45.043511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8a4e741d-a97e-481e-ba85-f2e3b0a2c2cd not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:45.115802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.424699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.431802 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.472223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.472910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Fanout notify agent at l3_agent the message router_deleted on router e1f813e5-005b-4741-b1db-c5fc7c9ecec0 {{(pid=83526) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 15:13:45.491567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.497202 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-51a44416-16a5-4af0-8b06-c140753df7ce admin admin] 10.222.0.70 "DELETE /v2.0/routers/e1f813e5-005b-4741-b1db-c5fc7c9ecec0 HTTP/1.1" status: 204 len: 168 time: 2.2166929 Nov 24 15:13:45.497824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55820) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:45.575418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Deleting subnet 2011a02a-5a19-4787-8def-3bfb750cbe1b {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 15:13:45.579144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.653031 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.782081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.862401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.868017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d91d401a-6ac1-48af-af17-fb71fbef982c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:45.905736 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2011a02a-5a19-4787-8def-3bfb750cbe1b,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:45.918147 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:45.925632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.926075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d001afd8-d8c4-46ac-8348-477a5b7711d7 None None] Network 7edb0d44-f6a4-45ec-996d-1c10575992d9 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:13:45.926237 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.926391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.927682 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.928621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.928997 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.929365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.929872 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.930254 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.930723 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.931084 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:45.935650 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:45.940336 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-47834bdc-c66d-47ee-9d02-192c85372af5 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/2011a02a-5a19-4787-8def-3bfb750cbe1b HTTP/1.1" status: 204 len: 168 time: 0.4390357 Nov 24 15:13:45.941611 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55824) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:46.129958 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:46.143567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Deleting port c56c4bdc-2e9b-4717-982e-88a055ba5a2e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:46.143943 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:46.267420 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] DHCP port deletion for 7edb0d44-f6a4-45ec-996d-1c10575992d9 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 15:13:46.273943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Deleting port c56c4bdc-2e9b-4717-982e-88a055ba5a2e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:46.274511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:46.574530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] For port c56c4bdc-2e9b-4717-982e-88a055ba5a2e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:46.574813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] For port c56c4bdc-2e9b-4717-982e-88a055ba5a2e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,segment=NetworkSegment(3634727d-b0b0-4f21-93f9-ce9566a38361),segment_id=3634727d-b0b0-4f21-93f9-ce9566a38361)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:46.575525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:46.575665 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:46.715554 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Calling delete_port for c56c4bdc-2e9b-4717-982e-88a055ba5a2e owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:46.739571 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Calling delete_port for c56c4bdc-2e9b-4717-982e-88a055ba5a2e owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:13:46.767693 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 25d4b937-8c2d-4510-8881-8f1dfa752e35 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:46.833017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:46.838912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:46.852399 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 25d4b937-8c2d-4510-8881-8f1dfa752e35 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:46.852948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 25d4b937-8c2d-4510-8881-8f1dfa752e35 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:46.853661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c56c4bdc-2e9b-4717-982e-88a055ba5a2e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:13:46.887429 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Pushing event deleted for resources: {'Port': ['ID=c56c4bdc-2e9b-4717-982e-88a055ba5a2e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:46.891185 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:46.892027 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] No DVR routers for this DVR port c56c4bdc-2e9b-4717-982e-88a055ba5a2e on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:13:46.930453 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: c56c4bdc-2e9b-4717-982e-88a055ba5a2e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:13:46.930924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device c56c4bdc-2e9b-4717-982e-88a055ba5a2e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:13:46.979027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 15:13:46.979605 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 15:13:47.021125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.051341 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7edb0d44-f6a4-45ec-996d-1c10575992d9']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:47.066286 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3634727d-b0b0-4f21-93f9-ce9566a38361') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:47.066577 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3634727d-b0b0-4f21-93f9-ce9566a38361') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:47.083739 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.105871 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.115473 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Releasing vlan 854 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 15:13:47.116125 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 15:13:47.132071 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 15:13:47.221905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.227124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-53f95b8b-6581-420e-9c53-46c4a8e5e461 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:47.244259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.261593 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Pushing event deleted for resources: {'Network': ['ID=7edb0d44-f6a4-45ec-996d-1c10575992d9,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:47.269509 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:47.276052 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-020c9973-be57-416f-98e6-f36358db24af admin admin] 10.222.0.70 "DELETE /v2.0/networks/7edb0d44-f6a4-45ec-996d-1c10575992d9 HTTP/1.1" status: 204 len: 168 time: 1.3326857 Nov 24 15:13:47.480950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Deleting port c56c4bdc-2e9b-4717-982e-88a055ba5a2e {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:13:47.481822 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.559173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55830) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:47.588040 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e9ee1c2d-3904-46ee-93c0-d78f35bd9988 None None] The port 'c56c4bdc-2e9b-4717-982e-88a055ba5a2e' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 15:13:47.629178 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d86eaf95-b174-4354-bc3e-ae8528476b69 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=8ea7acbe2851472a95e5b9a5d726a011&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0679336 Nov 24 15:13:47.634021 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55834) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:47.816527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.847276 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.914436 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.920123 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b62d26e5-71c5-4f94-a592-43425e69730a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:47.937464 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df466cd8-6fc5-4269-8ef3-806df17c31e6,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:47.941617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:47.946491 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:47.949294 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-69e76a19-85c3-4d1a-b768-a30d2791fe66 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/df466cd8-6fc5-4269-8ef3-806df17c31e6 HTTP/1.1" status: 204 len: 168 time: 0.3140943 Nov 24 15:13:48.541909 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55842) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:48.631007 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-85e2a6bf-8b45-4793-916c-9688e183d1f1 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=f88f6c692de147a68233f78a4b9d682f&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0871346 Nov 24 15:13:48.633598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55846) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:48.706442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:48.723715 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:48.762991 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:48.827002 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:48.832182 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-60d87dc3-7249-4ea5-8d1e-7037de5e62db tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:48.848096 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=812aad9c-9417-41c2-8626-7d8363837550,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:48.852705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:48.856702 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:48.857903 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-75aa5ddd-bc28-4ea4-848f-19b79271dd02 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/812aad9c-9417-41c2-8626-7d8363837550 HTTP/1.1" status: 204 len: 168 time: 0.2230523 Nov 24 15:13:50.047373 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55872) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:50.206633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-994375980-network', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:13:50.215396 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:50.222386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Usage tracker for resource:network and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:50.228534 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:50.236103 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:50.251628 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Made reservation on behalf of ed89aa580bcf48afa36f245d2283c042 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:13:50.254517 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.270571 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.308919 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:50.312970 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:50.316006 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:50.323538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:50.408678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.413869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.417426 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ee70cdfe-a47d-458a-be33-c9208746c47b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:50.450386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 859} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 15:13:50.460927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=821c7d36-e495-4dc8-b94f-c3c236f72d0c,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:50.465221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:50.469232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.469232 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Added segment 269b2190-9c40-4e00-a536-318758b03cfb of type vlan for network 81382f99-f5ff-40f4-ab19-dca39064a209 Nov 24 15:13:50.501143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.545251 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.546219 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:50.546799 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:50.550706 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a8da1b57-1e13-44b9-bf4f-a0274078407d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:50.665153 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6161749 Nov 24 15:13:50.665873 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Pushing event updated for resources: {'Network': ['ID=81382f99-f5ff-40f4-ab19-dca39064a209,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:50.668703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55878) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:50.671329 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:50.675172 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Request body: {'subnet': {'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-994375980-subnet', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'ip_version': 4}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:13:50.679695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 81382f99-f5ff-40f4-ab19-dca39064a209 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 15:13:50.680876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:50.685876 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Usage tracker for resource:subnet and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:50.690653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:50.698538 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:50.711078 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Made reservation on behalf of ed89aa580bcf48afa36f245d2283c042 for: {'subnet': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:13:50.714149 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8100989'] for subnet, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.017401 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7895387', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8100943'] for subnet, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.022102 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:51.103662 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Pushing event updated for resources: {'Subnet': ['ID=1c1cd4ec-e03e-44b4-a752-344d0d699cb7,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:51.108004 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:51.117359 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Checking segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83525) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:13:51.117713 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Network hostable DHCP agents. Network: 81382f99-f5ff-40f4-ab19-dca39064a209, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83525) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:13:51.144912 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Network 81382f99-f5ff-40f4-ab19-dca39064a209 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83525) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:13:51.156705 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 81382f99-f5ff-40f4-ab19-dca39064a209) {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:13:51.162365 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:51.163293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.169835 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c00c5937-f44d-47b4-9c8f-e7857054a6ed None None] Network 81382f99-f5ff-40f4-ab19-dca39064a209 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:13:51.191176 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f599aa44-f18e-4933-9614-ef6f9411d36c admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5212057 Nov 24 15:13:51.195830 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55882) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:51.201104 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:13:51.207056 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:51.212737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Usage tracker for resource:router and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:51.217477 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:51.229474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:51.250894 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.252573 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.288820 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.457360 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.545568 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-81382f99-f5ff-40f4-ab19-dca39064a209', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 15:13:51.546473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.694134 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.749836 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:51.841808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Allocated IP 172.20.0.2 (81382f99-f5ff-40f4-ab19-dca39064a209/1c1cd4ec-e03e-44b4-a752-344d0d699cb7/1add684e-4545-4126-92e8-4055d789c7fc) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:13:51.964176 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Allocated IP 172.26.4.120 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/d0294820-b84f-4b28-af9c-dd186e2b237a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:13:52.122374 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.138257 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Transition to ACTIVE for port object 1add684e-4545-4126-92e8-4055d789c7fc will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:13:52.150795 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.165326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Transition to ACTIVE for port object 1add684e-4545-4126-92e8-4055d789c7fc will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:13:52.174944 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.182703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:52.185949 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.190196 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:52.264896 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:13:52.268613 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:13:52.273880 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:13:52.286950 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Network 81382f99-f5ff-40f4-ab19-dca39064a209 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:13:52.300386 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Pushing event updated for resources: {'Port': ['ID=d0294820-b84f-4b28-af9c-dd186e2b237a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:52.301839 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:13:52.307598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:52.309731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:13:52.320164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Pushing event updated for resources: {'Port': ['ID=1add684e-4545-4126-92e8-4055d789c7fc,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:52.384094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.384355 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.384692 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.385035 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.385364 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.385698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.386030 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.386357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.386683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.387005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.387328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:13:52.396146 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:52.451628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Attempting to bind port 1add684e-4545-4126-92e8-4055d789c7fc on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:13:52.452039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Attempting to bind port 1add684e-4545-4126-92e8-4055d789c7fc by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:13:52.452423 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Attempting to bind port 1add684e-4545-4126-92e8-4055d789c7fc on network 81382f99-f5ff-40f4-ab19-dca39064a209 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:13:52.461181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:13:52.461566 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Checking segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:13:52.461985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.462396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Bound using segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:13:52.462928 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Bound port: 1add684e-4545-4126-92e8-4055d789c7fc, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:13:52.463321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.568351 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] For port 1add684e-4545-4126-92e8-4055d789c7fc, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:13:52.571940 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] For port 1add684e-4545-4126-92e8-4055d789c7fc, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1add684e-4545-4126-92e8-4055d789c7fc,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:13:52.578027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.582451 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:52.678859 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.679809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:52.690337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Pushing event updated for resources: {'Port': ['ID=1add684e-4545-4126-92e8-4055d789c7fc,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:52.694190 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:53.006497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83525) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 15:13:53.277883 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:13:53.295616 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:13:53.317974 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:53.323678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:53.323985 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-bb027133-55c1-4868-9cae-8c2df3f513ac admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.1244097 Nov 24 15:13:53.324137 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:53.324301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55886) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:53.595471 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:53.870128 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-054f0a7a-b7dd-4574-a206-847cc707cb4d None None] Network 81382f99-f5ff-40f4-ab19-dca39064a209 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:13:54.075231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-3422439e-430d-4b6a-995a-d413c6323994 None None] Provisioning for port 1add684e-4545-4126-92e8-4055d789c7fc completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:13:54.242171 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:52Z', 'revision_number': 3, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:54.253668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:13:54.254136 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Updating router db14b600-0316-4cbc-a676-2ac7b5d2d063 port d0294820-b84f-4b28-af9c-dd186e2b237a binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:13:54.390302 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:54.552809 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:54.766023 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1add684e-4545-4126-92e8-4055d789c7fc up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:13:54.886720 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Allocated IP 172.20.0.1 (81382f99-f5ff-40f4-ab19-dca39064a209/1c1cd4ec-e03e-44b4-a752-344d0d699cb7/8f03bf58-5b4b-4bef-83f2-f25bfd897a2a) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:13:54.887805 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:54.905050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Transition to ACTIVE for port object d0294820-b84f-4b28-af9c-dd186e2b237a will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:13:54.915966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:54.925910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:55.013683 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1add684e-4545-4126-92e8-4055d789c7fc completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:13:55.033240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1add684e-4545-4126-92e8-4055d789c7fc triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:13:55.034049 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.143051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Attempting to bind port d0294820-b84f-4b28-af9c-dd186e2b237a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:13:55.143337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Attempting to bind port d0294820-b84f-4b28-af9c-dd186e2b237a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:13:55.143727 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Attempting to bind port d0294820-b84f-4b28-af9c-dd186e2b237a on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:13:55.146769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549656b2-40c8-4258-b4b5-9edc9ef6ca54 None None] Pushing event updated for resources: {'Port': ['ID=d0294820-b84f-4b28-af9c-dd186e2b237a,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:55.152059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-549656b2-40c8-4258-b4b5-9edc9ef6ca54 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:55.168991 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:13:55.169368 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:13:55.169785 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.170189 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:13:55.170676 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Bound port: d0294820-b84f-4b28-af9c-dd186e2b237a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:13:55.171057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.208582 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.244521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Transition to ACTIVE for port object 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:13:55.282695 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.292339 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-29585fea-2d28-4590-8151-3a1a87a474c8 tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:55.309707 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.319989 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] For port d0294820-b84f-4b28-af9c-dd186e2b237a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:13:55.334363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] For port d0294820-b84f-4b28-af9c-dd186e2b237a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d0294820-b84f-4b28-af9c-dd186e2b237a,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:13:55.341630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.346158 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:55.404186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1add684e-4545-4126-92e8-4055d789c7fc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1add684e-4545-4126-92e8-4055d789c7fc,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:55.416687 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.416889 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Network 81382f99-f5ff-40f4-ab19-dca39064a209 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:13:55.424434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:13:55.428265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:13:55.445077 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549656b2-40c8-4258-b4b5-9edc9ef6ca54 None None] Pushing event updated for resources: {'Port': ['ID=d0294820-b84f-4b28-af9c-dd186e2b237a,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:55.448931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-549656b2-40c8-4258-b4b5-9edc9ef6ca54 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:55.449407 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-549656b2-40c8-4258-b4b5-9edc9ef6ca54 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.022s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:55.492745 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:13:55.493406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:55.495397 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Pushing event updated for resources: {'Port': ['ID=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:55.500544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:55.542813 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.655993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1add684e-4545-4126-92e8-4055d789c7fc,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:55.667050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:55.680167 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.734070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:13:55.974459 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.980548 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:55.988371 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf8ceb9e-5096-454a-baf3-d339c732cd6b None None] Provisioning for port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:13:55.999731 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-cf8ceb9e-5096-454a-baf3-d339c732cd6b None None] Provisioning complete for port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:13:56.000164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-cf8ceb9e-5096-454a-baf3-d339c732cd6b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:56.007588 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-0cf2a46a-7e03-4199-86bf-0086700e58af tempest-DeleteServersTestJSON-432473733 tempest-DeleteServersTestJSON-432473733-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:56.088875 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-cf8ceb9e-5096-454a-baf3-d339c732cd6b None None] Port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:13:56.120869 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Pushing event updated for resources: {'Port': ['ID=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:56.128895 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:56.130474 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:56.187691 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:52Z', 'revision_number': 3, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:13:56.193919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c60351cd-adac-48a9-93de-b846e6ba109f None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:52Z', 'revision_number': 3, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:13:56.341666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Network 81382f99-f5ff-40f4-ab19-dca39064a209 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:13:56.343910 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:13:56.734357 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-59aeec78-ecfd-40ea-b38d-6f45e3f09a59 None None] Provisioning complete for port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:13:56.735157 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-59aeec78-ecfd-40ea-b38d-6f45e3f09a59 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:56.844245 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-59aeec78-ecfd-40ea-b38d-6f45e3f09a59 None None] Port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:13:56.849892 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1add684e-4545-4126-92e8-4055d789c7fc up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:13:56.983228 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:13:56.985592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1add684e-4545-4126-92e8-4055d789c7fc triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:13:56.986169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:57.165269 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d0294820-b84f-4b28-af9c-dd186e2b237a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:13:57.300060 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port d0294820-b84f-4b28-af9c-dd186e2b237a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:13:57.310445 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d0294820-b84f-4b28-af9c-dd186e2b237a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:13:57.311068 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:57.369634 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:13:57.382432 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] 10.222.0.70 "PUT /v2.0/routers/db14b600-0316-4cbc-a676-2ac7b5d2d063/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0567021 Nov 24 15:13:57.506384 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:57.528385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port d0294820-b84f-4b28-af9c-dd186e2b237a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d0294820-b84f-4b28-af9c-dd186e2b237a,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:13:57.533788 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:57.536548 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:57.624240 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=d0294820-b84f-4b28-af9c-dd186e2b237a,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:57.628102 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:58.540581 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55912) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:58.548312 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-1069219494-network', 'tenant_id': 'f713946fca3f4f98b036135abad6def7'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:13:58.554500 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:58.564265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Usage tracker for resource:network and tenant:f713946fca3f4f98b036135abad6def7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:58.569607 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:58.577173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:58.590855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Made reservation on behalf of f713946fca3f4f98b036135abad6def7 for: {'network': 1} {{(pid=83525) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:13:58.594316 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for network, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.610050 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks [] for security_group, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.647866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:58.653033 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Usage tracker for resource:security_group_rule and tenant:f713946fca3f4f98b036135abad6def7 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:58.656106 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:58.664324 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:58.732059 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d0294820-b84f-4b28-af9c-dd186e2b237a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:13:58.758606 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.762848 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.766144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-41642272-c3d3-40ed-b92c-1b44397ed5ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:58.798673 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871} {{(pid=83525) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 15:13:58.808554 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fa08c9c-c9e8-40f6-a83c-84fa1fce4bbb,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:58.812661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:58.829940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.831795 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.segments_db [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Added segment c67e13f0-bebb-424a-8f9d-5efc5305f2f9 of type vlan for network 6ad18513-9668-45b7-b30d-ac3e6356da53 Nov 24 15:13:58.842361 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port d0294820-b84f-4b28-af9c-dd186e2b237a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:13:58.842844 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.886978 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8771275618295'] for network, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.944200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726'] for network, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.945677 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:58.946618 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:58.955808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d27b7606-b8ba-4526-8866-63f968e0e836 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:59.221461 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] 10.222.0.70 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.6795456 Nov 24 15:13:59.225129 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55920) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:59.232531 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Pushing event updated for resources: {'Network': ['ID=6ad18513-9668-45b7-b30d-ac3e6356da53,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:59.234967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Request body: {'subnet': {'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-1069219494-subnet', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'ip_version': 4}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:13:59.236625 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32bdc84b-690c-4485-8db8-b35528314277 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:59.241948 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:59.245873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 details requested by agent ovs-agent-dv-neutron-818151-2-hyperv with host dv-neutron-818151-2-hyperv {{(pid=83527) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} Nov 24 15:13:59.248420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Usage tracker for resource:subnet and tenant:f713946fca3f4f98b036135abad6def7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:59.253325 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:59.265203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:59.281128 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Made reservation on behalf of f713946fca3f4f98b036135abad6def7 for: {'subnet': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:13:59.283966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8240692'] for subnet, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:59.586472 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8272568', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8240646'] for subnet, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:59.592947 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-13187a7c-884f-4b5d-92ab-83dd153f3326 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:13:59.729638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8977cb21-6563-4cdd-9f63-abcbb3113a49,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:13:59.735888 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:13:59.752150 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Checking segment: {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:13:59.752743 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Network hostable DHCP agents. Network: 6ad18513-9668-45b7-b30d-ac3e6356da53, hostable agents: ['42153128-35a0-4d6f-8610-1ec654ed3b07'], hosted agents: [] {{(pid=83526) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 15:13:59.790490 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 is scheduled to be hosted by DHCP agent 42153128-35a0-4d6f-8610-1ec654ed3b07 with binding_index 1 {{(pid=83526) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 15:13:59.805567 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-neutron-818151-2-hyperv, 6ad18513-9668-45b7-b30d-ac3e6356da53) {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:13:59.811299 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Attributes excluded by policy engine: ['shared', 'segment_id', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:13:59.812794 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:59.822758 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27b5be73-d3e2-42f1-8436-23b180a9564e None None] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:13:59.853050 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-ddc0013f-5e6d-4e94-a60a-41f9838da147 admin admin] 10.222.0.70 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6223824 Nov 24 15:13:59.853443 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55926) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:13:59.862017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:13:59.870065 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:13:59.876047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Usage tracker for resource:router and tenant:f713946fca3f4f98b036135abad6def7 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:13:59.880041 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:13:59.890141 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:13:59.914745 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1003149', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24754'] for router, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:59.916533 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1001508', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1005824', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-987874', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-24765'] for router, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:13:59.946497 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.113399 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:14:00.129763 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:00.130629 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:00.133324 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1005878', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1003171', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-24719'] for router, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.166100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb6f87bd4-204b-54fc-9d4c-a3bac8fa034a-6ad18513-9668-45b7-b30d-ac3e6356da53', 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'fixed_ips': [{'subnet_id': '8977cb21-6563-4cdd-9f63-abcbb3113a49'}]}} from dv-neutron-818151-2-hyperv. {{(pid=83527) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:264}} Nov 24 15:14:00.168473 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.376620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.411523 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.418677 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:00.461870 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.db_base_plugin_common [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Allocated IP 172.20.0.2 (6ad18513-9668-45b7-b30d-ac3e6356da53/8977cb21-6563-4cdd-9f63-abcbb3113a49/e26379a3-e71d-4cf4-a9f1-841821b67e39) {{(pid=83527) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:14:00.791351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Allocated IP 172.26.4.103 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/1bc29381-c45f-434d-a8f6-3fad9bc3ecf7) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:14:00.795591 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Notify callbacks [] for port, precommit_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.808919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Transition to ACTIVE for port object e26379a3-e71d-4cf4-a9f1-841821b67e39 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:00.834210 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Transition to ACTIVE for port object e26379a3-e71d-4cf4-a9f1-841821b67e39 will not be triggered until provisioned by entity DHCP. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:00.841388 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033'] for port, after_create {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:00.846491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:00.987093 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 is already hosted by enough agents. {{(pid=83527) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:14:00.993113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.scheduler.base_scheduler [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Resources bound (agent type, host, resource id): {{(pid=83527) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:14:01.000162 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Received port after_create {{(pid=83527) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:14:01.006637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Pushing event updated for resources: {'Port': ['ID=e26379a3-e71d-4cf4-a9f1-841821b67e39,revision_number=1']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:01.012998 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:01.026788 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 2, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:01.034492 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:14:01.035418 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Updating router db14b600-0316-4cbc-a676-2ac7b5d2d063 port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:14:01.056674 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.104095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.111974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1c26ca0-90ee-4d55-b77a-deac5b027778 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:01.130831 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Attempting to bind port e26379a3-e71d-4cf4-a9f1-841821b67e39 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:14:01.131214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Attempting to bind port e26379a3-e71d-4cf4-a9f1-841821b67e39 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:14:01.131606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Attempting to bind port e26379a3-e71d-4cf4-a9f1-841821b67e39 on network 6ad18513-9668-45b7-b30d-ac3e6356da53 {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:14:01.139979 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:14:01.140370 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Checking segment: {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:14:01.140874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.141286 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Bound using segment: {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:14:01.141780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Bound port: e26379a3-e71d-4cf4-a9f1-841821b67e39, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:14:01.142176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.143538 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.202461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:14:01.211657 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:14:01.226575 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:14:01.253045 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] For port e26379a3-e71d-4cf4-a9f1-841821b67e39, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:14:01.258238 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] For port e26379a3-e71d-4cf4-a9f1-841821b67e39, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e26379a3-e71d-4cf4-a9f1-841821b67e39,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:14:01.265535 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.270953 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Pushing event updated for resources: {'Port': ['ID=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:01.282793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-87c19c47-dc2a-4a98-a9a5-f93baee66d4c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:01.283183 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:01.427658 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Pushing event updated for resources: {'Port': ['ID=e26379a3-e71d-4cf4-a9f1-841821b67e39,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:01.433514 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:01.459409 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.460635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1003188', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-999639'] for router, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.810935 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.825479 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Transition to ACTIVE for port object 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:01.834650 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:01.839211 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:01.839880 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea is scheduled to L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b with binding_index 1 {{(pid=83526) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 15:14:01.970465 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Pushing event updated for resources: {'Port': ['ID=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:02.050579 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.051001 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.051327 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.051655 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.052013 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.052338 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.052663 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.052989 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.053312 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.053646 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.053959 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83528) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:02.062081 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:02.102255 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:14:02.113112 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Sync routers for ids ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:14:02.138945 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Routers {'8fa310aa-beb1-4a84-afb8-29e74d8c8cea'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:02.140020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:02.145686 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Notify callbacks [] for router, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:02.148417 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] 10.222.0.70 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.2934294 Nov 24 15:14:02.151903 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55932) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:02.217796 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Attempting to bind port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:14:02.218387 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Attempting to bind port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:14:02.220415 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Attempting to bind port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a on network 81382f99-f5ff-40f4-ab19-dca39064a209 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:14:02.254781 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 13, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:14:02.255987 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Checking segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:14:02.264291 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:02.268069 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Bound using segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:14:02.268984 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Bound port: 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:14:02.273805 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:02.478620 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] For port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:14:02.485147 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] For port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:14:02.494459 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:02.505607 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-717d5f91-c69a-4c22-9a36-98dd1aabba9d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:02.522677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Set router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:02.677207 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Pushing event updated for resources: {'Port': ['ID=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:02.681875 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-731ac476-fdb3-4f10-abdd-d3d3fd3d10bb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:02.684028 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:02.684733 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:02.897549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b355a4df-0499-42e7-b228-23d581cc6c6a None None] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:14:02.911003 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e26379a3-e71d-4cf4-a9f1-841821b67e39 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:02.992744 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:03.193531 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-1ebea30b-7d4a-452e-9b2c-1eadc5e49b99 None None] Provisioning for port e26379a3-e71d-4cf4-a9f1-841821b67e39 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:03.229902 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port e26379a3-e71d-4cf4-a9f1-841821b67e39 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:03.245318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e26379a3-e71d-4cf4-a9f1-841821b67e39 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:03.245715 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:03.334506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:14:01Z', 'revision_number': 3, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:03.356360 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Checking router: 8fa310aa-beb1-4a84-afb8-29e74d8c8cea for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:14:03.356720 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Updating router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 binding host dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:14:03.405111 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:02Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:03.414646 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e0119b5-2c18-4905-89ef-5200cb4fe4b9 None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:02Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:14:03.439970 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:03.537853 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:03.565079 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a41a23cd-1fe0-425c-bb6f-3f44546817cd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:03.666054 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:03.850457 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port e26379a3-e71d-4cf4-a9f1-841821b67e39, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e26379a3-e71d-4cf4-a9f1-841821b67e39,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:03.879808 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:03.905592 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_common [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Allocated IP 172.20.0.1 (6ad18513-9668-45b7-b30d-ac3e6356da53/8977cb21-6563-4cdd-9f63-abcbb3113a49/79752e96-38b5-4668-a843-e4906791a43e) {{(pid=83525) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:14:03.909934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-e7335ab1-7ccf-4efe-957f-12d8f5473228 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:03.963110 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.115751 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks [] for port, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.145494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.provisioning_blocks [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Transition to ACTIVE for port object 79752e96-38b5-4668-a843-e4906791a43e will not be triggered until provisioned by entity DHCP. {{(pid=83525) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:04.158237 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=e26379a3-e71d-4cf4-a9f1-841821b67e39,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:04.163800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:04.184431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.192579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f87130c5-fade-45b0-9a9e-804fa3286cba tempest-TestMinimumBasicScenario-1883045976 tempest-TestMinimumBasicScenario-1883045976-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:04.193341 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-c60c2d9b-436d-45ab-9858-812dbbba9341 None None] Provisioning complete for port e26379a3-e71d-4cf4-a9f1-841821b67e39 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:04.193934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c60c2d9b-436d-45ab-9858-812dbbba9341 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.277094 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:14:04.282494 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:14:04.303515 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Received port after_create {{(pid=83525) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:14:04.401486 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Pushing event updated for resources: {'Port': ['ID=79752e96-38b5-4668-a843-e4906791a43e,revision_number=1']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:04.416806 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:04.440560 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-999449'] for router_interface, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.490168 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Notify callbacks [] for port, precommit_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.555264 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Transition to ACTIVE for port object 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 will not be triggered until provisioned by entity L2. {{(pid=83527) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:04.571816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.578782 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:04.586249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.663181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Attempting to bind port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:14:04.663592 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Attempting to bind port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:14:04.664007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Attempting to bind port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 on network 402f60a1-052a-4741-af19-c310771ae4cd {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:14:04.689686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf02fa4b-111f-410b-90ce-e1726cdc2c5b None None] Pushing event updated for resources: {'Port': ['ID=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,revision_number=2']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:04.693900 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 14, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:14:04.694289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Checking segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83527) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:14:04.694708 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.695115 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Bound using segment: {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'} {{(pid=83527) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:14:04.695619 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.managers [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Bound port: 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd'}}] {{(pid=83527) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:14:04.696042 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.731188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-bf02fa4b-111f-410b-90ce-e1726cdc2c5b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:04.791553 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-10056568-0ec4-4382-b875-69277dd18259 None None] Provisioning for port 79752e96-38b5-4668-a843-e4906791a43e completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:04.806386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-10056568-0ec4-4382-b875-69277dd18259 None None] Provisioning complete for port 79752e96-38b5-4668-a843-e4906791a43e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:04.806778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-10056568-0ec4-4382-b875-69277dd18259 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.866552 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] For port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83527) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:14:04.900169 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e26379a3-e71d-4cf4-a9f1-841821b67e39 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:04.945443 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] For port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:14:04.977426 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:04.983733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-10056568-0ec4-4382-b875-69277dd18259 None None] Port 79752e96-38b5-4668-a843-e4906791a43e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:14:04.991033 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:05.059703 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks [] for port, precommit_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:05.064714 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7895500'] for port, after_update {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:05.097310 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-ae6796fd-ef93-4600-a45d-11d85545e46c tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:05.178885 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Pushing event updated for resources: {'Port': ['ID=79752e96-38b5-4668-a843-e4906791a43e,revision_number=2']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:05.182320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf02fa4b-111f-410b-90ce-e1726cdc2c5b None None] Pushing event updated for resources: {'Port': ['ID=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,revision_number=3']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:05.183616 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:05.185045 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2023919', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1007477'] for router_interface, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:05.186550 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-bf02fa4b-111f-410b-90ce-e1726cdc2c5b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:05.192459 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Routers {'8fa310aa-beb1-4a84-afb8-29e74d8c8cea'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:05.193132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:13:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:05.258721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port e26379a3-e71d-4cf4-a9f1-841821b67e39 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:05.258721 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:05.407879 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 is already hosted by enough agents. {{(pid=83525) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:14:05.409821 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.base_scheduler [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Resources bound (agent type, host, resource id): {{(pid=83525) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:14:05.499350 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] Set router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:05.541637 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:05.853661 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:05.860621 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-04921b30-03bc-4489-abbb-2912acb5fb1b None None] Provisioning complete for port 79752e96-38b5-4668-a843-e4906791a43e triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:05.860993 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-04921b30-03bc-4489-abbb-2912acb5fb1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:05.893314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:05.893698 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:05.946381 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:14:06.135062 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-04921b30-03bc-4489-abbb-2912acb5fb1b None None] Port 79752e96-38b5-4668-a843-e4906791a43e cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:14:06.141118 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2c48b8f2-8d34-43fa-b11b-b988e1c5d95e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:06.191164 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:14:06.201953 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f35b4705-5cbe-49ef-8cc7-3911d5f0c6be admin admin] 10.222.0.70 "PUT /v2.0/routers/8fa310aa-beb1-4a84-afb8-29e74d8c8cea/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0475440 Nov 24 15:14:06.236282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:06.278161 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '79752e96-38b5-4668-a843-e4906791a43e', 'name': '', 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'mac_address': 'fa:16:3e:b4:e5:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:03Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 2, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'subnets': [{'id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:06.288027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6870b402-baab-40e7-a895-afcbe5fee318 None None] The sync data for ids ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'] in dv-neutron-818151-2-hyperv is: [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '79752e96-38b5-4668-a843-e4906791a43e', 'name': '', 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'mac_address': 'fa:16:3e:b4:e5:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:03Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 2, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'subnets': [{'id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:14:06.306530 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:06.312279 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:06.314966 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:06.389020 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:06.392156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:06.713562 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:06.792579 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:06.793260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.103707 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55942) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:07.116623 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1861641170', 'description': 'tempest-secgroup-smoke-1861641170 description', 'project_id': 'ed89aa580bcf48afa36f245d2283c042'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:07.128461 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:07.133050 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.134494 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:07.139179 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:07.146607 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:07.157638 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.199688 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:07.204747 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:07.208591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:07.215340 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:07.289373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.294656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.298945 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9a82078d-134c-4276-a04c-b7e6eaaa1574 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:07.346615 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9d581076-6e86-4c94-a8e9-984832944f47,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:07.351339 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:07.352371 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.353656 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-3dbde22d-760d-4f59-b357-c64adceb5b42 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1628 time: 0.2469058 Nov 24 15:14:07.358895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55946) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:07.366790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group_rule': {'security_group_id': '9d581076-6e86-4c94-a8e9-984832944f47', 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:07.374334 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:07.378995 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:07.382875 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:07.390561 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:07.423382 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.496933 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.501900 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.505758 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-88346bb3-dd90-4942-a194-63b40515b255 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:07.532173 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ee6febd-d903-4b44-9838-11ee52e243e0,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:07.535585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:07.545506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.546772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-cfec2415-948c-4440-a703-efb783dd726c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 706 time: 0.1867104 Nov 24 15:14:07.550298 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 55950) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:07.556380 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group_rule': {'security_group_id': '9d581076-6e86-4c94-a8e9-984832944f47', 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:07.562907 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:07.568098 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:07.572223 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:07.579666 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:07.600959 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.681968 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.686788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.689851 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-fcb4e423-98d5-4d30-9b70-410e3b0f185e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:07.717356 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=df563bd8-3e75-4e91-9855-03738f199102,revision_number=0']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:07.723978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:07.729462 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.731086 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-64b32356-519e-4b2f-afe7-25a4315837d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 705 time: 0.1795139 Nov 24 15:14:07.734550 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55954) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:07.741315 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group_rule': {'security_group_id': '9d581076-6e86-4c94-a8e9-984832944f47', 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:07.748455 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:07.753055 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:07.756578 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:07.764632 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:07.785734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.864866 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.869148 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.875583 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-52202541-e057-4328-aaf2-7a99e574a829 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:07.901905 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1caba60a-96c4-4c81-a461-fafe0727a907,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:07.905265 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:07.913855 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:07.915284 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 711 time: 0.1797082 Nov 24 15:14:07.918326 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55958) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:07.924737 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group_rule': {'security_group_id': '9d581076-6e86-4c94-a8e9-984832944f47', 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:07.931816 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:07.936411 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:07.939975 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:07.948832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:07.979392 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.057740 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.062417 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.064428 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-15f13b0f-33dc-480b-9d49-1af5f2921de9 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:08.089893 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9742e093-7cb6-4952-be20-5e96b52f01e9,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:08.096191 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:08.102199 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.103518 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-7d2e4a94-550c-4d52-8490-2047f4c92944 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 710 time: 0.1841760 Nov 24 15:14:08.106819 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55962) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:08.112656 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group_rule': {'security_group_id': '9d581076-6e86-4c94-a8e9-984832944f47', 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:08.120146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:08.125292 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:08.131439 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:08.142434 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:08.157853 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Project ed89aa580bcf48afa36f245d2283c042 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:14:08.165735 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.253658 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.261449 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.264299 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b2e8e583-66f8-46e4-83f7-dabef04ab50e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:08.296521 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d28d62b8-aa0d-4f04-bce5-9d3d77b45cf6,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:08.300116 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:08.309384 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.310747 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-d74b55a3-e94e-4618-a5c7-a299cf7385e0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 716 time: 0.2029335 Nov 24 15:14:08.314342 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 55966) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:08.320709 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.v2.base [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'security_group_rule': {'security_group_id': '9d581076-6e86-4c94-a8e9-984832944f47', 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=83525) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:08.327065 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:08.332519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:security_group_rule and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:08.336372 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=83525) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:08.344144 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.quota.driver [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=83525) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:08.358291 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.db.securitygroups_db [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Project ed89aa580bcf48afa36f245d2283c042 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 15:14:08.365956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.448602 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.453232 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044525'] for security_group_rule, after_create {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.455572 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c0954337-fcb2-4701-9ec3-4db0c75c6a44 tempest-TestNetworkBasicOps-606347546 tempest-TestNetworkBasicOps-606347546-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:08.480060 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=426e1d62-dead-4306-addb-06d1ae68c345,revision_number=0']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:08.482979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:08.493390 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.495006 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-284a27f6-c0bc-47fb-964c-6ad55bd048a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 715 time: 0.1796279 Nov 24 15:14:08.817867 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:08.891670 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c87ebfeb-1d88-4466-b18b-cf9e8e93901a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:security_group {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:14:08.920113 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c87ebfeb-1d88-4466-b18b-cf9e8e93901a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:security_group {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:14:08.921679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c87ebfeb-1d88-4466-b18b-cf9e8e93901a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1861641170&fields=id&tenant_id=ed89aa580bcf48afa36f245d2283c042 HTTP/1.1" status: 200 len: 267 time: 0.0778418 Nov 24 15:14:09.097701 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-fd75a945-6f57-40de-ab8b-a64107b87234 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:09.099930 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-fd75a945-6f57-40de-ab8b-a64107b87234 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 809 time: 0.1700490 Nov 24 15:14:09.118478 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-b5467750-968c-40d6-a643-53276916db94 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/quotas/ed89aa580bcf48afa36f245d2283c042 HTTP/1.1" status: 200 len: 375 time: 0.0127404 Nov 24 15:14:09.221600 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-0c99e376-828c-4dcb-a3cc-aaacf269c127 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0936656 Nov 24 15:14:09.247600 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-b93cfbb4-c57a-4efe-9fde-353cff865f70 service neutron] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 15:14:09.249509 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-b93cfbb4-c57a-4efe-9fde-353cff865f70 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0101652 Nov 24 15:14:09.504265 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-5fe01768-09e4-4e7a-b761-0f9e31747564 service neutron] 10.222.0.70 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2448325 Nov 24 15:14:09.772965 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-f8e7ad8d-126d-4f8c-b445-a9d68062241d service neutron] 10.222.0.70 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2625208 Nov 24 15:14:09.984768 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-bad78a93-43f1-4abd-bfb2-36f0e79204b2 req-e6419570-4d0a-46e1-87f7-4ee31b68e7bd tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:14:10.011028 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-bad78a93-43f1-4abd-bfb2-36f0e79204b2 req-e6419570-4d0a-46e1-87f7-4ee31b68e7bd tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:14:10.012419 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-bad78a93-43f1-4abd-bfb2-36f0e79204b2 req-e6419570-4d0a-46e1-87f7-4ee31b68e7bd tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 210 time: 0.0769255 Nov 24 15:14:11.299700 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-21c1af87-bcd5-4dcb-883b-14bce5207915 req-e3b2782f-8f2b-4557-bfa5-d2f6db251583 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 210 time: 0.1123343 Nov 24 15:14:11.381495 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-0468b4ad-eb45-40eb-b58e-df9f76a74942 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:11.383862 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-0468b4ad-eb45-40eb-b58e-df9f76a74942 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 809 time: 0.3433924 Nov 24 15:14:11.462277 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-f18b6c2e-830a-42d5-851f-5f3f58d86425 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ed89aa580bcf48afa36f245d2283c042 HTTP/1.1" status: 200 len: 380 time: 0.0573883 Nov 24 15:14:11.472976 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'port': {'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'admin_state_up': True, 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'security_groups': ['9d581076-6e86-4c94-a8e9-984832944f47']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:11.658635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:11.675084 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:11.687046 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Made reservation on behalf of ed89aa580bcf48afa36f245d2283c042 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:14:11.690292 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:11.875118 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Allocated IP 172.20.0.8 (81382f99-f5ff-40f4-ab19-dca39064a209/1c1cd4ec-e03e-44b4-a752-344d0d699cb7/e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:14:12.112440 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:12.131988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Transition to ACTIVE for port object e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:12.155504 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:12.162725 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c6c134b9-f2c3-4dbc-a627-a56c3b702d58 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:12.231940 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Network 81382f99-f5ff-40f4-ab19-dca39064a209 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:14:12.240620 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:14:12.243552 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:14:12.298273 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:12.312955 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:12.354738 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:12.355507 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:12.396846 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9282572 Nov 24 15:14:12.414465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Request body: {'port': {'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:12.592184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db05bbb-64e6-4866-b178-4548ef19c0ae req-ec5b8470-b4c4-40d4-849e-1f706a01c638 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:12.595950 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:12.596950 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9db05bbb-64e6-4866-b178-4548ef19c0ae req-ec5b8470-b4c4-40d4-849e-1f706a01c638 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 931 time: 0.1256864 Nov 24 15:14:12.605178 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-577d1183-ae95-4dcd-9876-984767da6c2a None None] Provisioning for port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:12.614034 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-577d1183-ae95-4dcd-9876-984767da6c2a None None] Provisioning complete for port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:12.615105 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-577d1183-ae95-4dcd-9876-984767da6c2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:12.683801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9db05bbb-64e6-4866-b178-4548ef19c0ae req-ed07041b-bcac-4d8f-a28f-e7a9eec5a2eb tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:security_group {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:14:12.689963 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-577d1183-ae95-4dcd-9876-984767da6c2a None None] Port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:14:12.709954 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-9db05bbb-64e6-4866-b178-4548ef19c0ae req-ed07041b-bcac-4d8f-a28f-e7a9eec5a2eb tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:security_group {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:14:12.716602 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-9db05bbb-64e6-4866-b178-4548ef19c0ae req-ed07041b-bcac-4d8f-a28f-e7a9eec5a2eb tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1144540 Nov 24 15:14:13.122021 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:14:13.130711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:13.154823 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Transition to ACTIVE for port object e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:13.160812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:13.170711 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1bc59e8-c175-4036-8d39-fdb8b03ca412 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:13.396282 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:13.403949 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:13.599464 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Attempting to bind port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:14:13.600082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Attempting to bind port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:14:13.600612 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Attempting to bind port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba on network 81382f99-f5ff-40f4-ab19-dca39064a209 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:14:13.609882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba on network 81382f99-f5ff-40f4-ab19-dca39064a209 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 15:14:13.610364 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Attempting to bind port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba on network 81382f99-f5ff-40f4-ab19-dca39064a209 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:14:13.620336 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 13, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:14:13.620852 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Checking segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:14:13.621399 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Bound using segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:14:13.622001 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Bound port: e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:14:13.622559 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:13.760543 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:14:13.764142 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:14:13.771008 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:13.776672 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-15e146e7-ea23-4812-8b7b-3e4461bcefb0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:13.886162 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:13.888295 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] 10.222.0.47 "PUT /v2.0/ports/e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 1093 time: 1.4828453 Nov 24 15:14:13.888905 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:14:13.924220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:13.953519 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-1086c3fc-a3fd-4430-9ff6-0a76f352dd9c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:14.325646 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'status': 'completed', 'code': 200} Nov 24 15:14:14.432813 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997b125a-62ee-4fe5-8372-887e3f6303fb req-54334648-cc45-44cb-9bb2-761d82995be1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:14.434006 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-997b125a-62ee-4fe5-8372-887e3f6303fb req-54334648-cc45-44cb-9bb2-761d82995be1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:14:14.446211 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-75bef7b4-3c0d-4fec-a5d5-40140bd2ecf0 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1096 time: 0.4735978 Nov 24 15:14:14.563839 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-997b125a-62ee-4fe5-8372-887e3f6303fb req-54334648-cc45-44cb-9bb2-761d82995be1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:14:14.564916 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-997b125a-62ee-4fe5-8372-887e3f6303fb req-54334648-cc45-44cb-9bb2-761d82995be1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 943 time: 0.5275908 Nov 24 15:14:14.567513 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-4c072cf8-290d-4ba1-a709-a4b013bbdb9e service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 217 time: 0.1123149 Nov 24 15:14:14.684082 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-06381006-de5b-4d01-b6af-cc3c3db23a5a service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:14.686402 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-06381006-de5b-4d01-b6af-cc3c3db23a5a service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.1136816 Nov 24 15:14:14.780673 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-997b125a-62ee-4fe5-8372-887e3f6303fb req-33358868-3f3a-456a-afa2-1ff87ec60530 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1742218 Nov 24 15:14:14.790200 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:14.855905 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-cec7d159-6219-4479-b7c9-04680672af24 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1624849 Nov 24 15:14:14.926007 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:14.935503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:14.936076 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:15.028848 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-283c39e7-57b6-4d7b-8f11-bbc2e326d221 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1662519 Nov 24 15:14:15.161292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:15.186676 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6aa38908-2fdf-45fe-bd97-18f351b241f6 req-7574a953-ac28-4f61-9b45-7b97c44456db service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1501672 Nov 24 15:14:15.192252 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:15.197195 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:15.199464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:15.301926 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:15.306686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:15.358261 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-563a88dd-cf89-47c7-8c0e-6e53238d8d55 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1096 time: 0.1183770 Nov 24 15:14:15.521594 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-c30f121e-51f9-4b9a-ad28-561c30646622 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:15.523055 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-c30f121e-51f9-4b9a-ad28-561c30646622 service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1572382 Nov 24 15:14:15.601533 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-dd13dfd4-1aa8-4482-8133-b7401cc63b40 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 217 time: 0.0710952 Nov 24 15:14:15.676613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-0dd55854-9dd4-4dfb-82e5-f28c86dfff85 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:15.678120 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-0dd55854-9dd4-4dfb-82e5-f28c86dfff85 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0702167 Nov 24 15:14:15.767662 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-3ca0170e-5be1-4481-a08d-e779b430c04f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0825634 Nov 24 15:14:15.920520 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-b858d2c2-3f29-4c42-a4f3-321d6f388738 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1451097 Nov 24 15:14:16.069336 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-88e71eb0-7462-4a9f-b61a-46d436e73b59 req-098bc96e-77b5-4b9c-831b-5ab470348146 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1421845 Nov 24 15:14:16.118985 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a0c98f-c5cd-4a52-85a4-08d2872cc4f9 req-e876b9a4-d6fb-41c7-82ed-82b5fe02d24b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:16.120830 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f7a0c98f-c5cd-4a52-85a4-08d2872cc4f9 req-e876b9a4-d6fb-41c7-82ed-82b5fe02d24b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 943 time: 0.1202261 Nov 24 15:14:16.172134 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f7a0c98f-c5cd-4a52-85a4-08d2872cc4f9 req-393a1c3c-9a27-4d81-8983-c3047d53576a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453012 Nov 24 15:14:16.723455 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:16.869124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:16.869783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:17.394841 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3dede36-4db0-4acd-802e-e25571c9566e req-0905487a-e62a-4a8a-8b14-d832724a0bd0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:17.396751 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a3dede36-4db0-4acd-802e-e25571c9566e req-0905487a-e62a-4a8a-8b14-d832724a0bd0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 943 time: 0.0856791 Nov 24 15:14:17.449519 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a3dede36-4db0-4acd-802e-e25571c9566e req-e235b7aa-ab29-44e3-9139-7fdfb540b713 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465903 Nov 24 15:14:18.031199 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:14:18.182769 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:18.198773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 859, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:14:18.260452 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:18.282921 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:14:18.306534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:18.311606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:18.314578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:18.429525 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:18.432826 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:18.636987 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:14:18.718855 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:18.806814 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb408411-a5ec-4806-b349-9117e5460199 req-821c5e82-e65c-4046-ace0-7f7119c4c277 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:18.808313 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb408411-a5ec-4806-b349-9117e5460199 req-821c5e82-e65c-4046-ace0-7f7119c4c277 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 944 time: 0.2208221 Nov 24 15:14:18.871787 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-eb408411-a5ec-4806-b349-9117e5460199 req-561caf3c-0ef0-4da4-8c13-f69a0a21d570 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514190 Nov 24 15:14:18.895404 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:14:20.046860 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:20.115568 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35422153-9bc1-46f7-a59b-8fa4f4478b0e req-adfb0109-4c43-4206-b387-e73854e98f4b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:20.117174 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-35422153-9bc1-46f7-a59b-8fa4f4478b0e req-adfb0109-4c43-4206-b387-e73854e98f4b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 944 time: 0.0956700 Nov 24 15:14:20.129300 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:20.135630 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:20.136194 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:20.172007 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-35422153-9bc1-46f7-a59b-8fa4f4478b0e req-81c14cba-bd19-4236-9ac9-6296f6bced74 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444415 Nov 24 15:14:20.270400 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:20.309918 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:14:20.324100 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:20.329319 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:20.332385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:20.381092 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'code': 200} Nov 24 15:14:20.412209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:20.416716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:20.652901 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2edfba60-9ca0-433f-8f7b-82a0da7c1710 req-8900d8a9-49ce-473f-ab9f-74b9d0da37a6 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1098 time: 0.0907981 Nov 24 15:14:20.732916 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2edfba60-9ca0-433f-8f7b-82a0da7c1710 req-ef5c9380-d050-4c69-9c76-4c2edff67cfa service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0736339 Nov 24 15:14:21.530861 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7e080d-ce02-4f74-a754-ba423799cc90 req-64e178da-b8f2-42b6-970c-cc439be5098c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:21.532781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8c7e080d-ce02-4f74-a754-ba423799cc90 req-64e178da-b8f2-42b6-970c-cc439be5098c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 945 time: 0.2249706 Nov 24 15:14:21.588588 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-8c7e080d-ce02-4f74-a754-ba423799cc90 req-5b7ccfcb-b53f-44d2-b68e-56709bde3730 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489931 Nov 24 15:14:22.838915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6717e8e7-0c42-45e2-80d1-b1f4bf49a6fa req-efa5ddc2-1a61-44e3-b1b6-fcc38434dfc2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:22.840892 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6717e8e7-0c42-45e2-80d1-b1f4bf49a6fa req-efa5ddc2-1a61-44e3-b1b6-fcc38434dfc2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 945 time: 0.1145818 Nov 24 15:14:22.896023 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-6717e8e7-0c42-45e2-80d1-b1f4bf49a6fa req-e8ad8cd2-c0af-4c07-86b4-22181913bbc5 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490785 Nov 24 15:14:23.126699 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd65f918-d0e3-4030-ad22-2a80c85b0369 req-099a9189-0b31-4252-8831-90c38437b432 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:23.129397 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd65f918-d0e3-4030-ad22-2a80c85b0369 req-099a9189-0b31-4252-8831-90c38437b432 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 945 time: 0.0937536 Nov 24 15:14:23.213772 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-dd65f918-d0e3-4030-ad22-2a80c85b0369 req-e6a18e48-1f74-4242-8b3b-f513f1b8f9b2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782926 Nov 24 15:14:23.272239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56018) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:23.558746 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b7f0fd47-5887-4bd5-baeb-dff9349b2efc tempest-TestSnapshotPattern-293862861 tempest-TestSnapshotPattern-293862861-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1093 time: 0.2848229 Nov 24 15:14:23.563354 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56024) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:14:23.569618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address': '172.20.0.8'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:14:23.576477 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:14:23.582145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:floatingip and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:14:23.585929 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:14:23.593338 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:14:23.607234 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:23.822847 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:24.054787 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Allocated IP 172.26.4.110 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/bf1b8861-1fd3-4a79-a94c-f93dec4f57b0) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:14:24.227619 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:24.264431 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:24.269726 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-84ba32fb-2db3-4348-b651-4121e565b416 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:24.342932 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:14:24.346931 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:14:24.351879 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:14:24.382788 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'Port': ['ID=bf1b8861-1fd3-4a79-a94c-f93dec4f57b0,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:24.404539 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.404923 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.405301 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.405703 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.406049 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.406412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.406779 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.407145 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.407506 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.407916 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.408260 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:14:24.418456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:24.988516 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:25.052048 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:25.294232 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:25.301351 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:25.306844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-14376dec-e48a-4221-bd84-04373d30f94e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:25.549815 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'Port': ['ID=bf1b8861-1fd3-4a79-a94c-f93dec4f57b0,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:25.555684 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:25.573094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:25.795541 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Floating IP 627118d1-4ed8-4452-8adb-a27f103fedc0 associated. External IP: 172.26.4.110, port: e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba. Nov 24 15:14:26.236653 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:14:26.476359 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:14:26.488219 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:14:26.508279 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:26.509440 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:14:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:26.513436 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:26.577957 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 3.0133798 Nov 24 15:14:26.578625 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:14:26.639637 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'status': 'completed', 'code': 200} Nov 24 15:14:26.750931 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-e5e076bc-8b7e-4833-a7d1-7fcb2ce33e42 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1098 time: 0.0862722 Nov 24 15:14:26.849249 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:26.899587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-c49293f4-73bb-4e03-bf8a-1a98b4e4ab42 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:26.901076 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-c49293f4-73bb-4e03-bf8a-1a98b4e4ab42 service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1442497 Nov 24 15:14:27.023323 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-10b8f3fc-d4ef-46c7-a64e-612d4c89adac service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 999 time: 0.1153255 Nov 24 15:14:27.093094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-80ab4f0b-b392-49cb-822b-086d439fd3d6 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:27.094532 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-80ab4f0b-b392-49cb-822b-086d439fd3d6 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0653172 Nov 24 15:14:27.207559 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-e82e875c-7cd0-415b-b1b6-ede2928e0a9d service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1046607 Nov 24 15:14:27.418924 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:24Z', 'revision_number': 0, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:27.425528 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:14:27.441465 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:27.442525 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:14:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:27.564148 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-7fb749a6-ab1d-42f9-a329-794226e18cbc service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3509977 Nov 24 15:14:27.694500 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:27.723457 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-4b4e2be3-494b-475d-97ca-17d250a9a5db req-ba9f228f-7e4c-4515-a2de-1d2cd22c7be6 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1529551 Nov 24 15:14:28.107688 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:24Z', 'revision_number': 0, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:28.113426 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5d52d0b-6a71-42ec-bd22-31f108588dbe None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:24Z', 'revision_number': 0, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:14:30.506314 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3a0029d-0993-4107-9812-ba355bf96874 None None] New status for floating IP 627118d1-4ed8-4452-8adb-a27f103fedc0: ACTIVE {{(pid=83527) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:14:33.446792 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6c7b9f3b-0c7d-4ad2-a3a7-9fd54d32f770 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:33.717329 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Sync routers for ids ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:14:33.734735 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Routers {'8fa310aa-beb1-4a84-afb8-29e74d8c8cea'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:33.735378 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:14:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:33.823072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:33.940132 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Set router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:34.344599 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '79752e96-38b5-4668-a843-e4906791a43e', 'name': '', 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'mac_address': 'fa:16:3e:b4:e5:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:03Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 2, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'subnets': [{'id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:34.352085 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Checking router: 8fa310aa-beb1-4a84-afb8-29e74d8c8cea for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:14:34.352441 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Updating router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea port 79752e96-38b5-4668-a843-e4906791a43e binding host dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:199}} Nov 24 15:14:34.412815 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:34.831780 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Notify callbacks [] for port, precommit_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:34.847496 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.provisioning_blocks [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Transition to ACTIVE for port object 79752e96-38b5-4668-a843-e4906791a43e will not be triggered until provisioned by entity L2. {{(pid=83528) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:14:34.855624 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:34.859661 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-7149d3f1-24f0-40e9-b1f5-9c3e0e409ac3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:35.041066 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc13310f-7909-4486-bcf2-810a0b9d4199 None None] Pushing event updated for resources: {'Port': ['ID=79752e96-38b5-4668-a843-e4906791a43e,revision_number=3']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:35.046069 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-cc13310f-7909-4486-bcf2-810a0b9d4199 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:35.149485 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Attempting to bind port 79752e96-38b5-4668-a843-e4906791a43e on host dv-neutron-818151-2-hyperv for vnic_type normal with profile {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:14:35.150394 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Attempting to bind port 79752e96-38b5-4668-a843-e4906791a43e by drivers openvswitch,hyperv on host dv-neutron-818151-2-hyperv at level 0 using segments [{'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:14:35.150631 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Attempting to bind port 79752e96-38b5-4668-a843-e4906791a43e on network 6ad18513-9668-45b7-b30d-ac3e6356da53 {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:14:35.159843 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Checking agent: {'id': 'ef664953-c8eb-4d82-aa77-3570b98b7070', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-neutron-818151-2-hyperv', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 47, 3), 'started_at': datetime.datetime(2021, 11, 24, 13, 47, 33), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 14, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-neutron-818151-2-hyperv'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.5', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.2', 'SecurityGroupRule': '1.0', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:14:35.160331 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Checking segment: {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83528) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:14:35.160747 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:35.161189 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Bound using segment: {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'} {{(pid=83528) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:14:35.161685 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.managers [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Bound port: 79752e96-38b5-4668-a843-e4906791a43e, host: dv-neutron-818151-2-hyperv, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53'}}] {{(pid=83528) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:14:35.162072 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:35.267679 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] For port 79752e96-38b5-4668-a843-e4906791a43e, host dv-neutron-818151-2-hyperv, cleared binding levels {{(pid=83528) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:14:35.272688 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.plugins.ml2.db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] For port 79752e96-38b5-4668-a843-e4906791a43e, host dv-neutron-818151-2-hyperv, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=79752e96-38b5-4668-a843-e4906791a43e,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83528) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:14:35.279781 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron_lib.callbacks.manager [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83528) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:35.283679 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-54a0a409-dce6-4b5c-931a-62000f918d6b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:35.373714 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc13310f-7909-4486-bcf2-810a0b9d4199 None None] Pushing event updated for resources: {'Port': ['ID=79752e96-38b5-4668-a843-e4906791a43e,revision_number=4']} {{(pid=83528) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:35.378440 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG oslo_concurrency.lockutils [None req-cc13310f-7909-4486-bcf2-810a0b9d4199 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=83528) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:35.380513 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Routers {'8fa310aa-beb1-4a84-afb8-29e74d8c8cea'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:14:35.381220 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:14:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:35.602540 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] Set router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:14:35.946145 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '79752e96-38b5-4668-a843-e4906791a43e', 'name': '', 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'mac_address': 'fa:16:3e:b4:e5:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:03Z', 'updated_at': '2021-11-24T15:14:35Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'subnets': [{'id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:14:35.950844 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44d8dc6f-6108-4a2a-bfe0-6a67d1ce797e None None] The sync data for ids ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'] in dv-neutron-818151-2-hyperv is: [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:14:04Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '79752e96-38b5-4668-a843-e4906791a43e', 'name': '', 'network_id': '6ad18513-9668-45b7-b30d-ac3e6356da53', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'mac_address': 'fa:16:3e:b4:e5:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:03Z', 'updated_at': '2021-11-24T15:14:35Z', 'revision_number': 4, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'subnets': [{'id': '8977cb21-6563-4cdd-9f63-abcbb3113a49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:14:35.980444 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-981841e6-7018-4d25-b94b-b3b4331e6b8e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:36.762680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 79752e96-38b5-4668-a843-e4906791a43e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:36.853813 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning for port 79752e96-38b5-4668-a843-e4906791a43e completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:14:36.863165 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 79752e96-38b5-4668-a843-e4906791a43e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:36.864113 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:37.000997 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:37.041924 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] For port 79752e96-38b5-4668-a843-e4906791a43e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=79752e96-38b5-4668-a843-e4906791a43e,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:14:37.047127 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:37.050784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-83f5f5a5-ea01-4e76-91a5-803cca0d53f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:14:37.167838 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:37.194282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Pushing event updated for resources: {'Port': ['ID=79752e96-38b5-4668-a843-e4906791a43e,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:14:37.198479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:14:38.747275 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 79752e96-38b5-4668-a843-e4906791a43e up at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:14:38.830650 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:38.843114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Provisioning complete for port 79752e96-38b5-4668-a843-e4906791a43e triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:14:38.843498 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:40.982352 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-e52492b3-1e3d-40d2-b8d1-4dca60b78dcf service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2151389 Nov 24 15:14:41.183930 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-04cd2add-a622-4124-8171-83601f4af155 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1098 time: 0.1020298 Nov 24 15:14:41.381618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-6cf7b93a-a68c-430d-a3af-3fa57c12cace service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:41.383105 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-6cf7b93a-a68c-430d-a3af-3fa57c12cace service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1732848 Nov 24 15:14:41.499435 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-c8d7fc9b-1c8b-4f6d-911c-f0996eb7b401 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 1001 time: 0.1095238 Nov 24 15:14:41.619606 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-b45b74f9-8ec9-4f26-a43d-5eb24b6c3d5b service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:14:41.621285 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-b45b74f9-8ec9-4f26-a43d-5eb24b6c3d5b service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.1149981 Nov 24 15:14:41.737699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-a3c25031-202e-4d34-8ea2-918c55520720 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1073947 Nov 24 15:14:41.922778 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-a5f87187-fc69-4b89-9f19-95c05bfb86db service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1792295 Nov 24 15:14:42.085173 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-05896cb0-deb4-478e-91c9-a012cec4b926 req-281a7c19-e4b9-46e0-9764-2b53651fa3ec service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1549060 Nov 24 15:14:48.711606 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:14:55.896386 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:15:03.442716 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-81d58fe4-73e7-47d1-9aea-d2c8e99e7413 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:03.827711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:05.977041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a1a163e6-0f75-490e-b3b4-027d35b47785 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:07.121412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:08.822947 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:18.713318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:32.897799 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:15:33.448500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b35d7066-8887-4a74-a144-46545afa2788 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:33.824175 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:35.973075 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0764ab48-b0cc-4848-a7f9-858fab770849 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:37.124612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:38.822833 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:15:42.847955 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-8421fd34-5614-4056-821a-db5370bdbd66 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0854087 Nov 24 15:15:43.019028 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-45902a3a-a663-4c74-812a-9a7e702e5cf7 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1098 time: 0.0901113 Nov 24 15:15:43.215887 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-f0feb791-ede5-48f6-92ad-e2916860d5a5 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:15:43.218235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-f0feb791-ede5-48f6-92ad-e2916860d5a5 service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1766121 Nov 24 15:15:43.398685 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-b4f5a166-f943-40b8-aa7f-e46a51b8f1b5 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 1001 time: 0.1726029 Nov 24 15:15:43.483618 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-135946bf-d087-4995-901a-7768a02c2340 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:15:43.485217 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-135946bf-d087-4995-901a-7768a02c2340 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0805998 Nov 24 15:15:43.572980 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-1239bbec-c1b7-4cf8-9226-c0d6ffb6a40e service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0807822 Nov 24 15:15:43.855269 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-158577f2-cacb-4abc-931f-a7ba923034a8 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2748048 Nov 24 15:15:44.045071 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-94d86fac-d343-4fd2-9f0f-52fc56708921 req-60c194b7-346d-414c-93f7-be31f43df33a service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1837587 Nov 24 15:15:48.745730 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:03.447028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-68e83a6d-f9e6-4be7-afe3-082f055a17b7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:03.818910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:05.970181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-996ed006-299f-4b7d-a4be-ab2a52bb1040 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:07.134419 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:08.829778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:09.898908 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:16:18.749208 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:33.443282 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6977ed57-e5ae-4360-867f-1a75efb2693f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:33.823131 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:35.968013 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-36594977-d1a4-4221-9702-7f173697b259 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:37.132266 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:38.829677 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:16:42.840699 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-b4f46700-9d00-4a90-a492-74570c70e134 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0803587 Nov 24 15:16:42.991935 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-99527905-cf69-47b3-b054-3bdda64d77de service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1098 time: 0.0784266 Nov 24 15:16:43.156912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-04cd30e1-8f24-40c1-9273-c6feb06d1c02 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:16:43.158384 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-04cd30e1-8f24-40c1-9273-c6feb06d1c02 service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1458464 Nov 24 15:16:43.297257 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-d2dc22e0-8a87-42af-beb5-c4eda3717202 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 1001 time: 0.1317837 Nov 24 15:16:43.376167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-35bd9e7b-7ffe-4dc9-835f-04e99422a937 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:16:43.377709 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-35bd9e7b-7ffe-4dc9-835f-04e99422a937 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0744116 Nov 24 15:16:43.490896 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-c23368ab-8b07-447b-b809-e62a80a2310f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1063786 Nov 24 15:16:43.689193 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-18548ad4-2752-4b29-adcf-5e34c0e470fa service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1912413 Nov 24 15:16:43.864318 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-76de87b7-5f4c-40d3-b66e-35816f033626 req-f313be0a-369d-4c54-9306-1584b6087674 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1678529 Nov 24 15:16:46.900067 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:16:48.750527 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:03.441109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-ea3e835d-ffea-4964-b386-f6ed7964e574 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:03.829767 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:04.892009 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:17:05.080915 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:05.097228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 859, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:17:05.156670 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:05.175783 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:17:05.193027 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:05.197800 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:05.200503 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-549656b2-40c8-4258-b4b5-9edc9ef6ca54 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:05.279283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:05.289052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.289401 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.289929 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.290147 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.290479 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.290849 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.291309 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.291608 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.291971 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.292330 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.292684 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:05.298057 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:17:05.378359 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:05.963015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-84fda6c4-ae19-4081-b611-feb7b08ca9b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:06.906565 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:17:06.985675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:17:06.986389 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:07.120625 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:07.153070 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:07.159164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:17:07.169697 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:07.173858 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:07.177325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:07.290270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:07.296293 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:07.425569 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'code': 200} Nov 24 15:17:08.829699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:18.777109 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:22.031412 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-e6dc54ce-f167-4333-b267-b255f7e90fe8 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1861641170&fields=id&tenant_id=ed89aa580bcf48afa36f245d2283c042 HTTP/1.1" status: 200 len: 267 time: 0.0492754 Nov 24 15:17:22.206406 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-d3456a0b-4e10-4ebe-b838-896b4d4c37d5 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:22.207899 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-d3456a0b-4e10-4ebe-b838-896b4d4c37d5 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 809 time: 0.1674912 Nov 24 15:17:22.226753 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-db2c283e-9781-406d-8ebe-7f1b492abbee tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/quotas/ed89aa580bcf48afa36f245d2283c042 HTTP/1.1" status: 200 len: 375 time: 0.0123568 Nov 24 15:17:22.331944 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-ff99ab01-0e6d-4ffc-896a-c5548c6bf2e6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0991614 Nov 24 15:17:22.574597 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-72fb9b1f-9746-4daa-9e13-d0b38d938464 service neutron] 10.222.0.70 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2286875 Nov 24 15:17:22.716946 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-62af4a7e-9d68-4362-9fa3-5667af20e426 service neutron] 10.222.0.70 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1357398 Nov 24 15:17:23.020039 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ea9e7d44-42a0-4c13-9f0b-ebe73757949d req-73a742b6-d9a8-4be0-a5cd-a2a0f2c44a00 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 210 time: 0.1190357 Nov 24 15:17:23.900416 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:17:24.353419 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-69c101bc-9367-4689-94e8-380f158812a9 req-6e2b0e8d-a22f-43d3-b90f-7bb941494a90 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 210 time: 0.1765788 Nov 24 15:17:24.520376 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-a5976e1f-d1e5-4b07-b62e-92b629a27eed tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:24.521899 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-a5976e1f-d1e5-4b07-b62e-92b629a27eed tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 809 time: 0.1712956 Nov 24 15:17:24.610102 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-8a528fa3-3699-4449-ac5c-7287e05fe6b5 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ed89aa580bcf48afa36f245d2283c042 HTTP/1.1" status: 200 len: 380 time: 0.0745578 Nov 24 15:17:24.621056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'port': {'device_id': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'admin_state_up': True, 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'security_groups': ['9d581076-6e86-4c94-a8e9-984832944f47']}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:17:24.771355 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:17:24.785631 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:17:24.794317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Made reservation on behalf of ed89aa580bcf48afa36f245d2283c042 for: {'port': 1} {{(pid=83526) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 15:17:24.797328 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:25.012420 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Allocated IP 172.20.0.6 (81382f99-f5ff-40f4-ab19-dca39064a209/1c1cd4ec-e03e-44b4-a752-344d0d699cb7/808253ec-882b-4e9b-9532-7c7ec5da4981) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:17:25.059092 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:17:25.215827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:25.305029 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:25.307484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:17:25.317028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:25.319510 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:25.367322 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:25.400076 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Transition to ACTIVE for port object 808253ec-882b-4e9b-9532-7c7ec5da4981 will not be triggered until provisioned by entity DHCP. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:17:25.436668 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:25.443649 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:25.444036 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:25.455013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-42d9692c-a861-4901-b5fc-02157743804f tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:25.524511 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'code': 200} Nov 24 15:17:25.589213 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Network 81382f99-f5ff-40f4-ab19-dca39064a209 is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:17:25.615285 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:25.619819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:17:25.674687 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:17:25.740424 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.741176 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.741790 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.742408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.743002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.743588 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.744220 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.744862 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.745525 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.747124 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.747748 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:17:25.754962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.301s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:25.795055 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:25.795718 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:25.850964 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-4e19531c-6f6e-4620-a478-206b868f951d tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2347615 Nov 24 15:17:25.863557 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209640a4-4143-4db5-988d-21950eb21bb7 req-db37ed46-7db9-415a-8932-1d4cbe4c8e2a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:25.864317 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-209640a4-4143-4db5-988d-21950eb21bb7 req-db37ed46-7db9-415a-8932-1d4cbe4c8e2a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:17:25.895610 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-209640a4-4143-4db5-988d-21950eb21bb7 req-db37ed46-7db9-415a-8932-1d4cbe4c8e2a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:17:25.897468 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-209640a4-4143-4db5-988d-21950eb21bb7 req-db37ed46-7db9-415a-8932-1d4cbe4c8e2a tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.3064594 Nov 24 15:17:25.988427 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-209640a4-4143-4db5-988d-21950eb21bb7 req-f53b9720-d1b5-4559-8953-a3878801d0dd tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761425 Nov 24 15:17:26.047913 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4b61c1fe-6bb8-4ba5-a222-72cac7a5b189 None None] Provisioning for port 808253ec-882b-4e9b-9532-7c7ec5da4981 completed by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:17:26.053233 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-4b61c1fe-6bb8-4ba5-a222-72cac7a5b189 None None] Provisioning complete for port 808253ec-882b-4e9b-9532-7c7ec5da4981 triggered by entity DHCP. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:17:26.053647 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4b61c1fe-6bb8-4ba5-a222-72cac7a5b189 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:26.112626 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-4b61c1fe-6bb8-4ba5-a222-72cac7a5b189 None None] Port 808253ec-882b-4e9b-9532-7c7ec5da4981 cannot update to ACTIVE because it is not bound. {{(pid=83527) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:311}} Nov 24 15:17:27.216956 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033c5fc4-415c-49ac-8edd-54c1cc1373b7 req-11efa563-5719-4577-8a33-042d68dd6d6c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:27.218491 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-033c5fc4-415c-49ac-8edd-54c1cc1373b7 req-11efa563-5719-4577-8a33-042d68dd6d6c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0875690 Nov 24 15:17:27.289497 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-033c5fc4-415c-49ac-8edd-54c1cc1373b7 req-30b469d9-62c6-4c73-a54d-5d18fa86c9a1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581934 Nov 24 15:17:28.492456 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53df765-ff90-4de5-891e-434d1644b265 req-988538cb-06b3-4d77-8703-b8eaa0a55bbd tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:28.493891 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d53df765-ff90-4de5-891e-434d1644b265 req-988538cb-06b3-4d77-8703-b8eaa0a55bbd tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0843937 Nov 24 15:17:28.548378 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d53df765-ff90-4de5-891e-434d1644b265 req-71688deb-8e7f-4901-adc0-68981061fbe9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478256 Nov 24 15:17:29.767281 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549f8d37-39d2-4400-8bb6-9a30bbf95b28 req-d745a3f0-a964-4361-bad3-ff3155f83e33 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:29.768971 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-549f8d37-39d2-4400-8bb6-9a30bbf95b28 req-d745a3f0-a964-4361-bad3-ff3155f83e33 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0943320 Nov 24 15:17:29.829681 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-549f8d37-39d2-4400-8bb6-9a30bbf95b28 req-0a0d35c9-70fe-4e2a-beb4-87cca18ebb0e tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469494 Nov 24 15:17:31.044266 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68002a87-1fd0-4104-a1f9-2b12cdf1834c req-4e3c887c-c742-4246-b53a-f5ee05bbea80 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:31.049527 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68002a87-1fd0-4104-a1f9-2b12cdf1834c req-4e3c887c-c742-4246-b53a-f5ee05bbea80 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0934327 Nov 24 15:17:31.100179 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-68002a87-1fd0-4104-a1f9-2b12cdf1834c req-fcd098fa-c5af-4850-93cd-e38935ca4357 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490181 Nov 24 15:17:32.321831 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2595eb8-141d-4d5f-b7ae-59615c2a2248 req-3659247e-9b56-4b5a-abd9-409fffc253f3 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:32.323344 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b2595eb8-141d-4d5f-b7ae-59615c2a2248 req-3659247e-9b56-4b5a-abd9-409fffc253f3 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0916066 Nov 24 15:17:32.381046 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-b2595eb8-141d-4d5f-b7ae-59615c2a2248 req-b2849e4a-8a7a-4de9-8680-785081fb0cb2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507455 Nov 24 15:17:33.444508 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d500fab2-0724-47d2-8e09-b2c92c9ff379 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:33.603092 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ace9871-09c3-4784-94e2-bd59a251a21b req-3a81d584-eb30-47fa-a228-0c125b9349c1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:33.604628 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ace9871-09c3-4784-94e2-bd59a251a21b req-3a81d584-eb30-47fa-a228-0c125b9349c1 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0853977 Nov 24 15:17:33.655665 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-6ace9871-09c3-4784-94e2-bd59a251a21b req-3ef5e80d-efc8-4933-829c-1e4e42b2753f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454042 Nov 24 15:17:33.826594 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:34.865792 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1956be16-bc02-4f65-ab17-df26ea5c8bec req-dbcf383a-da0c-4977-94f6-00f4fe2b44ef tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:34.867233 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1956be16-bc02-4f65-ab17-df26ea5c8bec req-dbcf383a-da0c-4977-94f6-00f4fe2b44ef tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0813372 Nov 24 15:17:34.914354 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-1956be16-bc02-4f65-ab17-df26ea5c8bec req-95134735-1581-48df-b07d-f7b8441f8680 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409687 Nov 24 15:17:35.956403 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-78329580-7c6c-41c8-b861-50c726702a85 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:36.124874 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fa40d5-445f-4c8b-a47c-2aecc3b6614c req-857d0379-b1be-4788-8172-62e0b26abb3f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:36.126320 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-73fa40d5-445f-4c8b-a47c-2aecc3b6614c req-857d0379-b1be-4788-8172-62e0b26abb3f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0845208 Nov 24 15:17:36.174369 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-73fa40d5-445f-4c8b-a47c-2aecc3b6614c req-7967feca-9f39-47ef-97c0-4da3d002fb8c tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425258 Nov 24 15:17:37.134491 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:37.379611 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c70c11-24ad-48c5-8811-d8989b9c5c2d req-a208ae17-3989-4609-b460-5c2f6dfe7c2b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:37.381141 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-21c70c11-24ad-48c5-8811-d8989b9c5c2d req-a208ae17-3989-4609-b460-5c2f6dfe7c2b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 931 time: 0.0809894 Nov 24 15:17:37.427223 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-21c70c11-24ad-48c5-8811-d8989b9c5c2d req-1f79c156-31f1-427b-96a6-1ea432620670 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404205 Nov 24 15:17:37.903966 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-6629ecf3-6cbf-4e33-ac6c-0ad15f8165ba tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] http://10.222.0.70:9696/v2.0/extensions returned with HTTP 200 {{(pid=83526) __call__ /opt/stack/neutron/neutron/wsgi.py:727}} Nov 24 15:17:37.904993 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-6629ecf3-6cbf-4e33-ac6c-0ad15f8165ba tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 12615 time: 0.0053444 Nov 24 15:17:37.918035 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Request body: {'port': {'device_id': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-neutron-8181'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:17:38.027591 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:38.552722 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 808253ec-882b-4e9b-9532-7c7ec5da4981 {{(pid=83526) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:17:38.559978 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:38.575068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.provisioning_blocks [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Transition to ACTIVE for port object 808253ec-882b-4e9b-9532-7c7ec5da4981 will not be triggered until provisioned by entity L2. {{(pid=83526) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 15:17:38.579939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:38.584465 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-0dfe02ca-01e1-4225-8dac-08f916ce6b3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:38.769993 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:38.778671 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:38.834711 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:38.884601 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4237a67-89bf-4c03-bae9-8c33fa989b6d req-0b2562e3-281b-4707-a235-bbbd21df02af tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:38.886157 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d4237a67-89bf-4c03-bae9-8c33fa989b6d req-0b2562e3-281b-4707-a235-bbbd21df02af tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 943 time: 0.2724342 Nov 24 15:17:38.932578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Attempting to bind port 808253ec-882b-4e9b-9532-7c7ec5da4981 on host hv-neutron-8181 for vnic_type normal with profile {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Nov 24 15:17:38.933677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Attempting to bind port 808253ec-882b-4e9b-9532-7c7ec5da4981 by drivers openvswitch,hyperv on host hv-neutron-8181 at level 0 using segments [{'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Nov 24 15:17:38.933677 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Attempting to bind port 808253ec-882b-4e9b-9532-7c7ec5da4981 on network 81382f99-f5ff-40f4-ab19-dca39064a209 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:17:38.952796 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Port 808253ec-882b-4e9b-9532-7c7ec5da4981 on network 81382f99-f5ff-40f4-ab19-dca39064a209 not bound, no agent of type Open vSwitch agent registered on host hv-neutron-8181 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:97}} Nov 24 15:17:38.953119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Attempting to bind port 808253ec-882b-4e9b-9532-7c7ec5da4981 on network 81382f99-f5ff-40f4-ab19-dca39064a209 {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:85}} Nov 24 15:17:38.961959 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d4237a67-89bf-4c03-bae9-8c33fa989b6d req-deb62b18-8031-43c6-9c7f-b2230ef1a70f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699809 Nov 24 15:17:38.966028 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Checking agent: {'id': 'e00fe112-4f62-42aa-b110-d38a3fd44c77', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-neutron-8181', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'started_at': datetime.datetime(2021, 11, 24, 13, 53, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 15, 17, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:104}} Nov 24 15:17:38.966365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Checking segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=83526) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:340}} Nov 24 15:17:38.966750 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Bound using segment: {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'} {{(pid=83526) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:114}} Nov 24 15:17:38.967172 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.managers [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Bound port: 808253ec-882b-4e9b-9532-7c7ec5da4981, host: hv-neutron-8181, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '269b2190-9c40-4e00-a536-318758b03cfb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 859, 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209'}}] {{(pid=83526) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Nov 24 15:17:38.967518 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:39.084514 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, cleared binding levels {{(pid=83526) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 15:17:39.090459 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, set binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83526) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 15:17:39.097171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:39.101963 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c1dcef44-4e48-426d-a50d-e33c35cffc09 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:39.162192 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:39.163526 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] 10.222.0.47 "PUT /v2.0/ports/808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 200 len: 1093 time: 1.2493742 Nov 24 15:17:39.164071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:17:39.188119 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=3']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:39.191231 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-3677fdf6-4e52-46da-9bf1-5a8ee4acdcc3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:39.251024 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'status': 'completed', 'code': 200} Nov 24 15:17:39.302366 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-67ddd4bb-fdee-44fb-a0ca-649212874958 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1096 time: 0.0919611 Nov 24 15:17:39.378575 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-b5c0106b-4a81-4617-b3c1-344a5dbc5aca service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 200 len: 217 time: 0.0670307 Nov 24 15:17:39.443069 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-531255d9-61a2-475e-8eb0-c88ffb7eb344 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:39.444445 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-531255d9-61a2-475e-8eb0-c88ffb7eb344 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0595608 Nov 24 15:17:39.524830 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-b2f0fb13-9167-406b-9fca-c3a4d060d5f9 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0740528 Nov 24 15:17:39.664611 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-d7fee1b1-5d34-445a-8afc-9d7148bd40a1 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1334133 Nov 24 15:17:39.795458 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2a6227ed-c224-4362-93b1-2734dc8974ea req-39d17e59-ce29-4d5d-85c6-0e8b392dd976 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1250343 Nov 24 15:17:39.911213 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-de480f96-0a23-4b84-92e8-30480ffd8512 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1096 time: 0.0674951 Nov 24 15:17:40.042998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31728525-3b1f-40eb-953e-55b8697407f9 req-23ee1e96-fda8-4cfc-ac5e-d2f48d33557d service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:40.044486 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-23ee1e96-fda8-4cfc-ac5e-d2f48d33557d service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1263232 Nov 24 15:17:40.158992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-bc5a43d2-53af-4933-b22c-21fc812d6316 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 200 len: 217 time: 0.1074789 Nov 24 15:17:40.234259 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31728525-3b1f-40eb-953e-55b8697407f9 req-58e855a9-c404-4573-b921-6788a2bd76f8 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:40.235682 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-58e855a9-c404-4573-b921-6788a2bd76f8 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0706787 Nov 24 15:17:40.394432 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b836b3-d0e2-419e-8c79-9c692c0fa28d req-e577d7ff-6632-44c9-a437-f07882efb42f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:40.395892 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a3b836b3-d0e2-419e-8c79-9c692c0fa28d req-e577d7ff-6632-44c9-a437-f07882efb42f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 943 time: 0.2890344 Nov 24 15:17:40.462226 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-a3b836b3-d0e2-419e-8c79-9c692c0fa28d req-0433a5c2-3d9b-4844-b4a6-60c6584bd1c9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593174 Nov 24 15:17:40.477956 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-4f986858-56ba-46e2-a389-64cf2e2c4530 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.2346056 Nov 24 15:17:40.611880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-0fd25359-1189-4e21-a4ff-b27eeb5aa7a0 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267138 Nov 24 15:17:40.747781 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-31728525-3b1f-40eb-953e-55b8697407f9 req-0a718d88-85a7-47d3-9138-52f0711b22a0 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1290646 Nov 24 15:17:41.721763 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad40ad6a-edfb-418f-9cb0-167c0e5dbda8 req-7369d300-4bbb-4552-b7de-e8bbb4adb515 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:41.723208 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ad40ad6a-edfb-418f-9cb0-167c0e5dbda8 req-7369d300-4bbb-4552-b7de-e8bbb4adb515 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 943 time: 0.0870383 Nov 24 15:17:41.771726 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-ad40ad6a-edfb-418f-9cb0-167c0e5dbda8 req-965f3c11-97df-405e-9744-059c1342e267 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428388 Nov 24 15:17:42.974792 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26498418-5abd-42a9-a0fe-50168a004b8e req-4df4ccc8-980e-4928-a2cd-c938fdac94ed tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:42.976235 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-26498418-5abd-42a9-a0fe-50168a004b8e req-4df4ccc8-980e-4928-a2cd-c938fdac94ed tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 943 time: 0.0788417 Nov 24 15:17:43.027455 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-26498418-5abd-42a9-a0fe-50168a004b8e req-fbf299cb-444b-43a9-8039-4d88ac7358fc tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456235 Nov 24 15:17:43.153053 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:17:43.295973 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:43.310481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'port_id': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'mac_address': 'fa:16:3e:26:0b:6b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 859, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:17:43.366298 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:43.385312 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 808253ec-882b-4e9b-9532-7c7ec5da4981 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:17:43.401859 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:43.406291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:43.409155 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:43.490124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=4']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:43.493349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:43.772663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['808253ec-882b-4e9b-9532-7c7ec5da4981'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:17:44.250206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efd0fd6-df2b-4b74-a4b1-8b6938de50b4 req-b9a14815-8538-4e97-bb9f-1a5ecd08fc13 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:44.252123 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8efd0fd6-df2b-4b74-a4b1-8b6938de50b4 req-b9a14815-8538-4e97-bb9f-1a5ecd08fc13 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 944 time: 0.0913386 Nov 24 15:17:44.302370 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-8efd0fd6-df2b-4b74-a4b1-8b6938de50b4 req-d2da8235-94c4-4ba4-9305-b9f2d8589dae tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442340 Nov 24 15:17:44.605121 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-c324f326-dd92-480d-8607-c0b8cfa8fad0 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0708191 Nov 24 15:17:44.751356 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-b140291e-1716-4121-9734-6fcc629beb02 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1096 time: 0.0746021 Nov 24 15:17:44.903869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80786c11-d703-4475-98b0-96c7b7531831 req-b14276e0-2f8a-402f-97ef-81bfee6e271f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:44.905375 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-b14276e0-2f8a-402f-97ef-81bfee6e271f service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1336474 Nov 24 15:17:45.013992 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-90ab11dd-ac61-4527-b68b-d9b7919602c2 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 999 time: 0.1020586 Nov 24 15:17:45.084821 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80786c11-d703-4475-98b0-96c7b7531831 req-9baadbd8-4e78-40af-8d10-b768e24d80a1 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:45.086246 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-9baadbd8-4e78-40af-8d10-b768e24d80a1 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0656993 Nov 24 15:17:45.153746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:17:45.166780 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-a130adc0-ff4a-48dc-81de-603bd1934732 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0742536 Nov 24 15:17:45.230114 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning for port 808253ec-882b-4e9b-9532-7c7ec5da4981 completed by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 15:17:45.236666 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 808253ec-882b-4e9b-9532-7c7ec5da4981 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:17:45.237052 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:45.336027 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-ea3bc1a0-dd24-453c-a223-0b1fbcd4a953 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1619346 Nov 24 15:17:45.364280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:45.392289 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:17:45.404164 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:17:45.409534 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:45.413325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:45.478674 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'code': 200} Nov 24 15:17:45.513638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=5']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:45.518799 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:45.581809 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-80786c11-d703-4475-98b0-96c7b7531831 req-9579c7d7-f0c9-44cc-8681-1390424a4c4a service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2389128 Nov 24 15:17:45.613064 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2579bee9-5b57-4c20-b150-b80690be0b23 req-d6439ff5-a477-4b3e-a24b-40dbe41d8768 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:45.614989 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2579bee9-5b57-4c20-b150-b80690be0b23 req-d6439ff5-a477-4b3e-a24b-40dbe41d8768 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 945 time: 0.1702011 Nov 24 15:17:45.718360 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-2579bee9-5b57-4c20-b150-b80690be0b23 req-eb7647f6-2fa6-47ea-8a8c-1c9997bd10d9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0963881 Nov 24 15:17:45.758471 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbeb70ef-31b5-48af-a45c-ad96ccb093e8 req-80dc477e-77bf-4768-8e01-27a3c83faa89 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1098 time: 0.0844097 Nov 24 15:17:45.806643 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bbeb70ef-31b5-48af-a45c-ad96ccb093e8 req-318d2cb8-399b-4594-9800-8afe5673b067 service neutron] 10.222.0.47 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421376 Nov 24 15:17:46.923443 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69617218-ede9-4008-a90e-0fc25d298d51 req-f53e7f31-b423-4da7-b157-e73b3282bc66 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:46.924923 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-69617218-ede9-4008-a90e-0fc25d298d51 req-f53e7f31-b423-4da7-b157-e73b3282bc66 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 945 time: 0.0771499 Nov 24 15:17:46.975340 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-69617218-ede9-4008-a90e-0fc25d298d51 req-fe7c5716-8b58-4209-b5b4-e75c87e774b9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449297 Nov 24 15:17:48.175974 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786da344-5d33-453d-8a36-63a77b9644be req-1071e4d4-92b3-415c-be6f-e74c09d24f6b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:48.177407 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-786da344-5d33-453d-8a36-63a77b9644be req-1071e4d4-92b3-415c-be6f-e74c09d24f6b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 945 time: 0.0809255 Nov 24 15:17:48.222488 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-786da344-5d33-453d-8a36-63a77b9644be req-1315544f-7493-421c-985d-41daaa5414a6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396316 Nov 24 15:17:48.436146 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cdad03b-c4e0-4e3b-86be-f5ff7e5931c1 req-cd762eb9-aebd-4a99-a54f-82b53d2bc16f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:48.437600 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2cdad03b-c4e0-4e3b-86be-f5ff7e5931c1 req-cd762eb9-aebd-4a99-a54f-82b53d2bc16f tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 945 time: 0.0803332 Nov 24 15:17:48.494616 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-2cdad03b-c4e0-4e3b-86be-f5ff7e5931c1 req-c22dff4e-a6ab-4d62-af48-721f3c4ac2e6 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515497 Nov 24 15:17:48.522643 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56290) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:17:48.596329 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a23257db-42b6-4201-b891-28a6a3d4ce7a tempest-TestSnapshotPattern-293862861 tempest-TestSnapshotPattern-293862861-project-admin] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1093 time: 0.0721881 Nov 24 15:17:48.598574 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56294) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:17:48.603681 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.v2.base [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Request body: {'floatingip': {'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'port_id': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address': '172.20.0.6'}} {{(pid=83526) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:719}} Nov 24 15:17:48.610836 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} Nov 24 15:17:48.614578 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Usage tracker for resource:floatingip and tenant:ed89aa580bcf48afa36f245d2283c042 is out of sync, need to count used quota {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} Nov 24 15:17:48.617387 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=83526) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} Nov 24 15:17:48.623682 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.quota.driver [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=83526) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} Nov 24 15:17:48.639077 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:48.766130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:48.905042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:49.044668 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_common [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Allocated IP 172.26.4.139 (402f60a1-052a-4741-af19-c310771ae4cd/376fcf88-d7db-4a45-9380-52e3473e9bba/26351ffc-31b8-4801-b62b-dba0fd81bc3e) {{(pid=83526) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 15:17:49.198427 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for port, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:49.227094 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8771275655033', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:49.230937 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-9ee00671-368e-479c-9c54-7982a92461f2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:49.299793 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Network 402f60a1-052a-4741-af19-c310771ae4cd is already hosted by enough agents. {{(pid=83526) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 15:17:49.303014 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.base_scheduler [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Resources bound (agent type, host, resource id): {{(pid=83526) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 15:17:49.307186 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Received port after_create {{(pid=83526) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 15:17:49.332394 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'Port': ['ID=26351ffc-31b8-4801-b62b-dba0fd81bc3e,revision_number=1']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:49.337248 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:49.834538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, precommit_create {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:49.892884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:50.108768 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for port, precommit_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:50.112998 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8272431'] for port, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:50.116589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-c34cab4a-fb8a-4c53-b377-5d082ac5f0d4 tempest-TestShelveInstance-1490761021 tempest-TestShelveInstance-1490761021-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:17:50.220169 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event updated for resources: {'Port': ['ID=26351ffc-31b8-4801-b62b-dba0fd81bc3e,revision_number=2']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:17:50.224114 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:17:50.239047 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-999558'] for floatingip, after_update {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:50.536064 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.db.l3_db [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Floating IP ae570cec-230c-49e2-835e-11fb76168860 associated. External IP: 172.26.4.139, port: 808253ec-882b-4e9b-9532-7c7ec5da4981. Nov 24 15:17:50.931071 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:17:51.138826 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:17:51.150101 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:17:51.161909 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:17:51.162573 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:17:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:17:51.165002 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:17:51.231869 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-a692e42d-b91e-42cc-9d96-ab90c0a9fe44 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6210482 Nov 24 15:17:51.231869 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:17:51.284761 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'status': 'completed', 'code': 200} Nov 24 15:17:51.345089 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:17:51.380954 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-0515c70c-032d-40cc-9312-7af644ddf558 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1098 time: 0.0728123 Nov 24 15:17:51.518585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-d7f71e87-3c6c-468e-8346-80e727d39036 service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:51.519947 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-d7f71e87-3c6c-468e-8346-80e727d39036 service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1325660 Nov 24 15:17:51.627508 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-03d6c84c-5df8-4847-8196-288bfa94ebe4 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 200 len: 999 time: 0.1015468 Nov 24 15:17:51.697635 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-50b19150-bc9d-4c45-bff0-6fc4a03bc5db service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:17:51.700433 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-50b19150-bc9d-4c45-bff0-6fc4a03bc5db service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0663309 Nov 24 15:17:51.702432 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:30Z', 'revision_number': 1, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}, {'id': 'ae570cec-230c-49e2-835e-11fb76168860', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.139', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:26:0b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:17:49Z', 'updated_at': '2021-11-24T15:17:49Z', 'revision_number': 0, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:17:51.708320 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:17:51.723523 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:17:51.724313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:17:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:17:51.791211 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-3ab73977-975f-487f-ac8a-1cdc5bbb93d2 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0848086 Nov 24 15:17:51.914632 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:17:51.925015 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-c6e477c1-f118-4ffd-91b3-7422dc340bc9 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279683 Nov 24 15:17:52.067107 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-e8d94db9-86d8-49c9-bea7-f30789a2f6e2 req-118f1ae2-bbeb-4504-b4aa-ab09b9e1f425 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1362159 Nov 24 15:17:52.294182 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:30Z', 'revision_number': 1, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}, {'id': 'ae570cec-230c-49e2-835e-11fb76168860', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.139', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:26:0b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:17:49Z', 'updated_at': '2021-11-24T15:17:49Z', 'revision_number': 0, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:17:52.298365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a21283b-99a7-4ff1-a36a-88618114fbb5 None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:30Z', 'revision_number': 1, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}, {'id': 'ae570cec-230c-49e2-835e-11fb76168860', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.139', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:26:0b:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:17:49Z', 'updated_at': '2021-11-24T15:17:49Z', 'revision_number': 0, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:17:52.507260 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54b8f9ad-40ad-4045-826b-852e719625c1 None None] New status for floating IP ae570cec-230c-49e2-835e-11fb76168860: ACTIVE {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:18:00.900207 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:18:03.437930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d698cf9f-2410-457e-b9af-9979efebdaba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:03.829209 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:05.961132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-eab4c72f-afa7-453f-adae-81777f057ba7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:07.138896 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:08.837044 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:18.778197 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:33.446615 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-97cf38db-3d04-4fa1-bbd3-c01d47052cbc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:33.831905 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:35.966321 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f2354bb4-5ba6-4173-84cc-aa98aecda195 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:37.142404 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:37.900084 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:18:38.837337 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:18:44.832975 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-d826656c-dbcb-411d-81ba-546ba13b074b service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0774488 Nov 24 15:18:45.109731 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-90f251c1-dece-4407-882d-af2404b3206c service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1096 time: 0.2023370 Nov 24 15:18:45.282214 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-76854842-a9d2-4815-90e0-c3ab913edbcc service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:18:45.284708 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-76854842-a9d2-4815-90e0-c3ab913edbcc service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1550996 Nov 24 15:18:45.406204 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-536d7952-554e-4d22-89c9-11bf5a0c4cec service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 999 time: 0.1134157 Nov 24 15:18:45.480909 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-168adb47-2538-4d74-9dbb-9c0c64030597 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:18:45.482342 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-168adb47-2538-4d74-9dbb-9c0c64030597 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0692139 Nov 24 15:18:45.574232 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-5846ce47-9cd4-4c85-a362-74f978ae1c25 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0831952 Nov 24 15:18:45.750242 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-a795600e-37c2-4f63-ba3e-ebd7d069ebf2 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1681495 Nov 24 15:18:45.918426 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-470641d4-3d7b-4b5f-8924-c0bef63829eb req-7083c980-fb15-4143-872b-3cd474ed4479 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1621227 Nov 24 15:18:48.800406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:03.439815 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b6ae5fa4-6db8-4b8d-ac4e-fba924a7f572 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:03.837789 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:05.970181 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-52cc001f-77c8-4e68-be56-7c70f20ab983 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:07.146267 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:08.840244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:14.900027 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:19:18.804949 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:33.442493 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e65903fd-f371-48be-9ac2-7e251a5052a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:33.830873 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:35.972753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-740bb775-c04c-4d00-9b6c-00542457fec7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:37.145967 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:38.843454 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:46.945860 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-8fe312ef-2cbc-4ab4-ad31-610f1a2810b5 service neutron] 10.222.0.47 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1528754 Nov 24 15:19:47.046788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-65a25813-f3a4-467a-94c0-63523d6115ff service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1098 time: 0.0789170 Nov 24 15:19:47.218239 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9087656-5905-45ac-b159-9064164e7bf2 req-85bd9111-ba64-4283-a4a8-73ff1eb4418f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:19:47.219695 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-85bd9111-ba64-4283-a4a8-73ff1eb4418f service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1523120 Nov 24 15:19:47.327715 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-587166ca-c501-4b81-8e6f-a1ef1cb06f75 service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 200 len: 1001 time: 0.1009219 Nov 24 15:19:47.394383 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9087656-5905-45ac-b159-9064164e7bf2 req-3772ffaa-69c2-462f-ac8c-27b46af5a585 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:19:47.395870 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-3772ffaa-69c2-462f-ac8c-27b46af5a585 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0620584 Nov 24 15:19:47.471928 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-a774fba6-4621-44a9-9d75-2700a90ea57f service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0696788 Nov 24 15:19:47.605087 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-dc5d77ba-0cb4-4664-8624-52b96ac6a29c service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262560 Nov 24 15:19:47.738340 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-b9087656-5905-45ac-b159-9064164e7bf2 req-82f5f938-31e3-4db2-acea-b2e2797dc7b4 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271949 Nov 24 15:19:48.816069 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:19:51.900633 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:20:03.450695 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-234688ad-6e8d-495a-99d7-a52e5a118235 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:03.840816 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:05.977037 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-22fea595-ccd4-49cf-80bb-86230d2c2357 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:07.152482 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:08.848874 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:09.976435 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 details requested by agent hyperv_hv-neutron-8181 with host hv-neutron-8181 {{(pid=83527) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} Nov 24 15:20:10.115328 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:10.129244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Returning: {'device': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'port_id': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'mac_address': 'fa:16:3e:26:0b:6b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 859, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=83527) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} Nov 24 15:20:10.184160 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:10.201776 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 808253ec-882b-4e9b-9532-7c7ec5da4981 {{(pid=83527) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 15:20:10.222545 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:10.227221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:10.228931 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-041c9de2-63e6-4bdb-8e35-d182c46c5367 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:10.303176 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=6']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:10.311976 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.312325 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.312662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.312995 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.313329 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.313663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.313986 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.314313 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.314655 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.314958 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.315292 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83527) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:10.320010 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] get_ports_and_sgs() called for port_ids ['808253ec-882b-4e9b-9532-7c7ec5da4981'] {{(pid=83527) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:163}} Nov 24 15:20:10.344549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:11.980663 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 up at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} Nov 24 15:20:12.055901 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.provisioning_blocks [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Provisioning complete for port 808253ec-882b-4e9b-9532-7c7ec5da4981 triggered by entity L2. {{(pid=83527) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 15:20:12.056280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1143837'] for port, provisioning_complete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:12.171228 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:12.200356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:20:12.210484 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:12.214680 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:12.217848 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:12.298848 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'code': 200} Nov 24 15:20:12.302409 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=7']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:12.305246 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:18.836489 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:24.494087 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56468) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:24.813778 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Deleting port 26351ffc-31b8-4801-b62b-dba0fd81bc3e {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:24.814031 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:24.982890 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:24.983226 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:25.108585 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Calling delete_port for 26351ffc-31b8-4801-b62b-dba0fd81bc3e owned by network:floatingip {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:25.254877 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:25.258487 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5c1bc31f-7416-482b-85fd-2ea2f2653522 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:25.304367 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event deleted for resources: {'Port': ['ID=26351ffc-31b8-4801-b62b-dba0fd81bc3e,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:25.343488 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.343896 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.344274 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.344641 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.345010 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.345373 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.345733 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.346095 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.346454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.346812 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.347167 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83526) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:25.353884 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:25.408344 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:25.801895 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83526) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:20:25.997529 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83526) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:20:26.006985 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:20:26.018315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:26.020521 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:26.021167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:26.193260 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-5cd0f813-3bc6-4132-8641-8161c509c1f9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "DELETE /v2.0/floatingips/ae570cec-230c-49e2-835e-11fb76168860 HTTP/1.1" status: 204 len: 168 time: 1.6973770 Nov 24 15:20:26.193910 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:20:26.218015 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:26.367060 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'status': 'completed', 'code': 200} Nov 24 15:20:26.466391 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-ec94ba2e-977f-44a3-b51b-01ec4eab0c9b service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 1098 time: 0.0772738 Nov 24 15:20:26.617939 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-f00126df-19ab-4903-8536-662196bae11b service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:26.620273 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-f00126df-19ab-4903-8536-662196bae11b service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1458049 Nov 24 15:20:26.636659 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:30Z', 'revision_number': 1, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:26.639980 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:20:26.650363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:26.651043 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:26.736238 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-9f63919c-c0f5-4327-9aaa-90892840553a service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 200 len: 217 time: 0.1081166 Nov 24 15:20:26.822016 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-2ca60c99-c9a2-4cf3-87be-f17ffc915593 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:26.824240 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-2ca60c99-c9a2-4cf3-87be-f17ffc915593 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0812509 Nov 24 15:20:26.830761 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd836617-e88a-4484-bc4e-e81bff907660 req-2786729d-1356-4437-a739-f5507d443cb9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:26.831401 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bd836617-e88a-4484-bc4e-e81bff907660 req-2786729d-1356-4437-a739-f5507d443cb9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:20:26.831507 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:26.889912 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-bd836617-e88a-4484-bc4e-e81bff907660 req-2786729d-1356-4437-a739-f5507d443cb9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:20:26.891163 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bd836617-e88a-4484-bc4e-e81bff907660 req-2786729d-1356-4437-a739-f5507d443cb9 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 945 time: 0.3372056 Nov 24 15:20:26.949372 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-e17286c7-886d-4004-8488-828d76f67ef0 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.1149328 Nov 24 15:20:26.956736 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-bd836617-e88a-4484-bc4e-e81bff907660 req-1bc58749-0102-412f-bcd4-ad26470e3ed0 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579987 Nov 24 15:20:27.084679 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-392904be-0d83-4212-a3ad-3a05ff9af132 service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1268280 Nov 24 15:20:27.189215 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:30Z', 'revision_number': 1, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:27.193442 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17ae9fc-7c76-4db4-bc14-d6678c699558 None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_floatingips': [{'id': '627118d1-4ed8-4452-8adb-a27f103fedc0', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'floating_ip_address': '172.26.4.110', 'floating_network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'router_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'port_id': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'fixed_ip_address': '172.20.0.8', 'status': 'ACTIVE', 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'mac_address': 'fa:16:3e:dd:42:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T15:14:24Z', 'updated_at': '2021-11-24T15:14:30Z', 'revision_number': 1, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:20:27.223515 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-20629c85-f3ab-4856-ad45-70ed279d2580 req-dcd69fe8-2aee-42ac-963c-dc798830d9ac service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324396 Nov 24 15:20:27.435521 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c30daa10-a30e-4bd2-b370-0d16bb9ffdf0 None None] New status for floating IP ae570cec-230c-49e2-835e-11fb76168860: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:20:28.091046 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:28.175395 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb53d4d-f07d-4711-9952-74c329af3f91 req-b58d3274-e5cd-450a-915b-5f08587bf9d3 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:28.176988 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cdb53d4d-f07d-4711-9952-74c329af3f91 req-b58d3274-e5cd-450a-915b-5f08587bf9d3 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 945 time: 0.0837581 Nov 24 15:20:28.204406 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1093080'] for port, before_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:28.227957 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-cdb53d4d-f07d-4711-9952-74c329af3f91 req-7a33beec-71d5-43e8-8a30-ce2b3220b0bf tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442419 Nov 24 15:20:28.248103 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:28.249412 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83527) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:20:28.261903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8771276033037', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8771275655051', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8771275655096'] for port, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:28.263773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:28.312660 dv-neutron-818151-2-hyperv neutron-server[83527]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'code': 200} Nov 24 15:20:28.323656 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-d8d81247-4105-4e65-b499-591081040050 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:28.325112 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-d8d81247-4105-4e65-b499-591081040050 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 943 time: 0.0915468 Nov 24 15:20:28.336460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Pushing event updated for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=8']} {{(pid=83527) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:28.340910 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_concurrency.lockutils [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=83527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:28.394068 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Deleting port 808253ec-882b-4e9b-9532-7c7ec5da4981 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:28.394408 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:28.643444 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] For port 808253ec-882b-4e9b-9532-7c7ec5da4981, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=808253ec-882b-4e9b-9532-7c7ec5da4981,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:28.643844 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:28.768967 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Calling delete_port for 808253ec-882b-4e9b-9532-7c7ec5da4981 owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:28.900201 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:20:28.924566 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:28.931240 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-2fef31e7-421c-480a-8c33-8ecab7b749af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:28.976412 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event deleted for resources: {'Port': ['ID=808253ec-882b-4e9b-9532-7c7ec5da4981,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:28.979538 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:29.155297 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] No DVR routers for this DVR port 808253ec-882b-4e9b-9532-7c7ec5da4981 on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:20:29.157634 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:29.160253 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-deleted', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:20:29.179579 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-589ebc5f-53da-49eb-b855-560fe571c3e8 req-a97d9471-6d9c-4680-9fff-2ff2d07cf2a2 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "DELETE /v2.0/ports/808253ec-882b-4e9b-9532-7c7ec5da4981 HTTP/1.1" status: 204 len: 173 time: 0.8453724 Nov 24 15:20:29.218788 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f2ea034d-006a-409e-a6c8-0d3ddb538d22', 'name': 'network-vif-deleted', 'tag': '808253ec-882b-4e9b-9532-7c7ec5da4981', 'status': 'completed', 'code': 200} Nov 24 15:20:29.414281 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d9f86dc0-bb2e-4113-b91e-1e6e52b861c4 req-e4197c72-e148-427a-b699-8e4666dfa597 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:20:29.430675 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.quota.resource [req-d9f86dc0-bb2e-4113-b91e-1e6e52b861c4 req-e4197c72-e148-427a-b699-8e4666dfa597 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83526) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:20:29.432630 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-d9f86dc0-bb2e-4113-b91e-1e6e52b861c4 req-e4197c72-e148-427a-b699-8e4666dfa597 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=f2ea034d-006a-409e-a6c8-0d3ddb538d22 HTTP/1.1" status: 200 len: 210 time: 0.0597169 Nov 24 15:20:31.103781 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56540) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:31.308073 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Deleting port bf1b8861-1fd3-4a79-a94c-f93dec4f57b0 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:31.308414 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:31.473940 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:31.474258 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:31.698906 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Calling delete_port for bf1b8861-1fd3-4a79-a94c-f93dec4f57b0 owned by network:floatingip {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:31.855285 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:31.859238 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f8a5514b-d9ec-4c49-ae37-336ed096a230 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:31.909356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event deleted for resources: {'Port': ['ID=bf1b8861-1fd3-4a79-a94c-f93dec4f57b0,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:31.952270 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.952771 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.953143 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.953756 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Port changed None to 1.5 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.954115 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.954469 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.954850 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroup changed None to 1.2 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.955200 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SecurityGroupRule changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.955549 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.955926 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.956274 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-neutron-818151-2-hyperv {{(pid=83525) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 15:20:31.965533 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:32.018711 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for floatingip, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:32.084686 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:32.117506 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: 808253ec-882b-4e9b-9532-7c7ec5da4981 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:32.117766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device 808253ec-882b-4e9b-9532-7c7ec5da4981 not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:32.413448 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:20:32.616398 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:20:32.626358 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:20:32.637769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for floatingip, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:32.639099 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:32.639723 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:32.691808 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-10ac99cf-a23b-4aaa-88f1-03ba81113d62 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "DELETE /v2.0/floatingips/627118d1-4ed8-4452-8adb-a27f103fedc0 HTTP/1.1" status: 204 len: 168 time: 1.5868063 Nov 24 15:20:32.692648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83525) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:20:32.836231 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:32.850282 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'status': 'completed', 'code': 200} Nov 24 15:20:32.962315 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-a68c9d69-4e45-4c30-bc9f-c18fe8013514 service neutron] 10.222.0.47 "GET /v2.0/ports?tenant_id=ed89aa580bcf48afa36f245d2283c042&device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 1096 time: 0.0887291 Nov 24 15:20:33.106221 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05a68eb-ceba-49b5-ba2e-dfa3beea0be2 req-8eb4f6d6-9313-40f9-81b1-3fbc672378db tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83525) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:33.107446 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-f05a68eb-ceba-49b5-ba2e-dfa3beea0be2 req-8eb4f6d6-9313-40f9-81b1-3fbc672378db tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Synchronizing usage tracker for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83525) resync /opt/stack/neutron/neutron/quota/resource.py:241}} Nov 24 15:20:33.110203 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-9bf43e2a-2fac-464a-84bc-e9454ea8b29f service neutron] Attributes excluded by policy engine: ['vlan_transparent'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:33.111880 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-9bf43e2a-2fac-464a-84bc-e9454ea8b29f service neutron] 10.222.0.47 "GET /v2.0/networks?id=81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 200 len: 910 time: 0.1419356 Nov 24 15:20:33.123249 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.quota.resource [req-f05a68eb-ceba-49b5-ba2e-dfa3beea0be2 req-8eb4f6d6-9313-40f9-81b1-3fbc672378db tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Unset dirty status for tenant:ed89aa580bcf48afa36f245d2283c042 on resource:port {{(pid=83525) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} Nov 24 15:20:33.129637 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f05a68eb-ceba-49b5-ba2e-dfa3beea0be2 req-8eb4f6d6-9313-40f9-81b1-3fbc672378db tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 943 time: 0.1051421 Nov 24 15:20:33.179873 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [req-f05a68eb-ceba-49b5-ba2e-dfa3beea0be2 req-f4e0f0dd-f913-4908-8bf7-354c854bfd95 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493531 Nov 24 15:20:33.187323 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-a793fd3d-e5d2-4e07-9dcb-fe794b95277f service neutron] 10.222.0.47 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 200 len: 217 time: 0.0679598 Nov 24 15:20:33.194922 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:33.208810 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:20:33.211674 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:33.212382 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:06Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:33.264454 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-6b851411-0e5e-465c-bf9b-63dce97f7d44 service neutron] Attributes excluded by policy engine: ['shared', 'segment_id'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:33.266137 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-6b851411-0e5e-465c-bf9b-63dce97f7d44 service neutron] 10.222.0.47 "GET /v2.0/subnets?id=1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 200 len: 848 time: 0.0720699 Nov 24 15:20:33.345311 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-c10fd5b3-06a5-41f3-aa3f-d748ea1fe618 service neutron] 10.222.0.47 "GET /v2.0/ports?network_id=81382f99-f5ff-40f4-ab19-dca39064a209&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1177 time: 0.0684624 Nov 24 15:20:33.454225 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:33.479765 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-53a70b7a-17df-47b4-b628-5b386186353d service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273992 Nov 24 15:20:33.493130 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-a6cee9f9-0b73-44d1-94d7-27c12cd8780a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:33.627196 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-f0ee8889-37f0-4f7e-8624-b145d38a9e1c req-1df8e31a-3007-4395-b7c5-2e99a567009f service neutron] 10.222.0.47 "GET /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1385632 Nov 24 15:20:33.790682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:33.795150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bfd7d95-3658-46da-84e8-73632acbe755 None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:55Z', 'revision_number': 4, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv', '_interfaces': [{'id': '8f03bf58-5b4b-4bef-83f2-f25bfd897a2a', 'name': '', 'network_id': '81382f99-f5ff-40f4-ab19-dca39064a209', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'mac_address': 'fa:16:3e:d7:6a:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_interface', 'fixed_ips': [{'subnet_id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:54Z', 'updated_at': '2021-11-24T15:14:06Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'subnets': [{'id': '1c1cd4ec-e03e-44b4-a752-344d0d699cb7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:20:33.837559 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:33.929423 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-f1ae4284-6e3d-46a0-94d0-aa257da186c3 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:33.930853 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-f1ae4284-6e3d-46a0-94d0-aa257da186c3 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 943 time: 0.0957730 Nov 24 15:20:34.002181 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Deleting port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:34.002819 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:34.018204 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe5eaee7-ca2f-446d-99d1-59e91f838ac0 None None] New status for floating IP 627118d1-4ed8-4452-8adb-a27f103fedc0: DOWN {{(pid=83528) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:264}} Nov 24 15:20:34.266613 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] For port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba, host hv-neutron-8181, got binding levels [PortBindingLevel(driver='hyperv',host='hv-neutron-8181',level=0,port_id=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:34.266962 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:34.423171 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Calling delete_port for e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba owned by compute:nova {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:34.678547 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d506dc-9476-4668-8931-e880e9f1cc95 req-6028dbaf-be54-48d1-860e-9c876fde3140 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Attributes excluded by policy engine: ['binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=83526) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 15:20:34.679943 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d506dc-9476-4668-8931-e880e9f1cc95 req-6028dbaf-be54-48d1-860e-9c876fde3140 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/ports?device_id=155fa2f7-cdc0-4e5f-8045-a8988d0c526c HTTP/1.1" status: 200 len: 943 time: 0.3472936 Nov 24 15:20:34.735930 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:34.743039 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-dd630f5b-4bc0-4263-aa59-38ecbec6d1c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:34.793149 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event deleted for resources: {'Port': ['ID=e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:34.796696 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:34.799598 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-04d506dc-9476-4668-8931-e880e9f1cc95 req-8de32bcb-bc66-43eb-8a53-50951807b965 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "GET /v2.0/security-groups?id=9d581076-6e86-4c94-a8e9-984832944f47&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1116173 Nov 24 15:20:34.877017 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] No DVR routers for this DVR port e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba on host hv-neutron-8181 {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:20:34.879365 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-74223'] for port, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:34.882056 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-deleted', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba'}] {{(pid=83526) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 15:20:34.898949 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [req-ebcd5ef5-41ac-4184-b974-92b2ba78ee2b req-6889549f-0c09-4a8f-bd00-ec8a3647462b tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.47 "DELETE /v2.0/ports/e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba HTTP/1.1" status: 204 len: 173 time: 0.9629166 Nov 24 15:20:34.942563 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '155fa2f7-cdc0-4e5f-8045-a8988d0c526c', 'name': 'network-vif-deleted', 'tag': 'e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba', 'status': 'completed', 'code': 200} Nov 24 15:20:35.914630 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56560) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:35.981260 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5201d147-3d47-456f-bf46-b98eecd96c88 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:35.987888 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:36.019648 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:36.091136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:36.096088 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-14ae96a2-8e17-4a0f-81c6-a774e678e01b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:36.112391 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d581076-6e86-4c94-a8e9-984832944f47,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:36.115234 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:36.127911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:36.129035 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-3f11f8ee-c09c-40e8-bcab-ded0ebcf1861 tempest-TestSnapshotPattern-1941728024 tempest-TestSnapshotPattern-1941728024-project] 10.222.0.70 "DELETE /v2.0/security-groups/9d581076-6e86-4c94-a8e9-984832944f47 HTTP/1.1" status: 204 len: 168 time: 0.2134457 Nov 24 15:20:37.153768 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:37.213817 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56568) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:37.891410 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:38.116028 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba no longer exists at agent hyperv_hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:38.151353 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] No Port match for: e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:38.151733 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Device e8441c81-82a2-4e7f-b0a6-dbf3894fc9ba not bound to the agent host hv-neutron-8181 {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:38.513160 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Deleting port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:38.513731 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:38.689977 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] For port 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:38.690317 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:38.816121 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Calling delete_port for 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:38.848908 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:39.023389 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:39.029661 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-38a96d21-d6ae-4c13-961b-a30fb1aad095 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:39.075429 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Pushing event deleted for resources: {'Port': ['ID=8f03bf58-5b4b-4bef-83f2-f25bfd897a2a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:39.077678 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:39.387077 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:40.105017 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Router db14b600-0316-4cbc-a676-2ac7b5d2d063 has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:20:40.319173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:20:40.329072 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] Sync routers for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:20:40.333122 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-57388acf-3d9f-40c8-b9b8-647aa41726a4 admin admin] 10.222.0.70 "PUT /v2.0/routers/db14b600-0316-4cbc-a676-2ac7b5d2d063/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1180556 Nov 24 15:20:40.335785 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56582) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:40.342307 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:40.342933 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:40.521481 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: dv-neutron-818151-2-hyperv {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:40.536352 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:40.737087 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:40.747579 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Deleting port d0294820-b84f-4b28-af9c-dd186e2b237a {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:40.747935 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:40.810192 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120'}], 'enable_snat': True}, 'gw_port_id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:20:38Z', 'revision_number': 5, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port': {'id': 'd0294820-b84f-4b28-af9c-dd186e2b237a', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:1c:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.120', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:13:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:40.814196 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] Checking router: db14b600-0316-4cbc-a676-2ac7b5d2d063 for host: dv-neutron-818151-2-hyperv {{(pid=83527) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:20:40.826214 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] Routers {'db14b600-0316-4cbc-a676-2ac7b5d2d063'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83527) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:40.826830 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['db14b600-0316-4cbc-a676-2ac7b5d2d063'], 'active': True} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:40.938475 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] For port d0294820-b84f-4b28-af9c-dd186e2b237a, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=d0294820-b84f-4b28-af9c-dd186e2b237a,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:40.938832 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:40.994363 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_dvr_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] Set router db14b600-0316-4cbc-a676-2ac7b5d2d063 gateway port host: None {{(pid=83527) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:41.154793 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.db.l3_hamode_db [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:20:40Z', 'revision_number': 6, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port_host': None}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:41.161283 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeb2763e-64f0-4c65-8f4e-470fdd43749d None None] The sync data for ids ['db14b600-0316-4cbc-a676-2ac7b5d2d063'] in dv-neutron-818151-2-hyperv is: [{'id': 'db14b600-0316-4cbc-a676-2ac7b5d2d063', 'name': 'tempest-TestSnapshotPattern-994375980-router', 'tenant_id': 'ed89aa580bcf48afa36f245d2283c042', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:51Z', 'updated_at': '2021-11-24T15:20:40Z', 'revision_number': 6, 'project_id': 'ed89aa580bcf48afa36f245d2283c042', 'gw_port_host': None}] {{(pid=83527) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:20:41.204979 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Calling delete_port for d0294820-b84f-4b28-af9c-dd186e2b237a owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:41.381454 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:41.386047 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-98a28ba8-ba37-43c4-a703-115e1f0375eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:41.428710 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Pushing event deleted for resources: {'Port': ['ID=d0294820-b84f-4b28-af9c-dd186e2b237a,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:41.432760 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:41.664184 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:41.929253 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:41.934117 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:41.961018 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:41.961527 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Fanout notify agent at l3_agent the message router_deleted on router db14b600-0316-4cbc-a676-2ac7b5d2d063 {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 15:20:41.976371 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:41.977723 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-90bc074f-5ef6-4b35-acd0-8e7fb7022095 admin admin] 10.222.0.70 "DELETE /v2.0/routers/db14b600-0316-4cbc-a676-2ac7b5d2d063 HTTP/1.1" status: 204 len: 168 time: 1.6409562 Nov 24 15:20:41.980563 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56586) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:42.046090 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.db_base_plugin_v2 [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Deleting subnet 1c1cd4ec-e03e-44b4-a752-344d0d699cb7 {{(pid=83525) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 15:20:42.049173 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.100136 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7957117'] for subnet, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.191380 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.275091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7895450', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8100952'] for subnet, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.279170 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-58d8d72c-6ee8-4421-a1b7-72df8640c4f7 tempest-NetworksTestDHCPv6-46909150 tempest-NetworksTestDHCPv6-46909150-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:42.317095 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1c1cd4ec-e03e-44b4-a752-344d0d699cb7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:42.326824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:42.326824 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.329811 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-32b7f680-515b-4136-b34e-ed7827a90d92 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/1c1cd4ec-e03e-44b4-a752-344d0d699cb7 HTTP/1.1" status: 204 len: 168 time: 0.3479528 Nov 24 15:20:42.332944 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56590) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:42.335956 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fed6cc1e-bbbe-41b6-b8c6-a70ca05b6029 None None] Network 81382f99-f5ff-40f4-ab19-dca39064a209 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:20:42.442250 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.452425 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Deleting port 1add684e-4545-4126-92e8-4055d789c7fc {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:42.452743 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.592022 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] DHCP port deletion for 81382f99-f5ff-40f4-ab19-dca39064a209 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 15:20:42.596470 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Deleting port 1add684e-4545-4126-92e8-4055d789c7fc {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:42.596919 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.774366 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] For port 1add684e-4545-4126-92e8-4055d789c7fc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1add684e-4545-4126-92e8-4055d789c7fc,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:42.774633 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.796557 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] For port 1add684e-4545-4126-92e8-4055d789c7fc, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1add684e-4545-4126-92e8-4055d789c7fc,segment=NetworkSegment(269b2190-9c40-4e00-a536-318758b03cfb),segment_id=269b2190-9c40-4e00-a536-318758b03cfb)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:42.796948 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.897861 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Calling delete_port for 1add684e-4545-4126-92e8-4055d789c7fc owned by network:dhcp {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:42.920741 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Calling delete_port for 1add684e-4545-4126-92e8-4055d789c7fc owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:42.950930 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1add684e-4545-4126-92e8-4055d789c7fc no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:42.978927 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:42.983657 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-8d971854-4600-44f4-bad9-d514a352bb54 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:42.992019 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1add684e-4545-4126-92e8-4055d789c7fc {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:42.992367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1add684e-4545-4126-92e8-4055d789c7fc not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:42.992778 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d0294820-b84f-4b28-af9c-dd186e2b237a no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:43.029917 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Pushing event deleted for resources: {'Port': ['ID=1add684e-4545-4126-92e8-4055d789c7fc,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:43.038206 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:43.038624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: d0294820-b84f-4b28-af9c-dd186e2b237a {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:43.038624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device d0294820-b84f-4b28-af9c-dd186e2b237a not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:43.038624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:43.043734 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] No DVR routers for this DVR port 1add684e-4545-4126-92e8-4055d789c7fc on host dv-neutron-818151-2-hyperv {{(pid=83525) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:20:43.079385 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:43.079729 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 8f03bf58-5b4b-4bef-83f2-f25bfd897a2a not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 15:20:43.093779 dv-neutron-818151-2-hyperv neutron-server[83527]: util.warn( Nov 24 15:20:43.100641 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 15:20:43.101000 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 15:20:43.161349 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.186747 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['81382f99-f5ff-40f4-ab19-dca39064a209']}} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:43.198519 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '269b2190-9c40-4e00-a536-318758b03cfb') {'for_net_delete': True} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:43.198808 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.services.segments.db [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '269b2190-9c40-4e00-a536-318758b03cfb') {} {{(pid=83525) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:43.210127 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7957092'] for segment, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.226356 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.233801 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Releasing vlan 859 on physical network physnet1 to pool {{(pid=83525) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 15:20:43.235035 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7896628'] for segment, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: Traceback (most recent call last): Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: timer() Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: cb(*args, **kw) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: return func(*args, **kwargs) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: self._notify() Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: self.callback(batched_events) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: event.method(event) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: return f(self, *a, **k) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._get(url).json() Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: return self.request(url, 'GET', **kwargs) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 15:20:43.247919 dv-neutron-818151-2-hyperv neutron-server[83525]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 15:20:43.330030 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.335497 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-da6d0e20-17c6-4231-a780-5c7a8b4979b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:43.353514 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Notify callbacks [] for network, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.370375 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Pushing event deleted for resources: {'Network': ['ID=81382f99-f5ff-40f4-ab19-dca39064a209,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:43.374528 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:43.376635 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-36b757a8-146d-4109-8edd-9bfdd6378e6a admin admin] 10.222.0.70 "DELETE /v2.0/networks/81382f99-f5ff-40f4-ab19-dca39064a209 HTTP/1.1" status: 204 len: 168 time: 1.0421786 Nov 24 15:20:43.379924 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56594) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:43.602622 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Deleting port 1add684e-4545-4126-92e8-4055d789c7fc {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:43.603244 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:43.668167 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-e057e695-d127-4989-89ab-dc006b82a2a8 None None] The port '1add684e-4545-4126-92e8-4055d789c7fc' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 15:20:43.789878 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1007494'] for router_interface, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:44.530507 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Deleting port 79752e96-38b5-4668-a843-e4906791a43e {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:44.531213 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:44.710260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] For port 79752e96-38b5-4668-a843-e4906791a43e, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=79752e96-38b5-4668-a843-e4906791a43e,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:44.710603 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:44.844725 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Calling delete_port for 79752e96-38b5-4668-a843-e4906791a43e owned by network:router_interface {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:45.029139 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:45.032797 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-3901adae-e9e1-4508-acb7-7f22778c729b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:45.078973 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Pushing event deleted for resources: {'Port': ['ID=79752e96-38b5-4668-a843-e4906791a43e,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:45.081769 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:45.391340 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2023841', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1006936'] for router_interface, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:46.109205 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea has already been hosted by L3 agent 54d16f2e-10ec-4381-a9f3-6cb331e1841b {{(pid=83525) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 15:20:46.315260 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] Notify agent at l3_agent.dv-neutron-818151-2-hyperv the message routers_updated {{(pid=83525) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 15:20:46.325444 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] Sync routers for ids ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'] in dv-neutron-818151-2-hyperv {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:119}} Nov 24 15:20:46.326386 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a38c810a-c558-4140-8ec5-a61efd1c0587 admin admin] 10.222.0.70 "PUT /v2.0/routers/8fa310aa-beb1-4a84-afb8-29e74d8c8cea/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9453382 Nov 24 15:20:46.329152 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56598) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:46.341377 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] Routers {'8fa310aa-beb1-4a84-afb8-29e74d8c8cea'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:46.341997 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:46.517980 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] Set router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:46.630598 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks [] for router, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:46.816573 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:20:44Z', 'revision_number': 5, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:46.820376 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] Checking router: 8fa310aa-beb1-4a84-afb8-29e74d8c8cea for host: dv-neutron-818151-2-hyperv {{(pid=83528) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:149}} Nov 24 15:20:46.832240 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] Routers {'8fa310aa-beb1-4a84-afb8-29e74d8c8cea'} bound to L3 agent in host dv-neutron-818151-2-hyperv {{(pid=83528) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 15:20:46.833032 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-neutron-818151-2-hyperv', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T13:47:06Z,description=,heartbeat_timestamp=2021-11-24T15:20:36Z,host='dv-neutron-818151-2-hyperv',id=54d16f2e-10ec-4381-a9f3-6cb331e1841b,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T13:47:06Z,topic='l3_agent')) {'router_ids': ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'], 'active': True} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:46.909442 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:46.919811 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Deleting port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 {{(pid=83525) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:46.920108 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:47.058047 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_dvr_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] Set router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea gateway port host: dv-neutron-818151-2-hyperv {{(pid=83528) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:871}} Nov 24 15:20:47.115091 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.db [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] For port 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,segment=NetworkSegment(44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9),segment_id=44b45dc5-8d15-4e5c-8cf6-19f06d87b3e9)] {{(pid=83525) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:47.115915 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:47.254198 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.plugins.ml2.plugin [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Calling delete_port for 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 owned by network:router_gateway {{(pid=83525) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:47.409019 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.l3_hamode_db [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:20:44Z', 'revision_number': 5, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}], 'dv-neutron-818151-2-hyperv', False) {} {{(pid=83528) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:47.417828 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b86094db-f7b8-4cbe-8da1-002171e58a13 None None] The sync data for ids ['8fa310aa-beb1-4a84-afb8-29e74d8c8cea'] in dv-neutron-818151-2-hyperv is: [{'id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'name': 'tempest-TestSnapshotPattern-1069219494-router', 'tenant_id': 'f713946fca3f4f98b036135abad6def7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'external_fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103'}], 'enable_snat': True}, 'gw_port_id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T15:13:59Z', 'updated_at': '2021-11-24T15:20:44Z', 'revision_number': 5, 'project_id': 'f713946fca3f4f98b036135abad6def7', 'gw_port': {'id': '1bc29381-c45f-434d-a8f6-3fad9bc3ecf7', 'name': '', 'network_id': '402f60a1-052a-4741-af19-c310771ae4cd', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:6b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8fa310aa-beb1-4a84-afb8-29e74d8c8cea', 'device_owner': 'network:router_gateway', 'fixed_ips': [{'subnet_id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'ip_address': '172.26.4.103', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-neutron-818151-2-hyperv', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T15:14:00Z', 'updated_at': '2021-11-24T15:14:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '376fcf88-d7db-4a45-9380-52e3473e9bba', 'cidr': '172.26.4.0/24', 'gateway_ip': '172.26.4.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-neutron-818151-2-hyperv'}] {{(pid=83528) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:131}} Nov 24 15:20:47.473666 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7895495'] for port, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:47.480245 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-c88edb8c-1f7d-4567-94c3-f971895d87c6 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:47.535653 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Pushing event deleted for resources: {'Port': ['ID=1bc29381-c45f-434d-a8f6-3fad9bc3ecf7,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:47.538717 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:47.941635 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-999675'] for router_gateway, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.232911 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1003079', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-24708'] for router, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.237621 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.270480 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-980951'] for router, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.271059 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8fa310aa-beb1-4a84-afb8-29e74d8c8cea {{(pid=83525) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 15:20:48.295338 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] Notify callbacks [] for router, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.299353 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-f9173084-67d5-4af0-8574-ee33153a793a admin admin] 10.222.0.70 "DELETE /v2.0/routers/8fa310aa-beb1-4a84-afb8-29e74d8c8cea HTTP/1.1" status: 204 len: 168 time: 1.9689829 Nov 24 15:20:48.299587 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56602) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:48.371786 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.db_base_plugin_v2 [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Deleting subnet 8977cb21-6563-4cdd-9f63-abcbb3113a49 {{(pid=83526) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1047}} Nov 24 15:20:48.375811 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.441621 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8272635'] for subnet, precommit_delete_associations {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.521101 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1082383'] for subnet, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.593414 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1082368', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22098', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8272505', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8240657'] for subnet, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.597210 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-713904be-d8b3-4ccd-80d0-2e8db2a52bbe tempest-NetworksIpV6Test-1619340652 tempest-NetworksIpV6Test-1619340652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:48.635451 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8977cb21-6563-4cdd-9f63-abcbb3113a49,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:48.639564 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:48.642360 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] Notify callbacks [] for subnet, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.647597 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b91d3e38-ebf7-40dd-8ff2-9eabe0203394 None None] Network 6ad18513-9668-45b7-b30d-ac3e6356da53 requested from dv-neutron-818151-2-hyperv {{(pid=83527) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:198}} Nov 24 15:20:48.654199 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-8ada83b3-f004-476e-9885-2709c3cc2d31 admin admin] 10.222.0.70 "DELETE /v2.0/subnets/8977cb21-6563-4cdd-9f63-abcbb3113a49 HTTP/1.1" status: 204 len: 168 time: 0.3532488 Nov 24 15:20:48.656775 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.wsgi [-] (83526) accepted ('10.222.0.70', 56606) {{(pid=83526) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:48.778521 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1514511'] for network, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.789773 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Deleting port e26379a3-e71d-4cf4-a9f1-841821b67e39 {{(pid=83526) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:48.790089 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.844549 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:48.967464 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] DHCP port deletion for 6ad18513-9668-45b7-b30d-ac3e6356da53 request from dv-neutron-818151-2-hyperv {{(pid=83527) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:245}} Nov 24 15:20:48.969817 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:49.004349 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Deleting port e26379a3-e71d-4cf4-a9f1-841821b67e39 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:49.004738 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.030315 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.db [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] For port e26379a3-e71d-4cf4-a9f1-841821b67e39, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e26379a3-e71d-4cf4-a9f1-841821b67e39,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83526) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:49.030652 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.036150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:49.036396 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 1bc29381-c45f-434d-a8f6-3fad9bc3ecf7 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:49.036628 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 79752e96-38b5-4668-a843-e4906791a43e no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:49.079537 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: 79752e96-38b5-4668-a843-e4906791a43e {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:49.079903 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device 79752e96-38b5-4668-a843-e4906791a43e not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:20:49.159020 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.plugin [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Calling delete_port for e26379a3-e71d-4cf4-a9f1-841821b67e39 owned by network:dhcp {{(pid=83526) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:49.240449 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-1089864', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-22110', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8771276033783', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8771275655042', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8272420'] for port, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.246013 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-935bc979-61a5-4dfd-8457-799e109fe25b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:49.257837 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.db [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] For port e26379a3-e71d-4cf4-a9f1-841821b67e39, host dv-neutron-818151-2-hyperv, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-neutron-818151-2-hyperv',level=0,port_id=e26379a3-e71d-4cf4-a9f1-841821b67e39,segment=NetworkSegment(c67e13f0-bebb-424a-8f9d-5efc5305f2f9),segment_id=c67e13f0-bebb-424a-8f9d-5efc5305f2f9)] {{(pid=83527) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 15:20:49.258500 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1003574'] for port, precommit_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.290988 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Pushing event deleted for resources: {'Port': ['ID=e26379a3-e71d-4cf4-a9f1-841821b67e39,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:49.294693 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:49.295474 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] No DVR routers for this DVR port e26379a3-e71d-4cf4-a9f1-841821b67e39 on host dv-neutron-818151-2-hyperv {{(pid=83526) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 15:20:49.414902 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1145232', 'neutron.services.segments.db._delete_segments_for_network-8771276175827'] for network, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.443882 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ad18513-9668-45b7-b30d-ac3e6356da53']}} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:49.461042 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9') {'for_net_delete': True} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:49.461329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.services.segments.db [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c67e13f0-bebb-424a-8f9d-5efc5305f2f9') {} {{(pid=83526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 15:20:49.472356 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Calling delete_port for e26379a3-e71d-4cf4-a9f1-841821b67e39 owned by network:dhcp {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1935}} Nov 24 15:20:49.473771 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8771276178158', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8272610'] for segment, before_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.495713 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1084347'] for segment, precommit_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.502702 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Releasing vlan 871 on physical network physnet1 to pool {{(pid=83526) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:310}} Nov 24 15:20:49.503093 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_after_delete_segment_change-1084290', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8273367'] for segment, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: Traceback (most recent call last): Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 461, in fire_timers Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: timer() Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: cb(*args, **kw) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: return func(*args, **kwargs) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: self._notify() Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: self.callback(batched_events) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: event.method(event) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: return f(self, *a, **k) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._get(url).json() Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1131, in get Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: return self.request(url, 'GET', **kwargs) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 801, in request Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1231, in get_endpoint Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1171, in _auth_required Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 15:20:49.516607 dv-neutron-818151-2-hyperv neutron-server[83526]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 15:20:49.550378 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.db.api [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Retry wrapper got retriable exception: DELETE statement on table 'standardattributes' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. {{(pid=83527) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 15:20:49.550746 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG oslo_db.api [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.delete_port {{(pid=83527) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 15:20:49.597508 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1145225', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2023726', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-999568'] for network, after_delete {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.601589 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-a6178fc1-6859-44fd-9552-d3552c1fad19 tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:49.621025 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron_lib.callbacks.manager [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Notify callbacks [] for network, before_response {{(pid=83526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.635329 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Pushing event deleted for resources: {'Network': ['ID=6ad18513-9668-45b7-b30d-ac3e6356da53,revision_number=None']} {{(pid=83526) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:49.638513 dv-neutron-818151-2-hyperv neutron-server[83526]: DEBUG oslo_concurrency.lockutils [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=83526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:49.641065 dv-neutron-818151-2-hyperv neutron-server[83526]: INFO neutron.wsgi [None req-b60ba5db-d1a1-4065-a2a7-64ba7e1bddf3 admin admin] 10.222.0.70 "DELETE /v2.0/networks/6ad18513-9668-45b7-b30d-ac3e6356da53 HTTP/1.1" status: 204 len: 168 time: 0.9823394 Nov 24 15:20:49.784617 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56612) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:49.838866 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-579c65d8-5371-4583-8f4c-2a212399e2c8 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=ed89aa580bcf48afa36f245d2283c042&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0514357 Nov 24 15:20:49.840208 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56616) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:49.903236 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.930803 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.986544 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:49.990193 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-2c4ee26e-04a4-4966-b806-a4a53932f79e tempest-TestNetworkAdvancedServerOps-779247174 tempest-TestNetworkAdvancedServerOps-779247174-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:50.006938 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=821c7d36-e495-4dc8-b94f-c3c236f72d0c,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:50.011950 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:50.015418 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:50.016442 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-a67e4433-3978-4c45-9a07-18bcfdc49d00 admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/821c7d36-e495-4dc8-b94f-c3c236f72d0c HTTP/1.1" status: 204 len: 168 time: 0.1753564 Nov 24 15:20:50.052943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Deleting port e26379a3-e71d-4cf4-a9f1-841821b67e39 {{(pid=83527) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1863}} Nov 24 15:20:50.053511 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8771276027908'] for port, before_delete {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:50.121735 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-da564845-a48a-46ca-9c1a-fb1fab948dfa None None] The port 'e26379a3-e71d-4cf4-a9f1-841821b67e39' was deleted {{(pid=83527) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1893}} Nov 24 15:20:50.480503 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56624) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:50.533772 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-70fc77f1-a785-4b21-a6c2-13a7fb6ba046 admin admin] 10.222.0.70 "GET /v2.0/security-groups?tenant_id=f713946fca3f4f98b036135abad6def7&name=default HTTP/1.1" status: 200 len: 2647 time: 0.0517709 Nov 24 15:20:50.536081 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [-] (83525) accepted ('10.222.0.70', 56628) {{(pid=83525) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} Nov 24 15:20:50.603301 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:50.630458 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:50.685595 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1044724'] for security_group, after_delete {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:50.690931 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-5d47f736-ed70-4f01-97a1-539220cc729f tempest-SecGroupTest-117906809 tempest-SecGroupTest-117906809-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 15:20:50.705118 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fa08c9c-c9e8-40f6-a83c-84fa1fce4bbb,revision_number=None']} {{(pid=83525) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 15:20:50.708230 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG oslo_concurrency.lockutils [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=83525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 15:20:50.710293 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron_lib.callbacks.manager [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=83525) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:20:50.711398 dv-neutron-818151-2-hyperv neutron-server[83525]: INFO neutron.wsgi [None req-b0bac19f-f8d4-4d1e-89e2-781a88ee00eb admin admin] 10.222.0.70 "DELETE /v2.0/security-groups/7fa08c9c-c9e8-40f6-a83c-84fa1fce4bbb HTTP/1.1" status: 204 len: 168 time: 0.1744037 Nov 24 15:20:50.920627 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e26379a3-e71d-4cf4-a9f1-841821b67e39 no longer exists at agent ovs-agent-dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} Nov 24 15:20:50.957784 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.plugin [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] No Port match for: e26379a3-e71d-4cf4-a9f1-841821b67e39 {{(pid=83527) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2189}} Nov 24 15:20:50.958205 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron.plugins.ml2.rpc [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Device e26379a3-e71d-4cf4-a9f1-841821b67e39 not bound to the agent host dv-neutron-818151-2-hyperv {{(pid=83527) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} Nov 24 15:21:03.449141 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3c69222-0f63-4deb-9b99-0137a7d39287 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:03.844186 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:05.900624 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:21:05.984496 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-d9321e03-6833-4dcd-bfb9-1980f42b2509 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:07.158612 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:08.852827 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:18.831094 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:33.450906 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f32b7106-328b-43af-89aa-82eb3685de9a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:33.837675 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:35.986934 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b3f573a9-76bc-4fe6-b53f-939cd77a7a6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:37.158318 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:38.857662 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:21:42.904456 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:21:48.845297 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:03.456051 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f440a4f1-072e-43b4-89ef-c2a1fb2942e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:03.840436 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:05.988504 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-460a4ed4-1371-4db2-b4b8-bf9ca4978fc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:07.161578 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:08.859564 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:18.843367 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:19.904579 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:22:33.458039 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-0d7a16a9-f2fa-4274-8928-c9b8ac67f581 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:33.842646 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:35.990524 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-889a95ec-89b9-42f3-bb7e-8b242c5aa167 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:37.164555 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:38.862703 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:48.846678 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:22:56.904523 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:23:03.461111 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-03b19062-6d0b-4684-b24f-2a911aaeca31 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:03.850132 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:05.995433 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c42c3990-a586-41aa-8f57-3c09792c54bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:07.168221 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:08.866291 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:18.862271 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:33.467156 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8682862a-e194-430a-9877-a34ed7fd549b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:33.844005 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:33.905230 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:23:35.998415 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-c58fa974-46da-417c-abee-1bd000ed4054 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:37.171638 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:38.866322 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:23:48.860766 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:03.470280 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-7e86d7b0-6c5d-4085-ad27-0619b6a2db06 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:03.850386 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:06.003365 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-5c1aa055-aa93-4385-89ec-16e243cc384d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:07.174016 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:08.872842 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:10.906593 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:24:18.874780 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:33.475232 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-4840bf0e-1828-4c6c-9e1f-a8d8c05f483c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:33.844682 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:36.006699 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-b873081c-0d28-468c-b9e5-269ca7f0b7e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:36.878431 dv-neutron-818151-2-hyperv neutron-server[83525]: DEBUG neutron.wsgi [req-bedd0a0d-d9d8-4daa-88f5-d23bb6ba0d59 req-5ea9c321-4330-4507-8395-353e1180bdcc service neutron] (83525) timed out ('10.222.0.47', 52973) {{(pid=83525) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} Nov 24 15:24:37.177706 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:38.874649 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:24:47.906844 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:24:48.869801 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:03.479421 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-24748666-f240-4813-8a00-33b5a251210a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:03.847150 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:06.008704 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-6a34892b-d32b-4af4-b9fc-220d51f0ebcc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:07.180270 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:08.879866 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:18.866824 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:24.906439 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:25:33.482460 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-29e53ac9-a76c-43ee-9756-59712c05a333 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:33.850654 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:36.012624 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-2a7e0f94-90df-4a2c-b039-f9f1ff18ccfc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:37.183188 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:38.887041 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:25:48.871124 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:01.906032 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}} Nov 24 15:26:03.488166 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-32c26819-c28a-4317-b723-3d7a18c2a199 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:03.852754 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:06.018242 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-030b6468-78f9-42af-908f-d8d76a1089c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:07.187977 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:08.889773 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:18.868540 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8725895d-6cdf-4ab0-949b-a9834aae46ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:33.491576 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-155c0421-1415-41bf-b16a-d7d792f0e1cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:33.856249 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-9dec61e0-02ef-41c1-bd97-c8752765e083 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:36.021753 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-8f90fd4a-f542-4564-98d6-cd661c3095fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:37.190943 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-045f7f4b-f33b-4182-807f-9ba04fd264e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:38.890326 dv-neutron-818151-2-hyperv neutron-server[83527]: DEBUG neutron_lib.callbacks.manager [None req-f29de5d1-29d1-48d7-bc3a-858b714339c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8771276175809', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1142986'] for agent, after_update {{(pid=83527) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Nov 24 15:26:38.909616 dv-neutron-818151-2-hyperv neutron-server[83528]: DEBUG neutron.db.agents_db [None req-5234b307-566e-4e55-8009-5ef661d9972b None None] Agent healthcheck: found 6 active agents {{(pid=83528) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:328}}